W0715 00:29:35.413000 2481536 site-packages/torch/distributed/run.py:766] 
W0715 00:29:35.413000 2481536 site-packages/torch/distributed/run.py:766] *****************************************
W0715 00:29:35.413000 2481536 site-packages/torch/distributed/run.py:766] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. 
W0715 00:29:35.413000 2481536 site-packages/torch/distributed/run.py:766] *****************************************
[INFO] Running in WANDB offline mode
[INFO] Running in WANDB offline mode
[INFO] Running in WANDB offline mode
[INFO] Running in WANDB offline mode
[INFO] Running in WANDB offline mode
[INFO] Running in WANDB offline mode
[INFO] Running in WANDB offline mode
[INFO] Running in WANDB offline mode
Trainer._get_train_sampler replaced with custom implementation.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
[2026-07-15 00:29:44,709] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
df: /home/dungpq6/.triton/autotune: No such file or directory
Trainer._get_train_sampler replaced with custom implementation.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
[2026-07-15 00:29:44,968] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
Trainer._get_train_sampler replaced with custom implementation.
Trainer._get_train_sampler replaced with custom implementation.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
Trainer._get_train_sampler replaced with custom implementation.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
[2026-07-15 00:29:45,065] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2026-07-15 00:29:45,065] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2026-07-15 00:29:45,076] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2026-07-15 00:29:45,087] [INFO] [comm.py:658:init_distributed] cdb=None
Trainer._get_train_sampler replaced with custom implementation.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
[2026-07-15 00:29:45,219] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
Trainer._get_train_sampler replaced with custom implementation.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
[2026-07-15 00:29:45,274] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-15 00:29:45,274] [INFO] [comm.py:689:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
Trainer._get_train_sampler replaced with custom implementation.
[2026-07-15 00:29:45,300] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
[2026-07-15 00:29:45,345] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2026-07-15 00:29:45,441] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-15 00:29:45,444] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-15 00:29:45,449] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-15 00:29:45,537] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-15 00:29:45,618] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-15 00:29:45,666] [INFO] [comm.py:658:init_distributed] cdb=None

Loading weights:   0%|          | 0/760 [00:00<?, ?it/s]
Loading weights:   8%|▊         | 61/760 [00:00<00:01, 578.24it/s]
Loading weights:  16%|█▌        | 119/760 [00:00<00:01, 513.24it/s]
Loading weights:  29%|██▉       | 223/760 [00:00<00:00, 728.01it/s]
Loading weights:  49%|████▉     | 373/760 [00:00<00:00, 935.00it/s]
Loading weights:   0%|          | 0/760 [00:00<?, ?it/s]
Loading weights:   0%|          | 0/760 [00:00<?, ?it/s]
Loading weights:  71%|███████▏  | 542/760 [00:00<00:00, 1170.19it/s]
Loading weights:   0%|          | 0/760 [00:00<?, ?it/s]
Loading weights:   0%|          | 0/760 [00:00<?, ?it/s]
Loading weights:   0%|          | 0/760 [00:00<?, ?it/s]
Loading weights:   0%|          | 0/760 [00:00<?, ?it/s]
Loading weights:   0%|          | 0/760 [00:00<?, ?it/s]
Loading weights:  70%|██████▉   | 530/760 [00:00<00:00, 5299.65it/s]
Loading weights: 100%|██████████| 760/760 [00:00<00:00, 7733.80it/s]

Loading weights: 100%|██████████| 760/760 [00:00<00:00, 8331.04it/s]

Loading weights: 100%|██████████| 760/760 [00:00<00:00, 1165.39it/s]

Loading weights: 100%|██████████| 760/760 [00:00<00:00, 8421.45it/s]

Loading weights: 100%|██████████| 760/760 [00:00<00:00, 8069.03it/s]

Loading weights: 100%|██████████| 760/760 [00:00<00:00, 7047.07it/s]

Loading weights: 100%|██████████| 760/760 [00:00<00:00, 9874.12it/s]

Loading weights: 100%|██████████| 760/760 [00:00<00:00, 12364.04it/s]
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[FeatureFusion] importance gate ENABLED on geometry delta
[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[FeatureFusion] importance gate ENABLED on geometry delta
[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[FeatureFusion] importance gate ENABLED on geometry delta
[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[FeatureFusion] importance gate ENABLED on geometry delta
[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[FeatureFusion] importance gate ENABLED on geometry delta
[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[FeatureFusion] importance gate ENABLED on geometry delta
[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[FeatureFusion] importance gate ENABLED on geometry delta
[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[FeatureFusion] importance gate ENABLED on geometry delta
[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
Loading weights from local directory
Loading weights from local directory
Loading weights from local directory
Loading weights from local directory
Loading weights from local directory
Loading weights from local directory
Loading weights from local directory
Loading weights from local directory
Vision Module - Attention Blocks:
Trainable Block Indices: None
Non-Trainable Block Indices: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26]
Merger Module Trainable: True
LLM Module - Embed Tokens Trainable: True
LLM Module - Trainable Layer Indices: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31]
LLM Module - Non-Trainable Layer Indices: None
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_importance_gate": true,
  "geometry_learnable_scale": true,
  "geometry_merger_type": "mlp",
  "geometry_spatial_bias": false,
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 4096,
    "initializer_range": 0.02,
    "intermediate_size": 12288,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": false,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": false,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 27,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1152,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4304,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 4096,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_importance_gate": true,
  "geometry_learnable_scale": true,
  "geometry_merger_type": "mlp",
  "geometry_spatial_bias": false,
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 4096,
    "initializer_range": 0.02,
    "intermediate_size": 12288,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": false,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": false,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 27,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1152,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4304,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 4096,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_importance_gate": true,
  "geometry_learnable_scale": true,
  "geometry_merger_type": "mlp",
  "geometry_spatial_bias": false,
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 4096,
    "initializer_range": 0.02,
    "intermediate_size": 12288,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": false,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": false,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 27,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1152,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4304,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 4096,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_importance_gate": true,
  "geometry_learnable_scale": true,
  "geometry_merger_type": "mlp",
  "geometry_spatial_bias": false,
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 4096,
    "initializer_range": 0.02,
    "intermediate_size": 12288,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": false,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": false,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 27,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1152,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4304,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 4096,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_importance_gate": true,
  "geometry_learnable_scale": true,
  "geometry_merger_type": "mlp",
  "geometry_spatial_bias": false,
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 4096,
    "initializer_range": 0.02,
    "intermediate_size": 12288,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": false,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": false,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 27,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1152,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4304,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 4096,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_importance_gate": true,
  "geometry_learnable_scale": true,
  "geometry_merger_type": "mlp",
  "geometry_spatial_bias": false,
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 4096,
    "initializer_range": 0.02,
    "intermediate_size": 12288,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": false,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": false,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 27,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1152,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4304,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 4096,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_importance_gate": true,
  "geometry_learnable_scale": true,
  "geometry_merger_type": "mlp",
  "geometry_spatial_bias": false,
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 4096,
    "initializer_range": 0.02,
    "intermediate_size": 12288,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": false,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": false,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 27,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1152,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4304,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 4096,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_importance_gate": true,
  "geometry_learnable_scale": true,
  "geometry_merger_type": "mlp",
  "geometry_spatial_bias": false,
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 4096,
    "initializer_range": 0.02,
    "intermediate_size": 12288,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": false,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": false,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 27,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1152,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4304,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 4096,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Total training samples: 2429620
Total training samples: 2429620
Total training samples: 2429620
Total training samples: 2429620
Total training samples: 2429620
Formatting inputs...Skip in lazy mode
Formatting inputs...Skip in lazy mode
Formatting inputs...Skip in lazy mode
Total training samples: 2429620
Formatting inputs...Skip in lazy mode
Formatting inputs...Skip in lazy mode
Total training samples: 2429620
Formatting inputs...Skip in lazy mode
Formatting inputs...Skip in lazy mode
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
Total training samples: 2429620
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
Formatting inputs...Skip in lazy mode
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
NCCL version 2.26.2+cuda12.2
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  0%|          | 0/37963 [00:00<?, ?it/s]/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  0%|          | 1/37963 [01:59<1254:53:24, 119.00s/it]/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  0%|          | 2/37963 [02:13<607:04:29, 57.57s/it]  
  0%|          | 3/37963 [02:27<399:01:04, 37.84s/it]
  0%|          | 4/37963 [02:41<299:48:05, 28.43s/it]
  0%|          | 5/37963 [03:03<275:16:51, 26.11s/it]
  0%|          | 6/37963 [03:18<232:53:07, 22.09s/it]
  0%|          | 7/37963 [03:32<206:00:04, 19.54s/it]
  0%|          | 8/37963 [03:46<188:50:55, 17.91s/it]/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  0%|          | 9/37963 [04:01<176:45:53, 16.77s/it]
  0%|          | 10/37963 [04:15<168:42:43, 16.00s/it]
                                                      
{'loss': '0.7027', 'grad_norm': '258.5', 'learning_rate': '1.58e-07', 'epoch': '0.0002634'}

  0%|          | 10/37963 [04:16<168:42:43, 16.00s/it]
  0%|          | 11/37963 [04:37<188:52:38, 17.92s/it]
  0%|          | 12/37963 [04:51<176:47:32, 16.77s/it]
  0%|          | 13/37963 [05:06<168:40:01, 16.00s/it]
  0%|          | 14/37963 [05:20<163:39:00, 15.52s/it]
  0%|          | 15/37963 [05:34<160:05:49, 15.19s/it]
  0%|          | 16/37963 [05:49<157:24:18, 14.93s/it]
  0%|          | 17/37963 [06:03<154:19:56, 14.64s/it]
  0%|          | 18/37963 [06:17<153:23:28, 14.55s/it]
  0%|          | 19/37963 [06:31<152:51:33, 14.50s/it]
  0%|          | 20/37963 [06:45<150:59:53, 14.33s/it]
                                                      
{'loss': '0.3359', 'grad_norm': '24.37', 'learning_rate': '3.336e-07', 'epoch': '0.0005268'}

  0%|          | 20/37963 [06:45<150:59:53, 14.33s/it]
  0%|          | 21/37963 [07:00<150:42:21, 14.30s/it]
  0%|          | 22/37963 [07:14<150:37:33, 14.29s/it]
  0%|          | 23/37963 [07:28<150:40:56, 14.30s/it]
  0%|          | 24/37963 [07:42<149:24:26, 14.18s/it]
  0%|          | 25/37963 [07:57<150:11:22, 14.25s/it]
  0%|          | 26/37963 [08:11<150:19:39, 14.27s/it]
  0%|          | 27/37963 [08:25<150:15:56, 14.26s/it]
  0%|          | 28/37963 [08:39<150:43:11, 14.30s/it]
  0%|          | 29/37963 [08:54<150:20:37, 14.27s/it]
  0%|          | 30/37963 [09:08<150:46:49, 14.31s/it]
                                                      
{'loss': '0.2469', 'grad_norm': '15.11', 'learning_rate': '5.092e-07', 'epoch': '0.0007902'}

  0%|          | 30/37963 [09:08<150:46:49, 14.31s/it]
  0%|          | 31/37963 [09:22<150:50:40, 14.32s/it]
  0%|          | 32/37963 [09:36<149:50:19, 14.22s/it]
  0%|          | 33/37963 [09:51<150:28:48, 14.28s/it]
  0%|          | 34/37963 [10:05<150:02:00, 14.24s/it]
  0%|          | 35/37963 [10:19<150:17:18, 14.26s/it]
  0%|          | 36/37963 [10:34<150:25:09, 14.28s/it]
  0%|          | 37/37963 [10:48<150:29:56, 14.29s/it]
  0%|          | 38/37963 [11:10<173:49:31, 16.50s/it]
  0%|          | 39/37963 [11:23<165:15:12, 15.69s/it]
  0%|          | 40/37963 [11:38<160:42:20, 15.26s/it]
                                                      
{'loss': '0.2243', 'grad_norm': '10.9', 'learning_rate': '6.848e-07', 'epoch': '0.001054'}

  0%|          | 40/37963 [11:38<160:42:20, 15.26s/it]
  0%|          | 41/37963 [11:52<157:40:54, 14.97s/it]
  0%|          | 42/37963 [12:06<155:28:45, 14.76s/it]
  0%|          | 43/37963 [12:35<201:04:47, 19.09s/it]
  0%|          | 44/37963 [13:09<247:44:04, 23.52s/it]
  0%|          | 45/37963 [13:30<237:56:46, 22.59s/it]
  0%|          | 46/37963 [13:50<231:49:24, 22.01s/it]
  0%|          | 47/37963 [14:05<207:54:50, 19.74s/it]
  0%|          | 48/37963 [14:19<190:46:37, 18.11s/it]
  0%|          | 49/37963 [14:34<179:14:00, 17.02s/it]
  0%|          | 50/37963 [14:48<170:41:45, 16.21s/it]
                                                      
{'loss': '0.2419', 'grad_norm': '17.52', 'learning_rate': '8.604e-07', 'epoch': '0.001317'}

  0%|          | 50/37963 [14:48<170:41:45, 16.21s/it]
  0%|          | 51/37963 [15:02<164:53:39, 15.66s/it]
  0%|          | 52/37963 [15:17<160:39:52, 15.26s/it]
  0%|          | 53/37963 [15:30<156:23:35, 14.85s/it]
  0%|          | 54/37963 [15:45<154:47:40, 14.70s/it]
  0%|          | 55/37963 [15:59<151:46:42, 14.41s/it]
  0%|          | 56/37963 [16:12<150:13:27, 14.27s/it]
  0%|          | 57/37963 [16:27<150:24:41, 14.28s/it]
  0%|          | 58/37963 [16:41<149:21:07, 14.18s/it]
  0%|          | 59/37963 [16:55<149:39:19, 14.21s/it]
  0%|          | 60/37963 [17:09<149:55:27, 14.24s/it]
                                                      
{'loss': '0.2256', 'grad_norm': '8.745', 'learning_rate': '1.036e-06', 'epoch': '0.00158'}

  0%|          | 60/37963 [17:09<149:55:27, 14.24s/it]
  0%|          | 61/37963 [17:24<150:26:38, 14.29s/it]
  0%|          | 62/37963 [17:37<148:27:46, 14.10s/it]
  0%|          | 63/37963 [17:52<149:15:32, 14.18s/it]
  0%|          | 64/37963 [18:06<148:37:05, 14.12s/it]
  0%|          | 65/37963 [18:20<149:10:22, 14.17s/it]
  0%|          | 66/37963 [18:34<147:56:33, 14.05s/it]
  0%|          | 67/37963 [18:48<148:43:25, 14.13s/it]
  0%|          | 68/37963 [19:02<148:06:29, 14.07s/it]
  0%|          | 69/37963 [19:16<146:37:41, 13.93s/it]
  0%|          | 70/37963 [19:30<147:48:04, 14.04s/it]
                                                      
{'loss': '0.2162', 'grad_norm': '12.16', 'learning_rate': '1.212e-06', 'epoch': '0.001844'}

  0%|          | 70/37963 [19:30<147:48:04, 14.04s/it]
  0%|          | 71/37963 [19:44<148:46:45, 14.14s/it]
  0%|          | 72/37963 [19:59<149:19:22, 14.19s/it]
  0%|          | 73/37963 [20:13<149:30:16, 14.20s/it]
  0%|          | 74/37963 [20:27<149:53:57, 14.24s/it]
  0%|          | 75/37963 [20:41<149:52:08, 14.24s/it]
  0%|          | 76/37963 [20:56<149:55:02, 14.25s/it]
  0%|          | 77/37963 [21:10<150:35:05, 14.31s/it]
  0%|          | 78/37963 [21:25<151:15:42, 14.37s/it]
  0%|          | 79/37963 [21:39<151:05:40, 14.36s/it]
  0%|          | 80/37963 [21:53<151:03:44, 14.36s/it]
                                                      
{'loss': '0.219', 'grad_norm': '6.292', 'learning_rate': '1.387e-06', 'epoch': '0.002107'}

  0%|          | 80/37963 [21:53<151:03:44, 14.36s/it]
  0%|          | 81/37963 [22:08<151:18:42, 14.38s/it]
  0%|          | 82/37963 [22:22<150:43:43, 14.32s/it]
  0%|          | 83/37963 [22:36<151:17:17, 14.38s/it]
  0%|          | 84/37963 [22:51<151:37:46, 14.41s/it]
  0%|          | 85/37963 [23:05<150:28:24, 14.30s/it]
  0%|          | 86/37963 [23:19<150:37:04, 14.32s/it]
  0%|          | 87/37963 [23:34<150:43:00, 14.33s/it]
  0%|          | 88/37963 [23:48<150:11:50, 14.28s/it]
  0%|          | 89/37963 [24:02<150:50:51, 14.34s/it]
  0%|          | 90/37963 [24:16<149:26:51, 14.21s/it]
                                                      
{'loss': '0.2075', 'grad_norm': '6.634', 'learning_rate': '1.563e-06', 'epoch': '0.002371'}

  0%|          | 90/37963 [24:16<149:26:51, 14.21s/it]
  0%|          | 91/37963 [24:31<150:02:22, 14.26s/it]
  0%|          | 92/37963 [25:04<209:27:10, 19.91s/it]
  0%|          | 93/37963 [25:31<232:41:26, 22.12s/it]
  0%|          | 94/37963 [25:52<229:21:58, 21.80s/it]
  0%|          | 95/37963 [26:15<231:49:09, 22.04s/it]
  0%|          | 96/37963 [26:36<228:16:27, 21.70s/it]
  0%|          | 97/37963 [26:50<205:08:23, 19.50s/it]
  0%|          | 98/37963 [27:04<188:56:11, 17.96s/it]
  0%|          | 99/37963 [27:19<177:36:19, 16.89s/it]
  0%|          | 100/37963 [27:33<168:56:59, 16.06s/it]
                                                       
{'loss': '0.204', 'grad_norm': '11.33', 'learning_rate': '1.738e-06', 'epoch': '0.002634'}

  0%|          | 100/37963 [27:33<168:56:59, 16.06s/it]
  0%|          | 101/37963 [27:47<163:38:05, 15.56s/it]
  0%|          | 102/37963 [28:02<159:54:34, 15.20s/it]
  0%|          | 103/37963 [28:16<157:11:32, 14.95s/it]
  0%|          | 104/37963 [28:30<155:18:00, 14.77s/it]
  0%|          | 105/37963 [28:44<151:21:19, 14.39s/it]
  0%|          | 106/37963 [28:58<151:39:47, 14.42s/it]
  0%|          | 107/37963 [29:13<151:23:35, 14.40s/it]
  0%|          | 108/37963 [29:27<151:18:17, 14.39s/it]
  0%|          | 109/37963 [29:41<151:14:42, 14.38s/it]
  0%|          | 110/37963 [29:56<151:05:02, 14.37s/it]
                                                       
{'loss': '0.2058', 'grad_norm': '7.536', 'learning_rate': '1.914e-06', 'epoch': '0.002898'}

  0%|          | 110/37963 [29:56<151:05:02, 14.37s/it]
  0%|          | 111/37963 [30:10<151:34:20, 14.42s/it]
  0%|          | 112/37963 [30:25<151:13:32, 14.38s/it]
  0%|          | 113/37963 [30:39<151:25:17, 14.40s/it]
  0%|          | 114/37963 [30:53<151:22:19, 14.40s/it]
  0%|          | 115/37963 [31:08<151:02:17, 14.37s/it]
  0%|          | 116/37963 [31:22<151:02:33, 14.37s/it]
  0%|          | 117/37963 [31:36<151:13:08, 14.38s/it]
  0%|          | 118/37963 [31:51<151:01:10, 14.37s/it]
  0%|          | 119/37963 [32:05<151:09:20, 14.38s/it]
  0%|          | 120/37963 [32:20<151:23:43, 14.40s/it]
                                                       
{'loss': '0.2232', 'grad_norm': '10.03', 'learning_rate': '2.09e-06', 'epoch': '0.003161'}

  0%|          | 120/37963 [32:20<151:23:43, 14.40s/it]
  0%|          | 121/37963 [32:33<149:29:38, 14.22s/it]
  0%|          | 122/37963 [32:48<149:26:50, 14.22s/it]
  0%|          | 123/37963 [33:02<149:11:07, 14.19s/it]
  0%|          | 124/37963 [33:16<148:40:46, 14.15s/it]
  0%|          | 125/37963 [33:29<146:29:16, 13.94s/it]
  0%|          | 126/37963 [33:44<147:42:00, 14.05s/it]
  0%|          | 127/37963 [33:58<149:01:31, 14.18s/it]
  0%|          | 128/37963 [34:12<148:20:13, 14.11s/it]
  0%|          | 129/37963 [34:26<147:32:12, 14.04s/it]
  0%|          | 130/37963 [34:40<148:52:44, 14.17s/it]
                                                       
{'loss': '0.1924', 'grad_norm': '7.197', 'learning_rate': '2.265e-06', 'epoch': '0.003424'}

  0%|          | 130/37963 [34:40<148:52:44, 14.17s/it]
  0%|          | 131/37963 [34:55<149:37:02, 14.24s/it]
  0%|          | 132/37963 [35:09<149:41:37, 14.24s/it]
  0%|          | 133/37963 [35:23<148:04:26, 14.09s/it]
  0%|          | 134/37963 [35:37<148:47:13, 14.16s/it]
  0%|          | 135/37963 [35:51<149:19:27, 14.21s/it]
  0%|          | 136/37963 [36:06<149:40:40, 14.24s/it]
  0%|          | 137/37963 [36:20<150:47:56, 14.35s/it]
  0%|          | 138/37963 [36:41<170:58:40, 16.27s/it]
  0%|          | 139/37963 [36:55<164:20:22, 15.64s/it]
  0%|          | 140/37963 [37:15<178:24:38, 16.98s/it]
                                                       
{'loss': '0.2064', 'grad_norm': '7.655', 'learning_rate': '2.441e-06', 'epoch': '0.003688'}

  0%|          | 140/37963 [37:15<178:24:38, 16.98s/it]
  0%|          | 141/37963 [37:50<233:13:28, 22.20s/it]
  0%|          | 142/37963 [38:04<206:55:30, 19.70s/it]
  0%|          | 143/37963 [38:31<230:05:53, 21.90s/it]
  0%|          | 144/37963 [38:45<206:28:06, 19.65s/it]
  0%|          | 145/37963 [39:00<190:07:57, 18.10s/it]
  0%|          | 146/37963 [39:14<177:31:15, 16.90s/it]
  0%|          | 147/37963 [39:28<169:21:31, 16.12s/it]
  0%|          | 148/37963 [39:42<163:51:25, 15.60s/it]
  0%|          | 149/37963 [39:57<159:32:00, 15.19s/it]
  0%|          | 150/37963 [40:11<156:09:25, 14.87s/it]
                                                       
{'loss': '0.2049', 'grad_norm': '4.625', 'learning_rate': '2.616e-06', 'epoch': '0.003951'}

  0%|          | 150/37963 [40:11<156:09:25, 14.87s/it]
  0%|          | 151/37963 [40:25<153:56:25, 14.66s/it]
  0%|          | 152/37963 [40:39<153:05:52, 14.58s/it]
  0%|          | 153/37963 [40:53<151:52:19, 14.46s/it]
  0%|          | 154/37963 [41:08<151:38:50, 14.44s/it]
  0%|          | 155/37963 [41:22<151:27:34, 14.42s/it]
  0%|          | 156/37963 [41:37<151:19:30, 14.41s/it]
  0%|          | 157/37963 [41:51<151:13:39, 14.40s/it]
  0%|          | 158/37963 [42:05<151:31:01, 14.43s/it]
  0%|          | 159/37963 [42:20<151:07:59, 14.39s/it]
  0%|          | 160/37963 [42:34<151:05:42, 14.39s/it]
                                                       
{'loss': '0.2211', 'grad_norm': '7.507', 'learning_rate': '2.792e-06', 'epoch': '0.004215'}

  0%|          | 160/37963 [42:34<151:05:42, 14.39s/it]
  0%|          | 161/37963 [42:48<149:49:28, 14.27s/it]
  0%|          | 162/37963 [43:02<150:06:33, 14.30s/it]
  0%|          | 163/37963 [43:16<148:10:19, 14.11s/it]
  0%|          | 164/37963 [43:31<149:40:42, 14.26s/it]
  0%|          | 165/37963 [43:45<149:55:28, 14.28s/it]
  0%|          | 166/37963 [43:59<150:00:55, 14.29s/it]
  0%|          | 167/37963 [44:13<148:53:30, 14.18s/it]
  0%|          | 168/37963 [44:28<149:27:28, 14.24s/it]
  0%|          | 169/37963 [44:42<149:08:48, 14.21s/it]
  0%|          | 170/37963 [44:56<149:36:08, 14.25s/it]
                                                       
{'loss': '0.2157', 'grad_norm': '6.76', 'learning_rate': '2.968e-06', 'epoch': '0.004478'}

  0%|          | 170/37963 [44:56<149:36:08, 14.25s/it]
  0%|          | 171/37963 [45:10<147:43:45, 14.07s/it]
  0%|          | 172/37963 [45:24<149:08:32, 14.21s/it]
  0%|          | 173/37963 [45:39<149:30:37, 14.24s/it]
  0%|          | 174/37963 [45:53<149:44:34, 14.27s/it]
  0%|          | 175/37963 [46:07<149:53:18, 14.28s/it]
  0%|          | 176/37963 [46:22<150:26:33, 14.33s/it]
  0%|          | 177/37963 [46:36<149:23:25, 14.23s/it]
  0%|          | 178/37963 [46:50<150:08:16, 14.30s/it]
  0%|          | 179/37963 [47:04<149:32:30, 14.25s/it]
  0%|          | 180/37963 [47:19<149:46:13, 14.27s/it]
                                                       
{'loss': '0.2171', 'grad_norm': '4.089', 'learning_rate': '3.143e-06', 'epoch': '0.004741'}

  0%|          | 180/37963 [47:19<149:46:13, 14.27s/it]
  0%|          | 181/37963 [47:33<149:52:35, 14.28s/it]
  0%|          | 182/37963 [47:47<149:51:27, 14.28s/it]
  0%|          | 183/37963 [48:02<150:23:14, 14.33s/it]
  0%|          | 184/37963 [48:16<149:55:08, 14.29s/it]
  0%|          | 185/37963 [48:30<150:07:08, 14.31s/it]
  0%|          | 186/37963 [48:45<150:23:59, 14.33s/it]
  0%|          | 187/37963 [48:59<150:18:45, 14.32s/it]
  0%|          | 188/37963 [49:20<170:40:11, 16.27s/it]
  0%|          | 189/37963 [49:54<226:28:20, 21.58s/it]
  1%|          | 190/37963 [50:15<225:21:09, 21.48s/it]
                                                       
{'loss': '0.2039', 'grad_norm': '5.246', 'learning_rate': '3.319e-06', 'epoch': '0.005005'}

  1%|          | 190/37963 [50:15<225:21:09, 21.48s/it]
  1%|          | 191/37963 [50:36<223:41:01, 21.32s/it]
  1%|          | 192/37963 [50:56<220:22:32, 21.00s/it]
  1%|          | 193/37963 [51:17<219:06:27, 20.88s/it]
  1%|          | 194/37963 [51:31<197:31:30, 18.83s/it]
  1%|          | 195/37963 [51:45<183:23:09, 17.48s/it]
  1%|          | 196/37963 [51:59<173:30:19, 16.54s/it]
  1%|          | 197/37963 [52:13<165:25:38, 15.77s/it]
  1%|          | 198/37963 [52:28<161:02:19, 15.35s/it]
  1%|          | 199/37963 [52:42<157:52:33, 15.05s/it]
  1%|          | 200/37963 [52:56<154:33:50, 14.73s/it]
                                                       
{'loss': '0.2136', 'grad_norm': '8.304', 'learning_rate': '3.494e-06', 'epoch': '0.005268'}

  1%|          | 200/37963 [52:56<154:33:50, 14.73s/it]
  1%|          | 201/37963 [53:11<153:19:28, 14.62s/it]
  1%|          | 202/37963 [53:25<152:20:27, 14.52s/it]
  1%|          | 203/37963 [53:39<151:45:19, 14.47s/it]
  1%|          | 204/37963 [53:53<151:16:36, 14.42s/it]
  1%|          | 205/37963 [54:08<150:57:07, 14.39s/it]
  1%|          | 206/37963 [54:22<150:35:38, 14.36s/it]
  1%|          | 207/37963 [54:36<150:20:05, 14.33s/it]
  1%|          | 208/37963 [54:51<150:37:30, 14.36s/it]
  1%|          | 209/37963 [55:05<151:06:19, 14.41s/it]
  1%|          | 210/37963 [55:20<150:35:50, 14.36s/it]
                                                       
{'loss': '0.2087', 'grad_norm': '11.16', 'learning_rate': '3.67e-06', 'epoch': '0.005532'}

  1%|          | 210/37963 [55:20<150:35:50, 14.36s/it]
  1%|          | 211/37963 [55:34<150:24:09, 14.34s/it]
  1%|          | 212/37963 [55:48<150:42:14, 14.37s/it]
  1%|          | 213/37963 [56:03<150:34:01, 14.36s/it]
  1%|          | 214/37963 [56:17<150:34:30, 14.36s/it]
  1%|          | 215/37963 [56:31<150:39:57, 14.37s/it]
  1%|          | 216/37963 [56:46<150:44:03, 14.38s/it]
  1%|          | 217/37963 [57:00<150:20:26, 14.34s/it]
  1%|          | 218/37963 [57:14<150:33:08, 14.36s/it]
  1%|          | 219/37963 [57:29<151:05:21, 14.41s/it]
  1%|          | 220/37963 [57:43<151:09:31, 14.42s/it]
                                                       
{'loss': '0.1989', 'grad_norm': '15.05', 'learning_rate': '3.845e-06', 'epoch': '0.005795'}

  1%|          | 220/37963 [57:43<151:09:31, 14.42s/it]
  1%|          | 221/37963 [57:57<149:23:01, 14.25s/it]
  1%|          | 222/37963 [58:12<149:46:44, 14.29s/it]
  1%|          | 223/37963 [58:26<150:17:14, 14.34s/it]
  1%|          | 224/37963 [58:41<150:36:02, 14.37s/it]
  1%|          | 225/37963 [58:55<150:46:13, 14.38s/it]
  1%|          | 226/37963 [59:09<148:19:42, 14.15s/it]
  1%|          | 227/37963 [59:23<148:51:12, 14.20s/it]
  1%|          | 228/37963 [59:37<149:19:26, 14.25s/it]
  1%|          | 229/37963 [59:51<147:46:42, 14.10s/it]
  1%|          | 230/37963 [1:00:05<148:27:02, 14.16s/it]
                                                         
{'loss': '0.2148', 'grad_norm': '11.54', 'learning_rate': '4.021e-06', 'epoch': '0.006059'}

  1%|          | 230/37963 [1:00:05<148:27:02, 14.16s/it]
  1%|          | 231/37963 [1:00:20<148:56:36, 14.21s/it]
  1%|          | 232/37963 [1:00:34<148:17:27, 14.15s/it]
  1%|          | 233/37963 [1:00:48<148:58:15, 14.21s/it]
  1%|          | 234/37963 [1:01:02<149:22:45, 14.25s/it]
  1%|          | 235/37963 [1:01:17<149:35:26, 14.27s/it]
  1%|          | 236/37963 [1:01:31<149:43:44, 14.29s/it]
  1%|          | 237/37963 [1:01:52<170:13:08, 16.24s/it]
  1%|          | 238/37963 [1:02:20<207:53:44, 19.84s/it]
  1%|          | 239/37963 [1:02:41<210:49:08, 20.12s/it]
  1%|          | 240/37963 [1:03:07<230:53:24, 22.03s/it]
                                                         
{'loss': '0.2185', 'grad_norm': '10.09', 'learning_rate': '4.197e-06', 'epoch': '0.006322'}

  1%|          | 240/37963 [1:03:07<230:53:24, 22.03s/it]
  1%|          | 241/37963 [1:03:21<204:58:03, 19.56s/it]
  1%|          | 242/37963 [1:03:42<209:25:24, 19.99s/it]
  1%|          | 243/37963 [1:03:56<192:02:50, 18.33s/it]
  1%|          | 244/37963 [1:04:11<180:18:30, 17.21s/it]
  1%|          | 245/37963 [1:04:25<171:18:54, 16.35s/it]
  1%|          | 246/37963 [1:04:40<164:54:23, 15.74s/it]
  1%|          | 247/37963 [1:04:54<160:27:33, 15.32s/it]
  1%|          | 248/37963 [1:05:09<157:45:24, 15.06s/it]
  1%|          | 249/37963 [1:05:22<153:52:48, 14.69s/it]
  1%|          | 250/37963 [1:05:37<153:10:26, 14.62s/it]
                                                         
{'loss': '0.1761', 'grad_norm': '5.904', 'learning_rate': '4.372e-06', 'epoch': '0.006585'}

  1%|          | 250/37963 [1:05:37<153:10:26, 14.62s/it]
  1%|          | 251/37963 [1:05:51<151:26:45, 14.46s/it]
  1%|          | 252/37963 [1:06:05<150:28:42, 14.37s/it]
  1%|          | 253/37963 [1:06:19<150:20:08, 14.35s/it]
  1%|          | 254/37963 [1:06:34<150:16:48, 14.35s/it]
  1%|          | 255/37963 [1:06:48<150:24:54, 14.36s/it]
  1%|          | 256/37963 [1:07:02<149:19:26, 14.26s/it]
  1%|          | 257/37963 [1:07:16<149:34:42, 14.28s/it]
  1%|          | 258/37963 [1:07:31<149:32:31, 14.28s/it]
  1%|          | 259/37963 [1:07:45<149:36:27, 14.28s/it]
  1%|          | 260/37963 [1:07:59<149:49:34, 14.31s/it]
                                                         
{'loss': '0.2062', 'grad_norm': '4.831', 'learning_rate': '4.548e-06', 'epoch': '0.006849'}

  1%|          | 260/37963 [1:07:59<149:49:34, 14.31s/it]
  1%|          | 261/37963 [1:08:14<149:54:11, 14.31s/it]
  1%|          | 262/37963 [1:08:28<150:03:44, 14.33s/it]
  1%|          | 263/37963 [1:08:42<150:06:00, 14.33s/it]
  1%|          | 264/37963 [1:08:57<150:13:23, 14.35s/it]
  1%|          | 265/37963 [1:09:11<150:22:08, 14.36s/it]
  1%|          | 266/37963 [1:09:26<150:37:25, 14.38s/it]
  1%|          | 267/37963 [1:09:40<150:48:22, 14.40s/it]
  1%|          | 268/37963 [1:09:54<150:34:48, 14.38s/it]
  1%|          | 269/37963 [1:10:09<149:52:49, 14.31s/it]
  1%|          | 270/37963 [1:10:23<149:52:16, 14.31s/it]
                                                         
{'loss': '0.1869', 'grad_norm': '5.634', 'learning_rate': '4.723e-06', 'epoch': '0.007112'}

  1%|          | 270/37963 [1:10:23<149:52:16, 14.31s/it]
  1%|          | 271/37963 [1:10:37<149:41:21, 14.30s/it]
  1%|          | 272/37963 [1:10:52<149:57:43, 14.32s/it]
  1%|          | 273/37963 [1:11:06<149:54:07, 14.32s/it]
  1%|          | 274/37963 [1:11:20<150:26:03, 14.37s/it]
  1%|          | 275/37963 [1:11:35<150:20:27, 14.36s/it]
  1%|          | 276/37963 [1:11:49<150:11:04, 14.35s/it]
  1%|          | 277/37963 [1:12:03<149:20:06, 14.27s/it]
  1%|          | 278/37963 [1:12:17<148:56:22, 14.23s/it]
  1%|          | 279/37963 [1:12:32<149:26:05, 14.28s/it]
  1%|          | 280/37963 [1:12:46<149:36:47, 14.29s/it]
                                                         
{'loss': '0.1941', 'grad_norm': '6.651', 'learning_rate': '4.899e-06', 'epoch': '0.007376'}

  1%|          | 280/37963 [1:12:46<149:36:47, 14.29s/it]
  1%|          | 281/37963 [1:13:00<149:40:16, 14.30s/it]
  1%|          | 282/37963 [1:13:15<149:55:54, 14.32s/it]
  1%|          | 283/37963 [1:13:29<150:11:21, 14.35s/it]
  1%|          | 284/37963 [1:13:43<150:33:03, 14.38s/it]
  1%|          | 285/37963 [1:13:58<149:54:06, 14.32s/it]
  1%|          | 286/37963 [1:14:25<190:28:31, 18.20s/it]
  1%|          | 287/37963 [1:14:46<200:48:56, 19.19s/it]
  1%|          | 288/37963 [1:15:21<250:35:57, 23.95s/it]
  1%|          | 289/37963 [1:15:42<241:00:29, 23.03s/it]
  1%|          | 290/37963 [1:16:02<231:27:52, 22.12s/it]
                                                         
{'loss': '0.1918', 'grad_norm': '5.62', 'learning_rate': '5.075e-06', 'epoch': '0.007639'}

  1%|          | 290/37963 [1:16:02<231:27:52, 22.12s/it]
  1%|          | 291/37963 [1:16:17<207:30:11, 19.83s/it]
  1%|          | 292/37963 [1:16:31<188:39:01, 18.03s/it]
  1%|          | 293/37963 [1:16:45<177:19:35, 16.95s/it]
  1%|          | 294/37963 [1:16:59<168:27:13, 16.10s/it]
  1%|          | 295/37963 [1:17:14<163:03:21, 15.58s/it]
  1%|          | 296/37963 [1:17:28<159:40:00, 15.26s/it]
  1%|          | 297/37963 [1:17:42<156:44:53, 14.98s/it]
  1%|          | 298/37963 [1:17:57<154:49:41, 14.80s/it]
  1%|          | 299/37963 [1:18:11<153:35:25, 14.68s/it]
  1%|          | 300/37963 [1:18:26<152:28:54, 14.57s/it]
                                                         
{'loss': '0.1931', 'grad_norm': '3.892', 'learning_rate': '5.25e-06', 'epoch': '0.007902'}

  1%|          | 300/37963 [1:18:26<152:28:54, 14.57s/it]
  1%|          | 301/37963 [1:18:40<151:42:15, 14.50s/it]
  1%|          | 302/37963 [1:18:54<151:15:49, 14.46s/it]
  1%|          | 303/37963 [1:19:09<151:41:20, 14.50s/it]
  1%|          | 304/37963 [1:19:23<151:23:28, 14.47s/it]
  1%|          | 305/37963 [1:19:38<151:09:26, 14.45s/it]
  1%|          | 306/37963 [1:19:52<150:29:28, 14.39s/it]
  1%|          | 307/37963 [1:20:06<150:42:08, 14.41s/it]
  1%|          | 308/37963 [1:20:21<150:59:28, 14.44s/it]
  1%|          | 309/37963 [1:20:35<150:04:13, 14.35s/it]
  1%|          | 310/37963 [1:20:49<148:46:02, 14.22s/it]
                                                         
{'loss': '0.1827', 'grad_norm': '4.611', 'learning_rate': '5.426e-06', 'epoch': '0.008166'}

  1%|          | 310/37963 [1:20:49<148:46:02, 14.22s/it]
  1%|          | 311/37963 [1:21:02<146:25:58, 14.00s/it]
  1%|          | 312/37963 [1:21:16<146:39:10, 14.02s/it]
  1%|          | 313/37963 [1:21:31<147:37:28, 14.12s/it]
  1%|          | 314/37963 [1:21:45<148:30:47, 14.20s/it]
  1%|          | 315/37963 [1:22:00<149:27:25, 14.29s/it]
  1%|          | 316/37963 [1:22:14<149:41:15, 14.31s/it]
  1%|          | 317/37963 [1:22:28<150:00:01, 14.34s/it]
  1%|          | 318/37963 [1:22:43<150:13:37, 14.37s/it]
  1%|          | 319/37963 [1:22:57<150:27:41, 14.39s/it]
  1%|          | 320/37963 [1:23:12<151:04:34, 14.45s/it]
                                                         
{'loss': '0.188', 'grad_norm': '7.958', 'learning_rate': '5.601e-06', 'epoch': '0.008429'}

  1%|          | 320/37963 [1:23:12<151:04:34, 14.45s/it]
  1%|          | 321/37963 [1:23:26<150:38:39, 14.41s/it]
  1%|          | 322/37963 [1:23:41<150:29:31, 14.39s/it]
  1%|          | 323/37963 [1:23:55<150:40:40, 14.41s/it]
  1%|          | 324/37963 [1:24:09<150:23:15, 14.38s/it]
  1%|          | 325/37963 [1:24:24<150:46:47, 14.42s/it]
  1%|          | 326/37963 [1:24:38<150:00:55, 14.35s/it]
  1%|          | 327/37963 [1:24:52<149:33:46, 14.31s/it]
  1%|          | 328/37963 [1:25:07<149:32:19, 14.30s/it]
  1%|          | 329/37963 [1:25:21<149:34:22, 14.31s/it]
  1%|          | 330/37963 [1:25:35<149:31:02, 14.30s/it]
                                                         
{'loss': '0.2052', 'grad_norm': '3.14', 'learning_rate': '5.777e-06', 'epoch': '0.008693'}

  1%|          | 330/37963 [1:25:35<149:31:02, 14.30s/it]
  1%|          | 331/37963 [1:25:50<151:03:19, 14.45s/it]
  1%|          | 332/37963 [1:26:04<150:28:48, 14.40s/it]
  1%|          | 333/37963 [1:26:19<150:20:57, 14.38s/it]
  1%|          | 334/37963 [1:26:39<170:33:19, 16.32s/it]
  1%|          | 335/37963 [1:27:00<184:20:55, 17.64s/it]
  1%|          | 336/37963 [1:27:28<218:00:56, 20.86s/it]
  1%|          | 337/37963 [1:27:50<219:15:30, 20.98s/it]
  1%|          | 338/37963 [1:28:16<236:53:20, 22.67s/it]
  1%|          | 339/37963 [1:28:37<231:56:20, 22.19s/it]
  1%|          | 340/37963 [1:28:51<205:51:58, 19.70s/it]
                                                         
{'loss': '0.1885', 'grad_norm': '7.029', 'learning_rate': '5.953e-06', 'epoch': '0.008956'}

  1%|          | 340/37963 [1:28:51<205:51:58, 19.70s/it]
  1%|          | 341/37963 [1:29:06<189:04:25, 18.09s/it]
  1%|          | 342/37963 [1:29:20<177:52:31, 17.02s/it]
  1%|          | 343/37963 [1:29:35<169:43:16, 16.24s/it]
  1%|          | 344/37963 [1:29:49<163:34:34, 15.65s/it]
  1%|          | 345/37963 [1:30:03<158:10:52, 15.14s/it]
  1%|          | 346/37963 [1:30:17<155:52:19, 14.92s/it]
  1%|          | 347/37963 [1:30:32<154:12:14, 14.76s/it]
  1%|          | 348/37963 [1:30:46<152:48:12, 14.62s/it]
  1%|          | 349/37963 [1:31:00<151:56:25, 14.54s/it]
  1%|          | 350/37963 [1:31:15<151:12:43, 14.47s/it]
                                                         
{'loss': '0.2146', 'grad_norm': '2.623', 'learning_rate': '6.128e-06', 'epoch': '0.00922'}

  1%|          | 350/37963 [1:31:15<151:12:43, 14.47s/it]
  1%|          | 351/37963 [1:31:28<149:07:33, 14.27s/it]
  1%|          | 352/37963 [1:31:43<149:22:04, 14.30s/it]
  1%|          | 353/37963 [1:31:57<149:27:17, 14.31s/it]
  1%|          | 354/37963 [1:32:11<148:58:28, 14.26s/it]
  1%|          | 355/37963 [1:32:26<149:36:08, 14.32s/it]
  1%|          | 356/37963 [1:32:40<149:48:01, 14.34s/it]
  1%|          | 357/37963 [1:32:55<150:16:20, 14.39s/it]
  1%|          | 358/37963 [1:33:09<150:18:06, 14.39s/it]
  1%|          | 359/37963 [1:33:23<148:44:08, 14.24s/it]
  1%|          | 360/37963 [1:33:37<149:10:04, 14.28s/it]
                                                         
{'loss': '0.1985', 'grad_norm': '3.532', 'learning_rate': '6.304e-06', 'epoch': '0.009483'}

  1%|          | 360/37963 [1:33:37<149:10:04, 14.28s/it]
  1%|          | 361/37963 [1:33:52<149:27:11, 14.31s/it]
  1%|          | 362/37963 [1:34:06<149:39:01, 14.33s/it]
  1%|          | 363/37963 [1:34:20<149:40:56, 14.33s/it]
  1%|          | 364/37963 [1:34:35<149:43:42, 14.34s/it]
  1%|          | 365/37963 [1:34:49<149:55:17, 14.35s/it]
  1%|          | 366/37963 [1:35:03<149:56:23, 14.36s/it]
  1%|          | 367/37963 [1:35:18<150:06:42, 14.37s/it]
  1%|          | 368/37963 [1:35:32<149:16:44, 14.29s/it]
  1%|          | 369/37963 [1:35:46<149:33:07, 14.32s/it]
  1%|          | 370/37963 [1:36:01<149:33:56, 14.32s/it]
                                                         
{'loss': '0.2016', 'grad_norm': '2.89', 'learning_rate': '6.479e-06', 'epoch': '0.009746'}

  1%|          | 370/37963 [1:36:01<149:33:56, 14.32s/it]
  1%|          | 371/37963 [1:36:15<149:36:58, 14.33s/it]
  1%|          | 372/37963 [1:36:29<149:36:33, 14.33s/it]
  1%|          | 373/37963 [1:36:44<149:44:54, 14.34s/it]
  1%|          | 374/37963 [1:36:57<147:42:18, 14.15s/it]
  1%|          | 375/37963 [1:37:12<148:39:24, 14.24s/it]
  1%|          | 376/37963 [1:37:26<149:26:10, 14.31s/it]
  1%|          | 377/37963 [1:37:41<149:31:11, 14.32s/it]
  1%|          | 378/37963 [1:37:55<149:21:35, 14.31s/it]
  1%|          | 379/37963 [1:38:09<149:37:34, 14.33s/it]
  1%|          | 380/37963 [1:38:24<149:33:40, 14.33s/it]
                                                         
{'loss': '0.2027', 'grad_norm': '4.146', 'learning_rate': '6.655e-06', 'epoch': '0.01001'}

  1%|          | 380/37963 [1:38:24<149:33:40, 14.33s/it]
  1%|          | 381/37963 [1:38:38<149:44:04, 14.34s/it]
  1%|          | 382/37963 [1:38:59<171:38:41, 16.44s/it]
  1%|          | 383/37963 [1:39:14<165:04:02, 15.81s/it]
  1%|          | 384/37963 [1:39:28<161:19:06, 15.45s/it]
  1%|          | 385/37963 [1:40:04<224:08:58, 21.47s/it]
  1%|          | 386/37963 [1:40:18<202:03:24, 19.36s/it]
  1%|          | 387/37963 [1:40:33<186:27:09, 17.86s/it]
  1%|          | 388/37963 [1:40:53<194:42:34, 18.65s/it]
  1%|          | 389/37963 [1:41:20<221:46:06, 21.25s/it]
  1%|          | 390/37963 [1:41:35<200:35:55, 19.22s/it]
                                                         
{'loss': '0.1945', 'grad_norm': '9.083', 'learning_rate': '6.831e-06', 'epoch': '0.01027'}

  1%|          | 390/37963 [1:41:35<200:35:55, 19.22s/it]
  1%|          | 391/37963 [1:41:50<186:19:19, 17.85s/it]
  1%|          | 392/37963 [1:42:04<175:35:34, 16.83s/it]
  1%|          | 393/37963 [1:42:18<168:06:17, 16.11s/it]
  1%|          | 394/37963 [1:42:31<158:23:02, 15.18s/it]
  1%|          | 395/37963 [1:42:46<155:40:29, 14.92s/it]
  1%|          | 396/37963 [1:43:00<153:19:41, 14.69s/it]
  1%|          | 397/37963 [1:43:14<152:22:33, 14.60s/it]
  1%|          | 398/37963 [1:43:29<151:34:04, 14.53s/it]
  1%|          | 399/37963 [1:43:43<150:27:36, 14.42s/it]
  1%|          | 400/37963 [1:43:57<150:19:59, 14.41s/it]
                                                         
{'loss': '0.1858', 'grad_norm': '6.832', 'learning_rate': '7.006e-06', 'epoch': '0.01054'}

  1%|          | 400/37963 [1:43:57<150:19:59, 14.41s/it]
  1%|          | 401/37963 [1:44:12<150:14:13, 14.40s/it]
  1%|          | 402/37963 [1:44:25<148:16:13, 14.21s/it]
  1%|          | 403/37963 [1:44:39<145:55:32, 13.99s/it]
  1%|          | 404/37963 [1:44:53<145:58:34, 13.99s/it]
  1%|          | 405/37963 [1:45:07<145:46:41, 13.97s/it]
  1%|          | 406/37963 [1:45:21<146:57:44, 14.09s/it]
  1%|          | 407/37963 [1:45:35<147:36:18, 14.15s/it]
  1%|          | 408/37963 [1:45:49<146:51:11, 14.08s/it]
  1%|          | 409/37963 [1:46:04<147:39:52, 14.16s/it]
  1%|          | 410/37963 [1:46:18<147:19:37, 14.12s/it]
                                                         
{'loss': '0.1839', 'grad_norm': '4.738', 'learning_rate': '7.182e-06', 'epoch': '0.0108'}

  1%|          | 410/37963 [1:46:18<147:19:37, 14.12s/it]
  1%|          | 411/37963 [1:46:32<148:11:29, 14.21s/it]
  1%|          | 412/37963 [1:46:46<148:32:13, 14.24s/it]
  1%|          | 413/37963 [1:47:01<148:48:42, 14.27s/it]
  1%|          | 414/37963 [1:47:15<149:21:24, 14.32s/it]
  1%|          | 415/37963 [1:47:30<149:40:34, 14.35s/it]
  1%|          | 416/37963 [1:47:44<149:07:50, 14.30s/it]
  1%|          | 417/37963 [1:47:58<147:48:21, 14.17s/it]
  1%|          | 418/37963 [1:48:12<147:29:26, 14.14s/it]
  1%|          | 419/37963 [1:48:26<148:27:29, 14.24s/it]
  1%|          | 420/37963 [1:48:40<148:18:02, 14.22s/it]
                                                         
{'loss': '0.1882', 'grad_norm': '4.67', 'learning_rate': '7.357e-06', 'epoch': '0.01106'}

  1%|          | 420/37963 [1:48:40<148:18:02, 14.22s/it]
  1%|          | 421/37963 [1:48:54<147:50:43, 14.18s/it]
  1%|          | 422/37963 [1:49:08<145:52:14, 13.99s/it]
  1%|          | 423/37963 [1:49:22<147:02:36, 14.10s/it]
  1%|          | 424/37963 [1:49:37<147:49:39, 14.18s/it]
  1%|          | 425/37963 [1:49:51<148:24:11, 14.23s/it]
  1%|          | 426/37963 [1:50:05<147:42:30, 14.17s/it]
  1%|          | 427/37963 [1:50:19<146:54:33, 14.09s/it]
  1%|          | 428/37963 [1:50:33<147:27:31, 14.14s/it]
  1%|          | 429/37963 [1:50:48<147:55:46, 14.19s/it]
  1%|          | 430/37963 [1:51:02<147:50:01, 14.18s/it]
                                                         
{'loss': '0.1757', 'grad_norm': '10.23', 'learning_rate': '7.533e-06', 'epoch': '0.01133'}

  1%|          | 430/37963 [1:51:02<147:50:01, 14.18s/it]
  1%|          | 431/37963 [1:51:29<189:54:04, 18.21s/it]
  1%|          | 432/37963 [1:51:44<178:08:28, 17.09s/it]
  1%|          | 433/37963 [1:52:05<190:52:09, 18.31s/it]
  1%|          | 434/37963 [1:52:26<198:08:10, 19.01s/it]
  1%|          | 435/37963 [1:52:54<227:55:04, 21.86s/it]
  1%|          | 436/37963 [1:53:08<202:26:52, 19.42s/it]
  1%|          | 437/37963 [1:53:35<225:35:46, 21.64s/it]
  1%|          | 438/37963 [1:53:49<202:34:58, 19.44s/it]
  1%|          | 439/37963 [1:54:03<186:39:47, 17.91s/it]
  1%|          | 440/37963 [1:54:18<175:35:11, 16.85s/it]
                                                         
{'loss': '0.185', 'grad_norm': '3.166', 'learning_rate': '7.709e-06', 'epoch': '0.01159'}

  1%|          | 440/37963 [1:54:18<175:35:11, 16.85s/it]
  1%|          | 441/37963 [1:54:32<167:45:45, 16.10s/it]
  1%|          | 442/37963 [1:54:46<162:14:49, 15.57s/it]
  1%|          | 443/37963 [1:55:01<158:54:46, 15.25s/it]
  1%|          | 444/37963 [1:55:15<156:08:15, 14.98s/it]
  1%|          | 445/37963 [1:55:29<153:34:15, 14.74s/it]
  1%|          | 446/37963 [1:55:43<151:10:31, 14.51s/it]
  1%|          | 447/37963 [1:55:57<148:40:09, 14.27s/it]
  1%|          | 448/37963 [1:56:11<148:39:42, 14.27s/it]
  1%|          | 449/37963 [1:56:26<148:52:12, 14.29s/it]
  1%|          | 450/37963 [1:56:40<149:18:03, 14.33s/it]
                                                         
{'loss': '0.1976', 'grad_norm': '6.172', 'learning_rate': '7.884e-06', 'epoch': '0.01185'}

  1%|          | 450/37963 [1:56:40<149:18:03, 14.33s/it]
  1%|          | 451/37963 [1:56:54<148:39:51, 14.27s/it]
  1%|          | 452/37963 [1:57:09<149:11:24, 14.32s/it]
  1%|          | 453/37963 [1:57:23<148:24:47, 14.24s/it]
  1%|          | 454/37963 [1:57:37<149:03:05, 14.31s/it]
  1%|          | 455/37963 [1:57:52<149:47:24, 14.38s/it]
  1%|          | 456/37963 [1:58:06<149:59:23, 14.40s/it]
  1%|          | 457/37963 [1:58:20<149:21:34, 14.34s/it]
  1%|          | 458/37963 [1:58:35<149:48:59, 14.38s/it]
  1%|          | 459/37963 [1:58:48<146:59:47, 14.11s/it]
  1%|          | 460/37963 [1:59:02<147:09:56, 14.13s/it]
                                                         
{'loss': '0.189', 'grad_norm': '9.791', 'learning_rate': '8.06e-06', 'epoch': '0.01212'}

  1%|          | 460/37963 [1:59:02<147:09:56, 14.13s/it]
  1%|          | 461/37963 [1:59:17<147:18:18, 14.14s/it]
  1%|          | 462/37963 [1:59:31<148:10:27, 14.22s/it]
  1%|          | 463/37963 [1:59:46<148:57:15, 14.30s/it]
  1%|          | 464/37963 [2:00:00<149:28:46, 14.35s/it]
  1%|          | 465/37963 [2:00:14<149:30:30, 14.35s/it]
  1%|          | 466/37963 [2:00:29<149:10:07, 14.32s/it]
  1%|          | 467/37963 [2:00:42<147:24:34, 14.15s/it]
  1%|          | 468/37963 [2:00:57<148:37:32, 14.27s/it]
  1%|          | 469/37963 [2:01:11<147:44:34, 14.19s/it]
  1%|          | 470/37963 [2:01:25<148:31:55, 14.26s/it]
                                                         
{'loss': '0.1827', 'grad_norm': '3.344', 'learning_rate': '8.235e-06', 'epoch': '0.01238'}

  1%|          | 470/37963 [2:01:25<148:31:55, 14.26s/it]
  1%|          | 471/37963 [2:01:40<148:53:14, 14.30s/it]
  1%|          | 472/37963 [2:01:54<147:18:53, 14.15s/it]
  1%|          | 473/37963 [2:02:08<147:53:36, 14.20s/it]
  1%|          | 474/37963 [2:02:22<148:31:37, 14.26s/it]
  1%|▏         | 475/37963 [2:02:37<148:56:22, 14.30s/it]
  1%|▏         | 476/37963 [2:02:51<148:31:59, 14.26s/it]
  1%|▏         | 477/37963 [2:03:05<148:50:43, 14.29s/it]
  1%|▏         | 478/37963 [2:03:25<167:27:41, 16.08s/it]
  1%|▏         | 479/37963 [2:03:40<162:08:32, 15.57s/it]
  1%|▏         | 480/37963 [2:03:54<158:37:22, 15.23s/it]
                                                         
{'loss': '0.1857', 'grad_norm': '4.695', 'learning_rate': '8.411e-06', 'epoch': '0.01264'}

  1%|▏         | 480/37963 [2:03:54<158:37:22, 15.23s/it]
  1%|▏         | 481/37963 [2:04:16<179:08:10, 17.21s/it]
  1%|▏         | 482/37963 [2:04:38<192:30:03, 18.49s/it]
  1%|▏         | 483/37963 [2:04:59<201:32:06, 19.36s/it]
  1%|▏         | 484/37963 [2:05:20<206:03:35, 19.79s/it]
  1%|▏         | 485/37963 [2:05:41<209:31:27, 20.13s/it]
  1%|▏         | 486/37963 [2:05:55<190:16:05, 18.28s/it]
  1%|▏         | 487/37963 [2:06:08<175:36:03, 16.87s/it]
  1%|▏         | 488/37963 [2:06:29<187:39:49, 18.03s/it]
  1%|▏         | 489/37963 [2:06:43<176:00:00, 16.91s/it]
  1%|▏         | 490/37963 [2:06:57<167:24:38, 16.08s/it]
                                                         
{'loss': '0.1915', 'grad_norm': '5.252', 'learning_rate': '8.586e-06', 'epoch': '0.01291'}

  1%|▏         | 490/37963 [2:06:57<167:24:38, 16.08s/it]
  1%|▏         | 491/37963 [2:07:11<160:03:44, 15.38s/it]
  1%|▏         | 492/37963 [2:07:25<155:56:11, 14.98s/it]
  1%|▏         | 493/37963 [2:07:39<152:46:47, 14.68s/it]
  1%|▏         | 494/37963 [2:07:54<151:54:23, 14.60s/it]
  1%|▏         | 495/37963 [2:08:08<150:54:41, 14.50s/it]
  1%|▏         | 496/37963 [2:08:22<149:05:32, 14.33s/it]
  1%|▏         | 497/37963 [2:08:36<148:31:17, 14.27s/it]
  1%|▏         | 498/37963 [2:08:50<148:44:33, 14.29s/it]
  1%|▏         | 499/37963 [2:09:05<149:21:26, 14.35s/it]
  1%|▏         | 500/37963 [2:09:19<149:20:00, 14.35s/it]
                                                         
{'loss': '0.2152', 'grad_norm': '5.606', 'learning_rate': '8.762e-06', 'epoch': '0.01317'}

  1%|▏         | 500/37963 [2:09:19<149:20:00, 14.35s/it]
  1%|▏         | 501/37963 [2:09:33<149:14:15, 14.34s/it]
  1%|▏         | 502/37963 [2:09:48<149:31:32, 14.37s/it]
  1%|▏         | 503/37963 [2:10:02<149:31:49, 14.37s/it]
  1%|▏         | 504/37963 [2:10:16<148:20:02, 14.26s/it]
  1%|▏         | 505/37963 [2:10:31<148:40:57, 14.29s/it]
  1%|▏         | 506/37963 [2:10:45<149:02:39, 14.32s/it]
  1%|▏         | 507/37963 [2:10:59<149:05:18, 14.33s/it]
  1%|▏         | 508/37963 [2:11:14<149:33:52, 14.38s/it]
  1%|▏         | 509/37963 [2:11:28<149:33:39, 14.38s/it]
  1%|▏         | 510/37963 [2:11:43<149:34:00, 14.38s/it]
                                                         
{'loss': '0.2067', 'grad_norm': '5.707', 'learning_rate': '8.938e-06', 'epoch': '0.01343'}

  1%|▏         | 510/37963 [2:11:43<149:34:00, 14.38s/it]
  1%|▏         | 511/37963 [2:11:57<149:47:40, 14.40s/it]
  1%|▏         | 512/37963 [2:12:11<149:41:05, 14.39s/it]
  1%|▏         | 513/37963 [2:12:26<149:00:19, 14.32s/it]
  1%|▏         | 514/37963 [2:12:40<149:25:21, 14.36s/it]
  1%|▏         | 515/37963 [2:12:54<149:27:37, 14.37s/it]
  1%|▏         | 516/37963 [2:13:09<149:29:23, 14.37s/it]
  1%|▏         | 517/37963 [2:13:23<149:17:00, 14.35s/it]
  1%|▏         | 518/37963 [2:13:38<149:37:59, 14.39s/it]
  1%|▏         | 519/37963 [2:13:52<149:43:29, 14.40s/it]
  1%|▏         | 520/37963 [2:14:06<149:36:24, 14.38s/it]
                                                         
{'loss': '0.1951', 'grad_norm': '4.102', 'learning_rate': '9.113e-06', 'epoch': '0.0137'}

  1%|▏         | 520/37963 [2:14:06<149:36:24, 14.38s/it]
  1%|▏         | 521/37963 [2:14:21<149:53:27, 14.41s/it]
  1%|▏         | 522/37963 [2:14:35<149:30:38, 14.38s/it]
  1%|▏         | 523/37963 [2:14:49<147:45:58, 14.21s/it]
  1%|▏         | 524/37963 [2:15:03<146:31:10, 14.09s/it]
  1%|▏         | 525/37963 [2:15:17<146:09:18, 14.05s/it]
  1%|▏         | 526/37963 [2:15:31<147:11:48, 14.15s/it]
  1%|▏         | 527/37963 [2:15:52<167:48:43, 16.14s/it]
  1%|▏         | 528/37963 [2:16:06<162:10:52, 15.60s/it]
  1%|▏         | 529/37963 [2:16:27<180:03:53, 17.32s/it]
  1%|▏         | 530/37963 [2:16:42<171:33:00, 16.50s/it]
                                                         
{'loss': '0.1857', 'grad_norm': '5.241', 'learning_rate': '9.289e-06', 'epoch': '0.01396'}

  1%|▏         | 530/37963 [2:16:42<171:33:00, 16.50s/it]
  1%|▏         | 531/37963 [2:17:10<207:36:30, 19.97s/it]
  1%|▏         | 532/37963 [2:17:37<230:01:16, 22.12s/it]
  1%|▏         | 533/37963 [2:17:58<225:31:40, 21.69s/it]
  1%|▏         | 534/37963 [2:18:12<203:07:12, 19.54s/it]
  1%|▏         | 535/37963 [2:18:27<187:33:59, 18.04s/it]
  1%|▏         | 536/37963 [2:18:48<195:54:23, 18.84s/it]
  1%|▏         | 537/37963 [2:19:02<181:43:46, 17.48s/it]
  1%|▏         | 538/37963 [2:19:16<171:43:48, 16.52s/it]
  1%|▏         | 539/37963 [2:19:30<162:27:02, 15.63s/it]
  1%|▏         | 540/37963 [2:19:44<158:27:22, 15.24s/it]
                                                         
{'loss': '0.1863', 'grad_norm': '5.712', 'learning_rate': '9.464e-06', 'epoch': '0.01422'}

  1%|▏         | 540/37963 [2:19:44<158:27:22, 15.24s/it]
  1%|▏         | 541/37963 [2:19:58<155:17:24, 14.94s/it]
  1%|▏         | 542/37963 [2:20:13<153:37:41, 14.78s/it]
  1%|▏         | 543/37963 [2:20:27<152:10:42, 14.64s/it]
  1%|▏         | 544/37963 [2:20:41<150:50:07, 14.51s/it]
  1%|▏         | 545/37963 [2:20:56<150:38:09, 14.49s/it]
  1%|▏         | 546/37963 [2:21:10<150:12:10, 14.45s/it]
  1%|▏         | 547/37963 [2:21:25<150:09:24, 14.45s/it]
  1%|▏         | 548/37963 [2:21:39<149:59:59, 14.43s/it]
  1%|▏         | 549/37963 [2:21:54<150:09:40, 14.45s/it]
  1%|▏         | 550/37963 [2:22:08<149:47:58, 14.41s/it]
                                                         
{'loss': '0.1812', 'grad_norm': '3.057', 'learning_rate': '9.64e-06', 'epoch': '0.01449'}

  1%|▏         | 550/37963 [2:22:08<149:47:58, 14.41s/it]
  1%|▏         | 551/37963 [2:22:22<149:34:53, 14.39s/it]
  1%|▏         | 552/37963 [2:22:37<149:46:43, 14.41s/it]
  1%|▏         | 553/37963 [2:22:51<149:49:42, 14.42s/it]
  1%|▏         | 554/37963 [2:23:05<149:25:49, 14.38s/it]
  1%|▏         | 555/37963 [2:23:20<149:00:52, 14.34s/it]
  1%|▏         | 556/37963 [2:23:34<149:17:40, 14.37s/it]
  1%|▏         | 557/37963 [2:23:48<148:35:37, 14.30s/it]
  1%|▏         | 558/37963 [2:24:03<148:51:07, 14.33s/it]
  1%|▏         | 559/37963 [2:24:17<148:52:27, 14.33s/it]
  1%|▏         | 560/37963 [2:24:31<148:58:56, 14.34s/it]
                                                         
{'loss': '0.1758', 'grad_norm': '3.591', 'learning_rate': '9.816e-06', 'epoch': '0.01475'}

  1%|▏         | 560/37963 [2:24:31<148:58:56, 14.34s/it]
  1%|▏         | 561/37963 [2:24:46<148:55:37, 14.33s/it]
  1%|▏         | 562/37963 [2:25:00<148:58:22, 14.34s/it]
  1%|▏         | 563/37963 [2:25:14<148:09:46, 14.26s/it]
  1%|▏         | 564/37963 [2:25:28<147:01:54, 14.15s/it]
  1%|▏         | 565/37963 [2:25:42<147:56:02, 14.24s/it]
  1%|▏         | 566/37963 [2:25:57<148:02:47, 14.25s/it]
  1%|▏         | 567/37963 [2:26:10<146:23:17, 14.09s/it]
  1%|▏         | 568/37963 [2:26:25<147:09:13, 14.17s/it]
  1%|▏         | 569/37963 [2:26:38<145:39:25, 14.02s/it]
  2%|▏         | 570/37963 [2:26:53<147:02:37, 14.16s/it]
                                                         
{'loss': '0.1911', 'grad_norm': '2.755', 'learning_rate': '9.991e-06', 'epoch': '0.01501'}

  2%|▏         | 570/37963 [2:26:53<147:02:37, 14.16s/it]
  2%|▏         | 571/37963 [2:27:07<147:38:30, 14.21s/it]
  2%|▏         | 572/37963 [2:27:22<148:08:08, 14.26s/it]
  2%|▏         | 573/37963 [2:27:36<148:24:09, 14.29s/it]
  2%|▏         | 574/37963 [2:27:50<147:27:06, 14.20s/it]
  2%|▏         | 575/37963 [2:28:04<146:48:23, 14.14s/it]
  2%|▏         | 576/37963 [2:28:25<167:17:38, 16.11s/it]
  2%|▏         | 577/37963 [2:28:39<161:51:25, 15.59s/it]
  2%|▏         | 578/37963 [2:29:00<178:18:02, 17.17s/it]
  2%|▏         | 579/37963 [2:29:14<169:21:45, 16.31s/it]
  2%|▏         | 580/37963 [2:29:42<205:26:47, 19.78s/it]
                                                         
{'loss': '0.1913', 'grad_norm': '4.693', 'learning_rate': '1.017e-05', 'epoch': '0.01528'}

  2%|▏         | 580/37963 [2:29:42<205:26:47, 19.78s/it]
  2%|▏         | 581/37963 [2:30:03<209:12:59, 20.15s/it]
  2%|▏         | 582/37963 [2:30:24<212:54:56, 20.50s/it]
  2%|▏         | 583/37963 [2:30:39<193:51:06, 18.67s/it]
  2%|▏         | 584/37963 [2:31:00<200:58:22, 19.36s/it]
  2%|▏         | 585/37963 [2:31:14<185:18:44, 17.85s/it]
  2%|▏         | 586/37963 [2:31:29<174:47:08, 16.83s/it]
  2%|▏         | 587/37963 [2:31:43<166:59:27, 16.08s/it]
  2%|▏         | 588/37963 [2:31:57<159:49:39, 15.39s/it]
  2%|▏         | 589/37963 [2:32:11<156:39:55, 15.09s/it]
  2%|▏         | 590/37963 [2:32:25<154:03:55, 14.84s/it]
                                                         
{'loss': '0.1821', 'grad_norm': '6.438', 'learning_rate': '1.034e-05', 'epoch': '0.01554'}

  2%|▏         | 590/37963 [2:32:25<154:03:55, 14.84s/it]
  2%|▏         | 591/37963 [2:32:40<152:32:45, 14.69s/it]
  2%|▏         | 592/37963 [2:32:54<151:20:12, 14.58s/it]
  2%|▏         | 593/37963 [2:33:08<151:01:39, 14.55s/it]
  2%|▏         | 594/37963 [2:33:23<150:00:17, 14.45s/it]
  2%|▏         | 595/37963 [2:33:37<150:05:10, 14.46s/it]
  2%|▏         | 596/37963 [2:33:51<148:48:34, 14.34s/it]
  2%|▏         | 597/37963 [2:34:06<149:03:49, 14.36s/it]
  2%|▏         | 598/37963 [2:34:20<149:12:40, 14.38s/it]
  2%|▏         | 599/37963 [2:34:34<149:12:25, 14.38s/it]
  2%|▏         | 600/37963 [2:34:48<148:21:42, 14.29s/it]
                                                         
{'loss': '0.1878', 'grad_norm': '7.599', 'learning_rate': '1.052e-05', 'epoch': '0.0158'}

  2%|▏         | 600/37963 [2:34:49<148:21:42, 14.29s/it]
  2%|▏         | 601/37963 [2:35:03<148:21:13, 14.29s/it]
  2%|▏         | 602/37963 [2:35:17<148:30:10, 14.31s/it]
  2%|▏         | 603/37963 [2:35:31<147:45:14, 14.24s/it]
  2%|▏         | 604/37963 [2:35:46<148:05:44, 14.27s/it]
  2%|▏         | 605/37963 [2:36:00<148:02:42, 14.27s/it]
  2%|▏         | 606/37963 [2:36:14<148:39:18, 14.33s/it]
  2%|▏         | 607/37963 [2:36:29<149:22:44, 14.40s/it]
  2%|▏         | 608/37963 [2:36:43<148:57:05, 14.35s/it]
  2%|▏         | 609/37963 [2:36:57<148:49:03, 14.34s/it]
  2%|▏         | 610/37963 [2:37:12<149:03:10, 14.37s/it]
                                                         
{'loss': '0.1909', 'grad_norm': '3.659', 'learning_rate': '1.069e-05', 'epoch': '0.01607'}

  2%|▏         | 610/37963 [2:37:12<149:03:10, 14.37s/it]
  2%|▏         | 611/37963 [2:37:26<147:01:20, 14.17s/it]
  2%|▏         | 612/37963 [2:37:40<147:44:48, 14.24s/it]
  2%|▏         | 613/37963 [2:37:54<146:33:09, 14.13s/it]
  2%|▏         | 614/37963 [2:38:08<147:11:38, 14.19s/it]
  2%|▏         | 615/37963 [2:38:22<147:42:52, 14.24s/it]
  2%|▏         | 616/37963 [2:38:36<146:19:23, 14.10s/it]
  2%|▏         | 617/37963 [2:38:51<147:12:26, 14.19s/it]
  2%|▏         | 618/37963 [2:39:05<148:00:04, 14.27s/it]
  2%|▏         | 619/37963 [2:39:19<147:46:41, 14.25s/it]
  2%|▏         | 620/37963 [2:39:33<147:30:18, 14.22s/it]
                                                         
{'loss': '0.1799', 'grad_norm': '4.501', 'learning_rate': '1.087e-05', 'epoch': '0.01633'}

  2%|▏         | 620/37963 [2:39:33<147:30:18, 14.22s/it]
  2%|▏         | 621/37963 [2:39:48<148:00:23, 14.27s/it]
  2%|▏         | 622/37963 [2:40:02<148:09:25, 14.28s/it]
  2%|▏         | 623/37963 [2:40:17<148:36:45, 14.33s/it]
  2%|▏         | 624/37963 [2:40:31<149:31:41, 14.42s/it]
  2%|▏         | 625/37963 [2:40:46<149:29:03, 14.41s/it]
  2%|▏         | 626/37963 [2:41:00<149:39:42, 14.43s/it]
  2%|▏         | 627/37963 [2:41:28<191:03:12, 18.42s/it]
  2%|▏         | 628/37963 [2:41:49<198:35:30, 19.15s/it]
  2%|▏         | 629/37963 [2:42:03<183:33:18, 17.70s/it]
  2%|▏         | 630/37963 [2:42:38<237:59:35, 22.95s/it]
                                                         
{'loss': '0.2052', 'grad_norm': '7.173', 'learning_rate': '1.104e-05', 'epoch': '0.0166'}

  2%|▏         | 630/37963 [2:42:38<237:59:35, 22.95s/it]
  2%|▏         | 631/37963 [2:42:52<210:15:39, 20.28s/it]
  2%|▏         | 632/37963 [2:43:13<212:12:56, 20.46s/it]
  2%|▏         | 633/37963 [2:43:27<192:00:41, 18.52s/it]
  2%|▏         | 634/37963 [2:43:42<179:11:29, 17.28s/it]
  2%|▏         | 635/37963 [2:43:56<170:08:56, 16.41s/it]
  2%|▏         | 636/37963 [2:44:10<163:46:52, 15.80s/it]
  2%|▏         | 637/37963 [2:44:25<159:29:10, 15.38s/it]
  2%|▏         | 638/37963 [2:44:39<155:44:54, 15.02s/it]
  2%|▏         | 639/37963 [2:44:53<153:45:07, 14.83s/it]
  2%|▏         | 640/37963 [2:45:08<152:09:10, 14.68s/it]
                                                         
{'loss': '0.1816', 'grad_norm': '6.791', 'learning_rate': '1.122e-05', 'epoch': '0.01686'}

  2%|▏         | 640/37963 [2:45:08<152:09:10, 14.68s/it]
  2%|▏         | 641/37963 [2:45:22<151:01:57, 14.57s/it]
  2%|▏         | 642/37963 [2:45:36<149:44:17, 14.44s/it]
  2%|▏         | 643/37963 [2:45:50<149:38:07, 14.43s/it]
  2%|▏         | 644/37963 [2:46:05<149:22:47, 14.41s/it]
  2%|▏         | 645/37963 [2:46:19<149:46:19, 14.45s/it]
  2%|▏         | 646/37963 [2:46:34<149:53:28, 14.46s/it]
  2%|▏         | 647/37963 [2:46:48<149:49:35, 14.45s/it]
  2%|▏         | 648/37963 [2:47:03<149:28:18, 14.42s/it]
  2%|▏         | 649/37963 [2:47:17<149:04:54, 14.38s/it]
  2%|▏         | 650/37963 [2:47:31<149:04:12, 14.38s/it]
                                                         
{'loss': '0.1804', 'grad_norm': '4.399', 'learning_rate': '1.14e-05', 'epoch': '0.01712'}

  2%|▏         | 650/37963 [2:47:31<149:04:12, 14.38s/it]
  2%|▏         | 651/37963 [2:47:46<149:20:02, 14.41s/it]
  2%|▏         | 652/37963 [2:48:00<149:19:26, 14.41s/it]
  2%|▏         | 653/37963 [2:48:14<147:24:53, 14.22s/it]
  2%|▏         | 654/37963 [2:48:28<147:21:45, 14.22s/it]
  2%|▏         | 655/37963 [2:48:43<148:11:15, 14.30s/it]
  2%|▏         | 656/37963 [2:48:57<147:57:59, 14.28s/it]
  2%|▏         | 657/37963 [2:49:11<148:11:07, 14.30s/it]
  2%|▏         | 658/37963 [2:49:26<148:56:49, 14.37s/it]
  2%|▏         | 659/37963 [2:49:40<149:02:48, 14.38s/it]
  2%|▏         | 660/37963 [2:49:55<150:18:58, 14.51s/it]
                                                         
{'loss': '0.2014', 'grad_norm': '3.314', 'learning_rate': '1.157e-05', 'epoch': '0.01739'}

  2%|▏         | 660/37963 [2:49:55<150:18:58, 14.51s/it]
  2%|▏         | 661/37963 [2:50:09<149:11:13, 14.40s/it]
  2%|▏         | 662/37963 [2:50:24<149:24:23, 14.42s/it]
  2%|▏         | 663/37963 [2:50:38<149:02:50, 14.39s/it]
  2%|▏         | 664/37963 [2:50:52<148:55:48, 14.37s/it]
  2%|▏         | 665/37963 [2:51:07<148:55:22, 14.37s/it]
  2%|▏         | 666/37963 [2:51:21<149:34:20, 14.44s/it]
  2%|▏         | 667/37963 [2:51:35<148:29:20, 14.33s/it]
  2%|▏         | 668/37963 [2:51:49<147:31:01, 14.24s/it]
  2%|▏         | 669/37963 [2:52:04<147:52:41, 14.27s/it]
  2%|▏         | 670/37963 [2:52:18<146:53:06, 14.18s/it]
                                                         
{'loss': '0.1947', 'grad_norm': '3.659', 'learning_rate': '1.175e-05', 'epoch': '0.01765'}

  2%|▏         | 670/37963 [2:52:18<146:53:06, 14.18s/it]
  2%|▏         | 671/37963 [2:52:32<147:03:51, 14.20s/it]
  2%|▏         | 672/37963 [2:52:46<147:49:48, 14.27s/it]
  2%|▏         | 673/37963 [2:53:01<148:29:29, 14.34s/it]
  2%|▏         | 674/37963 [2:53:15<148:42:51, 14.36s/it]
  2%|▏         | 675/37963 [2:53:30<149:03:53, 14.39s/it]
  2%|▏         | 676/37963 [2:54:04<209:42:34, 20.25s/it]
  2%|▏         | 677/37963 [2:54:24<209:02:38, 20.18s/it]
  2%|▏         | 678/37963 [2:54:51<232:16:16, 22.43s/it]
  2%|▏         | 679/37963 [2:55:12<227:25:19, 21.96s/it]
  2%|▏         | 680/37963 [2:55:33<223:47:21, 21.61s/it]
                                                         
{'loss': '0.1809', 'grad_norm': '3.533', 'learning_rate': '1.192e-05', 'epoch': '0.01791'}

  2%|▏         | 680/37963 [2:55:33<223:47:21, 21.61s/it]
  2%|▏         | 681/37963 [2:55:47<199:49:05, 19.29s/it]
  2%|▏         | 682/37963 [2:56:01<184:40:19, 17.83s/it]
  2%|▏         | 683/37963 [2:56:15<173:11:52, 16.73s/it]
  2%|▏         | 684/37963 [2:56:30<165:46:47, 16.01s/it]
  2%|▏         | 685/37963 [2:56:44<160:28:41, 15.50s/it]
  2%|▏         | 686/37963 [2:56:58<156:53:35, 15.15s/it]
  2%|▏         | 687/37963 [2:57:12<153:07:15, 14.79s/it]
  2%|▏         | 688/37963 [2:57:27<151:46:49, 14.66s/it]
  2%|▏         | 689/37963 [2:57:41<149:50:27, 14.47s/it]
  2%|▏         | 690/37963 [2:57:55<149:52:49, 14.48s/it]
                                                         
{'loss': '0.1993', 'grad_norm': '6.121', 'learning_rate': '1.21e-05', 'epoch': '0.01818'}

  2%|▏         | 690/37963 [2:57:55<149:52:49, 14.48s/it]
  2%|▏         | 691/37963 [2:58:10<149:48:59, 14.47s/it]
  2%|▏         | 692/37963 [2:58:24<149:22:39, 14.43s/it]
  2%|▏         | 693/37963 [2:58:38<148:50:30, 14.38s/it]
  2%|▏         | 694/37963 [2:58:53<148:48:35, 14.37s/it]
  2%|▏         | 695/37963 [2:59:07<148:45:09, 14.37s/it]
  2%|▏         | 696/37963 [2:59:21<148:46:38, 14.37s/it]
  2%|▏         | 697/37963 [2:59:35<147:09:38, 14.22s/it]
  2%|▏         | 698/37963 [2:59:49<146:37:52, 14.17s/it]
  2%|▏         | 699/37963 [3:00:04<147:14:34, 14.22s/it]
  2%|▏         | 700/37963 [3:00:18<147:31:01, 14.25s/it]
                                                         
{'loss': '0.1933', 'grad_norm': '3.188', 'learning_rate': '1.227e-05', 'epoch': '0.01844'}

  2%|▏         | 700/37963 [3:00:18<147:31:01, 14.25s/it]
  2%|▏         | 701/37963 [3:00:32<147:43:00, 14.27s/it]
  2%|▏         | 702/37963 [3:00:47<148:15:47, 14.32s/it]
  2%|▏         | 703/37963 [3:01:01<148:18:17, 14.33s/it]
  2%|▏         | 704/37963 [3:01:15<148:31:00, 14.35s/it]
  2%|▏         | 705/37963 [3:01:30<147:52:34, 14.29s/it]
  2%|▏         | 706/37963 [3:01:44<147:12:17, 14.22s/it]
  2%|▏         | 707/37963 [3:01:58<147:19:54, 14.24s/it]
  2%|▏         | 708/37963 [3:02:12<148:06:32, 14.31s/it]
  2%|▏         | 709/37963 [3:02:27<148:16:02, 14.33s/it]
  2%|▏         | 710/37963 [3:02:41<148:19:23, 14.33s/it]
                                                         
{'loss': '0.1806', 'grad_norm': '5.833', 'learning_rate': '1.245e-05', 'epoch': '0.0187'}

  2%|▏         | 710/37963 [3:02:41<148:19:23, 14.33s/it]
  2%|▏         | 711/37963 [3:02:56<149:09:39, 14.41s/it]
  2%|▏         | 712/37963 [3:03:09<146:07:35, 14.12s/it]
  2%|▏         | 713/37963 [3:03:24<146:56:31, 14.20s/it]
  2%|▏         | 714/37963 [3:03:38<147:11:22, 14.23s/it]
  2%|▏         | 715/37963 [3:03:52<147:36:29, 14.27s/it]
  2%|▏         | 716/37963 [3:04:07<148:08:05, 14.32s/it]
  2%|▏         | 717/37963 [3:04:21<148:11:14, 14.32s/it]
  2%|▏         | 718/37963 [3:04:35<148:22:47, 14.34s/it]
  2%|▏         | 719/37963 [3:04:50<148:34:00, 14.36s/it]
  2%|▏         | 720/37963 [3:05:04<149:11:52, 14.42s/it]
                                                         
{'loss': '0.1842', 'grad_norm': '4.546', 'learning_rate': '1.263e-05', 'epoch': '0.01897'}

  2%|▏         | 720/37963 [3:05:04<149:11:52, 14.42s/it]
  2%|▏         | 721/37963 [3:05:19<148:50:03, 14.39s/it]
  2%|▏         | 722/37963 [3:05:33<148:34:33, 14.36s/it]
  2%|▏         | 723/37963 [3:05:47<148:46:20, 14.38s/it]
  2%|▏         | 724/37963 [3:06:08<168:32:26, 16.29s/it]
  2%|▏         | 725/37963 [3:06:29<181:44:15, 17.57s/it]
  2%|▏         | 726/37963 [3:07:03<234:51:52, 22.71s/it]
  2%|▏         | 727/37963 [3:07:31<250:32:51, 24.22s/it]
  2%|▏         | 728/37963 [3:07:45<219:23:21, 21.21s/it]
  2%|▏         | 729/37963 [3:08:06<218:58:14, 21.17s/it]
  2%|▏         | 730/37963 [3:08:21<197:54:41, 19.14s/it]
                                                         
{'loss': '0.1843', 'grad_norm': '2.471', 'learning_rate': '1.28e-05', 'epoch': '0.01923'}

  2%|▏         | 730/37963 [3:08:21<197:54:41, 19.14s/it]
  2%|▏         | 731/37963 [3:08:35<183:01:40, 17.70s/it]
  2%|▏         | 732/37963 [3:08:50<172:57:07, 16.72s/it]
  2%|▏         | 733/37963 [3:09:04<166:07:22, 16.06s/it]
  2%|▏         | 734/37963 [3:09:19<161:10:40, 15.59s/it]
  2%|▏         | 735/37963 [3:09:33<157:35:26, 15.24s/it]
  2%|▏         | 736/37963 [3:09:47<154:41:56, 14.96s/it]
  2%|▏         | 737/37963 [3:10:02<153:03:29, 14.80s/it]
  2%|▏         | 738/37963 [3:10:16<152:43:43, 14.77s/it]
  2%|▏         | 739/37963 [3:10:31<151:46:58, 14.68s/it]
  2%|▏         | 740/37963 [3:10:45<151:04:45, 14.61s/it]
                                                         
{'loss': '0.191', 'grad_norm': '6.141', 'learning_rate': '1.298e-05', 'epoch': '0.01949'}

  2%|▏         | 740/37963 [3:10:45<151:04:45, 14.61s/it]
  2%|▏         | 741/37963 [3:11:00<150:22:21, 14.54s/it]
  2%|▏         | 742/37963 [3:11:14<150:21:07, 14.54s/it]
  2%|▏         | 743/37963 [3:11:29<149:43:24, 14.48s/it]
  2%|▏         | 744/37963 [3:11:43<149:16:36, 14.44s/it]
  2%|▏         | 745/37963 [3:11:57<148:56:42, 14.41s/it]
  2%|▏         | 746/37963 [3:12:12<149:16:22, 14.44s/it]
  2%|▏         | 747/37963 [3:12:26<148:57:30, 14.41s/it]
  2%|▏         | 748/37963 [3:12:40<148:43:19, 14.39s/it]
  2%|▏         | 749/37963 [3:12:54<147:41:01, 14.29s/it]
  2%|▏         | 750/37963 [3:13:09<146:57:19, 14.22s/it]
                                                         
{'loss': '0.206', 'grad_norm': '3.566', 'learning_rate': '1.315e-05', 'epoch': '0.01976'}

  2%|▏         | 750/37963 [3:13:09<146:57:19, 14.22s/it]
  2%|▏         | 751/37963 [3:13:23<147:19:02, 14.25s/it]
  2%|▏         | 752/37963 [3:13:37<147:30:43, 14.27s/it]
  2%|▏         | 753/37963 [3:13:52<148:00:46, 14.32s/it]
  2%|▏         | 754/37963 [3:14:06<148:03:33, 14.32s/it]
  2%|▏         | 755/37963 [3:14:20<148:22:25, 14.36s/it]
  2%|▏         | 756/37963 [3:14:35<148:19:08, 14.35s/it]
  2%|▏         | 757/37963 [3:14:49<148:36:58, 14.38s/it]
  2%|▏         | 758/37963 [3:15:03<148:24:14, 14.36s/it]
  2%|▏         | 759/37963 [3:15:18<148:19:05, 14.35s/it]
  2%|▏         | 760/37963 [3:15:32<148:16:26, 14.35s/it]
                                                         
{'loss': '0.1901', 'grad_norm': '4.855', 'learning_rate': '1.333e-05', 'epoch': '0.02002'}

  2%|▏         | 760/37963 [3:15:32<148:16:26, 14.35s/it]
  2%|▏         | 761/37963 [3:15:46<148:09:56, 14.34s/it]
  2%|▏         | 762/37963 [3:16:00<146:51:49, 14.21s/it]
  2%|▏         | 763/37963 [3:16:15<147:24:54, 14.27s/it]
  2%|▏         | 764/37963 [3:16:29<147:47:32, 14.30s/it]
  2%|▏         | 765/37963 [3:16:44<148:13:58, 14.35s/it]
  2%|▏         | 766/37963 [3:16:58<148:56:40, 14.42s/it]
  2%|▏         | 767/37963 [3:17:13<148:35:51, 14.38s/it]
  2%|▏         | 768/37963 [3:17:27<148:37:05, 14.38s/it]
  2%|▏         | 769/37963 [3:17:41<148:06:47, 14.34s/it]
  2%|▏         | 770/37963 [3:17:55<148:09:38, 14.34s/it]
                                                         
{'loss': '0.2059', 'grad_norm': '6.576', 'learning_rate': '1.35e-05', 'epoch': '0.02028'}

  2%|▏         | 770/37963 [3:17:55<148:09:38, 14.34s/it]
  2%|▏         | 771/37963 [3:18:10<148:15:02, 14.35s/it]
  2%|▏         | 772/37963 [3:18:24<148:15:20, 14.35s/it]
  2%|▏         | 773/37963 [3:18:45<167:53:11, 16.25s/it]
  2%|▏         | 774/37963 [3:19:12<200:04:02, 19.37s/it]
  2%|▏         | 775/37963 [3:19:46<246:08:05, 23.83s/it]
  2%|▏         | 776/37963 [3:20:07<238:04:01, 23.05s/it]
  2%|▏         | 777/37963 [3:20:21<210:02:20, 20.33s/it]
  2%|▏         | 778/37963 [3:20:35<191:25:21, 18.53s/it]
  2%|▏         | 779/37963 [3:20:56<198:11:00, 19.19s/it]
  2%|▏         | 780/37963 [3:21:10<183:14:36, 17.74s/it]
                                                         
{'loss': '0.1906', 'grad_norm': '2.102', 'learning_rate': '1.368e-05', 'epoch': '0.02055'}

  2%|▏         | 780/37963 [3:21:10<183:14:36, 17.74s/it]
  2%|▏         | 781/37963 [3:21:25<172:48:19, 16.73s/it]
  2%|▏         | 782/37963 [3:21:39<164:57:09, 15.97s/it]
  2%|▏         | 783/37963 [3:21:53<160:03:49, 15.50s/it]
  2%|▏         | 784/37963 [3:22:08<156:31:59, 15.16s/it]
  2%|▏         | 785/37963 [3:22:22<154:18:56, 14.94s/it]
  2%|▏         | 786/37963 [3:22:36<152:24:29, 14.76s/it]
  2%|▏         | 787/37963 [3:22:51<151:21:34, 14.66s/it]
  2%|▏         | 788/37963 [3:23:05<149:07:24, 14.44s/it]
  2%|▏         | 789/37963 [3:23:19<148:35:32, 14.39s/it]
  2%|▏         | 790/37963 [3:23:33<148:28:53, 14.38s/it]
                                                         
{'loss': '0.1821', 'grad_norm': '5.184', 'learning_rate': '1.385e-05', 'epoch': '0.02081'}

  2%|▏         | 790/37963 [3:23:33<148:28:53, 14.38s/it]
  2%|▏         | 791/37963 [3:23:47<147:20:54, 14.27s/it]
  2%|▏         | 792/37963 [3:24:02<147:32:59, 14.29s/it]
  2%|▏         | 793/37963 [3:24:16<147:49:55, 14.32s/it]
  2%|▏         | 794/37963 [3:24:31<148:04:38, 14.34s/it]
  2%|▏         | 795/37963 [3:24:45<147:17:57, 14.27s/it]
  2%|▏         | 796/37963 [3:24:59<148:02:00, 14.34s/it]
  2%|▏         | 797/37963 [3:25:13<146:09:22, 14.16s/it]
  2%|▏         | 798/37963 [3:25:27<146:50:42, 14.22s/it]
  2%|▏         | 799/37963 [3:25:42<147:13:32, 14.26s/it]
  2%|▏         | 800/37963 [3:25:56<147:22:01, 14.28s/it]
                                                         
{'loss': '0.2066', 'grad_norm': '11.51', 'learning_rate': '1.403e-05', 'epoch': '0.02107'}

  2%|▏         | 800/37963 [3:25:56<147:22:01, 14.28s/it]
  2%|▏         | 801/37963 [3:26:10<147:37:55, 14.30s/it]
  2%|▏         | 802/37963 [3:26:25<147:48:35, 14.32s/it]
  2%|▏         | 803/37963 [3:26:39<147:52:48, 14.33s/it]
  2%|▏         | 804/37963 [3:26:53<148:09:46, 14.35s/it]
  2%|▏         | 805/37963 [3:27:08<147:28:41, 14.29s/it]
  2%|▏         | 806/37963 [3:27:22<147:21:33, 14.28s/it]
  2%|▏         | 807/37963 [3:27:36<147:33:08, 14.30s/it]
  2%|▏         | 808/37963 [3:27:51<147:56:19, 14.33s/it]
  2%|▏         | 809/37963 [3:28:05<148:08:55, 14.35s/it]
  2%|▏         | 810/37963 [3:28:19<148:07:16, 14.35s/it]
                                                         
{'loss': '0.1897', 'grad_norm': '4.387', 'learning_rate': '1.421e-05', 'epoch': '0.02134'}

  2%|▏         | 810/37963 [3:28:19<148:07:16, 14.35s/it]
  2%|▏         | 811/37963 [3:28:34<148:11:15, 14.36s/it]
  2%|▏         | 812/37963 [3:28:48<148:12:34, 14.36s/it]
  2%|▏         | 813/37963 [3:29:03<148:24:01, 14.38s/it]
  2%|▏         | 814/37963 [3:29:16<146:28:59, 14.20s/it]
  2%|▏         | 815/37963 [3:29:31<146:59:58, 14.25s/it]
  2%|▏         | 816/37963 [3:29:45<147:15:24, 14.27s/it]
  2%|▏         | 817/37963 [3:29:59<145:42:12, 14.12s/it]
  2%|▏         | 818/37963 [3:30:12<143:46:11, 13.93s/it]
  2%|▏         | 819/37963 [3:30:27<145:13:01, 14.07s/it]
  2%|▏         | 820/37963 [3:30:41<145:51:25, 14.14s/it]
                                                         
{'loss': '0.181', 'grad_norm': '3.376', 'learning_rate': '1.438e-05', 'epoch': '0.0216'}

  2%|▏         | 820/37963 [3:30:41<145:51:25, 14.14s/it]
  2%|▏         | 821/37963 [3:31:09<188:08:48, 18.24s/it]
  2%|▏         | 822/37963 [3:31:23<175:59:11, 17.06s/it]
  2%|▏         | 823/37963 [3:31:44<187:20:56, 18.16s/it]
  2%|▏         | 824/37963 [3:32:25<258:14:12, 25.03s/it]
  2%|▏         | 825/37963 [3:32:39<224:08:05, 21.73s/it]
  2%|▏         | 826/37963 [3:32:53<201:32:17, 19.54s/it]
  2%|▏         | 827/37963 [3:33:08<185:26:36, 17.98s/it]
  2%|▏         | 828/37963 [3:33:21<171:13:54, 16.60s/it]
  2%|▏         | 829/37963 [3:33:42<184:13:23, 17.86s/it]
  2%|▏         | 830/37963 [3:33:56<173:24:41, 16.81s/it]
                                                         
{'loss': '0.184', 'grad_norm': '1.443', 'learning_rate': '1.456e-05', 'epoch': '0.02186'}

  2%|▏         | 830/37963 [3:33:56<173:24:41, 16.81s/it]
  2%|▏         | 831/37963 [3:34:10<165:15:05, 16.02s/it]
  2%|▏         | 832/37963 [3:34:25<160:07:48, 15.53s/it]
  2%|▏         | 833/37963 [3:34:39<156:48:07, 15.20s/it]
  2%|▏         | 834/37963 [3:34:54<154:23:19, 14.97s/it]
  2%|▏         | 835/37963 [3:35:08<152:27:01, 14.78s/it]
  2%|▏         | 836/37963 [3:35:22<150:02:29, 14.55s/it]
  2%|▏         | 837/37963 [3:35:36<149:59:20, 14.54s/it]
  2%|▏         | 838/37963 [3:35:51<149:06:58, 14.46s/it]
  2%|▏         | 839/37963 [3:36:05<148:46:41, 14.43s/it]
  2%|▏         | 840/37963 [3:36:19<148:21:48, 14.39s/it]
                                                         
{'loss': '0.1857', 'grad_norm': '3.725', 'learning_rate': '1.473e-05', 'epoch': '0.02213'}

  2%|▏         | 840/37963 [3:36:19<148:21:48, 14.39s/it]
  2%|▏         | 841/37963 [3:36:34<148:16:06, 14.38s/it]
  2%|▏         | 842/37963 [3:36:48<148:13:05, 14.37s/it]
  2%|▏         | 843/37963 [3:37:02<148:02:53, 14.36s/it]
  2%|▏         | 844/37963 [3:37:17<148:19:06, 14.38s/it]
  2%|▏         | 845/37963 [3:37:31<147:47:37, 14.33s/it]
  2%|▏         | 846/37963 [3:37:45<147:49:59, 14.34s/it]
  2%|▏         | 847/37963 [3:37:59<146:11:12, 14.18s/it]
  2%|▏         | 848/37963 [3:38:13<146:00:54, 14.16s/it]
  2%|▏         | 849/37963 [3:38:27<144:36:58, 14.03s/it]
  2%|▏         | 850/37963 [3:38:42<145:54:08, 14.15s/it]
                                                         
{'loss': '0.1893', 'grad_norm': '6.218', 'learning_rate': '1.491e-05', 'epoch': '0.02239'}

  2%|▏         | 850/37963 [3:38:42<145:54:08, 14.15s/it]
  2%|▏         | 851/37963 [3:38:56<146:51:19, 14.25s/it]
  2%|▏         | 852/37963 [3:39:10<147:16:31, 14.29s/it]
  2%|▏         | 853/37963 [3:39:24<145:54:10, 14.15s/it]
  2%|▏         | 854/37963 [3:39:39<146:56:07, 14.25s/it]
  2%|▏         | 855/37963 [3:39:53<146:52:22, 14.25s/it]
  2%|▏         | 856/37963 [3:40:08<148:06:11, 14.37s/it]
  2%|▏         | 857/37963 [3:40:22<148:04:59, 14.37s/it]
  2%|▏         | 858/37963 [3:40:36<148:07:11, 14.37s/it]
  2%|▏         | 859/37963 [3:40:51<148:17:06, 14.39s/it]
  2%|▏         | 860/37963 [3:41:05<148:08:09, 14.37s/it]
                                                         
{'loss': '0.1805', 'grad_norm': '3.773', 'learning_rate': '1.508e-05', 'epoch': '0.02265'}

  2%|▏         | 860/37963 [3:41:05<148:08:09, 14.37s/it]
  2%|▏         | 861/37963 [3:41:19<147:51:40, 14.35s/it]
  2%|▏         | 862/37963 [3:41:34<147:54:31, 14.35s/it]
  2%|▏         | 863/37963 [3:41:48<147:17:02, 14.29s/it]
  2%|▏         | 864/37963 [3:42:02<147:38:57, 14.33s/it]
  2%|▏         | 865/37963 [3:42:17<147:46:39, 14.34s/it]
  2%|▏         | 866/37963 [3:42:31<147:48:31, 14.34s/it]
  2%|▏         | 867/37963 [3:42:45<147:55:46, 14.36s/it]
  2%|▏         | 868/37963 [3:43:00<148:21:47, 14.40s/it]
  2%|▏         | 869/37963 [3:43:20<166:44:52, 16.18s/it]
  2%|▏         | 870/37963 [3:43:35<161:08:21, 15.64s/it]
                                                         
{'loss': '0.1949', 'grad_norm': '6.729', 'learning_rate': '1.526e-05', 'epoch': '0.02292'}

  2%|▏         | 870/37963 [3:43:35<161:08:21, 15.64s/it]
  2%|▏         | 871/37963 [3:43:55<176:43:56, 17.15s/it]
  2%|▏         | 872/37963 [3:44:17<190:45:21, 18.51s/it]
  2%|▏         | 873/37963 [3:44:58<260:05:45, 25.25s/it]
  2%|▏         | 874/37963 [3:45:12<226:41:33, 22.00s/it]
  2%|▏         | 875/37963 [3:45:27<203:33:38, 19.76s/it]
  2%|▏         | 876/37963 [3:45:41<186:32:16, 18.11s/it]
  2%|▏         | 877/37963 [3:45:55<173:15:57, 16.82s/it]
  2%|▏         | 878/37963 [3:46:16<185:22:29, 18.00s/it]
  2%|▏         | 879/37963 [3:46:30<173:41:16, 16.86s/it]
  2%|▏         | 880/37963 [3:46:44<165:51:52, 16.10s/it]
                                                         
{'loss': '0.2049', 'grad_norm': '3.206', 'learning_rate': '1.543e-05', 'epoch': '0.02318'}

  2%|▏         | 880/37963 [3:46:44<165:51:52, 16.10s/it]
  2%|▏         | 881/37963 [3:46:59<160:18:10, 15.56s/it]
  2%|▏         | 882/37963 [3:47:13<156:50:39, 15.23s/it]
  2%|▏         | 883/37963 [3:47:28<154:30:36, 15.00s/it]
  2%|▏         | 884/37963 [3:47:42<152:25:43, 14.80s/it]
  2%|▏         | 885/37963 [3:47:56<151:11:52, 14.68s/it]
  2%|▏         | 886/37963 [3:48:11<150:18:57, 14.59s/it]
  2%|▏         | 887/37963 [3:48:25<149:54:34, 14.56s/it]
  2%|▏         | 888/37963 [3:48:40<149:26:56, 14.51s/it]
  2%|▏         | 889/37963 [3:48:53<147:12:56, 14.30s/it]
  2%|▏         | 890/37963 [3:49:07<146:47:37, 14.25s/it]
                                                         
{'loss': '0.1824', 'grad_norm': '4.23', 'learning_rate': '1.561e-05', 'epoch': '0.02344'}

  2%|▏         | 890/37963 [3:49:07<146:47:37, 14.25s/it]
  2%|▏         | 891/37963 [3:49:22<146:54:11, 14.27s/it]
  2%|▏         | 892/37963 [3:49:35<145:13:10, 14.10s/it]
  2%|▏         | 893/37963 [3:49:50<146:12:17, 14.20s/it]
  2%|▏         | 894/37963 [3:50:04<146:35:42, 14.24s/it]
  2%|▏         | 895/37963 [3:50:19<146:58:18, 14.27s/it]
  2%|▏         | 896/37963 [3:50:33<146:31:17, 14.23s/it]
  2%|▏         | 897/37963 [3:50:47<145:20:21, 14.12s/it]
  2%|▏         | 898/37963 [3:51:01<146:01:14, 14.18s/it]
  2%|▏         | 899/37963 [3:51:15<145:50:30, 14.17s/it]
  2%|▏         | 900/37963 [3:51:29<146:38:04, 14.24s/it]
                                                         
{'loss': '0.1771', 'grad_norm': '4.21', 'learning_rate': '1.579e-05', 'epoch': '0.02371'}

  2%|▏         | 900/37963 [3:51:29<146:38:04, 14.24s/it]
  2%|▏         | 901/37963 [3:51:43<145:11:47, 14.10s/it]
  2%|▏         | 902/37963 [3:51:58<145:51:22, 14.17s/it]
  2%|▏         | 903/37963 [3:52:12<145:38:05, 14.15s/it]
  2%|▏         | 904/37963 [3:52:26<145:02:05, 14.09s/it]
  2%|▏         | 905/37963 [3:52:39<143:52:04, 13.98s/it]
  2%|▏         | 906/37963 [3:52:54<145:06:32, 14.10s/it]
  2%|▏         | 907/37963 [3:53:07<144:00:59, 13.99s/it]
  2%|▏         | 908/37963 [3:53:22<145:13:12, 14.11s/it]
  2%|▏         | 909/37963 [3:53:35<143:26:44, 13.94s/it]
  2%|▏         | 910/37963 [3:53:50<144:25:14, 14.03s/it]
                                                         
{'loss': '0.194', 'grad_norm': '2.785', 'learning_rate': '1.596e-05', 'epoch': '0.02397'}

  2%|▏         | 910/37963 [3:53:50<144:25:14, 14.03s/it]
  2%|▏         | 911/37963 [3:54:04<144:26:37, 14.03s/it]
  2%|▏         | 912/37963 [3:54:18<144:09:19, 14.01s/it]
  2%|▏         | 913/37963 [3:54:32<145:00:15, 14.09s/it]
  2%|▏         | 914/37963 [3:54:46<146:06:43, 14.20s/it]
  2%|▏         | 915/37963 [3:55:00<145:49:32, 14.17s/it]
  2%|▏         | 916/37963 [3:55:15<146:23:32, 14.23s/it]
  2%|▏         | 917/37963 [3:55:29<147:00:08, 14.29s/it]
  2%|▏         | 918/37963 [3:55:44<147:21:12, 14.32s/it]
  2%|▏         | 919/37963 [3:56:04<167:26:57, 16.27s/it]
  2%|▏         | 920/37963 [3:56:26<182:20:42, 17.72s/it]
                                                         
{'loss': '0.1951', 'grad_norm': '8.394', 'learning_rate': '1.614e-05', 'epoch': '0.02423'}

  2%|▏         | 920/37963 [3:56:26<182:20:42, 17.72s/it]
  2%|▏         | 921/37963 [3:56:53<212:18:25, 20.63s/it]
  2%|▏         | 922/37963 [3:57:21<234:16:12, 22.77s/it]
  2%|▏         | 923/37963 [3:57:41<226:14:58, 21.99s/it]
  2%|▏         | 924/37963 [3:58:01<220:15:22, 21.41s/it]
  2%|▏         | 925/37963 [3:58:15<198:27:27, 19.29s/it]
  2%|▏         | 926/37963 [3:58:29<182:03:17, 17.70s/it]
  2%|▏         | 927/37963 [3:58:44<171:57:26, 16.71s/it]
  2%|▏         | 928/37963 [3:58:58<163:14:17, 15.87s/it]
  2%|▏         | 929/37963 [3:59:12<158:08:11, 15.37s/it]
  2%|▏         | 930/37963 [3:59:26<154:31:39, 15.02s/it]
                                                         
{'loss': '0.1933', 'grad_norm': '2.914', 'learning_rate': '1.631e-05', 'epoch': '0.0245'}

  2%|▏         | 930/37963 [3:59:26<154:31:39, 15.02s/it]
  2%|▏         | 931/37963 [3:59:40<151:27:06, 14.72s/it]
  2%|▏         | 932/37963 [3:59:54<150:35:30, 14.64s/it]
  2%|▏         | 933/37963 [4:00:09<149:19:41, 14.52s/it]
  2%|▏         | 934/37963 [4:00:23<148:41:03, 14.46s/it]
  2%|▏         | 935/37963 [4:00:37<148:16:47, 14.42s/it]
  2%|▏         | 936/37963 [4:00:52<148:34:01, 14.44s/it]
  2%|▏         | 937/37963 [4:01:06<148:11:21, 14.41s/it]
  2%|▏         | 938/37963 [4:01:20<147:57:43, 14.39s/it]
  2%|▏         | 939/37963 [4:01:35<148:02:45, 14.40s/it]
  2%|▏         | 940/37963 [4:01:49<147:23:25, 14.33s/it]
                                                         
{'loss': '0.1828', 'grad_norm': '2.314', 'learning_rate': '1.649e-05', 'epoch': '0.02476'}

  2%|▏         | 940/37963 [4:01:49<147:23:25, 14.33s/it]
  2%|▏         | 941/37963 [4:02:04<148:08:02, 14.40s/it]
  2%|▏         | 942/37963 [4:02:18<147:56:55, 14.39s/it]
  2%|▏         | 943/37963 [4:02:32<148:06:53, 14.40s/it]
  2%|▏         | 944/37963 [4:02:47<147:26:53, 14.34s/it]
  2%|▏         | 945/37963 [4:03:01<147:38:43, 14.36s/it]
  2%|▏         | 946/37963 [4:03:15<147:40:49, 14.36s/it]
  2%|▏         | 947/37963 [4:03:29<146:00:26, 14.20s/it]
  2%|▏         | 948/37963 [4:03:44<146:55:16, 14.29s/it]
  2%|▏         | 949/37963 [4:03:58<147:30:36, 14.35s/it]
  3%|▎         | 950/37963 [4:04:12<146:28:41, 14.25s/it]
                                                         
{'loss': '0.1792', 'grad_norm': '3.003', 'learning_rate': '1.666e-05', 'epoch': '0.02502'}

  3%|▎         | 950/37963 [4:04:12<146:28:41, 14.25s/it]
  3%|▎         | 951/37963 [4:04:26<146:14:38, 14.22s/it]
  3%|▎         | 952/37963 [4:04:41<146:32:54, 14.25s/it]
  3%|▎         | 953/37963 [4:04:55<146:08:31, 14.22s/it]
  3%|▎         | 954/37963 [4:05:09<147:08:16, 14.31s/it]
  3%|▎         | 955/37963 [4:05:23<145:49:17, 14.18s/it]
  3%|▎         | 956/37963 [4:05:38<146:19:09, 14.23s/it]
  3%|▎         | 957/37963 [4:05:52<146:44:46, 14.28s/it]
  3%|▎         | 958/37963 [4:06:06<146:57:47, 14.30s/it]
  3%|▎         | 959/37963 [4:06:21<147:01:40, 14.30s/it]
  3%|▎         | 960/37963 [4:06:35<147:23:05, 14.34s/it]
                                                         
{'loss': '0.1845', 'grad_norm': '3.788', 'learning_rate': '1.684e-05', 'epoch': '0.02529'}

  3%|▎         | 960/37963 [4:06:35<147:23:05, 14.34s/it]
  3%|▎         | 961/37963 [4:06:49<147:19:46, 14.33s/it]
  3%|▎         | 962/37963 [4:07:03<146:21:06, 14.24s/it]
  3%|▎         | 963/37963 [4:07:18<146:13:51, 14.23s/it]
  3%|▎         | 964/37963 [4:07:32<146:38:41, 14.27s/it]
  3%|▎         | 965/37963 [4:07:46<146:45:22, 14.28s/it]
  3%|▎         | 966/37963 [4:08:01<146:30:33, 14.26s/it]
  3%|▎         | 967/37963 [4:08:22<168:35:51, 16.41s/it]
  3%|▎         | 968/37963 [4:08:43<182:30:15, 17.76s/it]
  3%|▎         | 969/37963 [4:09:04<191:59:14, 18.68s/it]
  3%|▎         | 970/37963 [4:09:24<197:55:04, 19.26s/it]
                                                         
{'loss': '0.1749', 'grad_norm': '2.152', 'learning_rate': '1.701e-05', 'epoch': '0.02555'}

  3%|▎         | 970/37963 [4:09:24<197:55:04, 19.26s/it]
  3%|▎         | 971/37963 [4:09:45<201:38:27, 19.62s/it]
  3%|▎         | 972/37963 [4:10:13<227:42:49, 22.16s/it]
  3%|▎         | 973/37963 [4:10:34<223:33:54, 21.76s/it]
  3%|▎         | 974/37963 [4:10:48<200:43:49, 19.54s/it]
  3%|▎         | 975/37963 [4:11:02<185:05:51, 18.02s/it]
  3%|▎         | 976/37963 [4:11:17<173:04:45, 16.85s/it]
  3%|▎         | 977/37963 [4:11:31<165:30:27, 16.11s/it]
  3%|▎         | 978/37963 [4:11:45<160:14:12, 15.60s/it]
  3%|▎         | 979/37963 [4:12:00<156:33:48, 15.24s/it]
  3%|▎         | 980/37963 [4:12:14<154:02:23, 14.99s/it]
                                                         
{'loss': '0.2037', 'grad_norm': '7.408', 'learning_rate': '1.719e-05', 'epoch': '0.02581'}

  3%|▎         | 980/37963 [4:12:14<154:02:23, 14.99s/it]
  3%|▎         | 981/37963 [4:12:29<152:12:47, 14.82s/it]
  3%|▎         | 982/37963 [4:12:43<150:57:35, 14.70s/it]
  3%|▎         | 983/37963 [4:12:57<150:03:37, 14.61s/it]
  3%|▎         | 984/37963 [4:13:12<148:25:37, 14.45s/it]
  3%|▎         | 985/37963 [4:13:26<148:11:17, 14.43s/it]
  3%|▎         | 986/37963 [4:13:40<147:41:57, 14.38s/it]
  3%|▎         | 987/37963 [4:13:54<147:32:36, 14.36s/it]
  3%|▎         | 988/37963 [4:14:09<147:29:24, 14.36s/it]
  3%|▎         | 989/37963 [4:14:23<145:28:54, 14.16s/it]
  3%|▎         | 990/37963 [4:14:37<146:05:34, 14.22s/it]
                                                         
{'loss': '0.1789', 'grad_norm': '2.416', 'learning_rate': '1.737e-05', 'epoch': '0.02608'}

  3%|▎         | 990/37963 [4:14:37<146:05:34, 14.22s/it]
  3%|▎         | 991/37963 [4:14:51<146:15:17, 14.24s/it]
  3%|▎         | 992/37963 [4:15:06<146:49:46, 14.30s/it]
  3%|▎         | 993/37963 [4:15:20<147:28:09, 14.36s/it]
  3%|▎         | 994/37963 [4:15:35<147:40:13, 14.38s/it]
  3%|▎         | 995/37963 [4:15:49<147:36:36, 14.37s/it]
  3%|▎         | 996/37963 [4:16:03<147:54:33, 14.40s/it]
  3%|▎         | 997/37963 [4:16:18<147:45:09, 14.39s/it]
  3%|▎         | 998/37963 [4:16:32<147:38:10, 14.38s/it]
  3%|▎         | 999/37963 [4:16:46<147:26:07, 14.36s/it]
  3%|▎         | 1000/37963 [4:17:01<147:30:10, 14.37s/it]
                                                          
{'loss': '0.1906', 'grad_norm': '5.225', 'learning_rate': '1.754e-05', 'epoch': '0.02634'}

  3%|▎         | 1000/37963 [4:17:01<147:30:10, 14.37s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.83s/it]
Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.83s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  3%|▎         | 1001/37963 [4:18:51<443:17:46, 43.18s/it]
  3%|▎         | 1002/37963 [4:19:06<354:42:01, 34.55s/it]
  3%|▎         | 1003/37963 [4:19:20<292:47:43, 28.52s/it]
  3%|▎         | 1004/37963 [4:19:34<249:18:52, 24.28s/it]
  3%|▎         | 1005/37963 [4:19:49<218:56:13, 21.33s/it]
  3%|▎         | 1006/37963 [4:20:03<196:51:09, 19.18s/it]
  3%|▎         | 1007/37963 [4:20:17<181:06:12, 17.64s/it]
  3%|▎         | 1008/37963 [4:20:32<171:09:11, 16.67s/it]
  3%|▎         | 1009/37963 [4:20:46<164:01:19, 15.98s/it]
  3%|▎         | 1010/37963 [4:21:00<158:44:30, 15.46s/it]
                                                          
{'loss': '0.1938', 'grad_norm': '2.646', 'learning_rate': '1.772e-05', 'epoch': '0.0266'}

  3%|▎         | 1010/37963 [4:21:00<158:44:30, 15.46s/it]
  3%|▎         | 1011/37963 [4:21:15<155:31:30, 15.15s/it]
  3%|▎         | 1012/37963 [4:21:29<153:20:18, 14.94s/it]
  3%|▎         | 1013/37963 [4:21:44<152:10:26, 14.83s/it]
  3%|▎         | 1014/37963 [4:22:05<171:15:58, 16.69s/it]
  3%|▎         | 1015/37963 [4:22:19<163:56:41, 15.97s/it]
  3%|▎         | 1016/37963 [4:22:33<158:56:05, 15.49s/it]
  3%|▎         | 1017/37963 [4:23:00<194:41:37, 18.97s/it]
  3%|▎         | 1018/37963 [4:23:15<180:23:52, 17.58s/it]
  3%|▎         | 1019/37963 [4:23:29<170:20:27, 16.60s/it]
  3%|▎         | 1020/37963 [4:24:00<214:09:53, 20.87s/it]
                                                          
{'loss': '0.1925', 'grad_norm': '4.212', 'learning_rate': '1.789e-05', 'epoch': '0.02687'}

  3%|▎         | 1020/37963 [4:24:00<214:09:53, 20.87s/it]
  3%|▎         | 1021/37963 [4:24:21<215:02:27, 20.96s/it]
  3%|▎         | 1022/37963 [4:24:42<214:43:15, 20.93s/it]
  3%|▎         | 1023/37963 [4:25:03<214:39:10, 20.92s/it]
  3%|▎         | 1024/37963 [4:25:17<192:48:55, 18.79s/it]
  3%|▎         | 1025/37963 [4:25:31<179:15:23, 17.47s/it]
  3%|▎         | 1026/37963 [4:25:45<169:43:14, 16.54s/it]
  3%|▎         | 1027/37963 [4:26:00<163:11:17, 15.91s/it]
  3%|▎         | 1028/37963 [4:26:14<157:13:23, 15.32s/it]
  3%|▎         | 1029/37963 [4:26:28<154:14:52, 15.03s/it]
  3%|▎         | 1030/37963 [4:26:42<152:10:43, 14.83s/it]
                                                          
{'loss': '0.1763', 'grad_norm': '2.227', 'learning_rate': '1.807e-05', 'epoch': '0.02713'}

  3%|▎         | 1030/37963 [4:26:42<152:10:43, 14.83s/it]
  3%|▎         | 1031/37963 [4:26:57<150:52:20, 14.71s/it]
  3%|▎         | 1032/37963 [4:27:11<149:33:52, 14.58s/it]
  3%|▎         | 1033/37963 [4:27:25<147:07:22, 14.34s/it]
  3%|▎         | 1034/37963 [4:27:39<147:04:56, 14.34s/it]
  3%|▎         | 1035/37963 [4:27:54<147:10:43, 14.35s/it]
  3%|▎         | 1036/37963 [4:28:08<146:39:18, 14.30s/it]
  3%|▎         | 1037/37963 [4:28:22<147:14:13, 14.35s/it]
  3%|▎         | 1038/37963 [4:28:36<146:04:14, 14.24s/it]
  3%|▎         | 1039/37963 [4:28:51<146:03:40, 14.24s/it]
  3%|▎         | 1040/37963 [4:29:05<146:13:23, 14.26s/it]
                                                          
{'loss': '0.187', 'grad_norm': '2.795', 'learning_rate': '1.824e-05', 'epoch': '0.0274'}

  3%|▎         | 1040/37963 [4:29:05<146:13:23, 14.26s/it]
  3%|▎         | 1041/37963 [4:29:19<146:55:16, 14.33s/it]
  3%|▎         | 1042/37963 [4:29:34<147:11:41, 14.35s/it]
  3%|▎         | 1043/37963 [4:29:48<146:43:51, 14.31s/it]
  3%|▎         | 1044/37963 [4:30:02<146:56:13, 14.33s/it]
  3%|▎         | 1045/37963 [4:30:16<146:16:42, 14.26s/it]
  3%|▎         | 1046/37963 [4:30:30<145:29:11, 14.19s/it]
  3%|▎         | 1047/37963 [4:30:45<146:12:51, 14.26s/it]
  3%|▎         | 1048/37963 [4:30:59<146:37:48, 14.30s/it]
  3%|▎         | 1049/37963 [4:31:14<146:49:29, 14.32s/it]
  3%|▎         | 1050/37963 [4:31:28<147:12:18, 14.36s/it]
                                                          
{'loss': '0.1808', 'grad_norm': '1.965', 'learning_rate': '1.842e-05', 'epoch': '0.02766'}

  3%|▎         | 1050/37963 [4:31:28<147:12:18, 14.36s/it]
  3%|▎         | 1051/37963 [4:31:42<147:25:39, 14.38s/it]
  3%|▎         | 1052/37963 [4:31:57<146:47:41, 14.32s/it]
  3%|▎         | 1053/37963 [4:32:11<146:52:46, 14.33s/it]
  3%|▎         | 1054/37963 [4:32:25<146:55:20, 14.33s/it]
  3%|▎         | 1055/37963 [4:32:40<147:04:07, 14.35s/it]
  3%|▎         | 1056/37963 [4:32:54<147:01:19, 14.34s/it]
  3%|▎         | 1057/37963 [4:33:08<147:13:29, 14.36s/it]
  3%|▎         | 1058/37963 [4:33:23<147:11:17, 14.36s/it]
  3%|▎         | 1059/37963 [4:33:37<147:16:10, 14.37s/it]
  3%|▎         | 1060/37963 [4:33:52<147:42:25, 14.41s/it]
                                                          
{'loss': '0.1998', 'grad_norm': '3.448', 'learning_rate': '1.86e-05', 'epoch': '0.02792'}

  3%|▎         | 1060/37963 [4:33:52<147:42:25, 14.41s/it]
  3%|▎         | 1061/37963 [4:34:06<147:21:53, 14.38s/it]
  3%|▎         | 1062/37963 [4:34:20<146:41:02, 14.31s/it]
  3%|▎         | 1063/37963 [4:34:34<146:41:40, 14.31s/it]
  3%|▎         | 1064/37963 [4:34:49<146:48:27, 14.32s/it]
  3%|▎         | 1065/37963 [4:35:09<164:37:51, 16.06s/it]
  3%|▎         | 1066/37963 [4:35:30<179:11:22, 17.48s/it]
  3%|▎         | 1067/37963 [4:35:44<168:34:03, 16.45s/it]
  3%|▎         | 1068/37963 [4:36:25<244:33:09, 23.86s/it]
  3%|▎         | 1069/37963 [4:36:46<235:33:25, 22.98s/it]
  3%|▎         | 1070/37963 [4:37:07<228:22:34, 22.28s/it]
                                                          
{'loss': '0.173', 'grad_norm': '2.349', 'learning_rate': '1.877e-05', 'epoch': '0.02819'}

  3%|▎         | 1070/37963 [4:37:07<228:22:34, 22.28s/it]
  3%|▎         | 1071/37963 [4:37:21<203:42:48, 19.88s/it]
  3%|▎         | 1072/37963 [4:37:35<186:53:56, 18.24s/it]
  3%|▎         | 1073/37963 [4:37:49<173:35:21, 16.94s/it]
  3%|▎         | 1074/37963 [4:38:03<165:38:23, 16.16s/it]
  3%|▎         | 1075/37963 [4:38:18<159:27:49, 15.56s/it]
  3%|▎         | 1076/37963 [4:38:32<155:46:21, 15.20s/it]
  3%|▎         | 1077/37963 [4:38:46<153:21:38, 14.97s/it]
  3%|▎         | 1078/37963 [4:39:01<151:13:32, 14.76s/it]
  3%|▎         | 1079/37963 [4:39:15<149:36:14, 14.60s/it]
  3%|▎         | 1080/37963 [4:39:29<149:02:57, 14.55s/it]
                                                          
{'loss': '0.1962', 'grad_norm': '1.669', 'learning_rate': '1.895e-05', 'epoch': '0.02845'}

  3%|▎         | 1080/37963 [4:39:29<149:02:57, 14.55s/it]
  3%|▎         | 1081/37963 [4:39:43<146:26:13, 14.29s/it]
  3%|▎         | 1082/37963 [4:39:57<146:45:25, 14.33s/it]
  3%|▎         | 1083/37963 [4:40:12<147:30:21, 14.40s/it]
  3%|▎         | 1084/37963 [4:40:26<146:44:42, 14.32s/it]
  3%|▎         | 1085/37963 [4:40:40<145:07:46, 14.17s/it]
  3%|▎         | 1086/37963 [4:40:54<145:46:50, 14.23s/it]
  3%|▎         | 1087/37963 [4:41:09<145:53:35, 14.24s/it]
  3%|▎         | 1088/37963 [4:41:23<146:04:44, 14.26s/it]
  3%|▎         | 1089/37963 [4:41:37<146:12:56, 14.28s/it]
  3%|▎         | 1090/37963 [4:41:51<143:48:34, 14.04s/it]
                                                          
{'loss': '0.1941', 'grad_norm': '5.572', 'learning_rate': '1.912e-05', 'epoch': '0.02871'}

  3%|▎         | 1090/37963 [4:41:51<143:48:34, 14.04s/it]
  3%|▎         | 1091/37963 [4:42:05<143:10:27, 13.98s/it]
  3%|▎         | 1092/37963 [4:42:19<144:15:48, 14.09s/it]
  3%|▎         | 1093/37963 [4:42:33<144:53:05, 14.15s/it]
  3%|▎         | 1094/37963 [4:42:47<144:31:12, 14.11s/it]
  3%|▎         | 1095/37963 [4:43:01<144:16:11, 14.09s/it]
  3%|▎         | 1096/37963 [4:43:15<144:34:54, 14.12s/it]
  3%|▎         | 1097/37963 [4:43:30<145:38:07, 14.22s/it]
  3%|▎         | 1098/37963 [4:43:44<145:08:54, 14.17s/it]
  3%|▎         | 1099/37963 [4:43:58<145:45:50, 14.23s/it]
  3%|▎         | 1100/37963 [4:44:13<146:28:37, 14.30s/it]
                                                          
{'loss': '0.1845', 'grad_norm': '2.797', 'learning_rate': '1.93e-05', 'epoch': '0.02898'}

  3%|▎         | 1100/37963 [4:44:13<146:28:37, 14.30s/it]
  3%|▎         | 1101/37963 [4:44:27<146:37:20, 14.32s/it]
  3%|▎         | 1102/37963 [4:44:42<146:47:55, 14.34s/it]
  3%|▎         | 1103/37963 [4:44:56<146:41:48, 14.33s/it]
  3%|▎         | 1104/37963 [4:45:10<147:01:47, 14.36s/it]
  3%|▎         | 1105/37963 [4:45:25<146:54:15, 14.35s/it]
  3%|▎         | 1106/37963 [4:45:39<146:56:47, 14.35s/it]
  3%|▎         | 1107/37963 [4:45:53<146:17:03, 14.29s/it]
  3%|▎         | 1108/37963 [4:46:08<146:40:21, 14.33s/it]
  3%|▎         | 1109/37963 [4:46:22<145:54:27, 14.25s/it]
  3%|▎         | 1110/37963 [4:46:36<145:35:49, 14.22s/it]
                                                          
{'loss': '0.1919', 'grad_norm': '3.491', 'learning_rate': '1.947e-05', 'epoch': '0.02924'}

  3%|▎         | 1110/37963 [4:46:36<145:35:49, 14.22s/it]
  3%|▎         | 1111/37963 [4:46:50<146:09:22, 14.28s/it]
  3%|▎         | 1112/37963 [4:47:05<146:31:52, 14.31s/it]
  3%|▎         | 1113/37963 [4:47:25<164:04:11, 16.03s/it]
  3%|▎         | 1114/37963 [4:47:45<178:55:57, 17.48s/it]
  3%|▎         | 1115/37963 [4:48:13<210:00:38, 20.52s/it]
  3%|▎         | 1116/37963 [4:48:35<214:59:32, 21.01s/it]
  3%|▎         | 1117/37963 [4:48:56<214:32:48, 20.96s/it]
  3%|▎         | 1118/37963 [4:49:10<194:16:29, 18.98s/it]
  3%|▎         | 1119/37963 [4:49:32<201:42:23, 19.71s/it]
  3%|▎         | 1120/37963 [4:49:46<184:56:44, 18.07s/it]
                                                          
{'loss': '0.1754', 'grad_norm': '4.151', 'learning_rate': '1.965e-05', 'epoch': '0.0295'}

  3%|▎         | 1120/37963 [4:49:46<184:56:44, 18.07s/it]
  3%|▎         | 1121/37963 [4:50:01<173:48:54, 16.98s/it]
  3%|▎         | 1122/37963 [4:50:15<165:49:27, 16.20s/it]
  3%|▎         | 1123/37963 [4:50:29<160:04:39, 15.64s/it]
  3%|▎         | 1124/37963 [4:50:44<156:11:23, 15.26s/it]
  3%|▎         | 1125/37963 [4:50:58<152:12:09, 14.87s/it]
  3%|▎         | 1126/37963 [4:51:11<148:20:25, 14.50s/it]
  3%|▎         | 1127/37963 [4:51:25<146:34:36, 14.33s/it]
  3%|▎         | 1128/37963 [4:51:39<146:39:20, 14.33s/it]
  3%|▎         | 1129/37963 [4:51:54<146:24:01, 14.31s/it]
  3%|▎         | 1130/37963 [4:52:08<146:27:00, 14.31s/it]
                                                          
{'loss': '0.1857', 'grad_norm': '4.583', 'learning_rate': '1.982e-05', 'epoch': '0.02977'}

  3%|▎         | 1130/37963 [4:52:08<146:27:00, 14.31s/it]
  3%|▎         | 1131/37963 [4:52:22<145:24:39, 14.21s/it]
  3%|▎         | 1132/37963 [4:52:36<144:13:17, 14.10s/it]
  3%|▎         | 1133/37963 [4:52:50<145:11:46, 14.19s/it]
  3%|▎         | 1134/37963 [4:53:05<146:17:30, 14.30s/it]
  3%|▎         | 1135/37963 [4:53:19<146:24:05, 14.31s/it]
  3%|▎         | 1136/37963 [4:53:34<146:45:41, 14.35s/it]
  3%|▎         | 1137/37963 [4:53:48<146:36:44, 14.33s/it]
  3%|▎         | 1138/37963 [4:54:02<146:30:42, 14.32s/it]
  3%|▎         | 1139/37963 [4:54:16<146:28:44, 14.32s/it]
  3%|▎         | 1140/37963 [4:54:31<146:16:15, 14.30s/it]
                                                          
{'loss': '0.1894', 'grad_norm': '1.847', 'learning_rate': '2e-05', 'epoch': '0.03003'}

  3%|▎         | 1140/37963 [4:54:31<146:16:15, 14.30s/it]
  3%|▎         | 1141/37963 [4:54:45<146:22:39, 14.31s/it]
  3%|▎         | 1142/37963 [4:55:00<146:43:19, 14.35s/it]
  3%|▎         | 1143/37963 [4:55:14<146:04:54, 14.28s/it]
  3%|▎         | 1144/37963 [4:55:28<146:11:06, 14.29s/it]
  3%|▎         | 1145/37963 [4:55:42<145:23:17, 14.22s/it]
  3%|▎         | 1146/37963 [4:55:56<145:47:22, 14.26s/it]
  3%|▎         | 1147/37963 [4:56:11<146:05:32, 14.29s/it]
  3%|▎         | 1148/37963 [4:56:25<146:20:45, 14.31s/it]
  3%|▎         | 1149/37963 [4:56:39<146:07:37, 14.29s/it]
  3%|▎         | 1150/37963 [4:56:54<146:23:03, 14.32s/it]
                                                          
{'loss': '0.1833', 'grad_norm': '6.929', 'learning_rate': '2e-05', 'epoch': '0.03029'}

  3%|▎         | 1150/37963 [4:56:54<146:23:03, 14.32s/it]
  3%|▎         | 1151/37963 [4:57:08<146:56:01, 14.37s/it]
  3%|▎         | 1152/37963 [4:57:22<145:23:58, 14.22s/it]
  3%|▎         | 1153/37963 [4:57:36<145:26:33, 14.22s/it]
  3%|▎         | 1154/37963 [4:57:50<143:10:02, 14.00s/it]
  3%|▎         | 1155/37963 [4:58:04<144:36:55, 14.14s/it]
  3%|▎         | 1156/37963 [4:58:18<144:01:13, 14.09s/it]
  3%|▎         | 1157/37963 [4:58:32<143:49:12, 14.07s/it]
  3%|▎         | 1158/37963 [4:58:47<145:15:54, 14.21s/it]
  3%|▎         | 1159/37963 [4:59:01<143:56:53, 14.08s/it]
  3%|▎         | 1160/37963 [4:59:21<162:23:07, 15.88s/it]
                                                          
{'loss': '0.1743', 'grad_norm': '3.677', 'learning_rate': '2e-05', 'epoch': '0.03056'}

  3%|▎         | 1160/37963 [4:59:21<162:23:07, 15.88s/it]
  3%|▎         | 1161/37963 [4:59:35<157:46:11, 15.43s/it]
  3%|▎         | 1162/37963 [5:00:02<194:23:11, 19.02s/it]
  3%|▎         | 1163/37963 [5:00:24<201:47:59, 19.74s/it]
  3%|▎         | 1164/37963 [5:00:46<207:44:52, 20.32s/it]
  3%|▎         | 1165/37963 [5:01:06<209:09:03, 20.46s/it]
  3%|▎         | 1166/37963 [5:01:20<189:20:17, 18.52s/it]
  3%|▎         | 1167/37963 [5:01:35<176:25:33, 17.26s/it]
  3%|▎         | 1168/37963 [5:02:03<209:52:03, 20.53s/it]
  3%|▎         | 1169/37963 [5:02:17<189:50:03, 18.57s/it]
  3%|▎         | 1170/37963 [5:02:31<176:36:18, 17.28s/it]
                                                          
{'loss': '0.1906', 'grad_norm': '3.431', 'learning_rate': '2e-05', 'epoch': '0.03082'}

  3%|▎         | 1170/37963 [5:02:31<176:36:18, 17.28s/it]
  3%|▎         | 1171/37963 [5:02:45<167:43:55, 16.41s/it]
  3%|▎         | 1172/37963 [5:03:00<161:23:36, 15.79s/it]
  3%|▎         | 1173/37963 [5:03:14<156:02:59, 15.27s/it]
  3%|▎         | 1174/37963 [5:03:28<153:14:28, 15.00s/it]
  3%|▎         | 1175/37963 [5:03:42<150:18:47, 14.71s/it]
  3%|▎         | 1176/37963 [5:03:57<149:13:06, 14.60s/it]
  3%|▎         | 1177/37963 [5:04:11<148:22:35, 14.52s/it]
  3%|▎         | 1178/37963 [5:04:25<147:47:24, 14.46s/it]
  3%|▎         | 1179/37963 [5:04:40<147:19:04, 14.42s/it]
  3%|▎         | 1180/37963 [5:04:54<147:24:31, 14.43s/it]
                                                          
{'loss': '0.1773', 'grad_norm': '2.086', 'learning_rate': '2e-05', 'epoch': '0.03108'}

  3%|▎         | 1180/37963 [5:04:54<147:24:31, 14.43s/it]
  3%|▎         | 1181/37963 [5:05:08<146:47:33, 14.37s/it]
  3%|▎         | 1182/37963 [5:05:23<146:38:40, 14.35s/it]
  3%|▎         | 1183/37963 [5:05:37<145:38:06, 14.25s/it]
  3%|▎         | 1184/37963 [5:05:50<143:57:25, 14.09s/it]
  3%|▎         | 1185/37963 [5:06:04<144:20:44, 14.13s/it]
  3%|▎         | 1186/37963 [5:06:19<144:51:55, 14.18s/it]
  3%|▎         | 1187/37963 [5:06:32<143:18:13, 14.03s/it]
  3%|▎         | 1188/37963 [5:06:47<144:43:52, 14.17s/it]
  3%|▎         | 1189/37963 [5:07:02<146:05:05, 14.30s/it]
  3%|▎         | 1190/37963 [5:07:16<146:10:37, 14.31s/it]
                                                          
{'loss': '0.1842', 'grad_norm': '3.997', 'learning_rate': '2e-05', 'epoch': '0.03135'}

  3%|▎         | 1190/37963 [5:07:16<146:10:37, 14.31s/it]
  3%|▎         | 1191/37963 [5:07:29<143:15:28, 14.03s/it]
  3%|▎         | 1192/37963 [5:07:44<144:17:20, 14.13s/it]
  3%|▎         | 1193/37963 [5:07:58<145:16:21, 14.22s/it]
  3%|▎         | 1194/37963 [5:08:12<145:35:25, 14.25s/it]
  3%|▎         | 1195/37963 [5:08:27<145:43:26, 14.27s/it]
  3%|▎         | 1196/37963 [5:08:40<144:05:09, 14.11s/it]
  3%|▎         | 1197/37963 [5:08:55<144:45:32, 14.17s/it]
  3%|▎         | 1198/37963 [5:09:09<145:14:53, 14.22s/it]
  3%|▎         | 1199/37963 [5:09:24<145:55:54, 14.29s/it]
  3%|▎         | 1200/37963 [5:09:38<146:53:08, 14.38s/it]
                                                          
{'loss': '0.1747', 'grad_norm': '3.21', 'learning_rate': '2e-05', 'epoch': '0.03161'}

  3%|▎         | 1200/37963 [5:09:38<146:53:08, 14.38s/it]
  3%|▎         | 1201/37963 [5:09:52<146:38:55, 14.36s/it]
  3%|▎         | 1202/37963 [5:10:07<146:38:39, 14.36s/it]
  3%|▎         | 1203/37963 [5:10:21<146:29:28, 14.35s/it]
  3%|▎         | 1204/37963 [5:10:35<146:24:56, 14.34s/it]
  3%|▎         | 1205/37963 [5:10:49<144:59:29, 14.20s/it]
  3%|▎         | 1206/37963 [5:11:04<145:09:39, 14.22s/it]
  3%|▎         | 1207/37963 [5:11:18<145:56:49, 14.29s/it]
  3%|▎         | 1208/37963 [5:11:32<146:03:37, 14.31s/it]
  3%|▎         | 1209/37963 [5:11:53<165:44:02, 16.23s/it]
  3%|▎         | 1210/37963 [5:12:07<159:54:49, 15.66s/it]
                                                          
{'loss': '0.1726', 'grad_norm': '8.872', 'learning_rate': '2e-05', 'epoch': '0.03187'}

  3%|▎         | 1210/37963 [5:12:07<159:54:49, 15.66s/it]
  3%|▎         | 1211/37963 [5:12:35<195:16:01, 19.13s/it]
  3%|▎         | 1212/37963 [5:12:56<200:56:08, 19.68s/it]
  3%|▎         | 1213/37963 [5:13:18<207:55:47, 20.37s/it]
  3%|▎         | 1214/37963 [5:13:38<209:00:05, 20.47s/it]
  3%|▎         | 1215/37963 [5:13:53<190:06:43, 18.62s/it]
  3%|▎         | 1216/37963 [5:14:07<176:44:35, 17.32s/it]
  3%|▎         | 1217/37963 [5:14:28<188:10:09, 18.43s/it]
  3%|▎         | 1218/37963 [5:14:42<175:40:26, 17.21s/it]
  3%|▎         | 1219/37963 [5:14:57<166:41:43, 16.33s/it]
  3%|▎         | 1220/37963 [5:15:11<159:35:39, 15.64s/it]
                                                          
{'loss': '0.1872', 'grad_norm': '5.98', 'learning_rate': '2e-05', 'epoch': '0.03214'}

  3%|▎         | 1220/37963 [5:15:11<159:35:39, 15.64s/it]
  3%|▎         | 1221/37963 [5:15:25<155:55:24, 15.28s/it]
  3%|▎         | 1222/37963 [5:15:39<152:25:09, 14.93s/it]
  3%|▎         | 1223/37963 [5:15:54<150:39:47, 14.76s/it]
  3%|▎         | 1224/37963 [5:16:08<149:26:14, 14.64s/it]
  3%|▎         | 1225/37963 [5:16:22<148:33:57, 14.56s/it]
  3%|▎         | 1226/37963 [5:16:37<148:23:22, 14.54s/it]
  3%|▎         | 1227/37963 [5:16:51<147:50:58, 14.49s/it]
  3%|▎         | 1228/37963 [5:17:05<147:23:59, 14.45s/it]
  3%|▎         | 1229/37963 [5:17:20<147:02:27, 14.41s/it]
  3%|▎         | 1230/37963 [5:17:34<146:54:11, 14.40s/it]
                                                          
{'loss': '0.2011', 'grad_norm': '6.966', 'learning_rate': '2e-05', 'epoch': '0.0324'}

  3%|▎         | 1230/37963 [5:17:34<146:54:11, 14.40s/it]
  3%|▎         | 1231/37963 [5:17:49<147:01:17, 14.41s/it]
  3%|▎         | 1232/37963 [5:18:03<146:41:42, 14.38s/it]
  3%|▎         | 1233/37963 [5:18:17<144:36:16, 14.17s/it]
  3%|▎         | 1234/37963 [5:18:31<145:33:35, 14.27s/it]
  3%|▎         | 1235/37963 [5:18:45<145:17:40, 14.24s/it]
  3%|▎         | 1236/37963 [5:19:00<145:53:09, 14.30s/it]
  3%|▎         | 1237/37963 [5:19:14<146:35:12, 14.37s/it]
  3%|▎         | 1238/37963 [5:19:29<146:38:54, 14.38s/it]
  3%|▎         | 1239/37963 [5:19:43<147:00:47, 14.41s/it]
  3%|▎         | 1240/37963 [5:19:58<147:09:54, 14.43s/it]
                                                          
{'loss': '0.1956', 'grad_norm': '11.58', 'learning_rate': '2e-05', 'epoch': '0.03266'}

  3%|▎         | 1240/37963 [5:19:58<147:09:54, 14.43s/it]
  3%|▎         | 1241/37963 [5:20:12<146:48:55, 14.39s/it]
  3%|▎         | 1242/37963 [5:20:26<146:22:17, 14.35s/it]
  3%|▎         | 1243/37963 [5:20:41<146:24:53, 14.35s/it]
  3%|▎         | 1244/37963 [5:20:54<144:36:38, 14.18s/it]
  3%|▎         | 1245/37963 [5:21:09<145:31:35, 14.27s/it]
  3%|▎         | 1246/37963 [5:21:23<145:52:21, 14.30s/it]
  3%|▎         | 1247/37963 [5:21:38<146:08:53, 14.33s/it]
  3%|▎         | 1248/37963 [5:21:52<146:12:29, 14.34s/it]
  3%|▎         | 1249/37963 [5:22:06<146:19:53, 14.35s/it]
  3%|▎         | 1250/37963 [5:22:20<144:19:37, 14.15s/it]
                                                          
{'loss': '0.1926', 'grad_norm': '4.839', 'learning_rate': '2e-05', 'epoch': '0.03293'}

  3%|▎         | 1250/37963 [5:22:20<144:19:37, 14.15s/it]
  3%|▎         | 1251/37963 [5:22:34<145:05:04, 14.23s/it]
  3%|▎         | 1252/37963 [5:22:48<143:40:55, 14.09s/it]
  3%|▎         | 1253/37963 [5:23:02<143:32:01, 14.08s/it]
  3%|▎         | 1254/37963 [5:23:16<144:12:31, 14.14s/it]
  3%|▎         | 1255/37963 [5:23:31<144:56:50, 14.22s/it]
  3%|▎         | 1256/37963 [5:23:45<145:32:51, 14.27s/it]
  3%|▎         | 1257/37963 [5:24:06<165:21:44, 16.22s/it]
  3%|▎         | 1258/37963 [5:24:20<158:33:22, 15.55s/it]
  3%|▎         | 1259/37963 [5:24:34<153:57:22, 15.10s/it]
  3%|▎         | 1260/37963 [5:25:01<190:43:21, 18.71s/it]
                                                          
{'loss': '0.1926', 'grad_norm': '5.751', 'learning_rate': '2e-05', 'epoch': '0.03319'}

  3%|▎         | 1260/37963 [5:25:01<190:43:21, 18.71s/it]
  3%|▎         | 1261/37963 [5:25:23<199:53:23, 19.61s/it]
  3%|▎         | 1262/37963 [5:25:44<204:24:08, 20.05s/it]
  3%|▎         | 1263/37963 [5:26:05<207:07:11, 20.32s/it]
  3%|▎         | 1264/37963 [5:26:26<209:17:59, 20.53s/it]
  3%|▎         | 1265/37963 [5:26:40<190:28:06, 18.68s/it]
  3%|▎         | 1266/37963 [5:27:01<196:44:54, 19.30s/it]
  3%|▎         | 1267/37963 [5:27:15<180:03:28, 17.66s/it]
  3%|▎         | 1268/37963 [5:27:29<169:53:09, 16.67s/it]
  3%|▎         | 1269/37963 [5:27:43<160:58:06, 15.79s/it]
  3%|▎         | 1270/37963 [5:27:57<156:42:53, 15.38s/it]
                                                          
{'loss': '0.1971', 'grad_norm': '1.46', 'learning_rate': '2e-05', 'epoch': '0.03345'}

  3%|▎         | 1270/37963 [5:27:57<156:42:53, 15.38s/it]
  3%|▎         | 1271/37963 [5:28:12<153:58:17, 15.11s/it]
  3%|▎         | 1272/37963 [5:28:26<151:34:05, 14.87s/it]
  3%|▎         | 1273/37963 [5:28:40<149:34:43, 14.68s/it]
  3%|▎         | 1274/37963 [5:28:55<147:56:48, 14.52s/it]
  3%|▎         | 1275/37963 [5:29:09<148:01:44, 14.53s/it]
  3%|▎         | 1276/37963 [5:29:24<147:41:05, 14.49s/it]
  3%|▎         | 1277/37963 [5:29:38<147:27:18, 14.47s/it]
  3%|▎         | 1278/37963 [5:29:52<147:20:22, 14.46s/it]
  3%|▎         | 1279/37963 [5:30:06<145:35:12, 14.29s/it]
  3%|▎         | 1280/37963 [5:30:21<145:38:15, 14.29s/it]
                                                          
{'loss': '0.1819', 'grad_norm': '2.551', 'learning_rate': '2e-05', 'epoch': '0.03372'}

  3%|▎         | 1280/37963 [5:30:21<145:38:15, 14.29s/it]
  3%|▎         | 1281/37963 [5:30:35<145:50:25, 14.31s/it]
  3%|▎         | 1282/37963 [5:30:49<145:49:29, 14.31s/it]
  3%|▎         | 1283/37963 [5:31:04<146:01:42, 14.33s/it]
  3%|▎         | 1284/37963 [5:31:18<146:02:43, 14.33s/it]
  3%|▎         | 1285/37963 [5:31:32<144:37:55, 14.20s/it]
  3%|▎         | 1286/37963 [5:31:46<145:10:18, 14.25s/it]
  3%|▎         | 1287/37963 [5:32:01<145:25:06, 14.27s/it]
  3%|▎         | 1288/37963 [5:32:14<144:26:58, 14.18s/it]
  3%|▎         | 1289/37963 [5:32:29<144:59:30, 14.23s/it]
  3%|▎         | 1290/37963 [5:32:43<145:21:01, 14.27s/it]
                                                          
{'loss': '0.195', 'grad_norm': '1.729', 'learning_rate': '2e-05', 'epoch': '0.03398'}

  3%|▎         | 1290/37963 [5:32:43<145:21:01, 14.27s/it]
  3%|▎         | 1291/37963 [5:32:58<145:30:38, 14.28s/it]
  3%|▎         | 1292/37963 [5:33:12<145:44:57, 14.31s/it]
  3%|▎         | 1293/37963 [5:33:26<145:08:28, 14.25s/it]
  3%|▎         | 1294/37963 [5:33:40<143:56:09, 14.13s/it]
  3%|▎         | 1295/37963 [5:33:54<144:43:52, 14.21s/it]
  3%|▎         | 1296/37963 [5:34:08<142:39:18, 14.01s/it]
  3%|▎         | 1297/37963 [5:34:22<143:34:43, 14.10s/it]
  3%|▎         | 1298/37963 [5:34:36<142:25:34, 13.98s/it]
  3%|▎         | 1299/37963 [5:34:50<143:43:34, 14.11s/it]
  3%|▎         | 1300/37963 [5:35:04<144:06:53, 14.15s/it]
                                                          
{'loss': '0.1781', 'grad_norm': '4.668', 'learning_rate': '2e-05', 'epoch': '0.03424'}

  3%|▎         | 1300/37963 [5:35:04<144:06:53, 14.15s/it]
  3%|▎         | 1301/37963 [5:35:19<144:52:55, 14.23s/it]
  3%|▎         | 1302/37963 [5:35:33<145:13:28, 14.26s/it]
  3%|▎         | 1303/37963 [5:35:48<145:19:38, 14.27s/it]
  3%|▎         | 1304/37963 [5:36:08<165:19:57, 16.24s/it]
  3%|▎         | 1305/37963 [5:36:23<159:32:39, 15.67s/it]
  3%|▎         | 1306/37963 [5:36:44<176:44:20, 17.36s/it]
  3%|▎         | 1307/37963 [5:36:58<167:26:35, 16.44s/it]
  3%|▎         | 1308/37963 [5:37:13<161:11:32, 15.83s/it]
  3%|▎         | 1309/37963 [5:37:34<179:06:28, 17.59s/it]
  3%|▎         | 1310/37963 [5:37:55<187:15:48, 18.39s/it]
                                                          
{'loss': '0.1806', 'grad_norm': '6.919', 'learning_rate': '2e-05', 'epoch': '0.03451'}

  3%|▎         | 1310/37963 [5:37:55<187:15:48, 18.39s/it]
  3%|▎         | 1311/37963 [5:38:16<196:01:20, 19.25s/it]
  3%|▎         | 1312/37963 [5:38:36<199:08:12, 19.56s/it]
  3%|▎         | 1313/37963 [5:38:50<182:46:53, 17.95s/it]
  3%|▎         | 1314/37963 [5:39:19<215:20:10, 21.15s/it]
  3%|▎         | 1315/37963 [5:39:33<194:46:17, 19.13s/it]
  3%|▎         | 1316/37963 [5:39:48<180:04:16, 17.69s/it]
  3%|▎         | 1317/37963 [5:40:02<169:23:02, 16.64s/it]
  3%|▎         | 1318/37963 [5:40:16<162:40:02, 15.98s/it]
  3%|▎         | 1319/37963 [5:40:31<157:36:26, 15.48s/it]
  3%|▎         | 1320/37963 [5:40:45<152:28:12, 14.98s/it]
                                                          
{'loss': '0.1764', 'grad_norm': '1.845', 'learning_rate': '2e-05', 'epoch': '0.03477'}

  3%|▎         | 1320/37963 [5:40:45<152:28:12, 14.98s/it]
  3%|▎         | 1321/37963 [5:40:58<148:53:55, 14.63s/it]
  3%|▎         | 1322/37963 [5:41:13<148:26:21, 14.58s/it]
  3%|▎         | 1323/37963 [5:41:27<146:33:59, 14.40s/it]
  3%|▎         | 1324/37963 [5:41:41<146:14:48, 14.37s/it]
  3%|▎         | 1325/37963 [5:41:55<146:06:24, 14.36s/it]
  3%|▎         | 1326/37963 [5:42:10<146:05:11, 14.35s/it]
  3%|▎         | 1327/37963 [5:42:24<146:12:32, 14.37s/it]
  3%|▎         | 1328/37963 [5:42:38<144:42:00, 14.22s/it]
  4%|▎         | 1329/37963 [5:42:52<142:57:08, 14.05s/it]
  4%|▎         | 1330/37963 [5:43:06<143:49:16, 14.13s/it]
                                                          
{'loss': '0.1816', 'grad_norm': '1.61', 'learning_rate': '2e-05', 'epoch': '0.03503'}

  4%|▎         | 1330/37963 [5:43:06<143:49:16, 14.13s/it]
  4%|▎         | 1331/37963 [5:43:20<144:41:06, 14.22s/it]
  4%|▎         | 1332/37963 [5:43:34<143:59:36, 14.15s/it]
  4%|▎         | 1333/37963 [5:43:49<144:48:18, 14.23s/it]
  4%|▎         | 1334/37963 [5:44:03<144:59:51, 14.25s/it]
  4%|▎         | 1335/37963 [5:44:17<145:16:47, 14.28s/it]
  4%|▎         | 1336/37963 [5:44:32<145:37:23, 14.31s/it]
  4%|▎         | 1337/37963 [5:44:46<145:36:57, 14.31s/it]
  4%|▎         | 1338/37963 [5:45:01<145:52:17, 14.34s/it]
  4%|▎         | 1339/37963 [5:45:15<145:50:20, 14.34s/it]
  4%|▎         | 1340/37963 [5:45:29<145:55:21, 14.34s/it]
                                                          
{'loss': '0.1872', 'grad_norm': '4.488', 'learning_rate': '2e-05', 'epoch': '0.0353'}

  4%|▎         | 1340/37963 [5:45:29<145:55:21, 14.34s/it]
  4%|▎         | 1341/37963 [5:45:43<144:50:58, 14.24s/it]
  4%|▎         | 1342/37963 [5:45:58<145:15:27, 14.28s/it]
  4%|▎         | 1343/37963 [5:46:12<145:33:51, 14.31s/it]
  4%|▎         | 1344/37963 [5:46:26<145:46:02, 14.33s/it]
  4%|▎         | 1345/37963 [5:46:41<146:08:22, 14.37s/it]
  4%|▎         | 1346/37963 [5:46:55<146:08:31, 14.37s/it]
  4%|▎         | 1347/37963 [5:47:10<146:11:34, 14.37s/it]
  4%|▎         | 1348/37963 [5:47:24<146:16:05, 14.38s/it]
  4%|▎         | 1349/37963 [5:47:38<146:13:55, 14.38s/it]
  4%|▎         | 1350/37963 [5:47:52<144:59:03, 14.26s/it]
                                                          
{'loss': '0.1825', 'grad_norm': '3.318', 'learning_rate': '2e-05', 'epoch': '0.03556'}

  4%|▎         | 1350/37963 [5:47:52<144:59:03, 14.26s/it]
  4%|▎         | 1351/37963 [5:48:07<145:10:11, 14.27s/it]
  4%|▎         | 1352/37963 [5:48:35<187:50:08, 18.47s/it]
  4%|▎         | 1353/37963 [5:48:49<175:06:25, 17.22s/it]
  4%|▎         | 1354/37963 [5:49:03<165:47:11, 16.30s/it]
  4%|▎         | 1355/37963 [5:49:18<159:09:24, 15.65s/it]
  4%|▎         | 1356/37963 [5:49:32<155:12:02, 15.26s/it]
  4%|▎         | 1357/37963 [5:49:53<174:34:40, 17.17s/it]
  4%|▎         | 1358/37963 [5:50:14<183:51:40, 18.08s/it]
  4%|▎         | 1359/37963 [5:50:35<192:52:23, 18.97s/it]
  4%|▎         | 1360/37963 [5:50:56<198:56:40, 19.57s/it]
                                                          
{'loss': '0.1914', 'grad_norm': '7.855', 'learning_rate': '2e-05', 'epoch': '0.03582'}

  4%|▎         | 1360/37963 [5:50:56<198:56:40, 19.57s/it]
  4%|▎         | 1361/37963 [5:51:10<183:03:17, 18.00s/it]
  4%|▎         | 1362/37963 [5:51:31<192:53:30, 18.97s/it]
  4%|▎         | 1363/37963 [5:51:52<197:10:19, 19.39s/it]
  4%|▎         | 1364/37963 [5:52:06<181:32:38, 17.86s/it]
  4%|▎         | 1365/37963 [5:52:20<170:51:16, 16.81s/it]
  4%|▎         | 1366/37963 [5:52:35<163:04:33, 16.04s/it]
  4%|▎         | 1367/37963 [5:52:49<158:24:05, 15.58s/it]
  4%|▎         | 1368/37963 [5:53:04<154:58:21, 15.25s/it]
  4%|▎         | 1369/37963 [5:53:18<151:44:07, 14.93s/it]
  4%|▎         | 1370/37963 [5:53:32<149:24:22, 14.70s/it]
                                                          
{'loss': '0.1887', 'grad_norm': '4.28', 'learning_rate': '2e-05', 'epoch': '0.03609'}

  4%|▎         | 1370/37963 [5:53:32<149:24:22, 14.70s/it]
  4%|▎         | 1371/37963 [5:53:46<148:01:24, 14.56s/it]
  4%|▎         | 1372/37963 [5:54:01<148:04:32, 14.57s/it]
  4%|▎         | 1373/37963 [5:54:15<147:35:50, 14.52s/it]
  4%|▎         | 1374/37963 [5:54:29<147:06:10, 14.47s/it]
  4%|▎         | 1375/37963 [5:54:44<147:00:47, 14.47s/it]
  4%|▎         | 1376/37963 [5:54:58<146:59:50, 14.46s/it]
  4%|▎         | 1377/37963 [5:55:13<146:37:12, 14.43s/it]
  4%|▎         | 1378/37963 [5:55:27<146:23:32, 14.41s/it]
  4%|▎         | 1379/37963 [5:55:41<145:57:55, 14.36s/it]
  4%|▎         | 1380/37963 [5:55:56<145:49:04, 14.35s/it]
                                                          
{'loss': '0.183', 'grad_norm': '3.57', 'learning_rate': '2e-05', 'epoch': '0.03635'}

  4%|▎         | 1380/37963 [5:55:56<145:49:04, 14.35s/it]
  4%|▎         | 1381/37963 [5:56:10<146:20:36, 14.40s/it]
  4%|▎         | 1382/37963 [5:56:24<144:28:17, 14.22s/it]
  4%|▎         | 1383/37963 [5:56:38<144:54:20, 14.26s/it]
  4%|▎         | 1384/37963 [5:56:53<145:01:57, 14.27s/it]
  4%|▎         | 1385/37963 [5:57:06<142:53:43, 14.06s/it]
  4%|▎         | 1386/37963 [5:57:21<143:54:25, 14.16s/it]
  4%|▎         | 1387/37963 [5:57:35<144:27:37, 14.22s/it]
  4%|▎         | 1388/37963 [5:57:49<143:25:40, 14.12s/it]
  4%|▎         | 1389/37963 [5:58:03<144:14:06, 14.20s/it]
  4%|▎         | 1390/37963 [5:58:18<144:54:58, 14.26s/it]
                                                          
{'loss': '0.1824', 'grad_norm': '2.066', 'learning_rate': '2e-05', 'epoch': '0.03661'}

  4%|▎         | 1390/37963 [5:58:18<144:54:58, 14.26s/it]
  4%|▎         | 1391/37963 [5:58:32<144:26:48, 14.22s/it]
  4%|▎         | 1392/37963 [5:58:46<145:05:07, 14.28s/it]
  4%|▎         | 1393/37963 [5:59:00<144:16:01, 14.20s/it]
  4%|▎         | 1394/37963 [5:59:14<144:35:49, 14.23s/it]
  4%|▎         | 1395/37963 [5:59:29<144:51:34, 14.26s/it]
  4%|▎         | 1396/37963 [5:59:43<144:52:16, 14.26s/it]
  4%|▎         | 1397/37963 [5:59:57<144:34:39, 14.23s/it]
  4%|▎         | 1398/37963 [6:00:11<143:17:45, 14.11s/it]
  4%|▎         | 1399/37963 [6:00:25<143:14:10, 14.10s/it]
  4%|▎         | 1400/37963 [6:00:40<144:09:27, 14.19s/it]
                                                          
{'loss': '0.1696', 'grad_norm': '3.377', 'learning_rate': '2e-05', 'epoch': '0.03688'}

  4%|▎         | 1400/37963 [6:00:40<144:09:27, 14.19s/it]
  4%|▎         | 1401/37963 [6:01:07<183:20:25, 18.05s/it]
  4%|▎         | 1402/37963 [6:01:21<171:59:18, 16.93s/it]
  4%|▎         | 1403/37963 [6:01:35<164:29:00, 16.20s/it]
  4%|▎         | 1404/37963 [6:01:50<158:34:47, 15.62s/it]
  4%|▎         | 1405/37963 [6:02:04<154:41:13, 15.23s/it]
  4%|▎         | 1406/37963 [6:02:25<172:17:43, 16.97s/it]
  4%|▎         | 1407/37963 [6:02:51<201:03:28, 19.80s/it]
  4%|▎         | 1408/37963 [6:03:06<184:26:10, 18.16s/it]
  4%|▎         | 1409/37963 [6:03:26<191:59:18, 18.91s/it]
  4%|▎         | 1410/37963 [6:03:40<176:56:04, 17.43s/it]
                                                          
{'loss': '0.1795', 'grad_norm': '3.17', 'learning_rate': '2e-05', 'epoch': '0.03714'}

  4%|▎         | 1410/37963 [6:03:40<176:56:04, 17.43s/it]
  4%|▎         | 1411/37963 [6:04:02<188:13:42, 18.54s/it]
  4%|▎         | 1412/37963 [6:04:16<175:25:32, 17.28s/it]
  4%|▎         | 1413/37963 [6:04:37<185:54:55, 18.31s/it]
  4%|▎         | 1414/37963 [6:04:50<172:07:36, 16.95s/it]
  4%|▎         | 1415/37963 [6:05:04<162:54:43, 16.05s/it]
  4%|▎         | 1416/37963 [6:05:19<157:43:11, 15.54s/it]
  4%|▎         | 1417/37963 [6:05:33<154:12:48, 15.19s/it]
  4%|▎         | 1418/37963 [6:05:47<151:47:49, 14.95s/it]
  4%|▎         | 1419/37963 [6:06:02<150:23:23, 14.82s/it]
  4%|▎         | 1420/37963 [6:06:16<148:56:32, 14.67s/it]
                                                          
{'loss': '0.1912', 'grad_norm': '2.27', 'learning_rate': '2e-05', 'epoch': '0.0374'}

  4%|▎         | 1420/37963 [6:06:16<148:56:32, 14.67s/it]
  4%|▎         | 1421/37963 [6:06:31<147:57:31, 14.58s/it]
  4%|▎         | 1422/37963 [6:06:45<147:22:06, 14.52s/it]
  4%|▎         | 1423/37963 [6:06:59<146:58:25, 14.48s/it]
  4%|▍         | 1424/37963 [6:07:14<146:36:16, 14.44s/it]
  4%|▍         | 1425/37963 [6:07:28<146:24:03, 14.42s/it]
  4%|▍         | 1426/37963 [6:07:43<146:15:29, 14.41s/it]
  4%|▍         | 1427/37963 [6:07:57<146:23:17, 14.42s/it]
  4%|▍         | 1428/37963 [6:08:11<145:01:47, 14.29s/it]
  4%|▍         | 1429/37963 [6:08:25<145:15:59, 14.31s/it]
  4%|▍         | 1430/37963 [6:08:40<145:47:33, 14.37s/it]
                                                          
{'loss': '0.1781', 'grad_norm': '3.78', 'learning_rate': '2e-05', 'epoch': '0.03767'}

  4%|▍         | 1430/37963 [6:08:40<145:47:33, 14.37s/it]
  4%|▍         | 1431/37963 [6:08:54<144:47:43, 14.27s/it]
  4%|▍         | 1432/37963 [6:09:08<145:28:23, 14.34s/it]
  4%|▍         | 1433/37963 [6:09:23<146:02:04, 14.39s/it]
  4%|▍         | 1434/37963 [6:09:37<145:42:36, 14.36s/it]
  4%|▍         | 1435/37963 [6:09:51<145:30:51, 14.34s/it]
  4%|▍         | 1436/37963 [6:10:06<145:44:55, 14.36s/it]
  4%|▍         | 1437/37963 [6:10:20<145:35:22, 14.35s/it]
  4%|▍         | 1438/37963 [6:10:35<145:33:04, 14.35s/it]
  4%|▍         | 1439/37963 [6:10:49<144:53:34, 14.28s/it]
  4%|▍         | 1440/37963 [6:11:03<144:17:09, 14.22s/it]
                                                          
{'loss': '0.1736', 'grad_norm': '4.622', 'learning_rate': '2e-05', 'epoch': '0.03793'}

  4%|▍         | 1440/37963 [6:11:03<144:17:09, 14.22s/it]
  4%|▍         | 1441/37963 [6:11:17<144:24:23, 14.23s/it]
  4%|▍         | 1442/37963 [6:11:31<144:51:10, 14.28s/it]
  4%|▍         | 1443/37963 [6:11:45<143:54:41, 14.19s/it]
  4%|▍         | 1444/37963 [6:12:00<143:53:00, 14.18s/it]
  4%|▍         | 1445/37963 [6:12:13<142:49:52, 14.08s/it]
  4%|▍         | 1446/37963 [6:12:28<144:15:39, 14.22s/it]
  4%|▍         | 1447/37963 [6:12:42<144:55:32, 14.29s/it]
  4%|▍         | 1448/37963 [6:12:57<145:05:41, 14.30s/it]
  4%|▍         | 1449/37963 [6:13:11<145:10:18, 14.31s/it]
  4%|▍         | 1450/37963 [6:13:25<145:30:03, 14.35s/it]
                                                          
{'loss': '0.1928', 'grad_norm': '3.167', 'learning_rate': '2e-05', 'epoch': '0.0382'}

  4%|▍         | 1450/37963 [6:13:25<145:30:03, 14.35s/it]
  4%|▍         | 1451/37963 [6:13:53<185:57:03, 18.33s/it]
  4%|▍         | 1452/37963 [6:14:07<173:49:44, 17.14s/it]
  4%|▍         | 1453/37963 [6:14:28<185:18:23, 18.27s/it]
  4%|▍         | 1454/37963 [6:14:43<173:21:17, 17.09s/it]
  4%|▍         | 1455/37963 [6:14:57<165:00:22, 16.27s/it]
  4%|▍         | 1456/37963 [6:15:17<176:30:32, 17.41s/it]
  4%|▍         | 1457/37963 [6:15:38<186:31:20, 18.39s/it]
  4%|▍         | 1458/37963 [6:15:52<174:11:56, 17.18s/it]
  4%|▍         | 1459/37963 [6:16:13<186:02:09, 18.35s/it]
  4%|▍         | 1460/37963 [6:16:34<192:51:25, 19.02s/it]
                                                          
{'loss': '0.1807', 'grad_norm': '2.264', 'learning_rate': '2e-05', 'epoch': '0.03846'}

  4%|▍         | 1460/37963 [6:16:34<192:51:25, 19.02s/it]
  4%|▍         | 1461/37963 [6:16:54<197:44:01, 19.50s/it]
  4%|▍         | 1462/37963 [6:17:09<181:37:22, 17.91s/it]
  4%|▍         | 1463/37963 [6:17:23<171:06:26, 16.88s/it]
  4%|▍         | 1464/37963 [6:17:37<163:26:42, 16.12s/it]
  4%|▍         | 1465/37963 [6:17:52<158:34:31, 15.64s/it]
  4%|▍         | 1466/37963 [6:18:06<153:47:37, 15.17s/it]
  4%|▍         | 1467/37963 [6:18:20<151:24:29, 14.94s/it]
  4%|▍         | 1468/37963 [6:18:35<149:37:43, 14.76s/it]
  4%|▍         | 1469/37963 [6:18:49<148:33:57, 14.66s/it]
  4%|▍         | 1470/37963 [6:19:04<147:34:04, 14.56s/it]
                                                          
{'loss': '0.1756', 'grad_norm': '2.61', 'learning_rate': '2e-05', 'epoch': '0.03872'}

  4%|▍         | 1470/37963 [6:19:04<147:34:04, 14.56s/it]
  4%|▍         | 1471/37963 [6:19:18<146:04:46, 14.41s/it]
  4%|▍         | 1472/37963 [6:19:32<145:26:40, 14.35s/it]
  4%|▍         | 1473/37963 [6:19:46<145:24:48, 14.35s/it]
  4%|▍         | 1474/37963 [6:20:01<145:34:35, 14.36s/it]
  4%|▍         | 1475/37963 [6:20:15<145:40:21, 14.37s/it]
  4%|▍         | 1476/37963 [6:20:29<145:53:57, 14.40s/it]
  4%|▍         | 1477/37963 [6:20:44<145:53:44, 14.40s/it]
  4%|▍         | 1478/37963 [6:20:58<145:56:51, 14.40s/it]
  4%|▍         | 1479/37963 [6:21:12<145:20:31, 14.34s/it]
  4%|▍         | 1480/37963 [6:21:27<145:50:01, 14.39s/it]
                                                          
{'loss': '0.1814', 'grad_norm': '3.859', 'learning_rate': '2e-05', 'epoch': '0.03899'}

  4%|▍         | 1480/37963 [6:21:27<145:50:01, 14.39s/it]
  4%|▍         | 1481/37963 [6:21:41<145:47:09, 14.39s/it]
  4%|▍         | 1482/37963 [6:21:56<145:41:06, 14.38s/it]
  4%|▍         | 1483/37963 [6:22:10<146:09:06, 14.42s/it]
  4%|▍         | 1484/37963 [6:22:25<145:53:02, 14.40s/it]
  4%|▍         | 1485/37963 [6:22:39<145:57:09, 14.40s/it]
  4%|▍         | 1486/37963 [6:22:53<145:27:43, 14.36s/it]
  4%|▍         | 1487/37963 [6:23:08<145:30:09, 14.36s/it]
  4%|▍         | 1488/37963 [6:23:22<145:46:34, 14.39s/it]
  4%|▍         | 1489/37963 [6:23:36<146:06:17, 14.42s/it]
  4%|▍         | 1490/37963 [6:23:51<145:11:22, 14.33s/it]
                                                          
{'loss': '0.182', 'grad_norm': '5.253', 'learning_rate': '2e-05', 'epoch': '0.03925'}

  4%|▍         | 1490/37963 [6:23:51<145:11:22, 14.33s/it]
  4%|▍         | 1491/37963 [6:24:05<145:31:44, 14.36s/it]
  4%|▍         | 1492/37963 [6:24:19<145:18:09, 14.34s/it]
  4%|▍         | 1493/37963 [6:24:34<144:53:02, 14.30s/it]
  4%|▍         | 1494/37963 [6:24:47<143:01:30, 14.12s/it]
  4%|▍         | 1495/37963 [6:25:01<143:07:20, 14.13s/it]
  4%|▍         | 1496/37963 [6:25:16<143:38:41, 14.18s/it]
  4%|▍         | 1497/37963 [6:25:37<164:20:24, 16.22s/it]
  4%|▍         | 1498/37963 [6:25:51<158:38:48, 15.66s/it]
  4%|▍         | 1499/37963 [6:26:12<174:03:26, 17.18s/it]
  4%|▍         | 1500/37963 [6:26:26<165:45:30, 16.37s/it]
                                                          
{'loss': '0.1728', 'grad_norm': '1.477', 'learning_rate': '2e-05', 'epoch': '0.03951'}

  4%|▍         | 1500/37963 [6:26:26<165:45:30, 16.37s/it]
  4%|▍         | 1501/37963 [6:26:41<159:46:59, 15.78s/it]
  4%|▍         | 1502/37963 [6:26:55<155:34:44, 15.36s/it]
  4%|▍         | 1503/37963 [6:27:09<151:25:04, 14.95s/it]
  4%|▍         | 1504/37963 [6:27:31<171:43:49, 16.96s/it]
  4%|▍         | 1505/37963 [6:27:51<181:39:26, 17.94s/it]
  4%|▍         | 1506/37963 [6:28:11<188:16:12, 18.59s/it]
  4%|▍         | 1507/37963 [6:28:25<175:16:20, 17.31s/it]
  4%|▍         | 1508/37963 [6:28:46<186:21:00, 18.40s/it]
  4%|▍         | 1509/37963 [6:29:00<172:28:30, 17.03s/it]
  4%|▍         | 1510/37963 [6:29:21<183:34:37, 18.13s/it]
                                                          
{'loss': '0.1693', 'grad_norm': '5.539', 'learning_rate': '2e-05', 'epoch': '0.03978'}

  4%|▍         | 1510/37963 [6:29:21<183:34:37, 18.13s/it]
  4%|▍         | 1511/37963 [6:29:41<190:43:19, 18.84s/it]
  4%|▍         | 1512/37963 [6:29:56<176:53:20, 17.47s/it]
  4%|▍         | 1513/37963 [6:30:10<166:58:47, 16.49s/it]
  4%|▍         | 1514/37963 [6:30:24<160:35:14, 15.86s/it]
  4%|▍         | 1515/37963 [6:30:38<154:33:34, 15.27s/it]
  4%|▍         | 1516/37963 [6:30:52<152:05:45, 15.02s/it]
  4%|▍         | 1517/37963 [6:31:07<150:06:19, 14.83s/it]
  4%|▍         | 1518/37963 [6:31:22<150:00:18, 14.82s/it]
  4%|▍         | 1519/37963 [6:31:36<148:23:43, 14.66s/it]
  4%|▍         | 1520/37963 [6:31:50<147:18:28, 14.55s/it]
                                                          
{'loss': '0.1684', 'grad_norm': '1.477', 'learning_rate': '1.999e-05', 'epoch': '0.04004'}

  4%|▍         | 1520/37963 [6:31:50<147:18:28, 14.55s/it]
  4%|▍         | 1521/37963 [6:32:05<146:41:21, 14.49s/it]
  4%|▍         | 1522/37963 [6:32:18<144:29:52, 14.27s/it]
  4%|▍         | 1523/37963 [6:32:32<143:33:52, 14.18s/it]
  4%|▍         | 1524/37963 [6:32:47<144:02:11, 14.23s/it]
  4%|▍         | 1525/37963 [6:33:01<144:19:06, 14.26s/it]
  4%|▍         | 1526/37963 [6:33:15<144:45:43, 14.30s/it]
  4%|▍         | 1527/37963 [6:33:30<145:05:24, 14.34s/it]
  4%|▍         | 1528/37963 [6:33:44<144:05:08, 14.24s/it]
  4%|▍         | 1529/37963 [6:33:58<143:46:10, 14.21s/it]
  4%|▍         | 1530/37963 [6:34:12<143:55:58, 14.22s/it]
                                                          
{'loss': '0.1679', 'grad_norm': '4.749', 'learning_rate': '1.999e-05', 'epoch': '0.0403'}

  4%|▍         | 1530/37963 [6:34:12<143:55:58, 14.22s/it]
  4%|▍         | 1531/37963 [6:34:27<144:25:40, 14.27s/it]
  4%|▍         | 1532/37963 [6:34:41<145:05:43, 14.34s/it]
  4%|▍         | 1533/37963 [6:34:55<145:11:51, 14.35s/it]
  4%|▍         | 1534/37963 [6:35:10<145:38:34, 14.39s/it]
  4%|▍         | 1535/37963 [6:35:24<145:20:59, 14.36s/it]
  4%|▍         | 1536/37963 [6:35:39<145:57:35, 14.42s/it]
  4%|▍         | 1537/37963 [6:35:53<145:39:41, 14.40s/it]
  4%|▍         | 1538/37963 [6:36:08<145:41:52, 14.40s/it]
  4%|▍         | 1539/37963 [6:36:22<145:19:13, 14.36s/it]
  4%|▍         | 1540/37963 [6:36:36<145:55:23, 14.42s/it]
                                                          
{'loss': '0.1977', 'grad_norm': '5.831', 'learning_rate': '1.999e-05', 'epoch': '0.04057'}

  4%|▍         | 1540/37963 [6:36:36<145:55:23, 14.42s/it]
  4%|▍         | 1541/37963 [6:36:51<146:11:04, 14.45s/it]
  4%|▍         | 1542/37963 [6:37:05<143:51:00, 14.22s/it]
  4%|▍         | 1543/37963 [6:37:18<142:21:14, 14.07s/it]
  4%|▍         | 1544/37963 [6:37:32<142:19:51, 14.07s/it]
  4%|▍         | 1545/37963 [6:37:46<140:29:32, 13.89s/it]
  4%|▍         | 1546/37963 [6:38:00<142:10:11, 14.05s/it]
  4%|▍         | 1547/37963 [6:38:15<143:04:31, 14.14s/it]
  4%|▍         | 1548/37963 [6:38:35<163:12:38, 16.14s/it]
  4%|▍         | 1549/37963 [6:38:57<178:24:12, 17.64s/it]
  4%|▍         | 1550/37963 [6:39:11<167:40:35, 16.58s/it]
                                                          
{'loss': '0.1911', 'grad_norm': '4.105', 'learning_rate': '1.999e-05', 'epoch': '0.04083'}

  4%|▍         | 1550/37963 [6:39:11<167:40:35, 16.58s/it]
  4%|▍         | 1551/37963 [6:39:25<160:50:52, 15.90s/it]
  4%|▍         | 1552/37963 [6:39:39<156:06:33, 15.43s/it]
  4%|▍         | 1553/37963 [6:40:01<174:23:25, 17.24s/it]
  4%|▍         | 1554/37963 [6:40:27<201:48:27, 19.95s/it]
  4%|▍         | 1555/37963 [6:40:41<184:29:42, 18.24s/it]
  4%|▍         | 1556/37963 [6:41:03<194:09:07, 19.20s/it]
  4%|▍         | 1557/37963 [6:41:17<178:27:03, 17.65s/it]
  4%|▍         | 1558/37963 [6:41:31<167:12:53, 16.54s/it]
  4%|▍         | 1559/37963 [6:41:58<200:15:52, 19.80s/it]
  4%|▍         | 1560/37963 [6:42:13<183:43:42, 18.17s/it]
                                                          
{'loss': '0.1658', 'grad_norm': '4.796', 'learning_rate': '1.999e-05', 'epoch': '0.04109'}

  4%|▍         | 1560/37963 [6:42:13<183:43:42, 18.17s/it]
  4%|▍         | 1561/37963 [6:42:27<171:34:17, 16.97s/it]
  4%|▍         | 1562/37963 [6:42:41<163:47:17, 16.20s/it]
  4%|▍         | 1563/37963 [6:42:55<158:04:12, 15.63s/it]
  4%|▍         | 1564/37963 [6:43:10<154:08:07, 15.24s/it]
  4%|▍         | 1565/37963 [6:43:24<151:35:46, 14.99s/it]
  4%|▍         | 1566/37963 [6:43:39<149:44:35, 14.81s/it]
  4%|▍         | 1567/37963 [6:43:53<148:20:43, 14.67s/it]
  4%|▍         | 1568/37963 [6:44:07<147:39:21, 14.61s/it]
  4%|▍         | 1569/37963 [6:44:22<147:01:15, 14.54s/it]
  4%|▍         | 1570/37963 [6:44:36<145:19:51, 14.38s/it]
                                                          
{'loss': '0.1803', 'grad_norm': '7.825', 'learning_rate': '1.999e-05', 'epoch': '0.04136'}

  4%|▍         | 1570/37963 [6:44:36<145:19:51, 14.38s/it]
  4%|▍         | 1571/37963 [6:44:50<145:08:34, 14.36s/it]
  4%|▍         | 1572/37963 [6:45:04<145:14:43, 14.37s/it]
  4%|▍         | 1573/37963 [6:45:19<145:25:46, 14.39s/it]
  4%|▍         | 1574/37963 [6:45:33<145:14:43, 14.37s/it]
  4%|▍         | 1575/37963 [6:45:47<143:45:25, 14.22s/it]
  4%|▍         | 1576/37963 [6:46:01<143:54:58, 14.24s/it]
  4%|▍         | 1577/37963 [6:46:16<144:00:57, 14.25s/it]
  4%|▍         | 1578/37963 [6:46:30<143:36:06, 14.21s/it]
  4%|▍         | 1579/37963 [6:46:44<144:01:08, 14.25s/it]
  4%|▍         | 1580/37963 [6:46:58<144:14:57, 14.27s/it]
                                                          
{'loss': '0.1761', 'grad_norm': '2.674', 'learning_rate': '1.999e-05', 'epoch': '0.04162'}

  4%|▍         | 1580/37963 [6:46:58<144:14:57, 14.27s/it]
  4%|▍         | 1581/37963 [6:47:12<143:28:34, 14.20s/it]
  4%|▍         | 1582/37963 [6:47:26<142:38:23, 14.11s/it]
  4%|▍         | 1583/37963 [6:47:40<141:45:51, 14.03s/it]
  4%|▍         | 1584/37963 [6:47:55<142:40:57, 14.12s/it]
  4%|▍         | 1585/37963 [6:48:08<141:15:56, 13.98s/it]
  4%|▍         | 1586/37963 [6:48:22<141:39:22, 14.02s/it]
  4%|▍         | 1587/37963 [6:48:37<142:54:35, 14.14s/it]
  4%|▍         | 1588/37963 [6:48:51<143:22:41, 14.19s/it]
  4%|▍         | 1589/37963 [6:49:05<143:48:17, 14.23s/it]
  4%|▍         | 1590/37963 [6:49:20<144:09:37, 14.27s/it]
                                                          
{'loss': '0.1784', 'grad_norm': '2.194', 'learning_rate': '1.999e-05', 'epoch': '0.04188'}

  4%|▍         | 1590/37963 [6:49:20<144:09:37, 14.27s/it]
  4%|▍         | 1591/37963 [6:49:34<144:25:33, 14.29s/it]
  4%|▍         | 1592/37963 [6:49:48<144:27:23, 14.30s/it]
  4%|▍         | 1593/37963 [6:50:02<143:31:49, 14.21s/it]
  4%|▍         | 1594/37963 [6:50:17<143:57:04, 14.25s/it]
  4%|▍         | 1595/37963 [6:50:31<144:13:14, 14.28s/it]
  4%|▍         | 1596/37963 [6:50:45<144:29:31, 14.30s/it]
  4%|▍         | 1597/37963 [6:51:06<163:43:24, 16.21s/it]
  4%|▍         | 1598/37963 [6:51:20<157:45:13, 15.62s/it]
  4%|▍         | 1599/37963 [6:51:42<174:48:30, 17.31s/it]
  4%|▍         | 1600/37963 [6:51:55<163:09:34, 16.15s/it]
                                                          
{'loss': '0.1917', 'grad_norm': '2.442', 'learning_rate': '1.999e-05', 'epoch': '0.04215'}

  4%|▍         | 1600/37963 [6:51:55<163:09:34, 16.15s/it]
  4%|▍         | 1601/37963 [6:52:09<157:29:43, 15.59s/it]
  4%|▍         | 1602/37963 [6:52:31<175:34:00, 17.38s/it]
  4%|▍         | 1603/37963 [6:52:45<166:01:25, 16.44s/it]
  4%|▍         | 1604/37963 [6:53:19<219:08:00, 21.70s/it]
  4%|▍         | 1605/37963 [6:53:33<196:57:47, 19.50s/it]
  4%|▍         | 1606/37963 [6:53:54<199:26:33, 19.75s/it]
  4%|▍         | 1607/37963 [6:54:08<182:47:56, 18.10s/it]
  4%|▍         | 1608/37963 [6:54:22<171:38:17, 17.00s/it]
  4%|▍         | 1609/37963 [6:54:43<183:04:28, 18.13s/it]
  4%|▍         | 1610/37963 [6:54:58<171:41:32, 17.00s/it]
                                                          
{'loss': '0.1705', 'grad_norm': '7.086', 'learning_rate': '1.999e-05', 'epoch': '0.04241'}

  4%|▍         | 1610/37963 [6:54:58<171:41:32, 17.00s/it]
  4%|▍         | 1611/37963 [6:55:12<163:33:04, 16.20s/it]
  4%|▍         | 1612/37963 [6:55:27<158:44:39, 15.72s/it]
  4%|▍         | 1613/37963 [6:55:41<154:47:24, 15.33s/it]
  4%|▍         | 1614/37963 [6:55:55<151:46:10, 15.03s/it]
  4%|▍         | 1615/37963 [6:56:10<149:37:18, 14.82s/it]
  4%|▍         | 1616/37963 [6:56:24<148:01:32, 14.66s/it]
  4%|▍         | 1617/37963 [6:56:38<146:45:57, 14.54s/it]
  4%|▍         | 1618/37963 [6:56:52<145:41:09, 14.43s/it]
  4%|▍         | 1619/37963 [6:57:07<145:44:34, 14.44s/it]
  4%|▍         | 1620/37963 [6:57:21<145:21:56, 14.40s/it]
                                                          
{'loss': '0.1792', 'grad_norm': '6.226', 'learning_rate': '1.999e-05', 'epoch': '0.04267'}

  4%|▍         | 1620/37963 [6:57:21<145:21:56, 14.40s/it]
  4%|▍         | 1621/37963 [6:57:35<145:10:22, 14.38s/it]
  4%|▍         | 1622/37963 [6:57:50<144:58:48, 14.36s/it]
  4%|▍         | 1623/37963 [6:58:04<143:46:51, 14.24s/it]
  4%|▍         | 1624/37963 [6:58:18<144:29:24, 14.31s/it]
  4%|▍         | 1625/37963 [6:58:32<144:00:59, 14.27s/it]
  4%|▍         | 1626/37963 [6:58:47<144:02:15, 14.27s/it]
  4%|▍         | 1627/37963 [6:59:01<144:10:00, 14.28s/it]
  4%|▍         | 1628/37963 [6:59:15<142:45:32, 14.14s/it]
  4%|▍         | 1629/37963 [6:59:29<143:27:11, 14.21s/it]
  4%|▍         | 1630/37963 [6:59:43<142:51:51, 14.16s/it]
                                                          
{'loss': '0.1643', 'grad_norm': '2.649', 'learning_rate': '1.999e-05', 'epoch': '0.04294'}

  4%|▍         | 1630/37963 [6:59:43<142:51:51, 14.16s/it]
  4%|▍         | 1631/37963 [6:59:58<143:34:57, 14.23s/it]
  4%|▍         | 1632/37963 [7:00:12<144:29:28, 14.32s/it]
  4%|▍         | 1633/37963 [7:00:26<144:33:13, 14.32s/it]
  4%|▍         | 1634/37963 [7:00:41<144:39:52, 14.34s/it]
  4%|▍         | 1635/37963 [7:00:55<143:43:20, 14.24s/it]
  4%|▍         | 1636/37963 [7:01:09<144:12:37, 14.29s/it]
  4%|▍         | 1637/37963 [7:01:24<144:33:43, 14.33s/it]
  4%|▍         | 1638/37963 [7:01:38<143:25:32, 14.21s/it]
  4%|▍         | 1639/37963 [7:01:52<144:00:35, 14.27s/it]
  4%|▍         | 1640/37963 [7:02:06<144:06:15, 14.28s/it]
                                                          
{'loss': '0.1851', 'grad_norm': '5.358', 'learning_rate': '1.999e-05', 'epoch': '0.0432'}

  4%|▍         | 1640/37963 [7:02:06<144:06:15, 14.28s/it]
  4%|▍         | 1641/37963 [7:02:21<144:11:26, 14.29s/it]
  4%|▍         | 1642/37963 [7:02:35<144:07:31, 14.29s/it]
  4%|▍         | 1643/37963 [7:02:48<141:42:49, 14.05s/it]
  4%|▍         | 1644/37963 [7:03:03<142:29:07, 14.12s/it]
  4%|▍         | 1645/37963 [7:03:23<161:33:50, 16.01s/it]
  4%|▍         | 1646/37963 [7:03:37<156:25:58, 15.51s/it]
  4%|▍         | 1647/37963 [7:03:52<153:07:48, 15.18s/it]
  4%|▍         | 1648/37963 [7:04:05<148:30:25, 14.72s/it]
  4%|▍         | 1649/37963 [7:04:20<147:31:30, 14.62s/it]
  4%|▍         | 1650/37963 [7:04:41<167:01:45, 16.56s/it]
                                                          
{'loss': '0.1697', 'grad_norm': '1.996', 'learning_rate': '1.999e-05', 'epoch': '0.04346'}

  4%|▍         | 1650/37963 [7:04:41<167:01:45, 16.56s/it]
  4%|▍         | 1651/37963 [7:05:03<182:27:27, 18.09s/it]
  4%|▍         | 1652/37963 [7:05:29<206:59:25, 20.52s/it]
  4%|▍         | 1653/37963 [7:05:43<189:22:46, 18.78s/it]
  4%|▍         | 1654/37963 [7:06:05<196:40:21, 19.50s/it]
  4%|▍         | 1655/37963 [7:06:26<201:04:51, 19.94s/it]
  4%|▍         | 1656/37963 [7:06:40<184:34:17, 18.30s/it]
  4%|▍         | 1657/37963 [7:06:54<172:25:36, 17.10s/it]
  4%|▍         | 1658/37963 [7:07:09<164:40:21, 16.33s/it]
  4%|▍         | 1659/37963 [7:07:30<177:55:32, 17.64s/it]
  4%|▍         | 1660/37963 [7:07:44<167:52:45, 16.65s/it]
                                                          
{'loss': '0.1975', 'grad_norm': '4.116', 'learning_rate': '1.999e-05', 'epoch': '0.04373'}

  4%|▍         | 1660/37963 [7:07:44<167:52:45, 16.65s/it]
  4%|▍         | 1661/37963 [7:07:58<161:04:40, 15.97s/it]
  4%|▍         | 1662/37963 [7:08:12<155:04:15, 15.38s/it]
  4%|▍         | 1663/37963 [7:08:27<152:07:33, 15.09s/it]
  4%|▍         | 1664/37963 [7:08:41<148:11:38, 14.70s/it]
  4%|▍         | 1665/37963 [7:08:55<146:58:38, 14.58s/it]
  4%|▍         | 1666/37963 [7:09:09<146:04:31, 14.49s/it]
  4%|▍         | 1667/37963 [7:09:24<145:56:16, 14.47s/it]
  4%|▍         | 1668/37963 [7:09:37<143:54:29, 14.27s/it]
  4%|▍         | 1669/37963 [7:09:52<144:34:50, 14.34s/it]
  4%|▍         | 1670/37963 [7:10:06<144:38:23, 14.35s/it]
                                                          
{'loss': '0.1948', 'grad_norm': '4.736', 'learning_rate': '1.999e-05', 'epoch': '0.04399'}

  4%|▍         | 1670/37963 [7:10:06<144:38:23, 14.35s/it]
  4%|▍         | 1671/37963 [7:10:21<144:55:15, 14.38s/it]
  4%|▍         | 1672/37963 [7:10:35<144:46:31, 14.36s/it]
  4%|▍         | 1673/37963 [7:10:49<144:19:48, 14.32s/it]
  4%|▍         | 1674/37963 [7:11:04<144:24:03, 14.33s/it]
  4%|▍         | 1675/37963 [7:11:18<143:33:28, 14.24s/it]
  4%|▍         | 1676/37963 [7:11:32<144:17:04, 14.31s/it]
  4%|▍         | 1677/37963 [7:11:46<143:59:42, 14.29s/it]
  4%|▍         | 1678/37963 [7:12:00<143:36:02, 14.25s/it]
  4%|▍         | 1679/37963 [7:12:15<144:00:23, 14.29s/it]
  4%|▍         | 1680/37963 [7:12:29<144:23:21, 14.33s/it]
                                                          
{'loss': '0.1731', 'grad_norm': '1.445', 'learning_rate': '1.999e-05', 'epoch': '0.04425'}

  4%|▍         | 1680/37963 [7:12:29<144:23:21, 14.33s/it]
  4%|▍         | 1681/37963 [7:12:44<144:56:51, 14.38s/it]
  4%|▍         | 1682/37963 [7:12:58<144:47:33, 14.37s/it]
  4%|▍         | 1683/37963 [7:13:12<144:32:20, 14.34s/it]
  4%|▍         | 1684/37963 [7:13:27<143:55:13, 14.28s/it]
  4%|▍         | 1685/37963 [7:13:41<144:29:56, 14.34s/it]
  4%|▍         | 1686/37963 [7:13:55<144:37:06, 14.35s/it]
  4%|▍         | 1687/37963 [7:14:10<144:42:36, 14.36s/it]
  4%|▍         | 1688/37963 [7:14:24<144:29:17, 14.34s/it]
  4%|▍         | 1689/37963 [7:14:39<144:49:34, 14.37s/it]
  4%|▍         | 1690/37963 [7:14:53<144:50:03, 14.37s/it]
                                                          
{'loss': '0.1766', 'grad_norm': '3.506', 'learning_rate': '1.999e-05', 'epoch': '0.04452'}

  4%|▍         | 1690/37963 [7:14:53<144:50:03, 14.37s/it]
  4%|▍         | 1691/37963 [7:15:07<144:07:39, 14.30s/it]
  4%|▍         | 1692/37963 [7:15:21<144:00:24, 14.29s/it]
  4%|▍         | 1693/37963 [7:15:36<143:58:44, 14.29s/it]
  4%|▍         | 1694/37963 [7:15:56<163:13:16, 16.20s/it]
  4%|▍         | 1695/37963 [7:16:11<157:26:20, 15.63s/it]
  4%|▍         | 1696/37963 [7:16:25<153:22:56, 15.23s/it]
  4%|▍         | 1697/37963 [7:16:39<150:34:36, 14.95s/it]
  4%|▍         | 1698/37963 [7:16:53<146:42:43, 14.56s/it]
  4%|▍         | 1699/37963 [7:17:21<189:11:17, 18.78s/it]
  4%|▍         | 1700/37963 [7:17:36<175:27:45, 17.42s/it]
                                                          
{'loss': '0.1884', 'grad_norm': '1.611', 'learning_rate': '1.999e-05', 'epoch': '0.04478'}

  4%|▍         | 1700/37963 [7:17:36<175:27:45, 17.42s/it]
  4%|▍         | 1701/37963 [7:17:56<185:46:19, 18.44s/it]
  4%|▍         | 1702/37963 [7:18:17<193:14:46, 19.19s/it]
  4%|▍         | 1703/37963 [7:18:39<200:24:45, 19.90s/it]
  4%|▍         | 1704/37963 [7:18:53<183:45:44, 18.24s/it]
  4%|▍         | 1705/37963 [7:19:14<191:14:16, 18.99s/it]
  4%|▍         | 1706/37963 [7:19:28<177:14:29, 17.60s/it]
  4%|▍         | 1707/37963 [7:19:49<185:44:37, 18.44s/it]
  4%|▍         | 1708/37963 [7:20:03<172:31:57, 17.13s/it]
  5%|▍         | 1709/37963 [7:20:17<163:58:02, 16.28s/it]
  5%|▍         | 1710/37963 [7:20:31<157:34:19, 15.65s/it]
                                                          
{'loss': '0.1861', 'grad_norm': '4.304', 'learning_rate': '1.999e-05', 'epoch': '0.04504'}

  5%|▍         | 1710/37963 [7:20:31<157:34:19, 15.65s/it]
  5%|▍         | 1711/37963 [7:20:46<153:48:44, 15.27s/it]
  5%|▍         | 1712/37963 [7:21:00<150:23:00, 14.93s/it]
  5%|▍         | 1713/37963 [7:21:14<148:25:55, 14.74s/it]
  5%|▍         | 1714/37963 [7:21:29<147:40:51, 14.67s/it]
  5%|▍         | 1715/37963 [7:21:43<147:32:58, 14.65s/it]
  5%|▍         | 1716/37963 [7:21:58<146:25:25, 14.54s/it]
  5%|▍         | 1717/37963 [7:22:11<144:12:28, 14.32s/it]
  5%|▍         | 1718/37963 [7:22:26<144:13:36, 14.33s/it]
  5%|▍         | 1719/37963 [7:22:40<144:04:54, 14.31s/it]
  5%|▍         | 1720/37963 [7:22:54<144:20:27, 14.34s/it]
                                                          
{'loss': '0.1829', 'grad_norm': '2.428', 'learning_rate': '1.999e-05', 'epoch': '0.04531'}

  5%|▍         | 1720/37963 [7:22:54<144:20:27, 14.34s/it]
  5%|▍         | 1721/37963 [7:23:08<142:42:52, 14.18s/it]
  5%|▍         | 1722/37963 [7:23:23<143:28:37, 14.25s/it]
  5%|▍         | 1723/37963 [7:23:37<144:04:08, 14.31s/it]
  5%|▍         | 1724/37963 [7:23:52<144:32:41, 14.36s/it]
  5%|▍         | 1725/37963 [7:24:06<144:30:03, 14.36s/it]
  5%|▍         | 1726/37963 [7:24:19<141:32:00, 14.06s/it]
  5%|▍         | 1727/37963 [7:24:34<142:45:15, 14.18s/it]
  5%|▍         | 1728/37963 [7:24:48<143:25:41, 14.25s/it]
  5%|▍         | 1729/37963 [7:25:02<142:50:40, 14.19s/it]
  5%|▍         | 1730/37963 [7:25:17<143:30:28, 14.26s/it]
                                                          
{'loss': '0.1882', 'grad_norm': '4.615', 'learning_rate': '1.999e-05', 'epoch': '0.04557'}

  5%|▍         | 1730/37963 [7:25:17<143:30:28, 14.26s/it]
  5%|▍         | 1731/37963 [7:25:31<143:46:01, 14.28s/it]
  5%|▍         | 1732/37963 [7:25:45<144:22:16, 14.35s/it]
  5%|▍         | 1733/37963 [7:26:00<144:20:31, 14.34s/it]
  5%|▍         | 1734/37963 [7:26:14<145:02:52, 14.41s/it]
  5%|▍         | 1735/37963 [7:26:29<144:44:34, 14.38s/it]
  5%|▍         | 1736/37963 [7:26:43<144:35:46, 14.37s/it]
  5%|▍         | 1737/37963 [7:26:57<144:38:09, 14.37s/it]
  5%|▍         | 1738/37963 [7:27:11<142:57:19, 14.21s/it]
  5%|▍         | 1739/37963 [7:27:26<143:16:33, 14.24s/it]
  5%|▍         | 1740/37963 [7:27:40<143:41:37, 14.28s/it]
                                                          
{'loss': '0.1788', 'grad_norm': '4.299', 'learning_rate': '1.999e-05', 'epoch': '0.04583'}

  5%|▍         | 1740/37963 [7:27:40<143:41:37, 14.28s/it]
  5%|▍         | 1741/37963 [7:27:54<143:56:57, 14.31s/it]
  5%|▍         | 1742/37963 [7:28:09<144:04:35, 14.32s/it]
  5%|▍         | 1743/37963 [7:28:29<161:34:54, 16.06s/it]
  5%|▍         | 1744/37963 [7:28:43<156:46:18, 15.58s/it]
  5%|▍         | 1745/37963 [7:28:58<153:11:44, 15.23s/it]
  5%|▍         | 1746/37963 [7:29:12<150:51:11, 14.99s/it]
  5%|▍         | 1747/37963 [7:29:33<169:53:41, 16.89s/it]
  5%|▍         | 1748/37963 [7:29:55<183:49:57, 18.27s/it]
  5%|▍         | 1749/37963 [7:30:09<172:01:46, 17.10s/it]
  5%|▍         | 1750/37963 [7:30:30<182:22:00, 18.13s/it]
                                                          
{'loss': '0.1828', 'grad_norm': '1.747', 'learning_rate': '1.999e-05', 'epoch': '0.0461'}

  5%|▍         | 1750/37963 [7:30:30<182:22:00, 18.13s/it]
  5%|▍         | 1751/37963 [7:30:50<189:38:40, 18.85s/it]
  5%|▍         | 1752/37963 [7:31:12<199:27:21, 19.83s/it]
  5%|▍         | 1753/37963 [7:31:33<200:18:01, 19.91s/it]
  5%|▍         | 1754/37963 [7:31:47<183:43:48, 18.27s/it]
  5%|▍         | 1755/37963 [7:32:01<171:50:07, 17.08s/it]
  5%|▍         | 1756/37963 [7:32:15<162:24:47, 16.15s/it]
  5%|▍         | 1757/37963 [7:32:30<157:04:24, 15.62s/it]
  5%|▍         | 1758/37963 [7:32:51<173:21:56, 17.24s/it]
  5%|▍         | 1759/37963 [7:33:05<164:55:51, 16.40s/it]
  5%|▍         | 1760/37963 [7:33:19<158:13:13, 15.73s/it]
                                                          
{'loss': '0.1763', 'grad_norm': '2.704', 'learning_rate': '1.999e-05', 'epoch': '0.04636'}

  5%|▍         | 1760/37963 [7:33:19<158:13:13, 15.73s/it]
  5%|▍         | 1761/37963 [7:33:33<152:57:26, 15.21s/it]
  5%|▍         | 1762/37963 [7:33:48<150:33:26, 14.97s/it]
  5%|▍         | 1763/37963 [7:34:02<148:33:19, 14.77s/it]
  5%|▍         | 1764/37963 [7:34:17<147:40:58, 14.69s/it]
  5%|▍         | 1765/37963 [7:34:31<146:53:44, 14.61s/it]
  5%|▍         | 1766/37963 [7:34:45<144:42:17, 14.39s/it]
  5%|▍         | 1767/37963 [7:34:59<144:10:56, 14.34s/it]
  5%|▍         | 1768/37963 [7:35:13<144:20:43, 14.36s/it]
  5%|▍         | 1769/37963 [7:35:28<144:52:44, 14.41s/it]
  5%|▍         | 1770/37963 [7:35:42<143:00:27, 14.22s/it]
                                                          
{'loss': '0.1833', 'grad_norm': '1.316', 'learning_rate': '1.999e-05', 'epoch': '0.04662'}

  5%|▍         | 1770/37963 [7:35:42<143:00:27, 14.22s/it]
  5%|▍         | 1771/37963 [7:35:55<140:53:55, 14.02s/it]
  5%|▍         | 1772/37963 [7:36:10<141:47:10, 14.10s/it]
  5%|▍         | 1773/37963 [7:36:24<142:23:44, 14.16s/it]
  5%|▍         | 1774/37963 [7:36:38<143:09:51, 14.24s/it]
  5%|▍         | 1775/37963 [7:36:53<143:22:01, 14.26s/it]
  5%|▍         | 1776/37963 [7:37:07<143:40:30, 14.29s/it]
  5%|▍         | 1777/37963 [7:37:21<143:01:08, 14.23s/it]
  5%|▍         | 1778/37963 [7:37:35<143:25:23, 14.27s/it]
  5%|▍         | 1779/37963 [7:37:50<142:49:24, 14.21s/it]
  5%|▍         | 1780/37963 [7:38:04<142:54:43, 14.22s/it]
                                                          
{'loss': '0.1801', 'grad_norm': '2.905', 'learning_rate': '1.999e-05', 'epoch': '0.04689'}

  5%|▍         | 1780/37963 [7:38:04<142:54:43, 14.22s/it]
  5%|▍         | 1781/37963 [7:38:18<143:19:20, 14.26s/it]
  5%|▍         | 1782/37963 [7:38:32<143:33:41, 14.28s/it]
  5%|▍         | 1783/37963 [7:38:47<143:38:25, 14.29s/it]
  5%|▍         | 1784/37963 [7:39:01<144:00:03, 14.33s/it]
  5%|▍         | 1785/37963 [7:39:16<144:10:08, 14.35s/it]
  5%|▍         | 1786/37963 [7:39:29<142:30:56, 14.18s/it]
  5%|▍         | 1787/37963 [7:39:43<141:29:33, 14.08s/it]
  5%|▍         | 1788/37963 [7:39:57<139:50:00, 13.92s/it]
  5%|▍         | 1789/37963 [7:40:11<140:46:54, 14.01s/it]
  5%|▍         | 1790/37963 [7:40:25<140:19:06, 13.96s/it]
                                                          
{'loss': '0.1691', 'grad_norm': '2.592', 'learning_rate': '1.998e-05', 'epoch': '0.04715'}

  5%|▍         | 1790/37963 [7:40:25<140:19:06, 13.96s/it]
  5%|▍         | 1791/37963 [7:40:46<160:55:44, 16.02s/it]
  5%|▍         | 1792/37963 [7:41:00<156:03:36, 15.53s/it]
  5%|▍         | 1793/37963 [7:41:14<152:24:08, 15.17s/it]
  5%|▍         | 1794/37963 [7:41:35<169:17:20, 16.85s/it]
  5%|▍         | 1795/37963 [7:41:49<161:46:59, 16.10s/it]
  5%|▍         | 1796/37963 [7:42:11<178:17:15, 17.75s/it]
  5%|▍         | 1797/37963 [7:42:26<168:20:21, 16.76s/it]
  5%|▍         | 1798/37963 [7:42:40<161:04:38, 16.03s/it]
  5%|▍         | 1799/37963 [7:43:00<174:10:24, 17.34s/it]
  5%|▍         | 1800/37963 [7:43:21<184:56:48, 18.41s/it]
                                                          
{'loss': '0.1807', 'grad_norm': '4.2', 'learning_rate': '1.998e-05', 'epoch': '0.04741'}

  5%|▍         | 1800/37963 [7:43:21<184:56:48, 18.41s/it]
  5%|▍         | 1801/37963 [7:43:43<194:03:39, 19.32s/it]
  5%|▍         | 1802/37963 [7:44:04<199:40:56, 19.88s/it]
  5%|▍         | 1803/37963 [7:44:18<183:15:53, 18.25s/it]
  5%|▍         | 1804/37963 [7:44:33<171:44:15, 17.10s/it]
  5%|▍         | 1805/37963 [7:44:47<163:33:47, 16.28s/it]
  5%|▍         | 1806/37963 [7:45:01<157:45:39, 15.71s/it]
  5%|▍         | 1807/37963 [7:45:22<172:54:59, 17.22s/it]
  5%|▍         | 1808/37963 [7:45:37<164:44:43, 16.40s/it]
  5%|▍         | 1809/37963 [7:45:51<158:38:50, 15.80s/it]
  5%|▍         | 1810/37963 [7:46:05<153:53:09, 15.32s/it]
                                                          
{'loss': '0.1895', 'grad_norm': '2.511', 'learning_rate': '1.998e-05', 'epoch': '0.04768'}

  5%|▍         | 1810/37963 [7:46:05<153:53:09, 15.32s/it]
  5%|▍         | 1811/37963 [7:46:20<151:08:53, 15.05s/it]
  5%|▍         | 1812/37963 [7:46:34<148:31:32, 14.79s/it]
  5%|▍         | 1813/37963 [7:46:48<147:45:25, 14.71s/it]
  5%|▍         | 1814/37963 [7:47:03<146:36:23, 14.60s/it]
  5%|▍         | 1815/37963 [7:47:17<146:00:22, 14.54s/it]
  5%|▍         | 1816/37963 [7:47:32<145:49:15, 14.52s/it]
  5%|▍         | 1817/37963 [7:47:46<145:18:18, 14.47s/it]
  5%|▍         | 1818/37963 [7:48:00<143:27:09, 14.29s/it]
  5%|▍         | 1819/37963 [7:48:14<144:00:02, 14.34s/it]
  5%|▍         | 1820/37963 [7:48:29<144:07:34, 14.36s/it]
                                                          
{'loss': '0.177', 'grad_norm': '3.277', 'learning_rate': '1.998e-05', 'epoch': '0.04794'}

  5%|▍         | 1820/37963 [7:48:29<144:07:34, 14.36s/it]
  5%|▍         | 1821/37963 [7:48:43<144:05:30, 14.35s/it]
  5%|▍         | 1822/37963 [7:48:57<142:32:55, 14.20s/it]
  5%|▍         | 1823/37963 [7:49:11<142:45:26, 14.22s/it]
  5%|▍         | 1824/37963 [7:49:25<142:42:00, 14.22s/it]
  5%|▍         | 1825/37963 [7:49:40<143:06:08, 14.26s/it]
  5%|▍         | 1826/37963 [7:49:54<143:08:47, 14.26s/it]
  5%|▍         | 1827/37963 [7:50:08<143:33:32, 14.30s/it]
  5%|▍         | 1828/37963 [7:50:23<143:42:19, 14.32s/it]
  5%|▍         | 1829/37963 [7:50:37<143:13:44, 14.27s/it]
  5%|▍         | 1830/37963 [7:50:51<143:25:37, 14.29s/it]
                                                          
{'loss': '0.178', 'grad_norm': '2.43', 'learning_rate': '1.998e-05', 'epoch': '0.0482'}

  5%|▍         | 1830/37963 [7:50:51<143:25:37, 14.29s/it]
  5%|▍         | 1831/37963 [7:51:06<143:46:06, 14.32s/it]
  5%|▍         | 1832/37963 [7:51:20<144:16:38, 14.38s/it]
  5%|▍         | 1833/37963 [7:51:34<144:16:55, 14.38s/it]
  5%|▍         | 1834/37963 [7:51:49<144:02:51, 14.35s/it]
  5%|▍         | 1835/37963 [7:52:03<143:43:19, 14.32s/it]
  5%|▍         | 1836/37963 [7:52:17<143:48:47, 14.33s/it]
  5%|▍         | 1837/37963 [7:52:32<143:52:58, 14.34s/it]
  5%|▍         | 1838/37963 [7:52:52<162:40:44, 16.21s/it]
  5%|▍         | 1839/37963 [7:53:06<155:27:41, 15.49s/it]
  5%|▍         | 1840/37963 [7:53:20<149:42:47, 14.92s/it]
                                                          
{'loss': '0.1756', 'grad_norm': '4.41', 'learning_rate': '1.998e-05', 'epoch': '0.04847'}

  5%|▍         | 1840/37963 [7:53:20<149:42:47, 14.92s/it]
  5%|▍         | 1841/37963 [7:53:34<147:58:47, 14.75s/it]
  5%|▍         | 1842/37963 [7:53:55<167:17:25, 16.67s/it]
  5%|▍         | 1843/37963 [7:54:09<159:13:13, 15.87s/it]
  5%|▍         | 1844/37963 [7:54:31<176:14:52, 17.57s/it]
  5%|▍         | 1845/37963 [7:54:45<167:05:49, 16.66s/it]
  5%|▍         | 1846/37963 [7:55:00<160:09:50, 15.96s/it]
  5%|▍         | 1847/37963 [7:55:20<174:49:11, 17.43s/it]
  5%|▍         | 1848/37963 [7:55:35<165:27:41, 16.49s/it]
  5%|▍         | 1849/37963 [7:55:56<178:22:23, 17.78s/it]
  5%|▍         | 1850/37963 [7:56:17<188:28:40, 18.79s/it]
                                                          
{'loss': '0.1831', 'grad_norm': '1.451', 'learning_rate': '1.998e-05', 'epoch': '0.04873'}

  5%|▍         | 1850/37963 [7:56:17<188:28:40, 18.79s/it]
  5%|▍         | 1851/37963 [7:56:31<175:57:57, 17.54s/it]
  5%|▍         | 1852/37963 [7:56:46<166:25:28, 16.59s/it]
  5%|▍         | 1853/37963 [7:57:00<159:00:55, 15.85s/it]
  5%|▍         | 1854/37963 [7:57:20<171:39:11, 17.11s/it]
  5%|▍         | 1855/37963 [7:57:41<182:24:37, 18.19s/it]
  5%|▍         | 1856/37963 [7:57:55<170:18:20, 16.98s/it]
  5%|▍         | 1857/37963 [7:58:09<162:07:18, 16.16s/it]
  5%|▍         | 1858/37963 [7:58:23<156:57:16, 15.65s/it]
  5%|▍         | 1859/37963 [7:58:38<152:21:12, 15.19s/it]
  5%|▍         | 1860/37963 [7:58:52<149:44:22, 14.93s/it]
                                                          
{'loss': '0.1646', 'grad_norm': '1.626', 'learning_rate': '1.998e-05', 'epoch': '0.049'}

  5%|▍         | 1860/37963 [7:58:52<149:44:22, 14.93s/it]
  5%|▍         | 1861/37963 [7:59:06<148:22:33, 14.80s/it]
  5%|▍         | 1862/37963 [7:59:20<145:58:18, 14.56s/it]
  5%|▍         | 1863/37963 [7:59:34<144:06:25, 14.37s/it]
  5%|▍         | 1864/37963 [7:59:49<144:02:58, 14.37s/it]
  5%|▍         | 1865/37963 [8:00:03<144:04:03, 14.37s/it]
  5%|▍         | 1866/37963 [8:00:17<143:28:39, 14.31s/it]
  5%|▍         | 1867/37963 [8:00:31<143:08:33, 14.28s/it]
  5%|▍         | 1868/37963 [8:00:45<142:34:56, 14.22s/it]
  5%|▍         | 1869/37963 [8:01:00<143:17:12, 14.29s/it]
  5%|▍         | 1870/37963 [8:01:14<143:18:58, 14.29s/it]
                                                          
{'loss': '0.1815', 'grad_norm': '2.848', 'learning_rate': '1.998e-05', 'epoch': '0.04926'}

  5%|▍         | 1870/37963 [8:01:14<143:18:58, 14.29s/it]
  5%|▍         | 1871/37963 [8:01:29<143:35:42, 14.32s/it]
  5%|▍         | 1872/37963 [8:01:43<143:42:18, 14.33s/it]
  5%|▍         | 1873/37963 [8:01:57<143:56:52, 14.36s/it]
  5%|▍         | 1874/37963 [8:02:12<143:59:10, 14.36s/it]
  5%|▍         | 1875/37963 [8:02:26<144:15:25, 14.39s/it]
  5%|▍         | 1876/37963 [8:02:41<144:27:58, 14.41s/it]
  5%|▍         | 1877/37963 [8:02:55<144:08:34, 14.38s/it]
  5%|▍         | 1878/37963 [8:03:09<144:13:12, 14.39s/it]
  5%|▍         | 1879/37963 [8:03:24<143:49:49, 14.35s/it]
  5%|▍         | 1880/37963 [8:03:38<143:44:30, 14.34s/it]
                                                          
{'loss': '0.1712', 'grad_norm': '3.434', 'learning_rate': '1.998e-05', 'epoch': '0.04952'}

  5%|▍         | 1880/37963 [8:03:38<143:44:30, 14.34s/it]
  5%|▍         | 1881/37963 [8:03:52<142:34:24, 14.22s/it]
  5%|▍         | 1882/37963 [8:04:06<142:54:35, 14.26s/it]
  5%|▍         | 1883/37963 [8:04:21<143:23:31, 14.31s/it]
  5%|▍         | 1884/37963 [8:04:35<143:29:44, 14.32s/it]
  5%|▍         | 1885/37963 [8:04:49<143:47:17, 14.35s/it]
  5%|▍         | 1886/37963 [8:05:04<144:00:29, 14.37s/it]
  5%|▍         | 1887/37963 [8:05:18<144:31:39, 14.42s/it]
  5%|▍         | 1888/37963 [8:05:39<164:22:53, 16.40s/it]
  5%|▍         | 1889/37963 [8:05:54<158:03:46, 15.77s/it]
  5%|▍         | 1890/37963 [8:06:08<153:45:17, 15.34s/it]
                                                          
{'loss': '0.1837', 'grad_norm': '4.058', 'learning_rate': '1.998e-05', 'epoch': '0.04979'}

  5%|▍         | 1890/37963 [8:06:08<153:45:17, 15.34s/it]
  5%|▍         | 1891/37963 [8:06:22<150:48:51, 15.05s/it]
  5%|▍         | 1892/37963 [8:06:44<169:53:48, 16.96s/it]
  5%|▍         | 1893/37963 [8:06:58<162:23:33, 16.21s/it]
  5%|▍         | 1894/37963 [8:07:19<176:27:20, 17.61s/it]
  5%|▍         | 1895/37963 [8:07:34<166:34:11, 16.63s/it]
  5%|▍         | 1896/37963 [8:07:48<159:47:10, 15.95s/it]
  5%|▍         | 1897/37963 [8:08:02<154:59:36, 15.47s/it]
  5%|▍         | 1898/37963 [8:08:30<192:21:51, 19.20s/it]
  5%|▌         | 1899/37963 [8:08:51<198:23:50, 19.80s/it]
  5%|▌         | 1900/37963 [8:09:06<182:06:59, 18.18s/it]
                                                          
{'loss': '0.1801', 'grad_norm': '2.858', 'learning_rate': '1.998e-05', 'epoch': '0.05005'}

  5%|▌         | 1900/37963 [8:09:06<182:06:59, 18.18s/it]
  5%|▌         | 1901/37963 [8:09:20<170:37:15, 17.03s/it]
  5%|▌         | 1902/37963 [8:09:35<162:49:54, 16.26s/it]
  5%|▌         | 1903/37963 [8:10:01<193:18:13, 19.30s/it]
  5%|▌         | 1904/37963 [8:10:15<178:24:55, 17.81s/it]
  5%|▌         | 1905/37963 [8:10:30<168:11:26, 16.79s/it]
  5%|▌         | 1906/37963 [8:10:44<160:49:54, 16.06s/it]
  5%|▌         | 1907/37963 [8:10:58<153:41:43, 15.35s/it]
  5%|▌         | 1908/37963 [8:11:12<150:16:41, 15.00s/it]
  5%|▌         | 1909/37963 [8:11:26<146:11:15, 14.60s/it]
  5%|▌         | 1910/37963 [8:11:40<145:06:41, 14.49s/it]
                                                          
{'loss': '0.1809', 'grad_norm': '4.273', 'learning_rate': '1.998e-05', 'epoch': '0.05031'}

  5%|▌         | 1910/37963 [8:11:40<145:06:41, 14.49s/it]
  5%|▌         | 1911/37963 [8:11:54<144:49:18, 14.46s/it]
  5%|▌         | 1912/37963 [8:12:09<144:49:39, 14.46s/it]
  5%|▌         | 1913/37963 [8:12:23<144:32:00, 14.43s/it]
  5%|▌         | 1914/37963 [8:12:37<142:36:05, 14.24s/it]
  5%|▌         | 1915/37963 [8:12:51<142:55:57, 14.27s/it]
  5%|▌         | 1916/37963 [8:13:06<143:35:44, 14.34s/it]
  5%|▌         | 1917/37963 [8:13:20<143:37:05, 14.34s/it]
  5%|▌         | 1918/37963 [8:13:34<143:29:38, 14.33s/it]
  5%|▌         | 1919/37963 [8:13:49<143:28:14, 14.33s/it]
  5%|▌         | 1920/37963 [8:14:03<142:54:55, 14.27s/it]
                                                          
{'loss': '0.1544', 'grad_norm': '4.974', 'learning_rate': '1.998e-05', 'epoch': '0.05058'}

  5%|▌         | 1920/37963 [8:14:03<142:54:55, 14.27s/it]
  5%|▌         | 1921/37963 [8:14:16<140:45:41, 14.06s/it]
  5%|▌         | 1922/37963 [8:14:31<141:19:25, 14.12s/it]
  5%|▌         | 1923/37963 [8:14:45<142:38:20, 14.25s/it]
  5%|▌         | 1924/37963 [8:14:59<141:54:44, 14.18s/it]
  5%|▌         | 1925/37963 [8:15:14<142:24:00, 14.22s/it]
  5%|▌         | 1926/37963 [8:15:28<142:41:18, 14.25s/it]
  5%|▌         | 1927/37963 [8:15:42<143:02:58, 14.29s/it]
  5%|▌         | 1928/37963 [8:15:56<142:08:39, 14.20s/it]
  5%|▌         | 1929/37963 [8:16:10<141:10:11, 14.10s/it]
  5%|▌         | 1930/37963 [8:16:25<142:19:59, 14.22s/it]
                                                          
{'loss': '0.184', 'grad_norm': '2.885', 'learning_rate': '1.998e-05', 'epoch': '0.05084'}

  5%|▌         | 1930/37963 [8:16:25<142:19:59, 14.22s/it]
  5%|▌         | 1931/37963 [8:16:39<143:02:10, 14.29s/it]
  5%|▌         | 1932/37963 [8:16:54<143:30:12, 14.34s/it]
  5%|▌         | 1933/37963 [8:17:08<143:32:20, 14.34s/it]
  5%|▌         | 1934/37963 [8:17:22<143:45:18, 14.36s/it]
  5%|▌         | 1935/37963 [8:17:37<143:46:37, 14.37s/it]
  5%|▌         | 1936/37963 [8:17:57<162:50:42, 16.27s/it]
  5%|▌         | 1937/37963 [8:18:11<155:51:15, 15.57s/it]
  5%|▌         | 1938/37963 [8:18:26<152:05:42, 15.20s/it]
  5%|▌         | 1939/37963 [8:18:40<149:05:11, 14.90s/it]
  5%|▌         | 1940/37963 [8:19:01<168:53:21, 16.88s/it]
                                                          
{'loss': '0.179', 'grad_norm': '1.751', 'learning_rate': '1.998e-05', 'epoch': '0.0511'}

  5%|▌         | 1940/37963 [8:19:01<168:53:21, 16.88s/it]
  5%|▌         | 1941/37963 [8:19:16<161:17:05, 16.12s/it]
  5%|▌         | 1942/37963 [8:19:36<175:06:16, 17.50s/it]
  5%|▌         | 1943/37963 [8:19:51<165:31:50, 16.54s/it]
  5%|▌         | 1944/37963 [8:20:05<158:44:47, 15.87s/it]
  5%|▌         | 1945/37963 [8:20:19<153:52:05, 15.38s/it]
  5%|▌         | 1946/37963 [8:20:34<150:55:47, 15.09s/it]
  5%|▌         | 1947/37963 [8:21:08<209:32:38, 20.95s/it]
  5%|▌         | 1948/37963 [8:21:23<190:01:19, 18.99s/it]
  5%|▌         | 1949/37963 [8:21:37<176:16:00, 17.62s/it]
  5%|▌         | 1950/37963 [8:21:51<166:30:15, 16.64s/it]
                                                          
{'loss': '0.1749', 'grad_norm': '3.49', 'learning_rate': '1.998e-05', 'epoch': '0.05137'}

  5%|▌         | 1950/37963 [8:21:51<166:30:15, 16.64s/it]
  5%|▌         | 1951/37963 [8:22:12<178:59:37, 17.89s/it]
  5%|▌         | 1952/37963 [8:22:33<188:17:47, 18.82s/it]
  5%|▌         | 1953/37963 [8:22:47<174:20:10, 17.43s/it]
  5%|▌         | 1954/37963 [8:23:02<165:34:56, 16.55s/it]
  5%|▌         | 1955/37963 [8:23:16<158:52:48, 15.88s/it]
  5%|▌         | 1956/37963 [8:23:31<154:17:13, 15.43s/it]
  5%|▌         | 1957/37963 [8:23:45<151:28:50, 15.15s/it]
  5%|▌         | 1958/37963 [8:24:00<149:14:15, 14.92s/it]
  5%|▌         | 1959/37963 [8:24:14<147:48:29, 14.78s/it]
  5%|▌         | 1960/37963 [8:24:28<145:28:37, 14.55s/it]
                                                          
{'loss': '0.1904', 'grad_norm': '3.887', 'learning_rate': '1.998e-05', 'epoch': '0.05163'}

  5%|▌         | 1960/37963 [8:24:28<145:28:37, 14.55s/it]
  5%|▌         | 1961/37963 [8:24:42<145:05:45, 14.51s/it]
  5%|▌         | 1962/37963 [8:24:56<143:10:26, 14.32s/it]
  5%|▌         | 1963/37963 [8:25:11<143:34:10, 14.36s/it]
  5%|▌         | 1964/37963 [8:25:25<143:24:33, 14.34s/it]
  5%|▌         | 1965/37963 [8:25:39<143:30:32, 14.35s/it]
  5%|▌         | 1966/37963 [8:25:54<143:31:34, 14.35s/it]
  5%|▌         | 1967/37963 [8:26:08<143:28:15, 14.35s/it]
  5%|▌         | 1968/37963 [8:26:22<143:33:04, 14.36s/it]
  5%|▌         | 1969/37963 [8:26:37<143:26:44, 14.35s/it]
  5%|▌         | 1970/37963 [8:26:51<143:04:36, 14.31s/it]
                                                          
{'loss': '0.1704', 'grad_norm': '4.156', 'learning_rate': '1.997e-05', 'epoch': '0.05189'}

  5%|▌         | 1970/37963 [8:26:51<143:04:36, 14.31s/it]
  5%|▌         | 1971/37963 [8:27:05<143:05:12, 14.31s/it]
  5%|▌         | 1972/37963 [8:27:19<141:59:32, 14.20s/it]
  5%|▌         | 1973/37963 [8:27:34<142:21:02, 14.24s/it]
  5%|▌         | 1974/37963 [8:27:48<142:50:39, 14.29s/it]
  5%|▌         | 1975/37963 [8:28:02<143:10:58, 14.32s/it]
  5%|▌         | 1976/37963 [8:28:17<143:17:16, 14.33s/it]
  5%|▌         | 1977/37963 [8:28:31<141:56:22, 14.20s/it]
  5%|▌         | 1978/37963 [8:28:45<142:54:34, 14.30s/it]
  5%|▌         | 1979/37963 [8:28:59<141:52:06, 14.19s/it]
  5%|▌         | 1980/37963 [8:29:14<142:27:53, 14.25s/it]
                                                          
{'loss': '0.1818', 'grad_norm': '1.679', 'learning_rate': '1.997e-05', 'epoch': '0.05216'}

  5%|▌         | 1980/37963 [8:29:14<142:27:53, 14.25s/it]
  5%|▌         | 1981/37963 [8:29:28<142:54:23, 14.30s/it]
  5%|▌         | 1982/37963 [8:29:42<142:37:42, 14.27s/it]
  5%|▌         | 1983/37963 [8:29:56<142:44:05, 14.28s/it]
  5%|▌         | 1984/37963 [8:30:11<142:51:32, 14.29s/it]
  5%|▌         | 1985/37963 [8:30:31<161:58:55, 16.21s/it]
  5%|▌         | 1986/37963 [8:30:46<156:31:34, 15.66s/it]
  5%|▌         | 1987/37963 [8:31:00<152:51:21, 15.30s/it]
  5%|▌         | 1988/37963 [8:31:14<148:41:24, 14.88s/it]
  5%|▌         | 1989/37963 [8:31:43<190:22:01, 19.05s/it]
  5%|▌         | 1990/37963 [8:31:57<176:27:53, 17.66s/it]
                                                          
{'loss': '0.1662', 'grad_norm': '1.624', 'learning_rate': '1.997e-05', 'epoch': '0.05242'}

  5%|▌         | 1990/37963 [8:31:57<176:27:53, 17.66s/it]
  5%|▌         | 1991/37963 [8:32:11<164:03:42, 16.42s/it]
  5%|▌         | 1992/37963 [8:32:25<157:50:11, 15.80s/it]
  5%|▌         | 1993/37963 [8:32:40<153:50:39, 15.40s/it]
  5%|▌         | 1994/37963 [8:32:54<150:42:01, 15.08s/it]
  5%|▌         | 1995/37963 [8:33:15<169:31:20, 16.97s/it]
  5%|▌         | 1996/37963 [8:33:43<199:52:35, 20.01s/it]
  5%|▌         | 1997/37963 [8:33:57<181:44:06, 18.19s/it]
  5%|▌         | 1998/37963 [8:34:11<170:17:24, 17.05s/it]
  5%|▌         | 1999/37963 [8:34:32<181:25:23, 18.16s/it]
  5%|▌         | 2000/37963 [8:34:46<169:05:50, 16.93s/it]
                                                          
{'loss': '0.1748', 'grad_norm': '4.163', 'learning_rate': '1.997e-05', 'epoch': '0.05268'}

  5%|▌         | 2000/37963 [8:34:46<169:05:50, 16.93s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.94s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.95s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  5%|▌         | 2001/37963 [8:36:24<413:36:19, 41.40s/it]
  5%|▌         | 2002/37963 [8:36:39<332:57:03, 33.33s/it]
  5%|▌         | 2003/37963 [8:36:59<293:17:44, 29.36s/it]
  5%|▌         | 2004/37963 [8:37:13<247:21:02, 24.76s/it]
  5%|▌         | 2005/37963 [8:37:27<216:18:12, 21.66s/it]
  5%|▌         | 2006/37963 [8:37:42<194:40:24, 19.49s/it]
  5%|▌         | 2007/37963 [8:37:56<179:04:38, 17.93s/it]
  5%|▌         | 2008/37963 [8:38:10<166:58:24, 16.72s/it]
  5%|▌         | 2009/37963 [8:38:24<160:20:51, 16.06s/it]
  5%|▌         | 2010/37963 [8:38:39<155:34:57, 15.58s/it]
                                                          
{'loss': '0.179', 'grad_norm': '1.385', 'learning_rate': '1.997e-05', 'epoch': '0.05295'}

  5%|▌         | 2010/37963 [8:38:39<155:34:57, 15.58s/it]
  5%|▌         | 2011/37963 [8:38:53<150:58:58, 15.12s/it]
  5%|▌         | 2012/37963 [8:39:07<148:43:06, 14.89s/it]
  5%|▌         | 2013/37963 [8:39:22<147:51:42, 14.81s/it]
  5%|▌         | 2014/37963 [8:39:36<146:20:26, 14.65s/it]
  5%|▌         | 2015/37963 [8:39:50<145:25:54, 14.56s/it]
  5%|▌         | 2016/37963 [8:40:05<144:44:35, 14.50s/it]
  5%|▌         | 2017/37963 [8:40:19<142:17:59, 14.25s/it]
  5%|▌         | 2018/37963 [8:40:33<142:39:35, 14.29s/it]
  5%|▌         | 2019/37963 [8:40:47<142:45:11, 14.30s/it]
  5%|▌         | 2020/37963 [8:41:01<141:35:44, 14.18s/it]
                                                          
{'loss': '0.1855', 'grad_norm': '4.968', 'learning_rate': '1.997e-05', 'epoch': '0.05321'}

  5%|▌         | 2020/37963 [8:41:01<141:35:44, 14.18s/it]
  5%|▌         | 2021/37963 [8:41:15<140:53:52, 14.11s/it]
  5%|▌         | 2022/37963 [8:41:29<140:24:11, 14.06s/it]
  5%|▌         | 2023/37963 [8:41:42<138:22:20, 13.86s/it]
  5%|▌         | 2024/37963 [8:41:57<139:52:35, 14.01s/it]
  5%|▌         | 2025/37963 [8:42:11<140:43:06, 14.10s/it]
  5%|▌         | 2026/37963 [8:42:25<140:49:21, 14.11s/it]
  5%|▌         | 2027/37963 [8:42:40<141:37:27, 14.19s/it]
  5%|▌         | 2028/37963 [8:42:54<142:07:00, 14.24s/it]
  5%|▌         | 2029/37963 [8:43:08<142:24:22, 14.27s/it]
  5%|▌         | 2030/37963 [8:43:23<142:57:19, 14.32s/it]
                                                          
{'loss': '0.1739', 'grad_norm': '3.245', 'learning_rate': '1.997e-05', 'epoch': '0.05347'}

  5%|▌         | 2030/37963 [8:43:23<142:57:19, 14.32s/it]
  5%|▌         | 2031/37963 [8:43:37<143:05:55, 14.34s/it]
  5%|▌         | 2032/37963 [8:43:52<143:42:40, 14.40s/it]
  5%|▌         | 2033/37963 [8:44:06<143:31:47, 14.38s/it]
  5%|▌         | 2034/37963 [8:44:20<143:26:56, 14.37s/it]
  5%|▌         | 2035/37963 [8:44:48<184:00:33, 18.44s/it]
  5%|▌         | 2036/37963 [8:45:03<171:54:08, 17.23s/it]
  5%|▌         | 2037/37963 [8:45:17<163:20:47, 16.37s/it]
  5%|▌         | 2038/37963 [8:45:38<177:10:15, 17.75s/it]
  5%|▌         | 2039/37963 [8:45:52<165:39:52, 16.60s/it]
  5%|▌         | 2040/37963 [8:46:06<157:43:22, 15.81s/it]
                                                          
{'loss': '0.1725', 'grad_norm': '2.596', 'learning_rate': '1.997e-05', 'epoch': '0.05374'}

  5%|▌         | 2040/37963 [8:46:06<157:43:22, 15.81s/it]
  5%|▌         | 2041/37963 [8:46:20<153:45:50, 15.41s/it]
  5%|▌         | 2042/37963 [8:46:35<150:49:47, 15.12s/it]
  5%|▌         | 2043/37963 [8:46:49<148:48:21, 14.91s/it]
  5%|▌         | 2044/37963 [8:47:10<165:31:58, 16.59s/it]
  5%|▌         | 2045/37963 [8:47:38<199:47:41, 20.03s/it]
  5%|▌         | 2046/37963 [8:47:59<202:45:42, 20.32s/it]
  5%|▌         | 2047/37963 [8:48:13<185:04:47, 18.55s/it]
  5%|▌         | 2048/37963 [8:48:28<172:27:46, 17.29s/it]
  5%|▌         | 2049/37963 [8:48:42<163:47:52, 16.42s/it]
  5%|▌         | 2050/37963 [8:48:56<157:36:26, 15.80s/it]
                                                          
{'loss': '0.1702', 'grad_norm': '2.024', 'learning_rate': '1.997e-05', 'epoch': '0.054'}

  5%|▌         | 2050/37963 [8:48:56<157:36:26, 15.80s/it]
  5%|▌         | 2051/37963 [8:49:17<173:20:01, 17.38s/it]
  5%|▌         | 2052/37963 [8:49:32<164:25:08, 16.48s/it]
  5%|▌         | 2053/37963 [8:49:46<157:56:44, 15.83s/it]
  5%|▌         | 2054/37963 [8:50:00<153:46:01, 15.42s/it]
  5%|▌         | 2055/37963 [8:50:15<149:45:58, 15.01s/it]
  5%|▌         | 2056/37963 [8:50:29<146:50:07, 14.72s/it]
  5%|▌         | 2057/37963 [8:50:42<143:56:09, 14.43s/it]
  5%|▌         | 2058/37963 [8:50:57<143:05:32, 14.35s/it]
  5%|▌         | 2059/37963 [8:51:11<143:07:55, 14.35s/it]
  5%|▌         | 2060/37963 [8:51:25<143:12:40, 14.36s/it]
                                                          
{'loss': '0.1835', 'grad_norm': '1.59', 'learning_rate': '1.997e-05', 'epoch': '0.05426'}

  5%|▌         | 2060/37963 [8:51:25<143:12:40, 14.36s/it]
  5%|▌         | 2061/37963 [8:51:39<142:36:46, 14.30s/it]
  5%|▌         | 2062/37963 [8:51:54<142:42:33, 14.31s/it]
  5%|▌         | 2063/37963 [8:52:08<142:48:38, 14.32s/it]
  5%|▌         | 2064/37963 [8:52:22<141:53:24, 14.23s/it]
  5%|▌         | 2065/37963 [8:52:36<142:14:18, 14.26s/it]
  5%|▌         | 2066/37963 [8:52:51<142:18:41, 14.27s/it]
  5%|▌         | 2067/37963 [8:53:05<142:54:12, 14.33s/it]
  5%|▌         | 2068/37963 [8:53:20<143:13:18, 14.36s/it]
  5%|▌         | 2069/37963 [8:53:34<143:16:25, 14.37s/it]
  5%|▌         | 2070/37963 [8:53:48<143:14:07, 14.37s/it]
                                                          
{'loss': '0.1836', 'grad_norm': '4.949', 'learning_rate': '1.997e-05', 'epoch': '0.05453'}

  5%|▌         | 2070/37963 [8:53:48<143:14:07, 14.37s/it]
  5%|▌         | 2071/37963 [8:54:02<141:41:30, 14.21s/it]
  5%|▌         | 2072/37963 [8:54:17<142:10:48, 14.26s/it]
  5%|▌         | 2073/37963 [8:54:31<142:33:48, 14.30s/it]
  5%|▌         | 2074/37963 [8:54:45<142:50:09, 14.33s/it]
  5%|▌         | 2075/37963 [8:55:00<142:38:19, 14.31s/it]
  5%|▌         | 2076/37963 [8:55:14<142:48:44, 14.33s/it]
  5%|▌         | 2077/37963 [8:55:28<142:53:42, 14.33s/it]
  5%|▌         | 2078/37963 [8:55:42<141:46:06, 14.22s/it]
  5%|▌         | 2079/37963 [8:55:56<140:49:32, 14.13s/it]
  5%|▌         | 2080/37963 [8:56:11<141:24:15, 14.19s/it]
                                                          
{'loss': '0.1721', 'grad_norm': '3.683', 'learning_rate': '1.997e-05', 'epoch': '0.05479'}

  5%|▌         | 2080/37963 [8:56:11<141:24:15, 14.19s/it]
  5%|▌         | 2081/37963 [8:56:25<141:48:25, 14.23s/it]
  5%|▌         | 2082/37963 [8:56:39<141:45:21, 14.22s/it]
  5%|▌         | 2083/37963 [8:57:01<163:17:35, 16.38s/it]
  5%|▌         | 2084/37963 [8:57:15<156:29:06, 15.70s/it]
  5%|▌         | 2085/37963 [8:57:36<171:56:40, 17.25s/it]
  5%|▌         | 2086/37963 [8:57:57<183:47:35, 18.44s/it]
  5%|▌         | 2087/37963 [8:58:11<171:32:05, 17.21s/it]
  6%|▌         | 2088/37963 [8:58:25<161:24:22, 16.20s/it]
  6%|▌         | 2089/37963 [8:58:39<156:11:25, 15.67s/it]
  6%|▌         | 2090/37963 [8:58:54<151:37:22, 15.22s/it]
                                                          
{'loss': '0.1792', 'grad_norm': '1.993', 'learning_rate': '1.997e-05', 'epoch': '0.05505'}

  6%|▌         | 2090/37963 [8:58:54<151:37:22, 15.22s/it]
  6%|▌         | 2091/37963 [8:59:08<149:07:10, 14.97s/it]
  6%|▌         | 2092/37963 [8:59:28<165:00:47, 16.56s/it]
  6%|▌         | 2093/37963 [8:59:56<198:30:45, 19.92s/it]
  6%|▌         | 2094/37963 [9:00:10<180:53:52, 18.16s/it]
  6%|▌         | 2095/37963 [9:00:24<168:52:41, 16.95s/it]
  6%|▌         | 2096/37963 [9:00:39<161:36:51, 16.22s/it]
  6%|▌         | 2097/37963 [9:00:53<155:58:07, 15.66s/it]
  6%|▌         | 2098/37963 [9:01:07<151:01:44, 15.16s/it]
  6%|▌         | 2099/37963 [9:01:21<148:17:17, 14.89s/it]
  6%|▌         | 2100/37963 [9:01:41<164:17:23, 16.49s/it]
                                                          
{'loss': '0.1844', 'grad_norm': '2.545', 'learning_rate': '1.997e-05', 'epoch': '0.05532'}

  6%|▌         | 2100/37963 [9:01:41<164:17:23, 16.49s/it]
  6%|▌         | 2101/37963 [9:01:56<158:22:33, 15.90s/it]
  6%|▌         | 2102/37963 [9:02:10<152:58:29, 15.36s/it]
  6%|▌         | 2103/37963 [9:02:24<150:01:49, 15.06s/it]
  6%|▌         | 2104/37963 [9:02:38<145:37:44, 14.62s/it]
  6%|▌         | 2105/37963 [9:02:52<143:52:53, 14.45s/it]
  6%|▌         | 2106/37963 [9:03:06<143:33:42, 14.41s/it]
  6%|▌         | 2107/37963 [9:03:21<143:22:31, 14.40s/it]
  6%|▌         | 2108/37963 [9:03:35<142:36:48, 14.32s/it]
  6%|▌         | 2109/37963 [9:03:49<142:54:19, 14.35s/it]
  6%|▌         | 2110/37963 [9:04:03<142:00:01, 14.26s/it]
                                                          
{'loss': '0.1658', 'grad_norm': '4.966', 'learning_rate': '1.997e-05', 'epoch': '0.05558'}

  6%|▌         | 2110/37963 [9:04:03<142:00:01, 14.26s/it]
  6%|▌         | 2111/37963 [9:04:17<141:09:38, 14.17s/it]
  6%|▌         | 2112/37963 [9:04:32<141:46:48, 14.24s/it]
  6%|▌         | 2113/37963 [9:04:46<142:00:23, 14.26s/it]
  6%|▌         | 2114/37963 [9:05:00<142:21:14, 14.30s/it]
  6%|▌         | 2115/37963 [9:05:15<142:30:32, 14.31s/it]
  6%|▌         | 2116/37963 [9:05:29<142:30:42, 14.31s/it]
  6%|▌         | 2117/37963 [9:05:43<142:11:56, 14.28s/it]
  6%|▌         | 2118/37963 [9:05:57<139:36:52, 14.02s/it]
  6%|▌         | 2119/37963 [9:06:11<139:31:26, 14.01s/it]
  6%|▌         | 2120/37963 [9:06:25<140:36:33, 14.12s/it]
                                                          
{'loss': '0.1782', 'grad_norm': '2.378', 'learning_rate': '1.997e-05', 'epoch': '0.05584'}

  6%|▌         | 2120/37963 [9:06:25<140:36:33, 14.12s/it]
  6%|▌         | 2121/37963 [9:06:39<141:11:50, 14.18s/it]
  6%|▌         | 2122/37963 [9:06:54<141:33:07, 14.22s/it]
  6%|▌         | 2123/37963 [9:07:08<141:39:00, 14.23s/it]
  6%|▌         | 2124/37963 [9:07:22<142:19:11, 14.30s/it]
  6%|▌         | 2125/37963 [9:07:36<140:33:00, 14.12s/it]
  6%|▌         | 2126/37963 [9:07:50<141:14:56, 14.19s/it]
  6%|▌         | 2127/37963 [9:08:05<141:51:56, 14.25s/it]
  6%|▌         | 2128/37963 [9:08:19<142:32:54, 14.32s/it]
  6%|▌         | 2129/37963 [9:08:34<143:03:38, 14.37s/it]
  6%|▌         | 2130/37963 [9:08:55<162:34:30, 16.33s/it]
                                                          
{'loss': '0.1784', 'grad_norm': '5.927', 'learning_rate': '1.996e-05', 'epoch': '0.05611'}

  6%|▌         | 2130/37963 [9:08:55<162:34:30, 16.33s/it]
  6%|▌         | 2131/37963 [9:09:16<177:02:15, 17.79s/it]
  6%|▌         | 2132/37963 [9:09:37<187:21:21, 18.82s/it]
  6%|▌         | 2133/37963 [9:09:51<173:43:25, 17.45s/it]
  6%|▌         | 2134/37963 [9:10:06<164:18:34, 16.51s/it]
  6%|▌         | 2135/37963 [9:10:20<157:48:28, 15.86s/it]
  6%|▌         | 2136/37963 [9:10:34<153:24:35, 15.42s/it]
  6%|▌         | 2137/37963 [9:10:49<150:30:06, 15.12s/it]
  6%|▌         | 2138/37963 [9:11:03<148:11:00, 14.89s/it]
  6%|▌         | 2139/37963 [9:11:18<146:34:31, 14.73s/it]
  6%|▌         | 2140/37963 [9:11:32<145:23:15, 14.61s/it]
                                                          
{'loss': '0.1759', 'grad_norm': '2.003', 'learning_rate': '1.996e-05', 'epoch': '0.05637'}

  6%|▌         | 2140/37963 [9:11:32<145:23:15, 14.61s/it]
  6%|▌         | 2141/37963 [9:11:59<183:19:21, 18.42s/it]
  6%|▌         | 2142/37963 [9:12:20<190:44:02, 19.17s/it]
  6%|▌         | 2143/37963 [9:12:41<196:33:58, 19.76s/it]
  6%|▌         | 2144/37963 [9:12:56<181:05:08, 18.20s/it]
  6%|▌         | 2145/37963 [9:13:10<169:57:42, 17.08s/it]
  6%|▌         | 2146/37963 [9:13:25<161:23:48, 16.22s/it]
  6%|▌         | 2147/37963 [9:13:39<155:45:03, 15.66s/it]
  6%|▌         | 2148/37963 [9:13:53<151:41:01, 15.25s/it]
  6%|▌         | 2149/37963 [9:14:07<146:12:51, 14.70s/it]
  6%|▌         | 2150/37963 [9:14:27<162:01:11, 16.29s/it]
                                                          
{'loss': '0.1625', 'grad_norm': '2.4', 'learning_rate': '1.996e-05', 'epoch': '0.05663'}

  6%|▌         | 2150/37963 [9:14:27<162:01:11, 16.29s/it]
  6%|▌         | 2151/37963 [9:14:41<156:17:34, 15.71s/it]
  6%|▌         | 2152/37963 [9:14:55<152:32:06, 15.33s/it]
  6%|▌         | 2153/37963 [9:15:10<149:29:36, 15.03s/it]
  6%|▌         | 2154/37963 [9:15:24<145:50:53, 14.66s/it]
  6%|▌         | 2155/37963 [9:15:38<144:27:41, 14.52s/it]
  6%|▌         | 2156/37963 [9:15:52<143:45:10, 14.45s/it]
  6%|▌         | 2157/37963 [9:16:06<143:24:47, 14.42s/it]
  6%|▌         | 2158/37963 [9:16:20<141:32:47, 14.23s/it]
  6%|▌         | 2159/37963 [9:16:35<142:23:44, 14.32s/it]
  6%|▌         | 2160/37963 [9:16:49<142:21:51, 14.31s/it]
                                                          
{'loss': '0.1655', 'grad_norm': '1.958', 'learning_rate': '1.996e-05', 'epoch': '0.0569'}

  6%|▌         | 2160/37963 [9:16:49<142:21:51, 14.31s/it]
  6%|▌         | 2161/37963 [9:17:04<143:00:56, 14.38s/it]
  6%|▌         | 2162/37963 [9:17:18<142:21:55, 14.32s/it]
  6%|▌         | 2163/37963 [9:17:32<142:06:50, 14.29s/it]
  6%|▌         | 2164/37963 [9:17:46<141:58:48, 14.28s/it]
  6%|▌         | 2165/37963 [9:18:00<141:57:58, 14.28s/it]
  6%|▌         | 2166/37963 [9:18:15<142:13:48, 14.30s/it]
  6%|▌         | 2167/37963 [9:18:29<142:34:13, 14.34s/it]
  6%|▌         | 2168/37963 [9:18:44<142:41:09, 14.35s/it]
  6%|▌         | 2169/37963 [9:18:57<140:47:42, 14.16s/it]
  6%|▌         | 2170/37963 [9:19:11<140:08:05, 14.09s/it]
                                                          
{'loss': '0.156', 'grad_norm': '2.705', 'learning_rate': '1.996e-05', 'epoch': '0.05716'}

  6%|▌         | 2170/37963 [9:19:11<140:08:05, 14.09s/it]
  6%|▌         | 2171/37963 [9:19:26<140:54:44, 14.17s/it]
  6%|▌         | 2172/37963 [9:19:40<141:22:29, 14.22s/it]
  6%|▌         | 2173/37963 [9:19:54<141:48:19, 14.26s/it]
  6%|▌         | 2174/37963 [9:20:08<141:27:04, 14.23s/it]
  6%|▌         | 2175/37963 [9:20:23<141:55:36, 14.28s/it]
  6%|▌         | 2176/37963 [9:20:37<142:22:59, 14.32s/it]
  6%|▌         | 2177/37963 [9:20:52<142:17:25, 14.31s/it]
  6%|▌         | 2178/37963 [9:21:12<161:45:07, 16.27s/it]
  6%|▌         | 2179/37963 [9:21:27<155:56:19, 15.69s/it]
  6%|▌         | 2180/37963 [9:21:41<152:06:30, 15.30s/it]
                                                          
{'loss': '0.1881', 'grad_norm': '2.662', 'learning_rate': '1.996e-05', 'epoch': '0.05742'}

  6%|▌         | 2180/37963 [9:21:41<152:06:30, 15.30s/it]
  6%|▌         | 2181/37963 [9:22:02<169:55:02, 17.10s/it]
  6%|▌         | 2182/37963 [9:22:17<161:39:13, 16.26s/it]
  6%|▌         | 2183/37963 [9:22:31<156:24:13, 15.74s/it]
  6%|▌         | 2184/37963 [9:22:52<172:41:27, 17.38s/it]
  6%|▌         | 2185/37963 [9:23:07<163:22:07, 16.44s/it]
  6%|▌         | 2186/37963 [9:23:21<157:01:09, 15.80s/it]
  6%|▌         | 2187/37963 [9:23:35<150:30:37, 15.15s/it]
  6%|▌         | 2188/37963 [9:23:49<148:50:15, 14.98s/it]
  6%|▌         | 2189/37963 [9:24:10<165:58:03, 16.70s/it]
  6%|▌         | 2190/37963 [9:24:30<177:20:11, 17.85s/it]
                                                          
{'loss': '0.1862', 'grad_norm': '7.25', 'learning_rate': '1.996e-05', 'epoch': '0.05769'}

  6%|▌         | 2190/37963 [9:24:30<177:20:11, 17.85s/it]
  6%|▌         | 2191/37963 [9:24:51<185:37:55, 18.68s/it]
  6%|▌         | 2192/37963 [9:25:05<172:23:17, 17.35s/it]
  6%|▌         | 2193/37963 [9:25:26<183:01:12, 18.42s/it]
  6%|▌         | 2194/37963 [9:25:41<170:55:03, 17.20s/it]
  6%|▌         | 2195/37963 [9:25:55<162:21:37, 16.34s/it]
  6%|▌         | 2196/37963 [9:26:09<156:27:21, 15.75s/it]
  6%|▌         | 2197/37963 [9:26:24<152:17:41, 15.33s/it]
  6%|▌         | 2198/37963 [9:26:37<147:22:56, 14.84s/it]
  6%|▌         | 2199/37963 [9:26:52<146:11:41, 14.72s/it]
  6%|▌         | 2200/37963 [9:27:06<143:51:43, 14.48s/it]
                                                          
{'loss': '0.1637', 'grad_norm': '1.26', 'learning_rate': '1.996e-05', 'epoch': '0.05795'}

  6%|▌         | 2200/37963 [9:27:06<143:51:43, 14.48s/it]
  6%|▌         | 2201/37963 [9:27:20<142:26:57, 14.34s/it]
  6%|▌         | 2202/37963 [9:27:34<142:25:44, 14.34s/it]
  6%|▌         | 2203/37963 [9:27:55<163:09:46, 16.43s/it]
  6%|▌         | 2204/37963 [9:28:10<156:45:31, 15.78s/it]
  6%|▌         | 2205/37963 [9:28:24<151:46:39, 15.28s/it]
  6%|▌         | 2206/37963 [9:28:38<149:16:56, 15.03s/it]
  6%|▌         | 2207/37963 [9:28:53<147:16:00, 14.83s/it]
  6%|▌         | 2208/37963 [9:29:07<146:11:57, 14.72s/it]
  6%|▌         | 2209/37963 [9:29:21<145:11:23, 14.62s/it]
  6%|▌         | 2210/37963 [9:29:36<144:37:53, 14.56s/it]
                                                          
{'loss': '0.1708', 'grad_norm': '3.761', 'learning_rate': '1.996e-05', 'epoch': '0.05821'}

  6%|▌         | 2210/37963 [9:29:36<144:37:53, 14.56s/it]
  6%|▌         | 2211/37963 [9:29:50<144:51:48, 14.59s/it]
  6%|▌         | 2212/37963 [9:30:05<144:37:33, 14.56s/it]
  6%|▌         | 2213/37963 [9:30:19<143:20:03, 14.43s/it]
  6%|▌         | 2214/37963 [9:30:33<143:07:57, 14.41s/it]
  6%|▌         | 2215/37963 [9:30:48<142:50:27, 14.38s/it]
  6%|▌         | 2216/37963 [9:31:02<141:31:35, 14.25s/it]
  6%|▌         | 2217/37963 [9:31:16<140:28:28, 14.15s/it]
  6%|▌         | 2218/37963 [9:31:30<140:50:38, 14.18s/it]
  6%|▌         | 2219/37963 [9:31:44<141:01:04, 14.20s/it]
  6%|▌         | 2220/37963 [9:31:58<140:44:41, 14.18s/it]
                                                          
{'loss': '0.1632', 'grad_norm': '1.834', 'learning_rate': '1.996e-05', 'epoch': '0.05848'}

  6%|▌         | 2220/37963 [9:31:58<140:44:41, 14.18s/it]
  6%|▌         | 2221/37963 [9:32:13<141:19:25, 14.23s/it]
  6%|▌         | 2222/37963 [9:32:27<141:40:42, 14.27s/it]
  6%|▌         | 2223/37963 [9:32:42<142:32:54, 14.36s/it]
  6%|▌         | 2224/37963 [9:32:56<142:12:51, 14.33s/it]
  6%|▌         | 2225/37963 [9:33:10<141:26:20, 14.25s/it]
  6%|▌         | 2226/37963 [9:33:23<139:06:51, 14.01s/it]
  6%|▌         | 2227/37963 [9:33:38<140:06:32, 14.11s/it]
  6%|▌         | 2228/37963 [9:33:52<141:00:07, 14.20s/it]
  6%|▌         | 2229/37963 [9:34:20<180:22:50, 18.17s/it]
  6%|▌         | 2230/37963 [9:34:40<187:51:22, 18.93s/it]
                                                          
{'loss': '0.1778', 'grad_norm': '2.833', 'learning_rate': '1.996e-05', 'epoch': '0.05874'}

  6%|▌         | 2230/37963 [9:34:40<187:51:22, 18.93s/it]
  6%|▌         | 2231/37963 [9:34:55<174:16:43, 17.56s/it]
  6%|▌         | 2232/37963 [9:35:09<164:28:41, 16.57s/it]
  6%|▌         | 2233/37963 [9:35:23<156:43:58, 15.79s/it]
  6%|▌         | 2234/37963 [9:35:37<151:23:25, 15.25s/it]
  6%|▌         | 2235/37963 [9:35:57<165:29:51, 16.68s/it]
  6%|▌         | 2236/37963 [9:36:11<158:35:19, 15.98s/it]
  6%|▌         | 2237/37963 [9:36:26<153:58:58, 15.52s/it]
  6%|▌         | 2238/37963 [9:36:46<168:13:34, 16.95s/it]
  6%|▌         | 2239/37963 [9:37:00<160:32:17, 16.18s/it]
  6%|▌         | 2240/37963 [9:37:14<154:05:09, 15.53s/it]
                                                          
{'loss': '0.1648', 'grad_norm': '5.458', 'learning_rate': '1.996e-05', 'epoch': '0.05901'}

  6%|▌         | 2240/37963 [9:37:14<154:05:09, 15.53s/it]
  6%|▌         | 2241/37963 [9:37:42<190:15:52, 19.17s/it]
  6%|▌         | 2242/37963 [9:37:56<175:49:59, 17.72s/it]
  6%|▌         | 2243/37963 [9:38:11<165:42:13, 16.70s/it]
  6%|▌         | 2244/37963 [9:38:25<158:54:03, 16.02s/it]
  6%|▌         | 2245/37963 [9:38:39<153:08:33, 15.44s/it]
  6%|▌         | 2246/37963 [9:38:54<150:21:27, 15.15s/it]
  6%|▌         | 2247/37963 [9:39:08<148:14:56, 14.94s/it]
  6%|▌         | 2248/37963 [9:39:23<146:52:01, 14.80s/it]
  6%|▌         | 2249/37963 [9:39:43<165:03:05, 16.64s/it]
  6%|▌         | 2250/37963 [9:39:57<157:07:41, 15.84s/it]
                                                          
{'loss': '0.1725', 'grad_norm': '3.626', 'learning_rate': '1.996e-05', 'epoch': '0.05927'}

  6%|▌         | 2250/37963 [9:39:57<157:07:41, 15.84s/it]
  6%|▌         | 2251/37963 [9:40:12<152:58:21, 15.42s/it]
  6%|▌         | 2252/37963 [9:40:25<147:33:42, 14.88s/it]
  6%|▌         | 2253/37963 [9:40:40<146:03:49, 14.72s/it]
  6%|▌         | 2254/37963 [9:40:54<144:48:34, 14.60s/it]
  6%|▌         | 2255/37963 [9:41:08<142:50:53, 14.40s/it]
  6%|▌         | 2256/37963 [9:41:23<142:59:13, 14.42s/it]
  6%|▌         | 2257/37963 [9:41:37<142:04:15, 14.32s/it]
  6%|▌         | 2258/37963 [9:41:51<141:01:46, 14.22s/it]
  6%|▌         | 2259/37963 [9:42:05<141:08:39, 14.23s/it]
  6%|▌         | 2260/37963 [9:42:19<141:07:32, 14.23s/it]
                                                          
{'loss': '0.1788', 'grad_norm': '2.625', 'learning_rate': '1.995e-05', 'epoch': '0.05953'}

  6%|▌         | 2260/37963 [9:42:19<141:07:32, 14.23s/it]
  6%|▌         | 2261/37963 [9:42:34<142:26:28, 14.36s/it]
  6%|▌         | 2262/37963 [9:42:48<142:23:20, 14.36s/it]
  6%|▌         | 2263/37963 [9:43:02<141:18:48, 14.25s/it]
  6%|▌         | 2264/37963 [9:43:16<141:16:00, 14.25s/it]
  6%|▌         | 2265/37963 [9:43:31<142:01:21, 14.32s/it]
  6%|▌         | 2266/37963 [9:43:45<142:00:11, 14.32s/it]
  6%|▌         | 2267/37963 [9:44:00<142:18:20, 14.35s/it]
  6%|▌         | 2268/37963 [9:44:14<142:17:41, 14.35s/it]
  6%|▌         | 2269/37963 [9:44:28<142:22:35, 14.36s/it]
  6%|▌         | 2270/37963 [9:44:42<141:15:24, 14.25s/it]
                                                          
{'loss': '0.1702', 'grad_norm': '3.908', 'learning_rate': '1.995e-05', 'epoch': '0.0598'}

  6%|▌         | 2270/37963 [9:44:42<141:15:24, 14.25s/it]
  6%|▌         | 2271/37963 [9:44:57<141:26:42, 14.27s/it]
  6%|▌         | 2272/37963 [9:45:11<141:38:47, 14.29s/it]
  6%|▌         | 2273/37963 [9:45:25<139:53:08, 14.11s/it]
  6%|▌         | 2274/37963 [9:45:39<140:27:44, 14.17s/it]
  6%|▌         | 2275/37963 [9:45:53<141:16:33, 14.25s/it]
  6%|▌         | 2276/37963 [9:46:08<141:12:03, 14.24s/it]
  6%|▌         | 2277/37963 [9:46:29<161:13:28, 16.26s/it]
  6%|▌         | 2278/37963 [9:46:50<176:10:59, 17.77s/it]
  6%|▌         | 2279/37963 [9:47:11<186:39:42, 18.83s/it]
  6%|▌         | 2280/37963 [9:47:25<173:00:05, 17.45s/it]
                                                          
{'loss': '0.1795', 'grad_norm': '2.903', 'learning_rate': '1.995e-05', 'epoch': '0.06006'}

  6%|▌         | 2280/37963 [9:47:25<173:00:05, 17.45s/it]
  6%|▌         | 2281/37963 [9:47:40<163:39:12, 16.51s/it]
  6%|▌         | 2282/37963 [9:47:54<156:17:58, 15.77s/it]
  6%|▌         | 2283/37963 [9:48:08<151:31:16, 15.29s/it]
  6%|▌         | 2284/37963 [9:48:29<167:59:02, 16.95s/it]
  6%|▌         | 2285/37963 [9:48:42<157:59:02, 15.94s/it]
  6%|▌         | 2286/37963 [9:48:57<153:06:02, 15.45s/it]
  6%|▌         | 2287/37963 [9:49:11<148:19:39, 14.97s/it]
  6%|▌         | 2288/37963 [9:49:31<165:41:55, 16.72s/it]
  6%|▌         | 2289/37963 [9:49:53<179:20:45, 18.10s/it]
  6%|▌         | 2290/37963 [9:50:14<187:41:07, 18.94s/it]
                                                          
{'loss': '0.1737', 'grad_norm': '3.692', 'learning_rate': '1.995e-05', 'epoch': '0.06032'}

  6%|▌         | 2290/37963 [9:50:14<187:41:07, 18.94s/it]
  6%|▌         | 2291/37963 [9:50:28<174:08:53, 17.57s/it]
  6%|▌         | 2292/37963 [9:50:42<164:41:12, 16.62s/it]
  6%|▌         | 2293/37963 [9:50:57<158:03:10, 15.95s/it]
  6%|▌         | 2294/37963 [9:51:10<151:18:07, 15.27s/it]
  6%|▌         | 2295/37963 [9:51:25<148:47:53, 15.02s/it]
  6%|▌         | 2296/37963 [9:51:39<147:14:49, 14.86s/it]
  6%|▌         | 2297/37963 [9:51:54<145:55:58, 14.73s/it]
  6%|▌         | 2298/37963 [9:52:15<164:39:24, 16.62s/it]
  6%|▌         | 2299/37963 [9:52:29<157:24:04, 15.89s/it]
  6%|▌         | 2300/37963 [9:52:43<152:53:01, 15.43s/it]
                                                          
{'loss': '0.1734', 'grad_norm': '4.977', 'learning_rate': '1.995e-05', 'epoch': '0.06059'}

  6%|▌         | 2300/37963 [9:52:43<152:53:01, 15.43s/it]
  6%|▌         | 2301/37963 [9:52:57<147:55:27, 14.93s/it]
  6%|▌         | 2302/37963 [9:53:12<146:23:31, 14.78s/it]
  6%|▌         | 2303/37963 [9:53:26<144:58:40, 14.64s/it]
  6%|▌         | 2304/37963 [9:53:40<143:43:02, 14.51s/it]
  6%|▌         | 2305/37963 [9:53:54<142:46:23, 14.41s/it]
  6%|▌         | 2306/37963 [9:54:09<142:32:45, 14.39s/it]
  6%|▌         | 2307/37963 [9:54:23<141:49:25, 14.32s/it]
  6%|▌         | 2308/37963 [9:54:37<141:51:05, 14.32s/it]
  6%|▌         | 2309/37963 [9:54:51<142:06:25, 14.35s/it]
  6%|▌         | 2310/37963 [9:55:06<142:25:47, 14.38s/it]
                                                          
{'loss': '0.1699', 'grad_norm': '1.941', 'learning_rate': '1.995e-05', 'epoch': '0.06085'}

  6%|▌         | 2310/37963 [9:55:06<142:25:47, 14.38s/it]
  6%|▌         | 2311/37963 [9:55:20<142:33:51, 14.40s/it]
  6%|▌         | 2312/37963 [9:55:35<142:34:04, 14.40s/it]
  6%|▌         | 2313/37963 [9:55:49<141:54:29, 14.33s/it]
  6%|▌         | 2314/37963 [9:56:03<142:05:49, 14.35s/it]
  6%|▌         | 2315/37963 [9:56:18<141:54:38, 14.33s/it]
  6%|▌         | 2316/37963 [9:56:32<141:51:27, 14.33s/it]
  6%|▌         | 2317/37963 [9:56:46<140:16:44, 14.17s/it]
  6%|▌         | 2318/37963 [9:57:00<140:42:20, 14.21s/it]
  6%|▌         | 2319/37963 [9:57:14<141:07:01, 14.25s/it]
  6%|▌         | 2320/37963 [9:57:29<140:43:16, 14.21s/it]
                                                          
{'loss': '0.1781', 'grad_norm': '3.609', 'learning_rate': '1.995e-05', 'epoch': '0.06111'}

  6%|▌         | 2320/37963 [9:57:29<140:43:16, 14.21s/it]
  6%|▌         | 2321/37963 [9:57:43<141:12:49, 14.26s/it]
  6%|▌         | 2322/37963 [9:57:57<140:52:56, 14.23s/it]
  6%|▌         | 2323/37963 [9:58:11<141:17:45, 14.27s/it]
  6%|▌         | 2324/37963 [9:58:26<141:33:30, 14.30s/it]
  6%|▌         | 2325/37963 [9:58:47<161:30:37, 16.32s/it]
  6%|▌         | 2326/37963 [9:59:01<155:08:54, 15.67s/it]
  6%|▌         | 2327/37963 [9:59:28<190:04:48, 19.20s/it]
  6%|▌         | 2328/37963 [9:59:43<175:50:35, 17.76s/it]
  6%|▌         | 2329/37963 [9:59:57<164:35:33, 16.63s/it]
  6%|▌         | 2330/37963 [10:00:11<157:43:48, 15.94s/it]
                                                           
{'loss': '0.1709', 'grad_norm': '3.872', 'learning_rate': '1.995e-05', 'epoch': '0.06138'}

  6%|▌         | 2330/37963 [10:00:11<157:43:48, 15.94s/it]
  6%|▌         | 2331/37963 [10:00:25<151:48:11, 15.34s/it]
  6%|▌         | 2332/37963 [10:00:39<148:46:51, 15.03s/it]
  6%|▌         | 2333/37963 [10:01:00<164:35:19, 16.63s/it]
  6%|▌         | 2334/37963 [10:01:14<157:53:04, 15.95s/it]
  6%|▌         | 2335/37963 [10:01:28<152:50:13, 15.44s/it]
  6%|▌         | 2336/37963 [10:01:49<167:59:37, 16.98s/it]
  6%|▌         | 2337/37963 [10:02:10<179:49:26, 18.17s/it]
  6%|▌         | 2338/37963 [10:02:24<168:33:08, 17.03s/it]
  6%|▌         | 2339/37963 [10:02:39<160:50:08, 16.25s/it]
  6%|▌         | 2340/37963 [10:02:59<172:58:17, 17.48s/it]
                                                           
{'loss': '0.1842', 'grad_norm': '7.495', 'learning_rate': '1.995e-05', 'epoch': '0.06164'}

  6%|▌         | 2340/37963 [10:02:59<172:58:17, 17.48s/it]
  6%|▌         | 2341/37963 [10:03:13<164:00:58, 16.58s/it]
  6%|▌         | 2342/37963 [10:03:28<157:15:39, 15.89s/it]
  6%|▌         | 2343/37963 [10:03:42<152:38:09, 15.43s/it]
  6%|▌         | 2344/37963 [10:03:56<149:09:14, 15.07s/it]
  6%|▌         | 2345/37963 [10:04:10<145:18:47, 14.69s/it]
  6%|▌         | 2346/37963 [10:04:24<143:36:54, 14.52s/it]
  6%|▌         | 2347/37963 [10:04:38<141:09:18, 14.27s/it]
  6%|▌         | 2348/37963 [10:04:59<160:30:14, 16.22s/it]
  6%|▌         | 2349/37963 [10:05:13<155:04:04, 15.67s/it]
  6%|▌         | 2350/37963 [10:05:27<150:30:53, 15.22s/it]
                                                           
{'loss': '0.1892', 'grad_norm': '4.899', 'learning_rate': '1.995e-05', 'epoch': '0.0619'}

  6%|▌         | 2350/37963 [10:05:27<150:30:53, 15.22s/it]
  6%|▌         | 2351/37963 [10:05:42<148:29:36, 15.01s/it]
  6%|▌         | 2352/37963 [10:05:56<146:23:12, 14.80s/it]
  6%|▌         | 2353/37963 [10:06:10<143:29:32, 14.51s/it]
  6%|▌         | 2354/37963 [10:06:24<141:24:11, 14.30s/it]
  6%|▌         | 2355/37963 [10:06:38<141:55:46, 14.35s/it]
  6%|▌         | 2356/37963 [10:06:53<141:58:06, 14.35s/it]
  6%|▌         | 2357/37963 [10:07:07<141:31:20, 14.31s/it]
  6%|▌         | 2358/37963 [10:07:21<141:37:14, 14.32s/it]
  6%|▌         | 2359/37963 [10:07:35<140:31:30, 14.21s/it]
  6%|▌         | 2360/37963 [10:07:50<141:09:34, 14.27s/it]
                                                           
{'loss': '0.186', 'grad_norm': '2.676', 'learning_rate': '1.995e-05', 'epoch': '0.06217'}

  6%|▌         | 2360/37963 [10:07:50<141:09:34, 14.27s/it]
  6%|▌         | 2361/37963 [10:08:04<141:32:14, 14.31s/it]
  6%|▌         | 2362/37963 [10:08:18<141:07:26, 14.27s/it]
  6%|▌         | 2363/37963 [10:08:32<141:23:37, 14.30s/it]
  6%|▌         | 2364/37963 [10:08:47<141:33:29, 14.32s/it]
  6%|▌         | 2365/37963 [10:09:01<140:18:20, 14.19s/it]
  6%|▌         | 2366/37963 [10:09:15<139:48:33, 14.14s/it]
  6%|▌         | 2367/37963 [10:09:29<140:33:04, 14.21s/it]
  6%|▌         | 2368/37963 [10:09:43<140:07:37, 14.17s/it]
  6%|▌         | 2369/37963 [10:09:57<140:20:29, 14.19s/it]
  6%|▌         | 2370/37963 [10:10:12<139:57:23, 14.16s/it]
                                                           
{'loss': '0.1649', 'grad_norm': '4.256', 'learning_rate': '1.994e-05', 'epoch': '0.06243'}

  6%|▌         | 2370/37963 [10:10:12<139:57:23, 14.16s/it]
  6%|▌         | 2371/37963 [10:10:26<140:15:31, 14.19s/it]
  6%|▌         | 2372/37963 [10:10:40<140:32:40, 14.22s/it]
  6%|▋         | 2373/37963 [10:11:01<161:20:42, 16.32s/it]
  6%|▋         | 2374/37963 [10:11:15<154:52:07, 15.67s/it]
  6%|▋         | 2375/37963 [10:11:36<169:44:25, 17.17s/it]
  6%|▋         | 2376/37963 [10:11:50<160:54:28, 16.28s/it]
  6%|▋         | 2377/37963 [10:12:05<155:10:40, 15.70s/it]
  6%|▋         | 2378/37963 [10:12:26<173:05:46, 17.51s/it]
  6%|▋         | 2379/37963 [10:12:41<163:48:07, 16.57s/it]
  6%|▋         | 2380/37963 [10:12:55<157:21:32, 15.92s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '3.154', 'learning_rate': '1.994e-05', 'epoch': '0.06269'}

  6%|▋         | 2380/37963 [10:12:55<157:21:32, 15.92s/it]
  6%|▋         | 2381/37963 [10:13:09<151:53:03, 15.37s/it]
  6%|▋         | 2382/37963 [10:13:24<148:52:33, 15.06s/it]
  6%|▋         | 2383/37963 [10:13:44<164:30:25, 16.64s/it]
  6%|▋         | 2384/37963 [10:13:58<156:07:57, 15.80s/it]
  6%|▋         | 2385/37963 [10:14:26<191:39:08, 19.39s/it]
  6%|▋         | 2386/37963 [10:14:40<176:00:04, 17.81s/it]
  6%|▋         | 2387/37963 [10:14:54<165:11:21, 16.72s/it]
  6%|▋         | 2388/37963 [10:15:08<158:01:32, 15.99s/it]
  6%|▋         | 2389/37963 [10:15:22<152:42:43, 15.45s/it]
  6%|▋         | 2390/37963 [10:15:43<168:17:25, 17.03s/it]
                                                           
{'loss': '0.1817', 'grad_norm': '5.568', 'learning_rate': '1.994e-05', 'epoch': '0.06296'}

  6%|▋         | 2390/37963 [10:15:43<168:17:25, 17.03s/it]
  6%|▋         | 2391/37963 [10:15:57<160:07:20, 16.20s/it]
  6%|▋         | 2392/37963 [10:16:12<155:08:36, 15.70s/it]
  6%|▋         | 2393/37963 [10:16:26<150:42:15, 15.25s/it]
  6%|▋         | 2394/37963 [10:16:40<148:18:12, 15.01s/it]
  6%|▋         | 2395/37963 [10:16:55<145:36:08, 14.74s/it]
  6%|▋         | 2396/37963 [10:17:09<144:29:00, 14.62s/it]
  6%|▋         | 2397/37963 [10:17:23<143:42:06, 14.55s/it]
  6%|▋         | 2398/37963 [10:17:38<143:01:25, 14.48s/it]
  6%|▋         | 2399/37963 [10:17:52<142:34:58, 14.43s/it]
  6%|▋         | 2400/37963 [10:18:13<163:21:30, 16.54s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '2.433', 'learning_rate': '1.994e-05', 'epoch': '0.06322'}

  6%|▋         | 2400/37963 [10:18:13<163:21:30, 16.54s/it]
  6%|▋         | 2401/37963 [10:18:28<157:24:06, 15.93s/it]
  6%|▋         | 2402/37963 [10:18:42<152:39:09, 15.45s/it]
  6%|▋         | 2403/37963 [10:18:57<149:33:32, 15.14s/it]
  6%|▋         | 2404/37963 [10:19:11<147:06:40, 14.89s/it]
  6%|▋         | 2405/37963 [10:19:25<145:37:31, 14.74s/it]
  6%|▋         | 2406/37963 [10:19:39<143:25:13, 14.52s/it]
  6%|▋         | 2407/37963 [10:19:53<142:07:56, 14.39s/it]
  6%|▋         | 2408/37963 [10:20:08<142:00:43, 14.38s/it]
  6%|▋         | 2409/37963 [10:20:22<141:56:29, 14.37s/it]
  6%|▋         | 2410/37963 [10:20:37<142:02:34, 14.38s/it]
                                                           
{'loss': '0.1755', 'grad_norm': '1.359', 'learning_rate': '1.994e-05', 'epoch': '0.06348'}

  6%|▋         | 2410/37963 [10:20:37<142:02:34, 14.38s/it]
  6%|▋         | 2411/37963 [10:20:51<142:08:12, 14.39s/it]
  6%|▋         | 2412/37963 [10:21:05<141:08:37, 14.29s/it]
  6%|▋         | 2413/37963 [10:21:19<141:19:04, 14.31s/it]
  6%|▋         | 2414/37963 [10:21:34<141:13:19, 14.30s/it]
  6%|▋         | 2415/37963 [10:21:48<141:19:58, 14.31s/it]
  6%|▋         | 2416/37963 [10:22:02<141:07:51, 14.29s/it]
  6%|▋         | 2417/37963 [10:22:16<139:24:31, 14.12s/it]
  6%|▋         | 2418/37963 [10:22:30<139:43:21, 14.15s/it]
  6%|▋         | 2419/37963 [10:22:45<140:14:41, 14.20s/it]
  6%|▋         | 2420/37963 [10:22:59<140:32:51, 14.24s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '1.438', 'learning_rate': '1.994e-05', 'epoch': '0.06375'}

  6%|▋         | 2420/37963 [10:22:59<140:32:51, 14.24s/it]
  6%|▋         | 2421/37963 [10:23:13<140:34:14, 14.24s/it]
  6%|▋         | 2422/37963 [10:23:34<160:45:53, 16.28s/it]
  6%|▋         | 2423/37963 [10:23:48<153:29:24, 15.55s/it]
  6%|▋         | 2424/37963 [10:24:09<169:01:19, 17.12s/it]
  6%|▋         | 2425/37963 [10:24:23<160:40:17, 16.28s/it]
  6%|▋         | 2426/37963 [10:24:37<154:48:09, 15.68s/it]
  6%|▋         | 2427/37963 [10:24:58<170:51:16, 17.31s/it]
  6%|▋         | 2428/37963 [10:25:13<161:49:26, 16.39s/it]
  6%|▋         | 2429/37963 [10:25:27<155:46:52, 15.78s/it]
  6%|▋         | 2430/37963 [10:25:47<167:18:49, 16.95s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '2.26', 'learning_rate': '1.994e-05', 'epoch': '0.06401'}

  6%|▋         | 2430/37963 [10:25:47<167:18:49, 16.95s/it]
  6%|▋         | 2431/37963 [10:26:01<159:44:50, 16.19s/it]
  6%|▋         | 2432/37963 [10:26:22<172:48:26, 17.51s/it]
  6%|▋         | 2433/37963 [10:26:36<163:22:39, 16.55s/it]
  6%|▋         | 2434/37963 [10:26:50<156:37:25, 15.87s/it]
  6%|▋         | 2435/37963 [10:27:11<171:35:55, 17.39s/it]
  6%|▋         | 2436/37963 [10:27:26<162:28:29, 16.46s/it]
  6%|▋         | 2437/37963 [10:27:40<156:12:22, 15.83s/it]
  6%|▋         | 2438/37963 [10:28:01<170:33:50, 17.28s/it]
  6%|▋         | 2439/37963 [10:28:15<162:20:26, 16.45s/it]
  6%|▋         | 2440/37963 [10:28:29<155:51:24, 15.79s/it]
                                                           
{'loss': '0.1816', 'grad_norm': '7.778', 'learning_rate': '1.994e-05', 'epoch': '0.06427'}

  6%|▋         | 2440/37963 [10:28:29<155:51:24, 15.79s/it]
  6%|▋         | 2441/37963 [10:28:44<151:40:43, 15.37s/it]
  6%|▋         | 2442/37963 [10:28:58<148:36:06, 15.06s/it]
  6%|▋         | 2443/37963 [10:29:13<146:40:49, 14.87s/it]
  6%|▋         | 2444/37963 [10:29:27<145:08:25, 14.71s/it]
  6%|▋         | 2445/37963 [10:29:41<144:14:33, 14.62s/it]
  6%|▋         | 2446/37963 [10:29:55<142:25:17, 14.44s/it]
  6%|▋         | 2447/37963 [10:30:16<160:54:12, 16.31s/it]
  6%|▋         | 2448/37963 [10:30:30<155:21:14, 15.75s/it]
  6%|▋         | 2449/37963 [10:30:45<151:09:49, 15.32s/it]
  6%|▋         | 2450/37963 [10:30:59<148:11:39, 15.02s/it]
                                                           
{'loss': '0.1582', 'grad_norm': '2.013', 'learning_rate': '1.994e-05', 'epoch': '0.06454'}

  6%|▋         | 2450/37963 [10:30:59<148:11:39, 15.02s/it]
  6%|▋         | 2451/37963 [10:31:13<146:13:38, 14.82s/it]
  6%|▋         | 2452/37963 [10:31:28<144:31:21, 14.65s/it]
  6%|▋         | 2453/37963 [10:31:42<142:33:00, 14.45s/it]
  6%|▋         | 2454/37963 [10:31:56<142:28:33, 14.44s/it]
  6%|▋         | 2455/37963 [10:32:10<141:35:24, 14.36s/it]
  6%|▋         | 2456/37963 [10:32:25<141:36:31, 14.36s/it]
  6%|▋         | 2457/37963 [10:32:39<141:04:54, 14.30s/it]
  6%|▋         | 2458/37963 [10:32:53<141:25:20, 14.34s/it]
  6%|▋         | 2459/37963 [10:33:07<140:02:05, 14.20s/it]
  6%|▋         | 2460/37963 [10:33:21<138:25:40, 14.04s/it]
                                                           
{'loss': '0.1639', 'grad_norm': '2.913', 'learning_rate': '1.994e-05', 'epoch': '0.0648'}

  6%|▋         | 2460/37963 [10:33:21<138:25:40, 14.04s/it]
  6%|▋         | 2461/37963 [10:33:35<139:19:50, 14.13s/it]
  6%|▋         | 2462/37963 [10:33:49<138:48:28, 14.08s/it]
  6%|▋         | 2463/37963 [10:34:03<138:27:07, 14.04s/it]
  6%|▋         | 2464/37963 [10:34:17<139:47:31, 14.18s/it]
  6%|▋         | 2465/37963 [10:34:32<140:12:19, 14.22s/it]
  6%|▋         | 2466/37963 [10:34:46<140:29:08, 14.25s/it]
  6%|▋         | 2467/37963 [10:35:00<140:15:45, 14.23s/it]
  7%|▋         | 2468/37963 [10:35:14<140:11:24, 14.22s/it]
  7%|▋         | 2469/37963 [10:35:29<140:42:19, 14.27s/it]
  7%|▋         | 2470/37963 [10:35:43<141:21:04, 14.34s/it]
                                                           
{'loss': '0.1774', 'grad_norm': '2.673', 'learning_rate': '1.994e-05', 'epoch': '0.06506'}

  7%|▋         | 2470/37963 [10:35:43<141:21:04, 14.34s/it]
  7%|▋         | 2471/37963 [10:35:57<140:36:17, 14.26s/it]
  7%|▋         | 2472/37963 [10:36:25<180:21:34, 18.29s/it]
  7%|▋         | 2473/37963 [10:36:39<168:34:30, 17.10s/it]
  7%|▋         | 2474/37963 [10:36:54<160:42:27, 16.30s/it]
  7%|▋         | 2475/37963 [10:37:08<155:05:18, 15.73s/it]
  7%|▋         | 2476/37963 [10:37:30<171:21:27, 17.38s/it]
  7%|▋         | 2477/37963 [10:37:43<160:46:55, 16.31s/it]
  7%|▋         | 2478/37963 [10:37:58<154:49:03, 15.71s/it]
  7%|▋         | 2479/37963 [10:38:18<169:32:50, 17.20s/it]
  7%|▋         | 2480/37963 [10:38:39<179:50:30, 18.25s/it]
                                                           
{'loss': '0.1816', 'grad_norm': '4.239', 'learning_rate': '1.993e-05', 'epoch': '0.06533'}

  7%|▋         | 2480/37963 [10:38:39<179:50:30, 18.25s/it]
  7%|▋         | 2481/37963 [10:38:54<168:43:25, 17.12s/it]
  7%|▋         | 2482/37963 [10:39:08<160:25:28, 16.28s/it]
  7%|▋         | 2483/37963 [10:39:22<154:53:14, 15.72s/it]
  7%|▋         | 2484/37963 [10:39:44<172:12:59, 17.47s/it]
  7%|▋         | 2485/37963 [10:39:58<162:57:41, 16.54s/it]
  7%|▋         | 2486/37963 [10:40:19<176:19:03, 17.89s/it]
  7%|▋         | 2487/37963 [10:40:34<165:58:12, 16.84s/it]
  7%|▋         | 2488/37963 [10:40:48<158:28:56, 16.08s/it]
  7%|▋         | 2489/37963 [10:41:02<153:15:39, 15.55s/it]
  7%|▋         | 2490/37963 [10:41:17<149:57:06, 15.22s/it]
                                                           
{'loss': '0.1792', 'grad_norm': '2.043', 'learning_rate': '1.993e-05', 'epoch': '0.06559'}

  7%|▋         | 2490/37963 [10:41:17<149:57:06, 15.22s/it]
  7%|▋         | 2491/37963 [10:41:31<145:51:46, 14.80s/it]
  7%|▋         | 2492/37963 [10:41:45<144:02:11, 14.62s/it]
  7%|▋         | 2493/37963 [10:41:59<141:36:58, 14.37s/it]
  7%|▋         | 2494/37963 [10:42:13<140:31:40, 14.26s/it]
  7%|▋         | 2495/37963 [10:42:27<140:32:06, 14.26s/it]
  7%|▋         | 2496/37963 [10:42:48<160:50:10, 16.33s/it]
  7%|▋         | 2497/37963 [10:43:02<154:28:09, 15.68s/it]
  7%|▋         | 2498/37963 [10:43:16<150:25:42, 15.27s/it]
  7%|▋         | 2499/37963 [10:43:30<146:15:39, 14.85s/it]
  7%|▋         | 2500/37963 [10:43:45<144:53:39, 14.71s/it]
                                                           
{'loss': '0.1708', 'grad_norm': '4.586', 'learning_rate': '1.993e-05', 'epoch': '0.06585'}

  7%|▋         | 2500/37963 [10:43:45<144:53:39, 14.71s/it]
  7%|▋         | 2501/37963 [10:43:59<143:16:01, 14.54s/it]
  7%|▋         | 2502/37963 [10:44:13<142:42:21, 14.49s/it]
  7%|▋         | 2503/37963 [10:44:28<142:22:23, 14.45s/it]
  7%|▋         | 2504/37963 [10:44:42<142:10:39, 14.43s/it]
  7%|▋         | 2505/37963 [10:44:56<141:11:39, 14.34s/it]
  7%|▋         | 2506/37963 [10:45:10<140:40:26, 14.28s/it]
  7%|▋         | 2507/37963 [10:45:25<141:12:55, 14.34s/it]
  7%|▋         | 2508/37963 [10:45:39<140:41:49, 14.29s/it]
  7%|▋         | 2509/37963 [10:45:53<141:02:14, 14.32s/it]
  7%|▋         | 2510/37963 [10:46:08<141:01:00, 14.32s/it]
                                                           
{'loss': '0.18', 'grad_norm': '2.238', 'learning_rate': '1.993e-05', 'epoch': '0.06612'}

  7%|▋         | 2510/37963 [10:46:08<141:01:00, 14.32s/it]
  7%|▋         | 2511/37963 [10:46:22<141:14:32, 14.34s/it]
  7%|▋         | 2512/37963 [10:46:36<140:10:10, 14.23s/it]
  7%|▋         | 2513/37963 [10:46:50<140:44:19, 14.29s/it]
  7%|▋         | 2514/37963 [10:47:05<140:46:48, 14.30s/it]
  7%|▋         | 2515/37963 [10:47:19<141:47:56, 14.40s/it]
  7%|▋         | 2516/37963 [10:47:34<141:43:24, 14.39s/it]
  7%|▋         | 2517/37963 [10:47:47<139:58:22, 14.22s/it]
  7%|▋         | 2518/37963 [10:48:02<140:31:56, 14.27s/it]
  7%|▋         | 2519/37963 [10:48:16<140:48:03, 14.30s/it]
  7%|▋         | 2520/37963 [10:48:38<161:30:26, 16.40s/it]
                                                           
{'loss': '0.183', 'grad_norm': '3.707', 'learning_rate': '1.993e-05', 'epoch': '0.06638'}

  7%|▋         | 2520/37963 [10:48:38<161:30:26, 16.40s/it]
  7%|▋         | 2521/37963 [10:48:58<174:05:36, 17.68s/it]
  7%|▋         | 2522/37963 [10:49:13<164:21:46, 16.70s/it]
  7%|▋         | 2523/37963 [10:49:27<157:24:06, 15.99s/it]
  7%|▋         | 2524/37963 [10:49:41<151:48:31, 15.42s/it]
  7%|▋         | 2525/37963 [10:50:02<168:49:59, 17.15s/it]
  7%|▋         | 2526/37963 [10:50:16<159:50:38, 16.24s/it]
  7%|▋         | 2527/37963 [10:50:31<154:23:00, 15.68s/it]
  7%|▋         | 2528/37963 [10:50:57<185:45:07, 18.87s/it]
  7%|▋         | 2529/37963 [10:51:11<172:29:37, 17.52s/it]
  7%|▋         | 2530/37963 [10:51:26<162:54:11, 16.55s/it]
                                                           
{'loss': '0.1865', 'grad_norm': '2.226', 'learning_rate': '1.993e-05', 'epoch': '0.06664'}

  7%|▋         | 2530/37963 [10:51:26<162:54:11, 16.55s/it]
  7%|▋         | 2531/37963 [10:51:40<156:32:05, 15.90s/it]
  7%|▋         | 2532/37963 [10:52:01<170:16:52, 17.30s/it]
  7%|▋         | 2533/37963 [10:52:15<161:44:19, 16.43s/it]
  7%|▋         | 2534/37963 [10:52:29<155:04:47, 15.76s/it]
  7%|▋         | 2535/37963 [10:52:44<150:59:12, 15.34s/it]
  7%|▋         | 2536/37963 [10:53:04<166:39:35, 16.94s/it]
  7%|▋         | 2537/37963 [10:53:19<159:06:51, 16.17s/it]
  7%|▋         | 2538/37963 [10:53:33<153:43:34, 15.62s/it]
  7%|▋         | 2539/37963 [10:53:47<150:07:37, 15.26s/it]
  7%|▋         | 2540/37963 [10:54:02<146:52:34, 14.93s/it]
                                                           
{'loss': '0.1723', 'grad_norm': '3.046', 'learning_rate': '1.993e-05', 'epoch': '0.06691'}

  7%|▋         | 2540/37963 [10:54:02<146:52:34, 14.93s/it]
  7%|▋         | 2541/37963 [10:54:16<143:55:52, 14.63s/it]
  7%|▋         | 2542/37963 [10:54:30<143:19:18, 14.57s/it]
  7%|▋         | 2543/37963 [10:54:44<142:21:38, 14.47s/it]
  7%|▋         | 2544/37963 [10:54:58<141:51:08, 14.42s/it]
  7%|▋         | 2545/37963 [10:55:13<140:59:28, 14.33s/it]
  7%|▋         | 2546/37963 [10:55:33<158:39:11, 16.13s/it]
  7%|▋         | 2547/37963 [10:55:47<153:26:28, 15.60s/it]
  7%|▋         | 2548/37963 [10:56:02<149:57:56, 15.24s/it]
  7%|▋         | 2549/37963 [10:56:16<147:33:27, 15.00s/it]
  7%|▋         | 2550/37963 [10:56:30<145:38:51, 14.81s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '1.044', 'learning_rate': '1.993e-05', 'epoch': '0.06717'}

  7%|▋         | 2550/37963 [10:56:30<145:38:51, 14.81s/it]
  7%|▋         | 2551/37963 [10:56:45<144:15:20, 14.67s/it]
  7%|▋         | 2552/37963 [10:56:59<143:37:53, 14.60s/it]
  7%|▋         | 2553/37963 [10:57:13<141:03:45, 14.34s/it]
  7%|▋         | 2554/37963 [10:57:27<139:31:39, 14.19s/it]
  7%|▋         | 2555/37963 [10:57:41<140:10:39, 14.25s/it]
  7%|▋         | 2556/37963 [10:57:56<140:39:01, 14.30s/it]
  7%|▋         | 2557/37963 [10:58:10<141:03:20, 14.34s/it]
  7%|▋         | 2558/37963 [10:58:25<141:18:43, 14.37s/it]
  7%|▋         | 2559/37963 [10:58:39<141:23:06, 14.38s/it]
  7%|▋         | 2560/37963 [10:58:53<141:27:24, 14.38s/it]
                                                           
{'loss': '0.1861', 'grad_norm': '0.9914', 'learning_rate': '1.993e-05', 'epoch': '0.06743'}

  7%|▋         | 2560/37963 [10:58:53<141:27:24, 14.38s/it]
  7%|▋         | 2561/37963 [10:59:08<141:33:13, 14.39s/it]
  7%|▋         | 2562/37963 [10:59:22<140:44:21, 14.31s/it]
  7%|▋         | 2563/37963 [10:59:36<140:37:13, 14.30s/it]
  7%|▋         | 2564/37963 [10:59:50<140:47:59, 14.32s/it]
  7%|▋         | 2565/37963 [11:00:05<140:52:18, 14.33s/it]
  7%|▋         | 2566/37963 [11:00:19<139:19:30, 14.17s/it]
  7%|▋         | 2567/37963 [11:00:39<157:04:10, 15.97s/it]
  7%|▋         | 2568/37963 [11:00:53<152:19:46, 15.49s/it]
  7%|▋         | 2569/37963 [11:01:08<148:57:23, 15.15s/it]
  7%|▋         | 2570/37963 [11:01:29<167:00:19, 16.99s/it]
                                                           
{'loss': '0.1829', 'grad_norm': '5.99', 'learning_rate': '1.993e-05', 'epoch': '0.0677'}

  7%|▋         | 2570/37963 [11:01:29<167:00:19, 16.99s/it]
  7%|▋         | 2571/37963 [11:01:43<158:48:21, 16.15s/it]
  7%|▋         | 2572/37963 [11:01:57<151:49:03, 15.44s/it]
  7%|▋         | 2573/37963 [11:02:18<168:16:09, 17.12s/it]
  7%|▋         | 2574/37963 [11:02:32<160:36:00, 16.34s/it]
  7%|▋         | 2575/37963 [11:02:47<155:12:57, 15.79s/it]
  7%|▋         | 2576/37963 [11:03:07<168:43:22, 17.16s/it]
  7%|▋         | 2577/37963 [11:03:28<180:18:28, 18.34s/it]
  7%|▋         | 2578/37963 [11:03:43<168:27:01, 17.14s/it]
  7%|▋         | 2579/37963 [11:03:57<159:29:23, 16.23s/it]
  7%|▋         | 2580/37963 [11:04:10<152:08:34, 15.48s/it]
                                                           
{'loss': '0.173', 'grad_norm': '2.922', 'learning_rate': '1.992e-05', 'epoch': '0.06796'}

  7%|▋         | 2580/37963 [11:04:10<152:08:34, 15.48s/it]
  7%|▋         | 2581/37963 [11:04:24<147:47:39, 15.04s/it]
  7%|▋         | 2582/37963 [11:04:46<167:00:40, 16.99s/it]
  7%|▋         | 2583/37963 [11:05:00<159:14:10, 16.20s/it]
  7%|▋         | 2584/37963 [11:05:15<153:48:51, 15.65s/it]
  7%|▋         | 2585/37963 [11:05:36<168:52:48, 17.18s/it]
  7%|▋         | 2586/37963 [11:05:50<160:45:08, 16.36s/it]
  7%|▋         | 2587/37963 [11:06:04<154:42:49, 15.74s/it]
  7%|▋         | 2588/37963 [11:06:19<150:27:13, 15.31s/it]
  7%|▋         | 2589/37963 [11:06:33<146:25:55, 14.90s/it]
  7%|▋         | 2590/37963 [11:06:47<143:59:58, 14.66s/it]
                                                           
{'loss': '0.1873', 'grad_norm': '1.626', 'learning_rate': '1.992e-05', 'epoch': '0.06822'}

  7%|▋         | 2590/37963 [11:06:47<143:59:58, 14.66s/it]
  7%|▋         | 2591/37963 [11:07:01<142:09:20, 14.47s/it]
  7%|▋         | 2592/37963 [11:07:14<140:21:30, 14.29s/it]
  7%|▋         | 2593/37963 [11:07:28<138:53:17, 14.14s/it]
  7%|▋         | 2594/37963 [11:07:42<137:59:27, 14.05s/it]
  7%|▋         | 2595/37963 [11:07:57<139:09:29, 14.16s/it]
  7%|▋         | 2596/37963 [11:08:17<158:49:27, 16.17s/it]
  7%|▋         | 2597/37963 [11:08:32<153:25:54, 15.62s/it]
  7%|▋         | 2598/37963 [11:08:46<149:35:11, 15.23s/it]
  7%|▋         | 2599/37963 [11:09:00<146:55:56, 14.96s/it]
  7%|▋         | 2600/37963 [11:09:14<143:29:51, 14.61s/it]
                                                           
{'loss': '0.1759', 'grad_norm': '3.69', 'learning_rate': '1.992e-05', 'epoch': '0.06849'}

  7%|▋         | 2600/37963 [11:09:14<143:29:51, 14.61s/it]
  7%|▋         | 2601/37963 [11:09:28<141:58:53, 14.45s/it]
  7%|▋         | 2602/37963 [11:09:43<141:47:04, 14.43s/it]
  7%|▋         | 2603/37963 [11:09:57<141:33:07, 14.41s/it]
  7%|▋         | 2604/37963 [11:10:11<140:35:48, 14.31s/it]
  7%|▋         | 2605/37963 [11:10:25<140:40:30, 14.32s/it]
  7%|▋         | 2606/37963 [11:10:40<140:53:59, 14.35s/it]
  7%|▋         | 2607/37963 [11:10:53<138:47:36, 14.13s/it]
  7%|▋         | 2608/37963 [11:11:08<139:10:57, 14.17s/it]
  7%|▋         | 2609/37963 [11:11:22<139:38:01, 14.22s/it]
  7%|▋         | 2610/37963 [11:11:37<140:16:56, 14.28s/it]
                                                           
{'loss': '0.174', 'grad_norm': '4.134', 'learning_rate': '1.992e-05', 'epoch': '0.06875'}

  7%|▋         | 2610/37963 [11:11:37<140:16:56, 14.28s/it]
  7%|▋         | 2611/37963 [11:11:50<138:46:12, 14.13s/it]
  7%|▋         | 2612/37963 [11:12:05<139:23:20, 14.19s/it]
  7%|▋         | 2613/37963 [11:12:19<138:37:43, 14.12s/it]
  7%|▋         | 2614/37963 [11:12:32<136:49:56, 13.94s/it]
  7%|▋         | 2615/37963 [11:12:52<153:14:14, 15.61s/it]
  7%|▋         | 2616/37963 [11:13:06<149:30:49, 15.23s/it]
  7%|▋         | 2617/37963 [11:13:20<144:50:45, 14.75s/it]
  7%|▋         | 2618/37963 [11:13:41<163:49:11, 16.69s/it]
  7%|▋         | 2619/37963 [11:13:55<156:19:50, 15.92s/it]
  7%|▋         | 2620/37963 [11:14:09<152:10:50, 15.50s/it]
                                                           
{'loss': '0.1822', 'grad_norm': '1.88', 'learning_rate': '1.992e-05', 'epoch': '0.06901'}

  7%|▋         | 2620/37963 [11:14:09<152:10:50, 15.50s/it]
  7%|▋         | 2621/37963 [11:14:24<148:31:42, 15.13s/it]
  7%|▋         | 2622/37963 [11:14:38<144:52:20, 14.76s/it]
  7%|▋         | 2623/37963 [11:14:59<164:13:30, 16.73s/it]
  7%|▋         | 2624/37963 [11:15:20<176:03:02, 17.93s/it]
  7%|▋         | 2625/37963 [11:15:40<184:18:32, 18.78s/it]
  7%|▋         | 2626/37963 [11:15:55<171:05:14, 17.43s/it]
  7%|▋         | 2627/37963 [11:16:09<161:59:13, 16.50s/it]
  7%|▋         | 2628/37963 [11:16:23<155:15:56, 15.82s/it]
  7%|▋         | 2629/37963 [11:16:37<150:25:43, 15.33s/it]
  7%|▋         | 2630/37963 [11:16:52<147:38:31, 15.04s/it]
                                                           
{'loss': '0.167', 'grad_norm': '4.366', 'learning_rate': '1.992e-05', 'epoch': '0.06928'}

  7%|▋         | 2630/37963 [11:16:52<147:38:31, 15.04s/it]
  7%|▋         | 2631/37963 [11:17:13<166:57:17, 17.01s/it]
  7%|▋         | 2632/37963 [11:17:27<158:16:31, 16.13s/it]
  7%|▋         | 2633/37963 [11:17:41<151:03:30, 15.39s/it]
  7%|▋         | 2634/37963 [11:18:01<165:21:52, 16.85s/it]
  7%|▋         | 2635/37963 [11:18:16<158:08:29, 16.11s/it]
  7%|▋         | 2636/37963 [11:18:30<153:22:10, 15.63s/it]
  7%|▋         | 2637/37963 [11:18:45<149:17:08, 15.21s/it]
  7%|▋         | 2638/37963 [11:18:59<146:49:13, 14.96s/it]
  7%|▋         | 2639/37963 [11:19:13<144:04:13, 14.68s/it]
  7%|▋         | 2640/37963 [11:19:27<143:14:09, 14.60s/it]
                                                           
{'loss': '1.622', 'grad_norm': '40.97', 'learning_rate': '1.992e-05', 'epoch': '0.06954'}

  7%|▋         | 2640/37963 [11:19:27<143:14:09, 14.60s/it]
  7%|▋         | 2641/37963 [11:19:42<142:32:29, 14.53s/it]
  7%|▋         | 2642/37963 [11:19:55<139:59:45, 14.27s/it]
  7%|▋         | 2643/37963 [11:20:17<161:16:59, 16.44s/it]
  7%|▋         | 2644/37963 [11:20:31<154:01:22, 15.70s/it]
  7%|▋         | 2645/37963 [11:20:45<148:15:13, 15.11s/it]
  7%|▋         | 2646/37963 [11:20:59<145:35:00, 14.84s/it]
  7%|▋         | 2647/37963 [11:21:13<142:57:47, 14.57s/it]
  7%|▋         | 2648/37963 [11:21:27<142:08:00, 14.49s/it]
  7%|▋         | 2649/37963 [11:21:41<141:39:09, 14.44s/it]
  7%|▋         | 2650/37963 [11:21:55<139:36:32, 14.23s/it]
                                                           
{'loss': '1.431', 'grad_norm': '2.912', 'learning_rate': '1.992e-05', 'epoch': '0.06981'}

  7%|▋         | 2650/37963 [11:21:55<139:36:32, 14.23s/it]
  7%|▋         | 2651/37963 [11:22:09<139:15:25, 14.20s/it]
  7%|▋         | 2652/37963 [11:22:24<139:42:52, 14.24s/it]
  7%|▋         | 2653/37963 [11:22:38<140:15:26, 14.30s/it]
  7%|▋         | 2654/37963 [11:22:52<140:18:48, 14.31s/it]
  7%|▋         | 2655/37963 [11:23:07<140:50:41, 14.36s/it]
  7%|▋         | 2656/37963 [11:23:21<140:51:11, 14.36s/it]
  7%|▋         | 2657/37963 [11:23:36<140:49:09, 14.36s/it]
  7%|▋         | 2658/37963 [11:23:50<141:16:12, 14.41s/it]
  7%|▋         | 2659/37963 [11:24:04<141:02:16, 14.38s/it]
  7%|▋         | 2660/37963 [11:24:19<141:32:48, 14.43s/it]
                                                           
{'loss': '0.2159', 'grad_norm': '3.25', 'learning_rate': '1.992e-05', 'epoch': '0.07007'}

  7%|▋         | 2660/37963 [11:24:19<141:32:48, 14.43s/it]
  7%|▋         | 2661/37963 [11:24:33<141:00:46, 14.38s/it]
  7%|▋         | 2662/37963 [11:24:54<159:08:05, 16.23s/it]
  7%|▋         | 2663/37963 [11:25:08<153:40:38, 15.67s/it]
  7%|▋         | 2664/37963 [11:25:22<148:35:30, 15.15s/it]
  7%|▋         | 2665/37963 [11:25:36<146:12:34, 14.91s/it]
  7%|▋         | 2666/37963 [11:25:51<144:04:15, 14.69s/it]
  7%|▋         | 2667/37963 [11:26:05<142:26:38, 14.53s/it]
  7%|▋         | 2668/37963 [11:26:19<142:03:55, 14.49s/it]
  7%|▋         | 2669/37963 [11:26:40<161:27:53, 16.47s/it]
  7%|▋         | 2670/37963 [11:26:55<155:09:12, 15.83s/it]
                                                           
{'loss': '0.2003', 'grad_norm': '3.112', 'learning_rate': '1.991e-05', 'epoch': '0.07033'}

  7%|▋         | 2670/37963 [11:26:55<155:09:12, 15.83s/it]
  7%|▋         | 2671/37963 [11:27:16<171:29:49, 17.49s/it]
  7%|▋         | 2672/37963 [11:27:30<162:06:02, 16.54s/it]
  7%|▋         | 2673/37963 [11:27:57<191:26:50, 19.53s/it]
  7%|▋         | 2674/37963 [11:28:11<176:20:45, 17.99s/it]
  7%|▋         | 2675/37963 [11:28:25<164:44:47, 16.81s/it]
  7%|▋         | 2676/37963 [11:28:40<157:34:36, 16.08s/it]
  7%|▋         | 2677/37963 [11:28:53<150:32:12, 15.36s/it]
  7%|▋         | 2678/37963 [11:29:08<147:31:29, 15.05s/it]
  7%|▋         | 2679/37963 [11:29:29<165:46:41, 16.91s/it]
  7%|▋         | 2680/37963 [11:29:43<158:15:52, 16.15s/it]
                                                           
{'loss': '0.18', 'grad_norm': '1.786', 'learning_rate': '1.991e-05', 'epoch': '0.0706'}

  7%|▋         | 2680/37963 [11:29:43<158:15:52, 16.15s/it]
  7%|▋         | 2681/37963 [11:29:58<153:03:20, 15.62s/it]
  7%|▋         | 2682/37963 [11:30:12<149:34:30, 15.26s/it]
  7%|▋         | 2683/37963 [11:30:33<165:57:06, 16.93s/it]
  7%|▋         | 2684/37963 [11:30:47<158:33:12, 16.18s/it]
  7%|▋         | 2685/37963 [11:31:01<152:16:35, 15.54s/it]
  7%|▋         | 2686/37963 [11:31:16<148:36:52, 15.17s/it]
  7%|▋         | 2687/37963 [11:31:30<146:21:10, 14.94s/it]
  7%|▋         | 2688/37963 [11:31:44<144:32:57, 14.75s/it]
  7%|▋         | 2689/37963 [11:31:59<143:52:07, 14.68s/it]
  7%|▋         | 2690/37963 [11:32:20<162:25:06, 16.58s/it]
                                                           
{'loss': '0.203', 'grad_norm': '1.961', 'learning_rate': '1.991e-05', 'epoch': '0.07086'}

  7%|▋         | 2690/37963 [11:32:20<162:25:06, 16.58s/it]
  7%|▋         | 2691/37963 [11:32:33<151:48:54, 15.49s/it]
  7%|▋         | 2692/37963 [11:32:46<146:03:54, 14.91s/it]
  7%|▋         | 2693/37963 [11:33:01<144:47:49, 14.78s/it]
  7%|▋         | 2694/37963 [11:33:15<142:32:33, 14.55s/it]
  7%|▋         | 2695/37963 [11:33:29<141:46:22, 14.47s/it]
  7%|▋         | 2696/37963 [11:33:43<139:28:47, 14.24s/it]
  7%|▋         | 2697/37963 [11:33:57<139:58:17, 14.29s/it]
  7%|▋         | 2698/37963 [11:34:11<139:04:23, 14.20s/it]
  7%|▋         | 2699/37963 [11:34:25<138:38:31, 14.15s/it]
  7%|▋         | 2700/37963 [11:34:40<139:13:40, 14.21s/it]
                                                           
{'loss': '0.2078', 'grad_norm': '4.032', 'learning_rate': '1.991e-05', 'epoch': '0.07112'}

  7%|▋         | 2700/37963 [11:34:40<139:13:40, 14.21s/it]
  7%|▋         | 2701/37963 [11:34:53<138:08:25, 14.10s/it]
  7%|▋         | 2702/37963 [11:35:08<138:49:17, 14.17s/it]
  7%|▋         | 2703/37963 [11:35:22<138:23:10, 14.13s/it]
  7%|▋         | 2704/37963 [11:35:36<139:08:42, 14.21s/it]
  7%|▋         | 2705/37963 [11:35:51<139:56:17, 14.29s/it]
  7%|▋         | 2706/37963 [11:36:05<140:36:17, 14.36s/it]
  7%|▋         | 2707/37963 [11:36:20<140:27:48, 14.34s/it]
  7%|▋         | 2708/37963 [11:36:34<140:37:01, 14.36s/it]
  7%|▋         | 2709/37963 [11:36:48<140:43:25, 14.37s/it]
  7%|▋         | 2710/37963 [11:37:03<140:38:10, 14.36s/it]
                                                           
{'loss': '0.1785', 'grad_norm': '2.326', 'learning_rate': '1.991e-05', 'epoch': '0.07139'}

  7%|▋         | 2710/37963 [11:37:03<140:38:10, 14.36s/it]
  7%|▋         | 2711/37963 [11:37:23<159:39:35, 16.30s/it]
  7%|▋         | 2712/37963 [11:37:38<153:48:10, 15.71s/it]
  7%|▋         | 2713/37963 [11:37:52<149:48:07, 15.30s/it]
  7%|▋         | 2714/37963 [11:38:06<146:42:32, 14.98s/it]
  7%|▋         | 2715/37963 [11:38:21<144:57:42, 14.81s/it]
  7%|▋         | 2716/37963 [11:38:35<143:00:08, 14.61s/it]
  7%|▋         | 2717/37963 [11:38:49<142:47:36, 14.58s/it]
  7%|▋         | 2718/37963 [11:39:03<141:03:29, 14.41s/it]
  7%|▋         | 2719/37963 [11:39:17<139:55:05, 14.29s/it]
  7%|▋         | 2720/37963 [11:39:38<158:26:54, 16.19s/it]
                                                           
{'loss': '0.1934', 'grad_norm': '3.845', 'learning_rate': '1.991e-05', 'epoch': '0.07165'}

  7%|▋         | 2720/37963 [11:39:38<158:26:54, 16.19s/it]
  7%|▋         | 2721/37963 [11:39:59<172:24:41, 17.61s/it]
  7%|▋         | 2722/37963 [11:40:25<197:43:21, 20.20s/it]
  7%|▋         | 2723/37963 [11:40:39<179:54:48, 18.38s/it]
  7%|▋         | 2724/37963 [11:40:54<167:55:18, 17.15s/it]
  7%|▋         | 2725/37963 [11:41:08<158:15:08, 16.17s/it]
  7%|▋         | 2726/37963 [11:41:21<150:58:53, 15.43s/it]
  7%|▋         | 2727/37963 [11:41:43<168:27:53, 17.21s/it]
  7%|▋         | 2728/37963 [11:41:57<160:05:41, 16.36s/it]
  7%|▋         | 2729/37963 [11:42:11<153:07:44, 15.65s/it]
  7%|▋         | 2730/37963 [11:42:25<149:21:00, 15.26s/it]
                                                           
{'loss': '0.1892', 'grad_norm': '1.933', 'learning_rate': '1.991e-05', 'epoch': '0.07191'}

  7%|▋         | 2730/37963 [11:42:25<149:21:00, 15.26s/it]
  7%|▋         | 2731/37963 [11:42:40<146:37:51, 14.98s/it]
  7%|▋         | 2732/37963 [11:42:54<144:49:43, 14.80s/it]
  7%|▋         | 2733/37963 [11:43:14<161:20:42, 16.49s/it]
  7%|▋         | 2734/37963 [11:43:29<155:07:47, 15.85s/it]
  7%|▋         | 2735/37963 [11:43:43<150:46:03, 15.41s/it]
  7%|▋         | 2736/37963 [11:43:58<148:05:33, 15.13s/it]
  7%|▋         | 2737/37963 [11:44:12<145:46:07, 14.90s/it]
  7%|▋         | 2738/37963 [11:44:27<144:35:11, 14.78s/it]
  7%|▋         | 2739/37963 [11:44:48<163:04:50, 16.67s/it]
  7%|▋         | 2740/37963 [11:45:02<156:00:53, 15.95s/it]
                                                           
{'loss': '0.1741', 'grad_norm': '2.226', 'learning_rate': '1.991e-05', 'epoch': '0.07218'}

  7%|▋         | 2740/37963 [11:45:02<156:00:53, 15.95s/it]
  7%|▋         | 2741/37963 [11:45:16<150:01:10, 15.33s/it]
  7%|▋         | 2742/37963 [11:45:30<146:53:29, 15.01s/it]
  7%|▋         | 2743/37963 [11:45:44<144:52:51, 14.81s/it]
  7%|▋         | 2744/37963 [11:45:59<143:05:49, 14.63s/it]
  7%|▋         | 2745/37963 [11:46:13<142:26:46, 14.56s/it]
  7%|▋         | 2746/37963 [11:46:27<141:46:10, 14.49s/it]
  7%|▋         | 2747/37963 [11:46:42<140:53:45, 14.40s/it]
  7%|▋         | 2748/37963 [11:46:56<140:40:27, 14.38s/it]
  7%|▋         | 2749/37963 [11:47:10<140:23:06, 14.35s/it]
  7%|▋         | 2750/37963 [11:47:24<140:13:38, 14.34s/it]
                                                           
{'loss': '0.1739', 'grad_norm': '2.69', 'learning_rate': '1.991e-05', 'epoch': '0.07244'}

  7%|▋         | 2750/37963 [11:47:24<140:13:38, 14.34s/it]
  7%|▋         | 2751/37963 [11:47:39<140:28:12, 14.36s/it]
  7%|▋         | 2752/37963 [11:47:53<140:41:14, 14.38s/it]
  7%|▋         | 2753/37963 [11:48:08<140:36:43, 14.38s/it]
  7%|▋         | 2754/37963 [11:48:22<140:47:17, 14.40s/it]
  7%|▋         | 2755/37963 [11:48:36<139:56:05, 14.31s/it]
  7%|▋         | 2756/37963 [11:48:51<140:33:46, 14.37s/it]
  7%|▋         | 2757/37963 [11:49:05<140:37:23, 14.38s/it]
  7%|▋         | 2758/37963 [11:49:19<140:20:26, 14.35s/it]
  7%|▋         | 2759/37963 [11:49:34<140:16:33, 14.34s/it]
  7%|▋         | 2760/37963 [11:49:55<159:06:38, 16.27s/it]
                                                           
{'loss': '0.185', 'grad_norm': '4.654', 'learning_rate': '1.99e-05', 'epoch': '0.0727'}

  7%|▋         | 2760/37963 [11:49:55<159:06:38, 16.27s/it]
  7%|▋         | 2761/37963 [11:50:09<153:15:52, 15.67s/it]
  7%|▋         | 2762/37963 [11:50:23<148:52:29, 15.23s/it]
  7%|▋         | 2763/37963 [11:50:37<145:38:13, 14.89s/it]
  7%|▋         | 2764/37963 [11:50:51<144:07:41, 14.74s/it]
  7%|▋         | 2765/37963 [11:51:06<143:05:49, 14.64s/it]
  7%|▋         | 2766/37963 [11:51:20<142:12:33, 14.55s/it]
  7%|▋         | 2767/37963 [11:51:35<141:40:54, 14.49s/it]
  7%|▋         | 2768/37963 [11:51:49<141:15:12, 14.45s/it]
  7%|▋         | 2769/37963 [11:52:10<160:57:11, 16.46s/it]
  7%|▋         | 2770/37963 [11:52:24<154:44:07, 15.83s/it]
                                                           
{'loss': '0.1776', 'grad_norm': '2.409', 'learning_rate': '1.99e-05', 'epoch': '0.07297'}

  7%|▋         | 2770/37963 [11:52:24<154:44:07, 15.83s/it]
  7%|▋         | 2771/37963 [11:52:45<169:52:00, 17.38s/it]
  7%|▋         | 2772/37963 [11:53:12<197:05:43, 20.16s/it]
  7%|▋         | 2773/37963 [11:53:26<179:55:21, 18.41s/it]
  7%|▋         | 2774/37963 [11:53:41<168:08:26, 17.20s/it]
  7%|▋         | 2775/37963 [11:54:02<178:31:45, 18.26s/it]
  7%|▋         | 2776/37963 [11:54:16<166:58:23, 17.08s/it]
  7%|▋         | 2777/37963 [11:54:30<157:57:15, 16.16s/it]
  7%|▋         | 2778/37963 [11:54:44<152:39:24, 15.62s/it]
  7%|▋         | 2779/37963 [11:54:58<147:25:41, 15.08s/it]
  7%|▋         | 2780/37963 [11:55:12<145:02:19, 14.84s/it]
                                                           
{'loss': '0.1771', 'grad_norm': '3.81', 'learning_rate': '1.99e-05', 'epoch': '0.07323'}

  7%|▋         | 2780/37963 [11:55:12<145:02:19, 14.84s/it]
  7%|▋         | 2781/37963 [11:55:27<144:32:53, 14.79s/it]
  7%|▋         | 2782/37963 [11:55:42<143:51:54, 14.72s/it]
  7%|▋         | 2783/37963 [11:56:02<159:43:12, 16.34s/it]
  7%|▋         | 2784/37963 [11:56:16<153:15:29, 15.68s/it]
  7%|▋         | 2785/37963 [11:56:30<149:30:01, 15.30s/it]
  7%|▋         | 2786/37963 [11:56:45<146:40:30, 15.01s/it]
  7%|▋         | 2787/37963 [11:56:59<144:38:04, 14.80s/it]
  7%|▋         | 2788/37963 [11:57:13<143:34:30, 14.69s/it]
  7%|▋         | 2789/37963 [11:57:27<141:23:07, 14.47s/it]
  7%|▋         | 2790/37963 [11:57:48<160:36:08, 16.44s/it]
                                                           
{'loss': '0.1793', 'grad_norm': '4.955', 'learning_rate': '1.99e-05', 'epoch': '0.07349'}

  7%|▋         | 2790/37963 [11:57:48<160:36:08, 16.44s/it]
  7%|▋         | 2791/37963 [11:58:03<154:19:09, 15.80s/it]
  7%|▋         | 2792/37963 [11:58:17<150:18:46, 15.39s/it]
  7%|▋         | 2793/37963 [11:58:31<147:17:42, 15.08s/it]
  7%|▋         | 2794/37963 [11:58:46<145:37:34, 14.91s/it]
  7%|▋         | 2795/37963 [11:59:00<143:54:59, 14.73s/it]
  7%|▋         | 2796/37963 [11:59:14<141:47:26, 14.51s/it]
  7%|▋         | 2797/37963 [11:59:29<141:26:06, 14.48s/it]
  7%|▋         | 2798/37963 [11:59:43<140:03:23, 14.34s/it]
  7%|▋         | 2799/37963 [11:59:57<139:49:57, 14.32s/it]
  7%|▋         | 2800/37963 [12:00:11<139:38:22, 14.30s/it]
                                                           
{'loss': '0.1797', 'grad_norm': '7.148', 'learning_rate': '1.99e-05', 'epoch': '0.07376'}

  7%|▋         | 2800/37963 [12:00:11<139:38:22, 14.30s/it]
  7%|▋         | 2801/37963 [12:00:25<138:44:09, 14.20s/it]
  7%|▋         | 2802/37963 [12:00:39<137:16:01, 14.05s/it]
  7%|▋         | 2803/37963 [12:00:53<138:06:32, 14.14s/it]
  7%|▋         | 2804/37963 [12:01:07<138:02:06, 14.13s/it]
  7%|▋         | 2805/37963 [12:01:21<137:42:22, 14.10s/it]
  7%|▋         | 2806/37963 [12:01:36<138:25:48, 14.17s/it]
  7%|▋         | 2807/37963 [12:01:50<138:28:20, 14.18s/it]
  7%|▋         | 2808/37963 [12:02:04<138:33:33, 14.19s/it]
  7%|▋         | 2809/37963 [12:02:24<156:32:41, 16.03s/it]
  7%|▋         | 2810/37963 [12:02:39<151:33:11, 15.52s/it]
                                                           
{'loss': '0.1801', 'grad_norm': '2.779', 'learning_rate': '1.99e-05', 'epoch': '0.07402'}

  7%|▋         | 2810/37963 [12:02:39<151:33:11, 15.52s/it]
  7%|▋         | 2811/37963 [12:02:53<147:10:43, 15.07s/it]
  7%|▋         | 2812/37963 [12:03:07<145:06:20, 14.86s/it]
  7%|▋         | 2813/37963 [12:03:21<143:08:45, 14.66s/it]
  7%|▋         | 2814/37963 [12:03:36<142:30:21, 14.60s/it]
  7%|▋         | 2815/37963 [12:03:50<141:51:17, 14.53s/it]
  7%|▋         | 2816/37963 [12:04:04<140:35:11, 14.40s/it]
  7%|▋         | 2817/37963 [12:04:25<160:26:37, 16.43s/it]
  7%|▋         | 2818/37963 [12:04:47<174:23:24, 17.86s/it]
  7%|▋         | 2819/37963 [12:05:01<164:23:59, 16.84s/it]
  7%|▋         | 2820/37963 [12:05:15<156:22:52, 16.02s/it]
                                                           
{'loss': '0.1762', 'grad_norm': '3.057', 'learning_rate': '1.99e-05', 'epoch': '0.07428'}

  7%|▋         | 2820/37963 [12:05:15<156:22:52, 16.02s/it]
  7%|▋         | 2821/37963 [12:05:36<169:59:46, 17.41s/it]
  7%|▋         | 2822/37963 [12:05:57<179:48:36, 18.42s/it]
  7%|▋         | 2823/37963 [12:06:18<187:12:01, 19.18s/it]
  7%|▋         | 2824/37963 [12:06:32<173:06:31, 17.74s/it]
  7%|▋         | 2825/37963 [12:06:46<163:04:41, 16.71s/it]
  7%|▋         | 2826/37963 [12:07:01<156:27:51, 16.03s/it]
  7%|▋         | 2827/37963 [12:07:15<150:10:44, 15.39s/it]
  7%|▋         | 2828/37963 [12:07:29<147:19:12, 15.09s/it]
  7%|▋         | 2829/37963 [12:07:43<145:18:02, 14.89s/it]
  7%|▋         | 2830/37963 [12:07:58<144:15:06, 14.78s/it]
                                                           
{'loss': '0.1879', 'grad_norm': '3.655', 'learning_rate': '1.99e-05', 'epoch': '0.07455'}

  7%|▋         | 2830/37963 [12:07:58<144:15:06, 14.78s/it]
  7%|▋         | 2831/37963 [12:08:12<142:50:54, 14.64s/it]
  7%|▋         | 2832/37963 [12:08:27<141:54:27, 14.54s/it]
  7%|▋         | 2833/37963 [12:08:41<141:14:49, 14.47s/it]
  7%|▋         | 2834/37963 [12:09:01<158:28:26, 16.24s/it]
  7%|▋         | 2835/37963 [12:09:15<152:41:29, 15.65s/it]
  7%|▋         | 2836/37963 [12:09:30<148:45:52, 15.25s/it]
  7%|▋         | 2837/37963 [12:09:43<144:01:38, 14.76s/it]
  7%|▋         | 2838/37963 [12:09:58<142:55:41, 14.65s/it]
  7%|▋         | 2839/37963 [12:10:12<142:01:31, 14.56s/it]
  7%|▋         | 2840/37963 [12:10:32<158:56:41, 16.29s/it]
                                                           
{'loss': '0.1786', 'grad_norm': '3.34', 'learning_rate': '1.99e-05', 'epoch': '0.07481'}

  7%|▋         | 2840/37963 [12:10:32<158:56:41, 16.29s/it]
  7%|▋         | 2841/37963 [12:10:46<152:14:42, 15.61s/it]
  7%|▋         | 2842/37963 [12:11:00<147:31:40, 15.12s/it]
  7%|▋         | 2843/37963 [12:11:14<143:02:32, 14.66s/it]
  7%|▋         | 2844/37963 [12:11:28<142:00:39, 14.56s/it]
  7%|▋         | 2845/37963 [12:11:43<141:28:55, 14.50s/it]
  7%|▋         | 2846/37963 [12:11:57<141:01:34, 14.46s/it]
  7%|▋         | 2847/37963 [12:12:11<140:40:17, 14.42s/it]
  8%|▊         | 2848/37963 [12:12:26<140:34:55, 14.41s/it]
  8%|▊         | 2849/37963 [12:12:40<140:28:58, 14.40s/it]
  8%|▊         | 2850/37963 [12:12:54<138:41:20, 14.22s/it]
                                                           
{'loss': '0.1781', 'grad_norm': '2.129', 'learning_rate': '1.989e-05', 'epoch': '0.07507'}

  8%|▊         | 2850/37963 [12:12:54<138:41:20, 14.22s/it]
  8%|▊         | 2851/37963 [12:13:08<139:11:24, 14.27s/it]
  8%|▊         | 2852/37963 [12:13:23<139:20:48, 14.29s/it]
  8%|▊         | 2853/37963 [12:13:37<139:35:33, 14.31s/it]
  8%|▊         | 2854/37963 [12:13:51<138:48:43, 14.23s/it]
  8%|▊         | 2855/37963 [12:14:06<139:11:39, 14.27s/it]
  8%|▊         | 2856/37963 [12:14:19<138:14:53, 14.18s/it]
  8%|▊         | 2857/37963 [12:14:40<156:43:13, 16.07s/it]
  8%|▊         | 2858/37963 [12:14:54<151:43:19, 15.56s/it]
  8%|▊         | 2859/37963 [12:15:09<148:14:27, 15.20s/it]
  8%|▊         | 2860/37963 [12:15:23<145:37:53, 14.94s/it]
                                                           
{'loss': '0.1876', 'grad_norm': '7.163', 'learning_rate': '1.989e-05', 'epoch': '0.07534'}

  8%|▊         | 2860/37963 [12:15:23<145:37:53, 14.94s/it]
  8%|▊         | 2861/37963 [12:15:37<143:58:56, 14.77s/it]
  8%|▊         | 2862/37963 [12:15:52<142:45:41, 14.64s/it]
  8%|▊         | 2863/37963 [12:16:06<141:33:11, 14.52s/it]
  8%|▊         | 2864/37963 [12:16:20<140:13:44, 14.38s/it]
  8%|▊         | 2865/37963 [12:16:41<159:57:40, 16.41s/it]
  8%|▊         | 2866/37963 [12:16:56<153:59:11, 15.79s/it]
  8%|▊         | 2867/37963 [12:17:17<169:52:44, 17.43s/it]
  8%|▊         | 2868/37963 [12:17:31<160:44:33, 16.49s/it]
  8%|▊         | 2869/37963 [12:17:52<173:27:06, 17.79s/it]
  8%|▊         | 2870/37963 [12:18:06<162:17:00, 16.65s/it]
                                                           
{'loss': '0.1706', 'grad_norm': '3.982', 'learning_rate': '1.989e-05', 'epoch': '0.0756'}

  8%|▊         | 2870/37963 [12:18:06<162:17:00, 16.65s/it]
  8%|▊         | 2871/37963 [12:18:27<174:35:38, 17.91s/it]
  8%|▊         | 2872/37963 [12:18:41<164:19:18, 16.86s/it]
  8%|▊         | 2873/37963 [12:19:02<177:28:43, 18.21s/it]
  8%|▊         | 2874/37963 [12:19:17<166:33:42, 17.09s/it]
  8%|▊         | 2875/37963 [12:19:31<157:41:19, 16.18s/it]
  8%|▊         | 2876/37963 [12:19:45<152:20:26, 15.63s/it]
  8%|▊         | 2877/37963 [12:20:00<148:40:05, 15.25s/it]
  8%|▊         | 2878/37963 [12:20:14<146:17:49, 15.01s/it]
  8%|▊         | 2879/37963 [12:20:28<144:07:23, 14.79s/it]
  8%|▊         | 2880/37963 [12:20:43<142:54:00, 14.66s/it]
                                                           
{'loss': '0.1908', 'grad_norm': '3.685', 'learning_rate': '1.989e-05', 'epoch': '0.07586'}

  8%|▊         | 2880/37963 [12:20:43<142:54:00, 14.66s/it]
  8%|▊         | 2881/37963 [12:20:57<140:58:07, 14.47s/it]
  8%|▊         | 2882/37963 [12:21:11<140:36:20, 14.43s/it]
  8%|▊         | 2883/37963 [12:21:26<140:25:44, 14.41s/it]
  8%|▊         | 2884/37963 [12:21:46<158:01:04, 16.22s/it]
  8%|▊         | 2885/37963 [12:22:00<152:28:55, 15.65s/it]
  8%|▊         | 2886/37963 [12:22:15<148:38:48, 15.26s/it]
  8%|▊         | 2887/37963 [12:22:29<145:54:38, 14.98s/it]
  8%|▊         | 2888/37963 [12:22:43<144:06:56, 14.79s/it]
  8%|▊         | 2889/37963 [12:23:04<160:20:02, 16.46s/it]
  8%|▊         | 2890/37963 [12:23:18<154:43:04, 15.88s/it]
                                                           
{'loss': '0.166', 'grad_norm': '1.975', 'learning_rate': '1.989e-05', 'epoch': '0.07613'}

  8%|▊         | 2890/37963 [12:23:18<154:43:04, 15.88s/it]
  8%|▊         | 2891/37963 [12:23:33<150:56:52, 15.49s/it]
  8%|▊         | 2892/37963 [12:23:47<147:42:04, 15.16s/it]
  8%|▊         | 2893/37963 [12:24:02<145:19:11, 14.92s/it]
  8%|▊         | 2894/37963 [12:24:15<142:32:04, 14.63s/it]
  8%|▊         | 2895/37963 [12:24:30<142:00:36, 14.58s/it]
  8%|▊         | 2896/37963 [12:24:44<141:18:21, 14.51s/it]
  8%|▊         | 2897/37963 [12:24:59<140:52:47, 14.46s/it]
  8%|▊         | 2898/37963 [12:25:13<140:36:01, 14.43s/it]
  8%|▊         | 2899/37963 [12:25:27<139:54:00, 14.36s/it]
  8%|▊         | 2900/37963 [12:25:41<139:04:36, 14.28s/it]
                                                           
{'loss': '0.151', 'grad_norm': '4.935', 'learning_rate': '1.989e-05', 'epoch': '0.07639'}

  8%|▊         | 2900/37963 [12:25:41<139:04:36, 14.28s/it]
  8%|▊         | 2901/37963 [12:25:56<139:33:52, 14.33s/it]
  8%|▊         | 2902/37963 [12:26:10<139:39:49, 14.34s/it]
  8%|▊         | 2903/37963 [12:26:24<138:42:18, 14.24s/it]
  8%|▊         | 2904/37963 [12:26:39<139:14:19, 14.30s/it]
  8%|▊         | 2905/37963 [12:26:53<139:28:17, 14.32s/it]
  8%|▊         | 2906/37963 [12:27:07<137:35:48, 14.13s/it]
  8%|▊         | 2907/37963 [12:27:27<157:04:29, 16.13s/it]
  8%|▊         | 2908/37963 [12:27:42<152:26:24, 15.65s/it]
  8%|▊         | 2909/37963 [12:27:56<147:48:33, 15.18s/it]
  8%|▊         | 2910/37963 [12:28:10<145:28:15, 14.94s/it]
                                                           
{'loss': '0.1828', 'grad_norm': '2.808', 'learning_rate': '1.989e-05', 'epoch': '0.07665'}

  8%|▊         | 2910/37963 [12:28:10<145:28:15, 14.94s/it]
  8%|▊         | 2911/37963 [12:28:25<143:27:52, 14.73s/it]
  8%|▊         | 2912/37963 [12:28:39<141:57:52, 14.58s/it]
  8%|▊         | 2913/37963 [12:28:53<141:35:46, 14.54s/it]
  8%|▊         | 2914/37963 [12:29:08<141:25:51, 14.53s/it]
  8%|▊         | 2915/37963 [12:29:36<180:37:11, 18.55s/it]
  8%|▊         | 2916/37963 [12:29:50<168:37:39, 17.32s/it]
  8%|▊         | 2917/37963 [12:30:04<159:02:37, 16.34s/it]
  8%|▊         | 2918/37963 [12:30:24<169:38:25, 17.43s/it]
  8%|▊         | 2919/37963 [12:30:38<160:11:17, 16.46s/it]
  8%|▊         | 2920/37963 [12:30:59<171:41:38, 17.64s/it]
                                                           
{'loss': '0.1765', 'grad_norm': '4.951', 'learning_rate': '1.988e-05', 'epoch': '0.07692'}

  8%|▊         | 2920/37963 [12:30:59<171:41:38, 17.64s/it]
  8%|▊         | 2921/37963 [12:31:20<182:06:38, 18.71s/it]
  8%|▊         | 2922/37963 [12:31:34<169:02:44, 17.37s/it]
  8%|▊         | 2923/37963 [12:31:49<160:17:22, 16.47s/it]
  8%|▊         | 2924/37963 [12:32:03<153:53:15, 15.81s/it]
  8%|▊         | 2925/37963 [12:32:17<149:28:06, 15.36s/it]
  8%|▊         | 2926/37963 [12:32:32<146:28:42, 15.05s/it]
  8%|▊         | 2927/37963 [12:32:46<144:11:27, 14.82s/it]
  8%|▊         | 2928/37963 [12:33:00<142:58:28, 14.69s/it]
  8%|▊         | 2929/37963 [12:33:15<142:04:20, 14.60s/it]
  8%|▊         | 2930/37963 [12:33:28<138:46:32, 14.26s/it]
                                                           
{'loss': '0.1678', 'grad_norm': '4.968', 'learning_rate': '1.988e-05', 'epoch': '0.07718'}

  8%|▊         | 2930/37963 [12:33:28<138:46:32, 14.26s/it]
  8%|▊         | 2931/37963 [12:33:42<138:34:10, 14.24s/it]
  8%|▊         | 2932/37963 [12:33:56<136:55:22, 14.07s/it]
  8%|▊         | 2933/37963 [12:34:10<137:32:22, 14.13s/it]
  8%|▊         | 2934/37963 [12:34:31<157:02:23, 16.14s/it]
  8%|▊         | 2935/37963 [12:34:46<152:11:23, 15.64s/it]
  8%|▊         | 2936/37963 [12:35:00<148:23:54, 15.25s/it]
  8%|▊         | 2937/37963 [12:35:14<145:08:53, 14.92s/it]
  8%|▊         | 2938/37963 [12:35:35<163:59:08, 16.86s/it]
  8%|▊         | 2939/37963 [12:35:50<156:49:53, 16.12s/it]
  8%|▊         | 2940/37963 [12:36:04<151:44:27, 15.60s/it]
                                                           
{'loss': '0.1873', 'grad_norm': '1.749', 'learning_rate': '1.988e-05', 'epoch': '0.07744'}

  8%|▊         | 2940/37963 [12:36:04<151:44:27, 15.60s/it]
  8%|▊         | 2941/37963 [12:36:19<148:11:14, 15.23s/it]
  8%|▊         | 2942/37963 [12:36:33<145:24:46, 14.95s/it]
  8%|▊         | 2943/37963 [12:36:47<143:36:50, 14.76s/it]
  8%|▊         | 2944/37963 [12:37:01<141:36:18, 14.56s/it]
  8%|▊         | 2945/37963 [12:37:16<141:06:16, 14.51s/it]
  8%|▊         | 2946/37963 [12:37:30<140:39:10, 14.46s/it]
  8%|▊         | 2947/37963 [12:37:44<140:16:34, 14.42s/it]
  8%|▊         | 2948/37963 [12:37:58<137:26:29, 14.13s/it]
  8%|▊         | 2949/37963 [12:38:12<138:07:20, 14.20s/it]
  8%|▊         | 2950/37963 [12:38:26<138:37:18, 14.25s/it]
                                                           
{'loss': '0.1753', 'grad_norm': '3.149', 'learning_rate': '1.988e-05', 'epoch': '0.07771'}

  8%|▊         | 2950/37963 [12:38:26<138:37:18, 14.25s/it]
  8%|▊         | 2951/37963 [12:38:41<138:39:52, 14.26s/it]
  8%|▊         | 2952/37963 [12:38:55<138:50:05, 14.28s/it]
  8%|▊         | 2953/37963 [12:39:09<138:33:28, 14.25s/it]
  8%|▊         | 2954/37963 [12:39:30<158:37:57, 16.31s/it]
  8%|▊         | 2955/37963 [12:39:45<152:22:27, 15.67s/it]
  8%|▊         | 2956/37963 [12:39:59<148:28:08, 15.27s/it]
  8%|▊         | 2957/37963 [12:40:13<146:04:23, 15.02s/it]
  8%|▊         | 2958/37963 [12:40:28<144:04:53, 14.82s/it]
  8%|▊         | 2959/37963 [12:40:42<142:47:10, 14.68s/it]
  8%|▊         | 2960/37963 [12:40:56<141:09:11, 14.52s/it]
                                                           
{'loss': '0.177', 'grad_norm': '2.408', 'learning_rate': '1.988e-05', 'epoch': '0.07797'}

  8%|▊         | 2960/37963 [12:40:56<141:09:11, 14.52s/it]
  8%|▊         | 2961/37963 [12:41:11<140:50:08, 14.49s/it]
  8%|▊         | 2962/37963 [12:41:25<139:36:23, 14.36s/it]
  8%|▊         | 2963/37963 [12:41:46<160:25:27, 16.50s/it]
  8%|▊         | 2964/37963 [12:42:08<174:40:23, 17.97s/it]
  8%|▊         | 2965/37963 [12:42:22<163:55:09, 16.86s/it]
  8%|▊         | 2966/37963 [12:42:36<155:26:22, 15.99s/it]
  8%|▊         | 2967/37963 [12:42:57<169:37:59, 17.45s/it]
  8%|▊         | 2968/37963 [12:43:17<179:15:15, 18.44s/it]
  8%|▊         | 2969/37963 [12:43:38<186:23:18, 19.17s/it]
  8%|▊         | 2970/37963 [12:43:53<172:24:40, 17.74s/it]
                                                           
{'loss': '0.1872', 'grad_norm': '3.235', 'learning_rate': '1.988e-05', 'epoch': '0.07823'}

  8%|▊         | 2970/37963 [12:43:53<172:24:40, 17.74s/it]
  8%|▊         | 2971/37963 [12:44:07<161:51:30, 16.65s/it]
  8%|▊         | 2972/37963 [12:44:20<153:16:13, 15.77s/it]
  8%|▊         | 2973/37963 [12:44:35<148:59:46, 15.33s/it]
  8%|▊         | 2974/37963 [12:44:49<146:04:05, 15.03s/it]
  8%|▊         | 2975/37963 [12:45:03<143:45:26, 14.79s/it]
  8%|▊         | 2976/37963 [12:45:18<142:21:28, 14.65s/it]
  8%|▊         | 2977/37963 [12:45:32<141:32:26, 14.56s/it]
  8%|▊         | 2978/37963 [12:45:46<140:49:07, 14.49s/it]
  8%|▊         | 2979/37963 [12:46:01<140:57:44, 14.51s/it]
  8%|▊         | 2980/37963 [12:46:15<140:36:22, 14.47s/it]
                                                           
{'loss': '0.1814', 'grad_norm': '1.275', 'learning_rate': '1.988e-05', 'epoch': '0.0785'}

  8%|▊         | 2980/37963 [12:46:15<140:36:22, 14.47s/it]
  8%|▊         | 2981/37963 [12:46:30<140:10:36, 14.43s/it]
  8%|▊         | 2982/37963 [12:46:50<158:44:09, 16.34s/it]
  8%|▊         | 2983/37963 [12:47:11<171:59:17, 17.70s/it]
  8%|▊         | 2984/37963 [12:47:25<160:28:12, 16.52s/it]
  8%|▊         | 2985/37963 [12:47:39<154:10:12, 15.87s/it]
  8%|▊         | 2986/37963 [12:47:54<150:11:51, 15.46s/it]
  8%|▊         | 2987/37963 [12:48:08<146:05:52, 15.04s/it]
  8%|▊         | 2988/37963 [12:48:22<144:18:03, 14.85s/it]
  8%|▊         | 2989/37963 [12:48:37<142:52:58, 14.71s/it]
  8%|▊         | 2990/37963 [12:48:51<141:44:07, 14.59s/it]
                                                           
{'loss': '0.1733', 'grad_norm': '4.224', 'learning_rate': '1.988e-05', 'epoch': '0.07876'}

  8%|▊         | 2990/37963 [12:48:51<141:44:07, 14.59s/it]
  8%|▊         | 2991/37963 [12:49:05<139:25:09, 14.35s/it]
  8%|▊         | 2992/37963 [12:49:19<139:21:07, 14.35s/it]
  8%|▊         | 2993/37963 [12:49:34<139:23:49, 14.35s/it]
  8%|▊         | 2994/37963 [12:49:48<138:21:02, 14.24s/it]
  8%|▊         | 2995/37963 [12:50:02<138:06:10, 14.22s/it]
  8%|▊         | 2996/37963 [12:50:16<137:48:49, 14.19s/it]
  8%|▊         | 2997/37963 [12:50:29<135:18:20, 13.93s/it]
  8%|▊         | 2998/37963 [12:50:44<136:32:26, 14.06s/it]
  8%|▊         | 2999/37963 [12:50:58<137:55:17, 14.20s/it]
  8%|▊         | 3000/37963 [12:51:12<138:19:55, 14.24s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '2.16', 'learning_rate': '1.987e-05', 'epoch': '0.07902'}

  8%|▊         | 3000/37963 [12:51:12<138:19:55, 14.24s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.91s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.91s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  8%|▊         | 3001/37963 [12:52:46<369:16:22, 38.02s/it]
  8%|▊         | 3002/37963 [12:53:00<300:18:29, 30.92s/it]
  8%|▊         | 3003/37963 [12:53:14<250:52:10, 25.83s/it]
  8%|▊         | 3004/37963 [12:53:29<217:52:13, 22.44s/it]
  8%|▊         | 3005/37963 [12:53:43<194:16:56, 20.01s/it]
  8%|▊         | 3006/37963 [12:53:57<177:47:08, 18.31s/it]
  8%|▊         | 3007/37963 [12:54:11<164:42:33, 16.96s/it]
  8%|▊         | 3008/37963 [12:54:26<157:01:57, 16.17s/it]
  8%|▊         | 3009/37963 [12:54:40<151:14:08, 15.58s/it]
  8%|▊         | 3010/37963 [12:54:54<147:35:56, 15.20s/it]
                                                           
{'loss': '0.1861', 'grad_norm': '2.431', 'learning_rate': '1.987e-05', 'epoch': '0.07929'}

  8%|▊         | 3010/37963 [12:54:54<147:35:56, 15.20s/it]
  8%|▊         | 3011/37963 [12:55:15<165:03:54, 17.00s/it]
  8%|▊         | 3012/37963 [12:55:30<157:19:55, 16.21s/it]
  8%|▊         | 3013/37963 [12:55:44<152:00:51, 15.66s/it]
  8%|▊         | 3014/37963 [12:56:05<169:01:07, 17.41s/it]
  8%|▊         | 3015/37963 [12:56:20<160:23:07, 16.52s/it]
  8%|▊         | 3016/37963 [12:56:47<190:43:00, 19.65s/it]
  8%|▊         | 3017/37963 [12:57:01<174:58:47, 18.03s/it]
  8%|▊         | 3018/37963 [12:57:16<164:24:20, 16.94s/it]
  8%|▊         | 3019/37963 [12:57:37<177:51:19, 18.32s/it]
  8%|▊         | 3020/37963 [12:57:51<166:24:05, 17.14s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '3.99', 'learning_rate': '1.987e-05', 'epoch': '0.07955'}

  8%|▊         | 3020/37963 [12:57:51<166:24:05, 17.14s/it]
  8%|▊         | 3021/37963 [12:58:06<158:31:02, 16.33s/it]
  8%|▊         | 3022/37963 [12:58:20<151:30:21, 15.61s/it]
  8%|▊         | 3023/37963 [12:58:34<147:42:44, 15.22s/it]
  8%|▊         | 3024/37963 [12:58:49<145:36:00, 15.00s/it]
  8%|▊         | 3025/37963 [12:59:03<144:36:26, 14.90s/it]
  8%|▊         | 3026/37963 [12:59:18<142:49:26, 14.72s/it]
  8%|▊         | 3027/37963 [12:59:32<141:44:31, 14.61s/it]
  8%|▊         | 3028/37963 [12:59:52<158:47:42, 16.36s/it]
  8%|▊         | 3029/37963 [13:00:13<171:08:39, 17.64s/it]
  8%|▊         | 3030/37963 [13:00:27<160:37:51, 16.55s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '4.19', 'learning_rate': '1.987e-05', 'epoch': '0.07981'}

  8%|▊         | 3030/37963 [13:00:27<160:37:51, 16.55s/it]
  8%|▊         | 3031/37963 [13:00:41<154:11:22, 15.89s/it]
  8%|▊         | 3032/37963 [13:00:55<148:48:11, 15.34s/it]
  8%|▊         | 3033/37963 [13:01:09<145:02:48, 14.95s/it]
  8%|▊         | 3034/37963 [13:01:24<142:30:36, 14.69s/it]
  8%|▊         | 3035/37963 [13:01:38<141:26:15, 14.58s/it]
  8%|▊         | 3036/37963 [13:01:52<140:45:09, 14.51s/it]
  8%|▊         | 3037/37963 [13:02:07<140:23:11, 14.47s/it]
  8%|▊         | 3038/37963 [13:02:21<140:05:44, 14.44s/it]
  8%|▊         | 3039/37963 [13:02:35<139:53:55, 14.42s/it]
  8%|▊         | 3040/37963 [13:02:50<139:42:33, 14.40s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '2.308', 'learning_rate': '1.987e-05', 'epoch': '0.08008'}

  8%|▊         | 3040/37963 [13:02:50<139:42:33, 14.40s/it]
  8%|▊         | 3041/37963 [13:03:04<139:34:42, 14.39s/it]
  8%|▊         | 3042/37963 [13:03:18<139:27:30, 14.38s/it]
  8%|▊         | 3043/37963 [13:03:33<139:27:25, 14.38s/it]
  8%|▊         | 3044/37963 [13:03:47<139:38:14, 14.40s/it]
  8%|▊         | 3045/37963 [13:04:02<139:23:58, 14.37s/it]
  8%|▊         | 3046/37963 [13:04:16<139:03:04, 14.34s/it]
  8%|▊         | 3047/37963 [13:04:30<137:58:24, 14.23s/it]
  8%|▊         | 3048/37963 [13:04:44<138:21:07, 14.27s/it]
  8%|▊         | 3049/37963 [13:05:04<154:52:16, 15.97s/it]
  8%|▊         | 3050/37963 [13:05:18<150:14:52, 15.49s/it]
                                                           
{'loss': '0.1752', 'grad_norm': '4.233', 'learning_rate': '1.987e-05', 'epoch': '0.08034'}

  8%|▊         | 3050/37963 [13:05:18<150:14:52, 15.49s/it]
  8%|▊         | 3051/37963 [13:05:33<146:51:46, 15.14s/it]
  8%|▊         | 3052/37963 [13:05:46<142:33:33, 14.70s/it]
  8%|▊         | 3053/37963 [13:06:01<140:54:24, 14.53s/it]
  8%|▊         | 3054/37963 [13:06:15<140:18:17, 14.47s/it]
  8%|▊         | 3055/37963 [13:06:29<139:07:44, 14.35s/it]
  8%|▊         | 3056/37963 [13:06:43<139:11:55, 14.36s/it]
  8%|▊         | 3057/37963 [13:06:57<138:20:09, 14.27s/it]
  8%|▊         | 3058/37963 [13:07:12<138:27:30, 14.28s/it]
  8%|▊         | 3059/37963 [13:07:26<137:41:11, 14.20s/it]
  8%|▊         | 3060/37963 [13:07:47<158:05:16, 16.31s/it]
                                                           
{'loss': '0.1792', 'grad_norm': '1.629', 'learning_rate': '1.987e-05', 'epoch': '0.08061'}

  8%|▊         | 3060/37963 [13:07:47<158:05:16, 16.31s/it]
  8%|▊         | 3061/37963 [13:08:08<171:46:32, 17.72s/it]
  8%|▊         | 3062/37963 [13:08:22<161:05:13, 16.62s/it]
  8%|▊         | 3063/37963 [13:08:36<152:57:34, 15.78s/it]
  8%|▊         | 3064/37963 [13:08:50<148:44:50, 15.34s/it]
  8%|▊         | 3065/37963 [13:09:17<182:08:49, 18.79s/it]
  8%|▊         | 3066/37963 [13:09:31<169:35:03, 17.49s/it]
  8%|▊         | 3067/37963 [13:09:45<159:27:37, 16.45s/it]
  8%|▊         | 3068/37963 [13:10:07<173:44:34, 17.92s/it]
  8%|▊         | 3069/37963 [13:10:21<163:24:09, 16.86s/it]
  8%|▊         | 3070/37963 [13:10:36<156:08:47, 16.11s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '1.984', 'learning_rate': '1.986e-05', 'epoch': '0.08087'}

  8%|▊         | 3070/37963 [13:10:36<156:08:47, 16.11s/it]
  8%|▊         | 3071/37963 [13:10:50<151:04:24, 15.59s/it]
  8%|▊         | 3072/37963 [13:11:04<147:18:41, 15.20s/it]
  8%|▊         | 3073/37963 [13:11:19<145:06:54, 14.97s/it]
  8%|▊         | 3074/37963 [13:11:33<143:02:22, 14.76s/it]
  8%|▊         | 3075/37963 [13:11:47<141:50:49, 14.64s/it]
  8%|▊         | 3076/37963 [13:12:08<159:26:20, 16.45s/it]
  8%|▊         | 3077/37963 [13:12:29<172:22:17, 17.79s/it]
  8%|▊         | 3078/37963 [13:12:43<160:34:03, 16.57s/it]
  8%|▊         | 3079/37963 [13:12:57<154:08:09, 15.91s/it]
  8%|▊         | 3080/37963 [13:13:11<149:36:37, 15.44s/it]
                                                           
{'loss': '0.1856', 'grad_norm': '2.487', 'learning_rate': '1.986e-05', 'epoch': '0.08113'}

  8%|▊         | 3080/37963 [13:13:11<149:36:37, 15.44s/it]
  8%|▊         | 3081/37963 [13:13:26<146:19:33, 15.10s/it]
  8%|▊         | 3082/37963 [13:13:40<144:22:45, 14.90s/it]
  8%|▊         | 3083/37963 [13:13:54<142:39:33, 14.72s/it]
  8%|▊         | 3084/37963 [13:14:09<141:47:07, 14.63s/it]
  8%|▊         | 3085/37963 [13:14:23<141:01:17, 14.56s/it]
  8%|▊         | 3086/37963 [13:14:38<140:26:33, 14.50s/it]
  8%|▊         | 3087/37963 [13:14:52<140:19:47, 14.49s/it]
  8%|▊         | 3088/37963 [13:15:06<140:11:19, 14.47s/it]
  8%|▊         | 3089/37963 [13:15:21<139:56:42, 14.45s/it]
  8%|▊         | 3090/37963 [13:15:35<138:48:07, 14.33s/it]
                                                           
{'loss': '0.1705', 'grad_norm': '4.982', 'learning_rate': '1.986e-05', 'epoch': '0.0814'}

  8%|▊         | 3090/37963 [13:15:35<138:48:07, 14.33s/it]
  8%|▊         | 3091/37963 [13:15:49<138:55:17, 14.34s/it]
  8%|▊         | 3092/37963 [13:16:04<139:04:04, 14.36s/it]
  8%|▊         | 3093/37963 [13:16:18<138:49:22, 14.33s/it]
  8%|▊         | 3094/37963 [13:16:32<139:09:09, 14.37s/it]
  8%|▊         | 3095/37963 [13:16:47<139:19:22, 14.38s/it]
  8%|▊         | 3096/37963 [13:17:01<139:15:49, 14.38s/it]
  8%|▊         | 3097/37963 [13:17:22<157:36:03, 16.27s/it]
  8%|▊         | 3098/37963 [13:17:36<151:53:56, 15.68s/it]
  8%|▊         | 3099/37963 [13:17:51<148:08:30, 15.30s/it]
  8%|▊         | 3100/37963 [13:18:05<144:27:01, 14.92s/it]
                                                           
{'loss': '0.1908', 'grad_norm': '1.664', 'learning_rate': '1.986e-05', 'epoch': '0.08166'}

  8%|▊         | 3100/37963 [13:18:05<144:27:01, 14.92s/it]
  8%|▊         | 3101/37963 [13:18:19<142:44:56, 14.74s/it]
  8%|▊         | 3102/37963 [13:18:33<142:03:12, 14.67s/it]
  8%|▊         | 3103/37963 [13:18:48<140:54:49, 14.55s/it]
  8%|▊         | 3104/37963 [13:19:02<140:25:56, 14.50s/it]
  8%|▊         | 3105/37963 [13:19:17<140:17:01, 14.49s/it]
  8%|▊         | 3106/37963 [13:19:31<139:51:01, 14.44s/it]
  8%|▊         | 3107/37963 [13:19:45<139:30:08, 14.41s/it]
  8%|▊         | 3108/37963 [13:20:00<139:38:49, 14.42s/it]
  8%|▊         | 3109/37963 [13:20:14<139:13:29, 14.38s/it]
  8%|▊         | 3110/37963 [13:20:35<158:56:31, 16.42s/it]
                                                           
{'loss': '0.1691', 'grad_norm': '4.502', 'learning_rate': '1.986e-05', 'epoch': '0.08192'}

  8%|▊         | 3110/37963 [13:20:35<158:56:31, 16.42s/it]
  8%|▊         | 3111/37963 [13:20:49<153:06:05, 15.81s/it]
  8%|▊         | 3112/37963 [13:21:10<165:36:54, 17.11s/it]
  8%|▊         | 3113/37963 [13:21:24<157:43:38, 16.29s/it]
  8%|▊         | 3114/37963 [13:21:51<189:11:50, 19.54s/it]
  8%|▊         | 3115/37963 [13:22:06<174:08:20, 17.99s/it]
  8%|▊         | 3116/37963 [13:22:20<163:08:33, 16.85s/it]
  8%|▊         | 3117/37963 [13:22:34<155:31:20, 16.07s/it]
  8%|▊         | 3118/37963 [13:22:55<171:18:33, 17.70s/it]
  8%|▊         | 3119/37963 [13:23:10<161:39:38, 16.70s/it]
  8%|▊         | 3120/37963 [13:23:24<154:55:53, 16.01s/it]
                                                           
{'loss': '0.1697', 'grad_norm': '3.102', 'learning_rate': '1.986e-05', 'epoch': '0.08219'}

  8%|▊         | 3120/37963 [13:23:24<154:55:53, 16.01s/it]
  8%|▊         | 3121/37963 [13:23:39<150:29:49, 15.55s/it]
  8%|▊         | 3122/37963 [13:23:53<147:22:56, 15.23s/it]
  8%|▊         | 3123/37963 [13:24:14<163:59:13, 16.94s/it]
  8%|▊         | 3124/37963 [13:24:29<156:38:37, 16.19s/it]
  8%|▊         | 3125/37963 [13:24:43<151:32:17, 15.66s/it]
  8%|▊         | 3126/37963 [13:24:57<146:57:28, 15.19s/it]
  8%|▊         | 3127/37963 [13:25:11<144:26:16, 14.93s/it]
  8%|▊         | 3128/37963 [13:25:32<161:32:31, 16.69s/it]
  8%|▊         | 3129/37963 [13:25:46<153:58:54, 15.91s/it]
  8%|▊         | 3130/37963 [13:26:01<149:19:27, 15.43s/it]
                                                           
{'loss': '0.1792', 'grad_norm': '6.982', 'learning_rate': '1.986e-05', 'epoch': '0.08245'}

  8%|▊         | 3130/37963 [13:26:01<149:19:27, 15.43s/it]
  8%|▊         | 3131/37963 [13:26:14<144:42:04, 14.96s/it]
  8%|▊         | 3132/37963 [13:26:29<142:16:51, 14.71s/it]
  8%|▊         | 3133/37963 [13:26:43<141:14:22, 14.60s/it]
  8%|▊         | 3134/37963 [13:26:57<139:36:36, 14.43s/it]
  8%|▊         | 3135/37963 [13:27:11<139:34:45, 14.43s/it]
  8%|▊         | 3136/37963 [13:27:26<139:20:00, 14.40s/it]
  8%|▊         | 3137/37963 [13:27:40<138:24:28, 14.31s/it]
  8%|▊         | 3138/37963 [13:27:54<138:29:22, 14.32s/it]
  8%|▊         | 3139/37963 [13:28:08<138:32:59, 14.32s/it]
  8%|▊         | 3140/37963 [13:28:23<138:41:45, 14.34s/it]
                                                           
{'loss': '0.1691', 'grad_norm': '2.477', 'learning_rate': '1.985e-05', 'epoch': '0.08271'}

  8%|▊         | 3140/37963 [13:28:23<138:41:45, 14.34s/it]
  8%|▊         | 3141/37963 [13:28:37<138:11:34, 14.29s/it]
  8%|▊         | 3142/37963 [13:28:51<138:25:57, 14.31s/it]
  8%|▊         | 3143/37963 [13:29:06<138:33:48, 14.33s/it]
  8%|▊         | 3144/37963 [13:29:20<138:34:13, 14.33s/it]
  8%|▊         | 3145/37963 [13:29:34<137:58:52, 14.27s/it]
  8%|▊         | 3146/37963 [13:29:49<138:38:25, 14.34s/it]
  8%|▊         | 3147/37963 [13:30:03<138:50:53, 14.36s/it]
  8%|▊         | 3148/37963 [13:30:23<156:01:00, 16.13s/it]
  8%|▊         | 3149/37963 [13:30:38<151:15:23, 15.64s/it]
  8%|▊         | 3150/37963 [13:30:52<146:26:14, 15.14s/it]
                                                           
{'loss': '0.1782', 'grad_norm': '6.56', 'learning_rate': '1.985e-05', 'epoch': '0.08298'}

  8%|▊         | 3150/37963 [13:30:52<146:26:14, 15.14s/it]
  8%|▊         | 3151/37963 [13:31:06<144:03:21, 14.90s/it]
  8%|▊         | 3152/37963 [13:31:21<142:42:10, 14.76s/it]
  8%|▊         | 3153/37963 [13:31:35<141:19:38, 14.62s/it]
  8%|▊         | 3154/37963 [13:31:49<140:55:09, 14.57s/it]
  8%|▊         | 3155/37963 [13:32:04<140:15:37, 14.51s/it]
  8%|▊         | 3156/37963 [13:32:18<139:47:18, 14.46s/it]
  8%|▊         | 3157/37963 [13:32:32<138:49:57, 14.36s/it]
  8%|▊         | 3158/37963 [13:32:47<138:43:21, 14.35s/it]
  8%|▊         | 3159/37963 [13:33:07<157:33:15, 16.30s/it]
  8%|▊         | 3160/37963 [13:33:29<172:27:50, 17.84s/it]
                                                           
{'loss': '0.1707', 'grad_norm': '5.821', 'learning_rate': '1.985e-05', 'epoch': '0.08324'}

  8%|▊         | 3160/37963 [13:33:29<172:27:50, 17.84s/it]
  8%|▊         | 3161/37963 [13:33:43<162:18:01, 16.79s/it]
  8%|▊         | 3162/37963 [13:34:04<173:52:06, 17.99s/it]
  8%|▊         | 3163/37963 [13:34:18<163:25:58, 16.91s/it]
  8%|▊         | 3164/37963 [13:34:33<156:48:24, 16.22s/it]
  8%|▊         | 3165/37963 [13:34:54<170:00:41, 17.59s/it]
  8%|▊         | 3166/37963 [13:35:15<180:52:41, 18.71s/it]
  8%|▊         | 3167/37963 [13:35:29<166:25:30, 17.22s/it]
  8%|▊         | 3168/37963 [13:35:42<155:56:18, 16.13s/it]
  8%|▊         | 3169/37963 [13:35:57<150:51:03, 15.61s/it]
  8%|▊         | 3170/37963 [13:36:11<145:47:27, 15.08s/it]
                                                           
{'loss': '0.1636', 'grad_norm': '1.231', 'learning_rate': '1.985e-05', 'epoch': '0.0835'}

  8%|▊         | 3170/37963 [13:36:11<145:47:27, 15.08s/it]
  8%|▊         | 3171/37963 [13:36:31<159:58:04, 16.55s/it]
  8%|▊         | 3172/37963 [13:36:45<153:28:42, 15.88s/it]
  8%|▊         | 3173/37963 [13:36:59<148:52:50, 15.41s/it]
  8%|▊         | 3174/37963 [13:37:14<145:55:08, 15.10s/it]
  8%|▊         | 3175/37963 [13:37:28<143:35:31, 14.86s/it]
  8%|▊         | 3176/37963 [13:37:42<142:05:13, 14.70s/it]
  8%|▊         | 3177/37963 [13:38:03<160:12:46, 16.58s/it]
  8%|▊         | 3178/37963 [13:38:18<153:47:25, 15.92s/it]
  8%|▊         | 3179/37963 [13:38:32<149:26:03, 15.47s/it]
  8%|▊         | 3180/37963 [13:38:46<146:05:08, 15.12s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '3.974', 'learning_rate': '1.985e-05', 'epoch': '0.08377'}

  8%|▊         | 3180/37963 [13:38:46<146:05:08, 15.12s/it]
  8%|▊         | 3181/37963 [13:39:01<143:59:48, 14.90s/it]
  8%|▊         | 3182/37963 [13:39:15<142:29:46, 14.75s/it]
  8%|▊         | 3183/37963 [13:39:29<141:25:16, 14.64s/it]
  8%|▊         | 3184/37963 [13:39:44<140:45:30, 14.57s/it]
  8%|▊         | 3185/37963 [13:39:58<140:20:35, 14.53s/it]
  8%|▊         | 3186/37963 [13:40:13<140:13:35, 14.52s/it]
  8%|▊         | 3187/37963 [13:40:27<138:31:44, 14.34s/it]
  8%|▊         | 3188/37963 [13:40:41<138:23:48, 14.33s/it]
  8%|▊         | 3189/37963 [13:40:55<138:47:34, 14.37s/it]
  8%|▊         | 3190/37963 [13:41:10<138:57:15, 14.39s/it]
                                                           
{'loss': '0.1678', 'grad_norm': '3.664', 'learning_rate': '1.985e-05', 'epoch': '0.08403'}

  8%|▊         | 3190/37963 [13:41:10<138:57:15, 14.39s/it]
  8%|▊         | 3191/37963 [13:41:24<138:47:14, 14.37s/it]
  8%|▊         | 3192/37963 [13:41:39<138:52:23, 14.38s/it]
  8%|▊         | 3193/37963 [13:41:53<138:00:03, 14.29s/it]
  8%|▊         | 3194/37963 [13:42:07<137:49:35, 14.27s/it]
  8%|▊         | 3195/37963 [13:42:21<137:23:58, 14.23s/it]
  8%|▊         | 3196/37963 [13:42:35<136:37:29, 14.15s/it]
  8%|▊         | 3197/37963 [13:42:55<153:35:19, 15.90s/it]
  8%|▊         | 3198/37963 [13:43:10<149:26:23, 15.47s/it]
  8%|▊         | 3199/37963 [13:43:24<145:55:16, 15.11s/it]
  8%|▊         | 3200/37963 [13:43:38<143:41:15, 14.88s/it]
                                                           
{'loss': '0.1806', 'grad_norm': '4.73', 'learning_rate': '1.985e-05', 'epoch': '0.08429'}

  8%|▊         | 3200/37963 [13:43:38<143:41:15, 14.88s/it]
  8%|▊         | 3201/37963 [13:43:52<140:45:21, 14.58s/it]
  8%|▊         | 3202/37963 [13:44:06<139:54:36, 14.49s/it]
  8%|▊         | 3203/37963 [13:44:21<139:40:51, 14.47s/it]
  8%|▊         | 3204/37963 [13:44:35<138:38:15, 14.36s/it]
  8%|▊         | 3205/37963 [13:44:49<138:44:54, 14.37s/it]
  8%|▊         | 3206/37963 [13:45:10<157:22:06, 16.30s/it]
  8%|▊         | 3207/37963 [13:45:24<151:47:18, 15.72s/it]
  8%|▊         | 3208/37963 [13:45:38<146:07:39, 15.14s/it]
  8%|▊         | 3209/37963 [13:45:53<143:59:15, 14.91s/it]
  8%|▊         | 3210/37963 [13:46:21<182:00:02, 18.85s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '2.75', 'learning_rate': '1.984e-05', 'epoch': '0.08456'}

  8%|▊         | 3210/37963 [13:46:21<182:00:02, 18.85s/it]
  8%|▊         | 3211/37963 [13:46:35<169:16:48, 17.54s/it]
  8%|▊         | 3212/37963 [13:46:56<178:33:17, 18.50s/it]
  8%|▊         | 3213/37963 [13:47:10<166:43:06, 17.27s/it]
  8%|▊         | 3214/37963 [13:47:31<177:53:00, 18.43s/it]
  8%|▊         | 3215/37963 [13:47:46<166:06:27, 17.21s/it]
  8%|▊         | 3216/37963 [13:48:00<157:42:27, 16.34s/it]
  8%|▊         | 3217/37963 [13:48:14<152:10:30, 15.77s/it]
  8%|▊         | 3218/37963 [13:48:29<148:10:23, 15.35s/it]
  8%|▊         | 3219/37963 [13:48:50<164:34:30, 17.05s/it]
  8%|▊         | 3220/37963 [13:49:04<157:03:49, 16.27s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '5.675', 'learning_rate': '1.984e-05', 'epoch': '0.08482'}

  8%|▊         | 3220/37963 [13:49:04<157:03:49, 16.27s/it]
  8%|▊         | 3221/37963 [13:49:18<150:55:44, 15.64s/it]
  8%|▊         | 3222/37963 [13:49:33<146:50:20, 15.22s/it]
  8%|▊         | 3223/37963 [13:49:47<144:15:15, 14.95s/it]
  8%|▊         | 3224/37963 [13:50:08<161:27:12, 16.73s/it]
  8%|▊         | 3225/37963 [13:50:22<154:29:38, 16.01s/it]
  8%|▊         | 3226/37963 [13:50:37<150:26:44, 15.59s/it]
  9%|▊         | 3227/37963 [13:50:51<146:28:12, 15.18s/it]
  9%|▊         | 3228/37963 [13:51:05<144:02:42, 14.93s/it]
  9%|▊         | 3229/37963 [13:51:20<142:21:43, 14.76s/it]
  9%|▊         | 3230/37963 [13:51:34<141:20:36, 14.65s/it]
                                                           
{'loss': '0.1754', 'grad_norm': '2.598', 'learning_rate': '1.984e-05', 'epoch': '0.08508'}

  9%|▊         | 3230/37963 [13:51:34<141:20:36, 14.65s/it]
  9%|▊         | 3231/37963 [13:51:48<139:17:54, 14.44s/it]
  9%|▊         | 3232/37963 [13:52:03<139:25:42, 14.45s/it]
  9%|▊         | 3233/37963 [13:52:17<139:05:58, 14.42s/it]
  9%|▊         | 3234/37963 [13:52:31<138:51:19, 14.39s/it]
  9%|▊         | 3235/37963 [13:52:46<138:34:49, 14.37s/it]
  9%|▊         | 3236/37963 [13:53:00<137:27:37, 14.25s/it]
  9%|▊         | 3237/37963 [13:53:13<136:27:04, 14.15s/it]
  9%|▊         | 3238/37963 [13:53:28<136:30:13, 14.15s/it]
  9%|▊         | 3239/37963 [13:53:42<137:33:22, 14.26s/it]
  9%|▊         | 3240/37963 [13:53:57<138:14:18, 14.33s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '4.184', 'learning_rate': '1.984e-05', 'epoch': '0.08535'}

  9%|▊         | 3240/37963 [13:53:57<138:14:18, 14.33s/it]
  9%|▊         | 3241/37963 [13:54:10<136:41:12, 14.17s/it]
  9%|▊         | 3242/37963 [13:54:25<137:11:07, 14.22s/it]
  9%|▊         | 3243/37963 [13:54:39<137:19:12, 14.24s/it]
  9%|▊         | 3244/37963 [13:55:00<156:36:26, 16.24s/it]
  9%|▊         | 3245/37963 [13:55:14<150:57:02, 15.65s/it]
  9%|▊         | 3246/37963 [13:55:29<147:04:50, 15.25s/it]
  9%|▊         | 3247/37963 [13:55:43<144:30:57, 14.99s/it]
  9%|▊         | 3248/37963 [13:55:57<142:29:48, 14.78s/it]
  9%|▊         | 3249/37963 [13:56:11<141:08:43, 14.64s/it]
  9%|▊         | 3250/37963 [13:56:26<139:35:44, 14.48s/it]
                                                           
{'loss': '0.1814', 'grad_norm': '2.395', 'learning_rate': '1.984e-05', 'epoch': '0.08561'}

  9%|▊         | 3250/37963 [13:56:26<139:35:44, 14.48s/it]
  9%|▊         | 3251/37963 [13:56:40<139:15:41, 14.44s/it]
  9%|▊         | 3252/37963 [13:56:54<139:08:07, 14.43s/it]
  9%|▊         | 3253/37963 [13:57:09<138:54:59, 14.41s/it]
  9%|▊         | 3254/37963 [13:57:30<157:55:10, 16.38s/it]
  9%|▊         | 3255/37963 [13:57:44<151:11:56, 15.68s/it]
  9%|▊         | 3256/37963 [13:57:58<147:07:27, 15.26s/it]
  9%|▊         | 3257/37963 [13:58:12<144:21:29, 14.97s/it]
  9%|▊         | 3258/37963 [13:58:33<161:46:12, 16.78s/it]
  9%|▊         | 3259/37963 [13:58:48<154:53:48, 16.07s/it]
  9%|▊         | 3260/37963 [13:59:09<170:10:15, 17.65s/it]
                                                           
{'loss': '0.1595', 'grad_norm': '3.917', 'learning_rate': '1.984e-05', 'epoch': '0.08587'}

  9%|▊         | 3260/37963 [13:59:09<170:10:15, 17.65s/it]
  9%|▊         | 3261/37963 [13:59:29<177:45:49, 18.44s/it]
  9%|▊         | 3262/37963 [13:59:44<165:58:55, 17.22s/it]
  9%|▊         | 3263/37963 [13:59:58<158:08:31, 16.41s/it]
  9%|▊         | 3264/37963 [14:00:13<152:23:02, 15.81s/it]
  9%|▊         | 3265/37963 [14:00:34<169:11:15, 17.55s/it]
  9%|▊         | 3266/37963 [14:00:55<179:02:30, 18.58s/it]
  9%|▊         | 3267/37963 [14:01:09<166:21:50, 17.26s/it]
  9%|▊         | 3268/37963 [14:01:24<157:40:56, 16.36s/it]
  9%|▊         | 3269/37963 [14:01:38<151:19:01, 15.70s/it]
  9%|▊         | 3270/37963 [14:01:58<164:08:27, 17.03s/it]
                                                           
{'loss': '0.1697', 'grad_norm': '1.714', 'learning_rate': '1.984e-05', 'epoch': '0.08614'}

  9%|▊         | 3270/37963 [14:01:58<164:08:27, 17.03s/it]
  9%|▊         | 3271/37963 [14:02:12<155:48:42, 16.17s/it]
  9%|▊         | 3272/37963 [14:02:26<149:57:54, 15.56s/it]
  9%|▊         | 3273/37963 [14:02:41<146:26:19, 15.20s/it]
  9%|▊         | 3274/37963 [14:02:55<142:36:16, 14.80s/it]
  9%|▊         | 3275/37963 [14:03:09<140:48:09, 14.61s/it]
  9%|▊         | 3276/37963 [14:03:23<140:11:39, 14.55s/it]
  9%|▊         | 3277/37963 [14:03:37<137:53:01, 14.31s/it]
  9%|▊         | 3278/37963 [14:03:51<138:04:55, 14.33s/it]
  9%|▊         | 3279/37963 [14:04:05<137:51:47, 14.31s/it]
  9%|▊         | 3280/37963 [14:04:20<138:14:43, 14.35s/it]
                                                           
{'loss': '0.176', 'grad_norm': '2.092', 'learning_rate': '1.983e-05', 'epoch': '0.0864'}

  9%|▊         | 3280/37963 [14:04:20<138:14:43, 14.35s/it]
  9%|▊         | 3281/37963 [14:04:34<137:13:30, 14.24s/it]
  9%|▊         | 3282/37963 [14:04:48<137:46:43, 14.30s/it]
  9%|▊         | 3283/37963 [14:05:02<136:30:55, 14.17s/it]
  9%|▊         | 3284/37963 [14:05:17<137:07:08, 14.23s/it]
  9%|▊         | 3285/37963 [14:05:31<137:50:51, 14.31s/it]
  9%|▊         | 3286/37963 [14:05:45<138:03:16, 14.33s/it]
  9%|▊         | 3287/37963 [14:06:00<137:57:26, 14.32s/it]
  9%|▊         | 3288/37963 [14:06:14<138:05:38, 14.34s/it]
  9%|▊         | 3289/37963 [14:06:28<138:05:52, 14.34s/it]
  9%|▊         | 3290/37963 [14:06:43<138:07:52, 14.34s/it]
                                                           
{'loss': '0.1752', 'grad_norm': '4.647', 'learning_rate': '1.983e-05', 'epoch': '0.08666'}

  9%|▊         | 3290/37963 [14:06:43<138:07:52, 14.34s/it]
  9%|▊         | 3291/37963 [14:06:57<137:07:12, 14.24s/it]
  9%|▊         | 3292/37963 [14:07:17<154:58:44, 16.09s/it]
  9%|▊         | 3293/37963 [14:07:31<148:47:17, 15.45s/it]
  9%|▊         | 3294/37963 [14:07:45<144:58:03, 15.05s/it]
  9%|▊         | 3295/37963 [14:08:00<143:13:31, 14.87s/it]
  9%|▊         | 3296/37963 [14:08:14<141:34:31, 14.70s/it]
  9%|▊         | 3297/37963 [14:08:28<140:40:50, 14.61s/it]
  9%|▊         | 3298/37963 [14:08:42<137:51:45, 14.32s/it]
  9%|▊         | 3299/37963 [14:08:56<136:47:05, 14.21s/it]
  9%|▊         | 3300/37963 [14:09:10<136:03:31, 14.13s/it]
                                                           
{'loss': '0.1847', 'grad_norm': '5.068', 'learning_rate': '1.983e-05', 'epoch': '0.08693'}

  9%|▊         | 3300/37963 [14:09:10<136:03:31, 14.13s/it]
  9%|▊         | 3301/37963 [14:09:24<136:39:56, 14.19s/it]
  9%|▊         | 3302/37963 [14:09:46<156:58:08, 16.30s/it]
  9%|▊         | 3303/37963 [14:09:59<148:59:40, 15.48s/it]
  9%|▊         | 3304/37963 [14:10:13<145:07:44, 15.07s/it]
  9%|▊         | 3305/37963 [14:10:34<161:03:09, 16.73s/it]
  9%|▊         | 3306/37963 [14:10:48<154:00:58, 16.00s/it]
  9%|▊         | 3307/37963 [14:11:03<149:13:47, 15.50s/it]
  9%|▊         | 3308/37963 [14:11:17<146:01:00, 15.17s/it]
  9%|▊         | 3309/37963 [14:11:31<143:24:22, 14.90s/it]
  9%|▊         | 3310/37963 [14:11:58<177:46:14, 18.47s/it]
                                                           
{'loss': '0.1654', 'grad_norm': '5.291', 'learning_rate': '1.983e-05', 'epoch': '0.08719'}

  9%|▊         | 3310/37963 [14:11:58<177:46:14, 18.47s/it]
  9%|▊         | 3311/37963 [14:12:12<164:50:54, 17.13s/it]
  9%|▊         | 3312/37963 [14:12:26<156:39:18, 16.28s/it]
  9%|▊         | 3313/37963 [14:12:47<169:28:53, 17.61s/it]
  9%|▊         | 3314/37963 [14:13:08<178:44:56, 18.57s/it]
  9%|▊         | 3315/37963 [14:13:22<166:59:24, 17.35s/it]
  9%|▊         | 3316/37963 [14:13:37<158:16:01, 16.44s/it]
  9%|▊         | 3317/37963 [14:13:51<151:44:44, 15.77s/it]
  9%|▊         | 3318/37963 [14:14:12<166:47:25, 17.33s/it]
  9%|▊         | 3319/37963 [14:14:26<158:28:30, 16.47s/it]
  9%|▊         | 3320/37963 [14:14:41<152:24:44, 15.84s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '7.787', 'learning_rate': '1.983e-05', 'epoch': '0.08745'}

  9%|▊         | 3320/37963 [14:14:41<152:24:44, 15.84s/it]
  9%|▊         | 3321/37963 [14:14:55<148:41:44, 15.45s/it]
  9%|▉         | 3322/37963 [14:15:09<145:19:53, 15.10s/it]
  9%|▉         | 3323/37963 [14:15:24<143:04:54, 14.87s/it]
  9%|▉         | 3324/37963 [14:15:38<141:25:24, 14.70s/it]
  9%|▉         | 3325/37963 [14:15:52<140:37:40, 14.62s/it]
  9%|▉         | 3326/37963 [14:16:07<139:51:42, 14.54s/it]
  9%|▉         | 3327/37963 [14:16:21<139:23:03, 14.49s/it]
  9%|▉         | 3328/37963 [14:16:35<138:30:00, 14.40s/it]
  9%|▉         | 3329/37963 [14:16:50<138:22:51, 14.38s/it]
  9%|▉         | 3330/37963 [14:17:04<138:36:31, 14.41s/it]
                                                           
{'loss': '0.1681', 'grad_norm': '3.264', 'learning_rate': '1.983e-05', 'epoch': '0.08772'}

  9%|▉         | 3330/37963 [14:17:04<138:36:31, 14.41s/it]
  9%|▉         | 3331/37963 [14:17:19<138:30:08, 14.40s/it]
  9%|▉         | 3332/37963 [14:17:33<137:47:45, 14.32s/it]
  9%|▉         | 3333/37963 [14:17:47<137:58:41, 14.34s/it]
  9%|▉         | 3334/37963 [14:18:02<138:05:46, 14.36s/it]
  9%|▉         | 3335/37963 [14:18:16<138:01:41, 14.35s/it]
  9%|▉         | 3336/37963 [14:18:30<137:57:02, 14.34s/it]
  9%|▉         | 3337/37963 [14:18:44<137:36:25, 14.31s/it]
  9%|▉         | 3338/37963 [14:18:59<137:38:52, 14.31s/it]
  9%|▉         | 3339/37963 [14:19:19<154:51:44, 16.10s/it]
  9%|▉         | 3340/37963 [14:19:33<147:22:07, 15.32s/it]
                                                           
{'loss': '0.1651', 'grad_norm': '3.914', 'learning_rate': '1.982e-05', 'epoch': '0.08798'}

  9%|▉         | 3340/37963 [14:19:33<147:22:07, 15.32s/it]
  9%|▉         | 3341/37963 [14:19:47<144:36:29, 15.04s/it]
  9%|▉         | 3342/37963 [14:20:01<142:45:01, 14.84s/it]
  9%|▉         | 3343/37963 [14:20:15<139:14:44, 14.48s/it]
  9%|▉         | 3344/37963 [14:20:29<136:57:53, 14.24s/it]
  9%|▉         | 3345/37963 [14:20:43<137:23:32, 14.29s/it]
  9%|▉         | 3346/37963 [14:20:57<137:36:09, 14.31s/it]
  9%|▉         | 3347/37963 [14:21:12<137:58:03, 14.35s/it]
  9%|▉         | 3348/37963 [14:21:25<135:12:44, 14.06s/it]
  9%|▉         | 3349/37963 [14:21:39<135:53:02, 14.13s/it]
  9%|▉         | 3350/37963 [14:21:54<136:32:39, 14.20s/it]
                                                           
{'loss': '0.1715', 'grad_norm': '3.316', 'learning_rate': '1.982e-05', 'epoch': '0.08824'}

  9%|▉         | 3350/37963 [14:21:54<136:32:39, 14.20s/it]
  9%|▉         | 3351/37963 [14:22:15<157:20:52, 16.37s/it]
  9%|▉         | 3352/37963 [14:22:30<151:21:14, 15.74s/it]
  9%|▉         | 3353/37963 [14:22:44<147:11:50, 15.31s/it]
  9%|▉         | 3354/37963 [14:22:58<144:44:48, 15.06s/it]
  9%|▉         | 3355/37963 [14:23:13<142:41:42, 14.84s/it]
  9%|▉         | 3356/37963 [14:23:33<159:56:55, 16.64s/it]
  9%|▉         | 3357/37963 [14:23:55<172:39:05, 17.96s/it]
  9%|▉         | 3358/37963 [14:24:16<181:45:03, 18.91s/it]
  9%|▉         | 3359/37963 [14:24:30<168:41:29, 17.55s/it]
  9%|▉         | 3360/37963 [14:24:44<157:35:59, 16.40s/it]
                                                           
{'loss': '0.1749', 'grad_norm': '1.753', 'learning_rate': '1.982e-05', 'epoch': '0.08851'}

  9%|▉         | 3360/37963 [14:24:44<157:35:59, 16.40s/it]
  9%|▉         | 3361/37963 [14:24:58<151:35:24, 15.77s/it]
  9%|▉         | 3362/37963 [14:25:20<168:15:24, 17.51s/it]
  9%|▉         | 3363/37963 [14:25:41<178:16:47, 18.55s/it]
  9%|▉         | 3364/37963 [14:25:55<165:23:44, 17.21s/it]
  9%|▉         | 3365/37963 [14:26:09<157:10:04, 16.35s/it]
  9%|▉         | 3366/37963 [14:26:30<170:32:03, 17.74s/it]
  9%|▉         | 3367/37963 [14:26:44<159:44:19, 16.62s/it]
  9%|▉         | 3368/37963 [14:26:58<153:16:34, 15.95s/it]
  9%|▉         | 3369/37963 [14:27:13<149:14:31, 15.53s/it]
  9%|▉         | 3370/37963 [14:27:27<144:24:02, 15.03s/it]
                                                           
{'loss': '0.1711', 'grad_norm': '4.426', 'learning_rate': '1.982e-05', 'epoch': '0.08877'}

  9%|▉         | 3370/37963 [14:27:27<144:24:02, 15.03s/it]
  9%|▉         | 3371/37963 [14:27:41<142:37:22, 14.84s/it]
  9%|▉         | 3372/37963 [14:27:56<141:19:20, 14.71s/it]
  9%|▉         | 3373/37963 [14:28:10<139:26:37, 14.51s/it]
  9%|▉         | 3374/37963 [14:28:24<138:49:42, 14.45s/it]
  9%|▉         | 3375/37963 [14:28:38<138:39:26, 14.43s/it]
  9%|▉         | 3376/37963 [14:28:53<138:28:59, 14.41s/it]
  9%|▉         | 3377/37963 [14:29:07<138:17:53, 14.40s/it]
  9%|▉         | 3378/37963 [14:29:22<138:58:42, 14.47s/it]
  9%|▉         | 3379/37963 [14:29:36<138:35:30, 14.43s/it]
  9%|▉         | 3380/37963 [14:29:50<137:39:37, 14.33s/it]
                                                           
{'loss': '0.1632', 'grad_norm': '4.72', 'learning_rate': '1.982e-05', 'epoch': '0.08903'}

  9%|▉         | 3380/37963 [14:29:50<137:39:37, 14.33s/it]
  9%|▉         | 3381/37963 [14:30:04<136:39:39, 14.23s/it]
  9%|▉         | 3382/37963 [14:30:18<136:06:53, 14.17s/it]
  9%|▉         | 3383/37963 [14:30:32<135:57:33, 14.15s/it]
  9%|▉         | 3384/37963 [14:30:47<136:37:43, 14.22s/it]
  9%|▉         | 3385/37963 [14:31:00<135:22:57, 14.10s/it]
  9%|▉         | 3386/37963 [14:31:15<135:31:32, 14.11s/it]
  9%|▉         | 3387/37963 [14:31:29<136:14:11, 14.18s/it]
  9%|▉         | 3388/37963 [14:31:50<155:26:37, 16.19s/it]
  9%|▉         | 3389/37963 [14:32:04<150:17:57, 15.65s/it]
  9%|▉         | 3390/37963 [14:32:19<146:31:13, 15.26s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '2.405', 'learning_rate': '1.982e-05', 'epoch': '0.0893'}

  9%|▉         | 3390/37963 [14:32:19<146:31:13, 15.26s/it]
  9%|▉         | 3391/37963 [14:32:33<144:04:34, 15.00s/it]
  9%|▉         | 3392/37963 [14:32:47<140:39:18, 14.65s/it]
  9%|▉         | 3393/37963 [14:33:01<138:12:38, 14.39s/it]
  9%|▉         | 3394/37963 [14:33:15<137:51:17, 14.36s/it]
  9%|▉         | 3395/37963 [14:33:29<137:47:45, 14.35s/it]
  9%|▉         | 3396/37963 [14:33:43<136:42:02, 14.24s/it]
  9%|▉         | 3397/37963 [14:33:58<136:59:40, 14.27s/it]
  9%|▉         | 3398/37963 [14:34:12<137:29:17, 14.32s/it]
  9%|▉         | 3399/37963 [14:34:33<157:13:13, 16.38s/it]
  9%|▉         | 3400/37963 [14:34:48<151:44:18, 15.80s/it]
                                                           
{'loss': '0.1701', 'grad_norm': '1.71', 'learning_rate': '1.981e-05', 'epoch': '0.08956'}

  9%|▉         | 3400/37963 [14:34:48<151:44:18, 15.80s/it]
  9%|▉         | 3401/37963 [14:35:02<147:29:14, 15.36s/it]
  9%|▉         | 3402/37963 [14:35:23<162:30:24, 16.93s/it]
  9%|▉         | 3403/37963 [14:35:37<155:10:14, 16.16s/it]
  9%|▉         | 3404/37963 [14:35:58<168:34:43, 17.56s/it]
  9%|▉         | 3405/37963 [14:36:12<159:11:13, 16.58s/it]
  9%|▉         | 3406/37963 [14:36:26<152:52:52, 15.93s/it]
  9%|▉         | 3407/37963 [14:36:40<147:34:03, 15.37s/it]
  9%|▉         | 3408/37963 [14:37:02<164:16:24, 17.11s/it]
  9%|▉         | 3409/37963 [14:37:16<156:19:41, 16.29s/it]
  9%|▉         | 3410/37963 [14:37:37<168:41:38, 17.58s/it]
                                                           
{'loss': '0.1665', 'grad_norm': '3.425', 'learning_rate': '1.981e-05', 'epoch': '0.08982'}

  9%|▉         | 3410/37963 [14:37:37<168:41:38, 17.58s/it]
  9%|▉         | 3411/37963 [14:37:57<177:56:28, 18.54s/it]
  9%|▉         | 3412/37963 [14:38:18<184:19:30, 19.21s/it]
  9%|▉         | 3413/37963 [14:38:33<170:42:33, 17.79s/it]
  9%|▉         | 3414/37963 [14:38:47<160:56:20, 16.77s/it]
  9%|▉         | 3415/37963 [14:39:01<152:23:02, 15.88s/it]
  9%|▉         | 3416/37963 [14:39:15<148:06:03, 15.43s/it]
  9%|▉         | 3417/37963 [14:39:30<144:54:49, 15.10s/it]
  9%|▉         | 3418/37963 [14:39:44<142:34:30, 14.86s/it]
  9%|▉         | 3419/37963 [14:39:58<141:05:03, 14.70s/it]
  9%|▉         | 3420/37963 [14:40:13<140:01:26, 14.59s/it]
                                                           
{'loss': '0.1716', 'grad_norm': '2.676', 'learning_rate': '1.981e-05', 'epoch': '0.09009'}

  9%|▉         | 3420/37963 [14:40:13<140:01:26, 14.59s/it]
  9%|▉         | 3421/37963 [14:40:27<138:31:36, 14.44s/it]
  9%|▉         | 3422/37963 [14:40:41<137:56:03, 14.38s/it]
  9%|▉         | 3423/37963 [14:40:55<138:13:22, 14.41s/it]
  9%|▉         | 3424/37963 [14:41:10<138:13:00, 14.41s/it]
  9%|▉         | 3425/37963 [14:41:23<136:19:59, 14.21s/it]
  9%|▉         | 3426/37963 [14:41:38<136:26:05, 14.22s/it]
  9%|▉         | 3427/37963 [14:41:52<137:18:07, 14.31s/it]
  9%|▉         | 3428/37963 [14:42:07<137:26:15, 14.33s/it]
  9%|▉         | 3429/37963 [14:42:21<138:04:57, 14.39s/it]
  9%|▉         | 3430/37963 [14:42:35<137:54:12, 14.38s/it]
                                                           
{'loss': '0.1725', 'grad_norm': '1.914', 'learning_rate': '1.981e-05', 'epoch': '0.09035'}

  9%|▉         | 3430/37963 [14:42:35<137:54:12, 14.38s/it]
  9%|▉         | 3431/37963 [14:42:50<138:12:06, 14.41s/it]
  9%|▉         | 3432/37963 [14:43:03<135:36:32, 14.14s/it]
  9%|▉         | 3433/37963 [14:43:18<136:10:14, 14.20s/it]
  9%|▉         | 3434/37963 [14:43:32<136:44:20, 14.26s/it]
  9%|▉         | 3435/37963 [14:43:47<137:43:26, 14.36s/it]
  9%|▉         | 3436/37963 [14:44:01<138:20:44, 14.42s/it]
  9%|▉         | 3437/37963 [14:44:15<136:35:13, 14.24s/it]
  9%|▉         | 3438/37963 [14:44:36<154:48:20, 16.14s/it]
  9%|▉         | 3439/37963 [14:44:50<149:07:50, 15.55s/it]
  9%|▉         | 3440/37963 [14:45:04<145:13:50, 15.14s/it]
                                                           
{'loss': '0.1747', 'grad_norm': '2.513', 'learning_rate': '1.981e-05', 'epoch': '0.09061'}

  9%|▉         | 3440/37963 [14:45:04<145:13:50, 15.14s/it]
  9%|▉         | 3441/37963 [14:45:18<141:24:50, 14.75s/it]
  9%|▉         | 3442/37963 [14:45:32<140:22:42, 14.64s/it]
  9%|▉         | 3443/37963 [14:45:46<136:59:21, 14.29s/it]
  9%|▉         | 3444/37963 [14:46:00<137:30:26, 14.34s/it]
  9%|▉         | 3445/37963 [14:46:15<137:15:01, 14.31s/it]
  9%|▉         | 3446/37963 [14:46:29<137:38:57, 14.36s/it]
  9%|▉         | 3447/37963 [14:46:43<137:16:46, 14.32s/it]
  9%|▉         | 3448/37963 [14:46:58<138:12:01, 14.41s/it]
  9%|▉         | 3449/37963 [14:47:12<138:00:35, 14.40s/it]
  9%|▉         | 3450/37963 [14:47:33<156:01:27, 16.27s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '3.108', 'learning_rate': '1.981e-05', 'epoch': '0.09088'}

  9%|▉         | 3450/37963 [14:47:33<156:01:27, 16.27s/it]
  9%|▉         | 3451/37963 [14:47:47<150:26:27, 15.69s/it]
  9%|▉         | 3452/37963 [14:48:08<166:19:18, 17.35s/it]
  9%|▉         | 3453/37963 [14:48:29<176:35:50, 18.42s/it]
  9%|▉         | 3454/37963 [14:48:43<163:26:44, 17.05s/it]
  9%|▉         | 3455/37963 [14:48:57<155:32:23, 16.23s/it]
  9%|▉         | 3456/37963 [14:49:12<150:09:41, 15.67s/it]
  9%|▉         | 3457/37963 [14:49:32<164:28:58, 17.16s/it]
  9%|▉         | 3458/37963 [14:49:54<177:15:55, 18.49s/it]
  9%|▉         | 3459/37963 [14:50:14<181:45:51, 18.96s/it]
  9%|▉         | 3460/37963 [14:50:28<168:10:00, 17.55s/it]
                                                           
{'loss': '0.152', 'grad_norm': '1.617', 'learning_rate': '1.98e-05', 'epoch': '0.09114'}

  9%|▉         | 3460/37963 [14:50:28<168:10:00, 17.55s/it]
  9%|▉         | 3461/37963 [14:50:43<159:17:49, 16.62s/it]
  9%|▉         | 3462/37963 [14:51:04<171:31:54, 17.90s/it]
  9%|▉         | 3463/37963 [14:51:18<159:47:10, 16.67s/it]
  9%|▉         | 3464/37963 [14:51:32<153:02:36, 15.97s/it]
  9%|▉         | 3465/37963 [14:51:46<146:16:46, 15.26s/it]
  9%|▉         | 3466/37963 [14:52:00<143:46:39, 15.00s/it]
  9%|▉         | 3467/37963 [14:52:14<142:08:41, 14.83s/it]
  9%|▉         | 3468/37963 [14:52:29<141:12:58, 14.74s/it]
  9%|▉         | 3469/37963 [14:52:43<140:05:07, 14.62s/it]
  9%|▉         | 3470/37963 [14:52:58<139:14:08, 14.53s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '1.65', 'learning_rate': '1.98e-05', 'epoch': '0.09141'}

  9%|▉         | 3470/37963 [14:52:58<139:14:08, 14.53s/it]
  9%|▉         | 3471/37963 [14:53:12<138:09:07, 14.42s/it]
  9%|▉         | 3472/37963 [14:53:26<138:03:27, 14.41s/it]
  9%|▉         | 3473/37963 [14:53:40<137:45:30, 14.38s/it]
  9%|▉         | 3474/37963 [14:53:54<136:43:54, 14.27s/it]
  9%|▉         | 3475/37963 [14:54:09<136:47:43, 14.28s/it]
  9%|▉         | 3476/37963 [14:54:23<137:06:32, 14.31s/it]
  9%|▉         | 3477/37963 [14:54:37<137:01:28, 14.30s/it]
  9%|▉         | 3478/37963 [14:54:52<137:31:57, 14.36s/it]
  9%|▉         | 3479/37963 [14:55:06<137:23:56, 14.34s/it]
  9%|▉         | 3480/37963 [14:55:21<137:35:24, 14.36s/it]
                                                           
{'loss': '0.1813', 'grad_norm': '2.31', 'learning_rate': '1.98e-05', 'epoch': '0.09167'}

  9%|▉         | 3480/37963 [14:55:21<137:35:24, 14.36s/it]
  9%|▉         | 3481/37963 [14:55:35<137:30:32, 14.36s/it]
  9%|▉         | 3482/37963 [14:55:49<137:40:14, 14.37s/it]
  9%|▉         | 3483/37963 [14:56:03<136:31:47, 14.25s/it]
  9%|▉         | 3484/37963 [14:56:18<136:40:25, 14.27s/it]
  9%|▉         | 3485/37963 [14:56:32<136:21:59, 14.24s/it]
  9%|▉         | 3486/37963 [14:56:52<153:25:31, 16.02s/it]
  9%|▉         | 3487/37963 [14:57:06<148:38:04, 15.52s/it]
  9%|▉         | 3488/37963 [14:57:21<145:11:38, 15.16s/it]
  9%|▉         | 3489/37963 [14:57:35<142:41:50, 14.90s/it]
  9%|▉         | 3490/37963 [14:57:49<139:52:36, 14.61s/it]
                                                           
{'loss': '0.1576', 'grad_norm': '4.137', 'learning_rate': '1.98e-05', 'epoch': '0.09193'}

  9%|▉         | 3490/37963 [14:57:49<139:52:36, 14.61s/it]
  9%|▉         | 3491/37963 [14:58:03<138:27:58, 14.46s/it]
  9%|▉         | 3492/37963 [14:58:17<138:08:08, 14.43s/it]
  9%|▉         | 3493/37963 [14:58:32<138:06:20, 14.42s/it]
  9%|▉         | 3494/37963 [14:58:46<136:50:59, 14.29s/it]
  9%|▉         | 3495/37963 [14:59:00<137:05:44, 14.32s/it]
  9%|▉         | 3496/37963 [14:59:15<137:28:08, 14.36s/it]
  9%|▉         | 3497/37963 [14:59:29<137:26:37, 14.36s/it]
  9%|▉         | 3498/37963 [14:59:56<175:20:35, 18.32s/it]
  9%|▉         | 3499/37963 [15:00:10<162:58:39, 17.02s/it]
  9%|▉         | 3500/37963 [15:00:25<155:28:30, 16.24s/it]
                                                           
{'loss': '0.1778', 'grad_norm': '1.737', 'learning_rate': '1.98e-05', 'epoch': '0.0922'}

  9%|▉         | 3500/37963 [15:00:25<155:28:30, 16.24s/it]
  9%|▉         | 3501/37963 [15:00:46<169:45:48, 17.73s/it]
  9%|▉         | 3502/37963 [15:01:00<159:57:39, 16.71s/it]
  9%|▉         | 3503/37963 [15:01:15<152:56:25, 15.98s/it]
  9%|▉         | 3504/37963 [15:01:29<148:22:09, 15.50s/it]
  9%|▉         | 3505/37963 [15:01:43<144:42:00, 15.12s/it]
  9%|▉         | 3506/37963 [15:01:58<142:28:20, 14.89s/it]
  9%|▉         | 3507/37963 [15:02:26<180:18:09, 18.84s/it]
  9%|▉         | 3508/37963 [15:02:47<185:56:44, 19.43s/it]
  9%|▉         | 3509/37963 [15:03:01<171:20:47, 17.90s/it]
  9%|▉         | 3510/37963 [15:03:15<161:07:53, 16.84s/it]
                                                           
{'loss': '0.1674', 'grad_norm': '1.296', 'learning_rate': '1.98e-05', 'epoch': '0.09246'}

  9%|▉         | 3510/37963 [15:03:15<161:07:53, 16.84s/it]
  9%|▉         | 3511/37963 [15:03:29<153:47:06, 16.07s/it]
  9%|▉         | 3512/37963 [15:03:50<167:44:56, 17.53s/it]
  9%|▉         | 3513/37963 [15:04:05<158:36:22, 16.57s/it]
  9%|▉         | 3514/37963 [15:04:19<152:06:42, 15.90s/it]
  9%|▉         | 3515/37963 [15:04:33<147:30:32, 15.42s/it]
  9%|▉         | 3516/37963 [15:04:48<144:29:59, 15.10s/it]
  9%|▉         | 3517/37963 [15:05:01<140:29:44, 14.68s/it]
  9%|▉         | 3518/37963 [15:05:16<139:26:25, 14.57s/it]
  9%|▉         | 3519/37963 [15:05:30<138:09:25, 14.44s/it]
  9%|▉         | 3520/37963 [15:05:44<137:53:19, 14.41s/it]
                                                           
{'loss': '0.1632', 'grad_norm': '1.356', 'learning_rate': '1.979e-05', 'epoch': '0.09272'}

  9%|▉         | 3520/37963 [15:05:44<137:53:19, 14.41s/it]
  9%|▉         | 3521/37963 [15:05:59<137:39:13, 14.39s/it]
  9%|▉         | 3522/37963 [15:06:13<136:26:17, 14.26s/it]
  9%|▉         | 3523/37963 [15:06:27<136:48:25, 14.30s/it]
  9%|▉         | 3524/37963 [15:06:41<136:51:28, 14.31s/it]
  9%|▉         | 3525/37963 [15:06:56<137:05:00, 14.33s/it]
  9%|▉         | 3526/37963 [15:07:09<135:40:31, 14.18s/it]
  9%|▉         | 3527/37963 [15:07:24<136:02:01, 14.22s/it]
  9%|▉         | 3528/37963 [15:07:38<136:39:05, 14.29s/it]
  9%|▉         | 3529/37963 [15:07:52<136:28:53, 14.27s/it]
  9%|▉         | 3530/37963 [15:08:07<136:53:19, 14.31s/it]
                                                           
{'loss': '0.164', 'grad_norm': '2.529', 'learning_rate': '1.979e-05', 'epoch': '0.09299'}

  9%|▉         | 3530/37963 [15:08:07<136:53:19, 14.31s/it]
  9%|▉         | 3531/37963 [15:08:21<136:32:30, 14.28s/it]
  9%|▉         | 3532/37963 [15:08:35<135:01:07, 14.12s/it]
  9%|▉         | 3533/37963 [15:08:49<135:31:36, 14.17s/it]
  9%|▉         | 3534/37963 [15:09:03<136:07:14, 14.23s/it]
  9%|▉         | 3535/37963 [15:09:18<136:37:46, 14.29s/it]
  9%|▉         | 3536/37963 [15:09:38<154:39:41, 16.17s/it]
  9%|▉         | 3537/37963 [15:09:53<149:18:38, 15.61s/it]
  9%|▉         | 3538/37963 [15:10:07<146:01:14, 15.27s/it]
  9%|▉         | 3539/37963 [15:10:22<143:47:54, 15.04s/it]
  9%|▉         | 3540/37963 [15:10:36<141:48:30, 14.83s/it]
                                                           
{'loss': '0.1748', 'grad_norm': '2.211', 'learning_rate': '1.979e-05', 'epoch': '0.09325'}

  9%|▉         | 3540/37963 [15:10:36<141:48:30, 14.83s/it]
  9%|▉         | 3541/37963 [15:10:51<141:12:22, 14.77s/it]
  9%|▉         | 3542/37963 [15:11:05<139:55:58, 14.64s/it]
  9%|▉         | 3543/37963 [15:11:19<138:16:00, 14.46s/it]
  9%|▉         | 3544/37963 [15:11:33<136:46:05, 14.31s/it]
  9%|▉         | 3545/37963 [15:11:47<136:42:38, 14.30s/it]
  9%|▉         | 3546/37963 [15:12:02<136:49:46, 14.31s/it]
  9%|▉         | 3547/37963 [15:12:16<136:00:16, 14.23s/it]
  9%|▉         | 3548/37963 [15:12:36<154:41:52, 16.18s/it]
  9%|▉         | 3549/37963 [15:12:58<168:51:06, 17.66s/it]
  9%|▉         | 3550/37963 [15:13:12<159:28:56, 16.68s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '1.801', 'learning_rate': '1.979e-05', 'epoch': '0.09351'}

  9%|▉         | 3550/37963 [15:13:12<159:28:56, 16.68s/it]
  9%|▉         | 3551/37963 [15:13:26<152:50:40, 15.99s/it]
  9%|▉         | 3552/37963 [15:13:41<148:37:53, 15.55s/it]
  9%|▉         | 3553/37963 [15:13:55<145:05:58, 15.18s/it]
  9%|▉         | 3554/37963 [15:14:10<142:55:42, 14.95s/it]
  9%|▉         | 3555/37963 [15:14:31<161:02:32, 16.85s/it]
  9%|▉         | 3556/37963 [15:14:52<173:45:42, 18.18s/it]
  9%|▉         | 3557/37963 [15:15:07<163:07:43, 17.07s/it]
  9%|▉         | 3558/37963 [15:15:21<154:29:41, 16.17s/it]
  9%|▉         | 3559/37963 [15:15:42<168:54:22, 17.67s/it]
  9%|▉         | 3560/37963 [15:15:56<159:14:43, 16.66s/it]
                                                           
{'loss': '0.1731', 'grad_norm': '2.194', 'learning_rate': '1.979e-05', 'epoch': '0.09378'}

  9%|▉         | 3560/37963 [15:15:56<159:14:43, 16.66s/it]
  9%|▉         | 3561/37963 [15:16:16<169:32:01, 17.74s/it]
  9%|▉         | 3562/37963 [15:16:30<158:45:12, 16.61s/it]
  9%|▉         | 3563/37963 [15:16:45<152:03:53, 15.91s/it]
  9%|▉         | 3564/37963 [15:16:59<147:33:13, 15.44s/it]
  9%|▉         | 3565/37963 [15:17:13<144:22:45, 15.11s/it]
  9%|▉         | 3566/37963 [15:17:28<142:08:13, 14.88s/it]
  9%|▉         | 3567/37963 [15:17:42<140:40:57, 14.72s/it]
  9%|▉         | 3568/37963 [15:17:56<138:34:37, 14.50s/it]
  9%|▉         | 3569/37963 [15:18:10<138:01:59, 14.45s/it]
  9%|▉         | 3570/37963 [15:18:24<136:31:17, 14.29s/it]
                                                           
{'loss': '0.1741', 'grad_norm': '3.643', 'learning_rate': '1.979e-05', 'epoch': '0.09404'}

  9%|▉         | 3570/37963 [15:18:24<136:31:17, 14.29s/it]
  9%|▉         | 3571/37963 [15:18:39<136:36:19, 14.30s/it]
  9%|▉         | 3572/37963 [15:18:53<136:38:05, 14.30s/it]
  9%|▉         | 3573/37963 [15:19:07<136:35:59, 14.30s/it]
  9%|▉         | 3574/37963 [15:19:22<136:57:49, 14.34s/it]
  9%|▉         | 3575/37963 [15:19:36<137:03:55, 14.35s/it]
  9%|▉         | 3576/37963 [15:19:50<137:05:53, 14.35s/it]
  9%|▉         | 3577/37963 [15:20:04<136:03:10, 14.24s/it]
  9%|▉         | 3578/37963 [15:20:19<136:10:57, 14.26s/it]
  9%|▉         | 3579/37963 [15:20:33<136:40:00, 14.31s/it]
  9%|▉         | 3580/37963 [15:20:47<136:27:14, 14.29s/it]
                                                           
{'loss': '0.1741', 'grad_norm': '1.238', 'learning_rate': '1.978e-05', 'epoch': '0.0943'}

  9%|▉         | 3580/37963 [15:20:47<136:27:14, 14.29s/it]
  9%|▉         | 3581/37963 [15:21:02<136:47:48, 14.32s/it]
  9%|▉         | 3582/37963 [15:21:16<136:23:52, 14.28s/it]
  9%|▉         | 3583/37963 [15:21:30<136:01:23, 14.24s/it]
  9%|▉         | 3584/37963 [15:21:50<152:20:30, 15.95s/it]
  9%|▉         | 3585/37963 [15:22:04<147:15:26, 15.42s/it]
  9%|▉         | 3586/37963 [15:22:18<143:18:18, 15.01s/it]
  9%|▉         | 3587/37963 [15:22:33<141:16:04, 14.79s/it]
  9%|▉         | 3588/37963 [15:22:47<139:49:47, 14.64s/it]
  9%|▉         | 3589/37963 [15:23:01<139:25:10, 14.60s/it]
  9%|▉         | 3590/37963 [15:23:15<137:55:59, 14.45s/it]
                                                           
{'loss': '0.1666', 'grad_norm': '2.157', 'learning_rate': '1.978e-05', 'epoch': '0.09457'}

  9%|▉         | 3590/37963 [15:23:15<137:55:59, 14.45s/it]
  9%|▉         | 3591/37963 [15:23:30<137:22:01, 14.39s/it]
  9%|▉         | 3592/37963 [15:23:44<137:13:54, 14.37s/it]
  9%|▉         | 3593/37963 [15:23:58<136:06:16, 14.26s/it]
  9%|▉         | 3594/37963 [15:24:12<136:23:40, 14.29s/it]
  9%|▉         | 3595/37963 [15:24:33<153:44:03, 16.10s/it]
  9%|▉         | 3596/37963 [15:24:47<148:21:32, 15.54s/it]
  9%|▉         | 3597/37963 [15:25:01<144:57:12, 15.18s/it]
  9%|▉         | 3598/37963 [15:25:29<181:08:27, 18.98s/it]
  9%|▉         | 3599/37963 [15:25:43<167:53:32, 17.59s/it]
  9%|▉         | 3600/37963 [15:25:58<158:44:48, 16.63s/it]
                                                           
{'loss': '0.1706', 'grad_norm': '3.97', 'learning_rate': '1.978e-05', 'epoch': '0.09483'}

  9%|▉         | 3600/37963 [15:25:58<158:44:48, 16.63s/it]
  9%|▉         | 3601/37963 [15:26:12<151:07:25, 15.83s/it]
  9%|▉         | 3602/37963 [15:26:26<147:14:57, 15.43s/it]
  9%|▉         | 3603/37963 [15:26:47<163:30:57, 17.13s/it]
  9%|▉         | 3604/37963 [15:27:02<155:36:49, 16.30s/it]
  9%|▉         | 3605/37963 [15:27:29<186:44:38, 19.57s/it]
  9%|▉         | 3606/37963 [15:27:43<171:58:43, 18.02s/it]
 10%|▉         | 3607/37963 [15:27:58<161:06:26, 16.88s/it]
 10%|▉         | 3608/37963 [15:28:12<153:19:56, 16.07s/it]
 10%|▉         | 3609/37963 [15:28:26<148:23:00, 15.55s/it]
 10%|▉         | 3610/37963 [15:28:47<163:18:20, 17.11s/it]
                                                           
{'loss': '0.1716', 'grad_norm': '2.729', 'learning_rate': '1.978e-05', 'epoch': '0.09509'}

 10%|▉         | 3610/37963 [15:28:47<163:18:20, 17.11s/it]
 10%|▉         | 3611/37963 [15:29:01<154:37:46, 16.20s/it]
 10%|▉         | 3612/37963 [15:29:15<149:16:17, 15.64s/it]
 10%|▉         | 3613/37963 [15:29:30<145:27:29, 15.24s/it]
 10%|▉         | 3614/37963 [15:29:44<142:43:44, 14.96s/it]
 10%|▉         | 3615/37963 [15:29:58<141:02:26, 14.78s/it]
 10%|▉         | 3616/37963 [15:30:12<139:02:14, 14.57s/it]
 10%|▉         | 3617/37963 [15:30:27<138:24:03, 14.51s/it]
 10%|▉         | 3618/37963 [15:30:41<137:47:14, 14.44s/it]
 10%|▉         | 3619/37963 [15:30:55<137:32:29, 14.42s/it]
 10%|▉         | 3620/37963 [15:31:10<137:16:04, 14.39s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '5.103', 'learning_rate': '1.978e-05', 'epoch': '0.09536'}

 10%|▉         | 3620/37963 [15:31:10<137:16:04, 14.39s/it]
 10%|▉         | 3621/37963 [15:31:24<136:11:13, 14.28s/it]
 10%|▉         | 3622/37963 [15:31:38<136:04:53, 14.27s/it]
 10%|▉         | 3623/37963 [15:31:52<134:59:03, 14.15s/it]
 10%|▉         | 3624/37963 [15:32:06<135:23:54, 14.19s/it]
 10%|▉         | 3625/37963 [15:32:21<136:10:23, 14.28s/it]
 10%|▉         | 3626/37963 [15:32:35<136:25:35, 14.30s/it]
 10%|▉         | 3627/37963 [15:32:49<136:05:11, 14.27s/it]
 10%|▉         | 3628/37963 [15:33:03<135:50:10, 14.24s/it]
 10%|▉         | 3629/37963 [15:33:18<136:12:23, 14.28s/it]
 10%|▉         | 3630/37963 [15:33:32<135:31:44, 14.21s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '1.378', 'learning_rate': '1.978e-05', 'epoch': '0.09562'}

 10%|▉         | 3630/37963 [15:33:32<135:31:44, 14.21s/it]
 10%|▉         | 3631/37963 [15:33:46<135:24:23, 14.20s/it]
 10%|▉         | 3632/37963 [15:34:00<134:41:13, 14.12s/it]
 10%|▉         | 3633/37963 [15:34:14<136:05:31, 14.27s/it]
 10%|▉         | 3634/37963 [15:34:29<135:50:29, 14.25s/it]
 10%|▉         | 3635/37963 [15:34:49<152:41:22, 16.01s/it]
 10%|▉         | 3636/37963 [15:35:03<147:10:32, 15.43s/it]
 10%|▉         | 3637/37963 [15:35:17<143:02:09, 15.00s/it]
 10%|▉         | 3638/37963 [15:35:31<140:01:59, 14.69s/it]
 10%|▉         | 3639/37963 [15:35:45<138:22:29, 14.51s/it]
 10%|▉         | 3640/37963 [15:35:59<136:06:13, 14.28s/it]
                                                           
{'loss': '0.1797', 'grad_norm': '1.246', 'learning_rate': '1.977e-05', 'epoch': '0.09588'}

 10%|▉         | 3640/37963 [15:35:59<136:06:13, 14.28s/it]
 10%|▉         | 3641/37963 [15:36:13<134:58:01, 14.16s/it]
 10%|▉         | 3642/37963 [15:36:27<136:04:47, 14.27s/it]
 10%|▉         | 3643/37963 [15:36:41<136:31:01, 14.32s/it]
 10%|▉         | 3644/37963 [15:37:02<154:58:33, 16.26s/it]
 10%|▉         | 3645/37963 [15:37:23<167:49:55, 17.61s/it]
 10%|▉         | 3646/37963 [15:37:37<158:30:16, 16.63s/it]
 10%|▉         | 3647/37963 [15:37:58<170:37:14, 17.90s/it]
 10%|▉         | 3648/37963 [15:38:13<160:18:53, 16.82s/it]
 10%|▉         | 3649/37963 [15:38:27<153:25:19, 16.10s/it]
 10%|▉         | 3650/37963 [15:38:41<148:24:51, 15.57s/it]
                                                           
{'loss': '0.1793', 'grad_norm': '4.235', 'learning_rate': '1.977e-05', 'epoch': '0.09615'}

 10%|▉         | 3650/37963 [15:38:41<148:24:51, 15.57s/it]
 10%|▉         | 3651/37963 [15:38:56<144:57:37, 15.21s/it]
 10%|▉         | 3652/37963 [15:39:16<161:01:10, 16.89s/it]
 10%|▉         | 3653/37963 [15:39:30<152:29:25, 16.00s/it]
 10%|▉         | 3654/37963 [15:39:51<166:27:43, 17.47s/it]
 10%|▉         | 3655/37963 [15:40:06<157:23:32, 16.52s/it]
 10%|▉         | 3656/37963 [15:40:26<169:55:36, 17.83s/it]
 10%|▉         | 3657/37963 [15:40:41<159:23:25, 16.73s/it]
 10%|▉         | 3658/37963 [15:40:55<152:38:11, 16.02s/it]
 10%|▉         | 3659/37963 [15:41:09<147:20:45, 15.46s/it]
 10%|▉         | 3660/37963 [15:41:30<162:21:51, 17.04s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '2.405', 'learning_rate': '1.977e-05', 'epoch': '0.09641'}

 10%|▉         | 3660/37963 [15:41:30<162:21:51, 17.04s/it]
 10%|▉         | 3661/37963 [15:41:44<154:23:59, 16.20s/it]
 10%|▉         | 3662/37963 [15:41:58<149:09:38, 15.65s/it]
 10%|▉         | 3663/37963 [15:42:12<144:18:57, 15.15s/it]
 10%|▉         | 3664/37963 [15:42:27<141:59:16, 14.90s/it]
 10%|▉         | 3665/37963 [15:42:41<140:23:50, 14.74s/it]
 10%|▉         | 3666/37963 [15:42:55<139:18:47, 14.62s/it]
 10%|▉         | 3667/37963 [15:43:10<138:26:49, 14.53s/it]
 10%|▉         | 3668/37963 [15:43:24<137:49:54, 14.47s/it]
 10%|▉         | 3669/37963 [15:43:39<137:37:24, 14.45s/it]
 10%|▉         | 3670/37963 [15:43:53<137:02:27, 14.39s/it]
                                                           
{'loss': '0.1825', 'grad_norm': '9.041', 'learning_rate': '1.977e-05', 'epoch': '0.09667'}

 10%|▉         | 3670/37963 [15:43:53<137:02:27, 14.39s/it]
 10%|▉         | 3671/37963 [15:44:07<136:29:44, 14.33s/it]
 10%|▉         | 3672/37963 [15:44:22<137:03:15, 14.39s/it]
 10%|▉         | 3673/37963 [15:44:36<136:53:43, 14.37s/it]
 10%|▉         | 3674/37963 [15:44:50<136:51:38, 14.37s/it]
 10%|▉         | 3675/37963 [15:45:05<136:47:55, 14.36s/it]
 10%|▉         | 3676/37963 [15:45:19<135:52:11, 14.27s/it]
 10%|▉         | 3677/37963 [15:45:33<135:39:25, 14.24s/it]
 10%|▉         | 3678/37963 [15:45:47<136:10:53, 14.30s/it]
 10%|▉         | 3679/37963 [15:46:02<136:28:35, 14.33s/it]
 10%|▉         | 3680/37963 [15:46:16<136:41:18, 14.35s/it]
                                                           
{'loss': '0.1809', 'grad_norm': '5.899', 'learning_rate': '1.977e-05', 'epoch': '0.09694'}

 10%|▉         | 3680/37963 [15:46:16<136:41:18, 14.35s/it]
 10%|▉         | 3681/37963 [15:46:30<136:57:55, 14.38s/it]
 10%|▉         | 3682/37963 [15:46:45<137:11:30, 14.41s/it]
 10%|▉         | 3683/37963 [15:46:59<136:01:45, 14.29s/it]
 10%|▉         | 3684/37963 [15:47:20<154:10:57, 16.19s/it]
 10%|▉         | 3685/37963 [15:47:34<148:54:21, 15.64s/it]
 10%|▉         | 3686/37963 [15:47:48<145:27:09, 15.28s/it]
 10%|▉         | 3687/37963 [15:48:03<142:49:54, 15.00s/it]
 10%|▉         | 3688/37963 [15:48:17<141:50:58, 14.90s/it]
 10%|▉         | 3689/37963 [15:48:32<140:22:39, 14.74s/it]
 10%|▉         | 3690/37963 [15:48:46<139:18:37, 14.63s/it]
                                                           
{'loss': '0.1807', 'grad_norm': '4.746', 'learning_rate': '1.976e-05', 'epoch': '0.0972'}

 10%|▉         | 3690/37963 [15:48:46<139:18:37, 14.63s/it]
 10%|▉         | 3691/37963 [15:49:01<138:40:04, 14.57s/it]
 10%|▉         | 3692/37963 [15:49:15<137:23:57, 14.43s/it]
 10%|▉         | 3693/37963 [15:49:35<155:15:01, 16.31s/it]
 10%|▉         | 3694/37963 [15:49:56<168:32:06, 17.70s/it]
 10%|▉         | 3695/37963 [15:50:11<158:56:24, 16.70s/it]
 10%|▉         | 3696/37963 [15:50:25<152:13:16, 15.99s/it]
 10%|▉         | 3697/37963 [15:50:47<168:09:23, 17.67s/it]
 10%|▉         | 3698/37963 [15:51:01<158:03:10, 16.61s/it]
 10%|▉         | 3699/37963 [15:51:15<152:14:58, 16.00s/it]
 10%|▉         | 3700/37963 [15:51:29<146:33:04, 15.40s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '3.637', 'learning_rate': '1.976e-05', 'epoch': '0.09746'}

 10%|▉         | 3700/37963 [15:51:29<146:33:04, 15.40s/it]
 10%|▉         | 3701/37963 [15:51:57<182:28:32, 19.17s/it]
 10%|▉         | 3702/37963 [15:52:11<167:16:01, 17.58s/it]
 10%|▉         | 3703/37963 [15:52:25<156:51:32, 16.48s/it]
 10%|▉         | 3704/37963 [15:52:39<150:43:07, 15.84s/it]
 10%|▉         | 3705/37963 [15:53:00<163:41:55, 17.20s/it]
 10%|▉         | 3706/37963 [15:53:14<155:29:33, 16.34s/it]
 10%|▉         | 3707/37963 [15:53:28<149:37:41, 15.72s/it]
 10%|▉         | 3708/37963 [15:53:43<146:06:52, 15.36s/it]
 10%|▉         | 3709/37963 [15:54:03<160:22:25, 16.85s/it]
 10%|▉         | 3710/37963 [15:54:18<153:23:10, 16.12s/it]
                                                           
{'loss': '0.1805', 'grad_norm': '2.275', 'learning_rate': '1.976e-05', 'epoch': '0.09773'}

 10%|▉         | 3710/37963 [15:54:18<153:23:10, 16.12s/it]
 10%|▉         | 3711/37963 [15:54:32<148:13:52, 15.58s/it]
 10%|▉         | 3712/37963 [15:54:46<144:40:20, 15.21s/it]
 10%|▉         | 3713/37963 [15:55:01<142:09:59, 14.94s/it]
 10%|▉         | 3714/37963 [15:55:15<140:52:20, 14.81s/it]
 10%|▉         | 3715/37963 [15:55:29<139:24:50, 14.65s/it]
 10%|▉         | 3716/37963 [15:55:44<137:57:32, 14.50s/it]
 10%|▉         | 3717/37963 [15:55:58<136:40:01, 14.37s/it]
 10%|▉         | 3718/37963 [15:56:12<135:44:44, 14.27s/it]
 10%|▉         | 3719/37963 [15:56:26<135:54:33, 14.29s/it]
 10%|▉         | 3720/37963 [15:56:40<136:10:34, 14.32s/it]
                                                           
{'loss': '0.1657', 'grad_norm': '1.393', 'learning_rate': '1.976e-05', 'epoch': '0.09799'}

 10%|▉         | 3720/37963 [15:56:40<136:10:34, 14.32s/it]
 10%|▉         | 3721/37963 [15:56:55<136:38:11, 14.37s/it]
 10%|▉         | 3722/37963 [15:57:09<136:26:34, 14.35s/it]
 10%|▉         | 3723/37963 [15:57:23<135:49:46, 14.28s/it]
 10%|▉         | 3724/37963 [15:57:38<136:05:56, 14.31s/it]
 10%|▉         | 3725/37963 [15:57:52<136:22:42, 14.34s/it]
 10%|▉         | 3726/37963 [15:58:07<136:40:50, 14.37s/it]
 10%|▉         | 3727/37963 [15:58:20<134:50:32, 14.18s/it]
 10%|▉         | 3728/37963 [15:58:35<135:28:45, 14.25s/it]
 10%|▉         | 3729/37963 [15:58:49<135:41:58, 14.27s/it]
 10%|▉         | 3730/37963 [15:59:03<135:06:21, 14.21s/it]
                                                           
{'loss': '0.1587', 'grad_norm': '2.614', 'learning_rate': '1.976e-05', 'epoch': '0.09825'}

 10%|▉         | 3730/37963 [15:59:03<135:06:21, 14.21s/it]
 10%|▉         | 3731/37963 [15:59:24<153:32:30, 16.15s/it]
 10%|▉         | 3732/37963 [15:59:38<148:32:41, 15.62s/it]
 10%|▉         | 3733/37963 [15:59:52<144:48:44, 15.23s/it]
 10%|▉         | 3734/37963 [16:00:07<141:39:59, 14.90s/it]
 10%|▉         | 3735/37963 [16:00:21<140:32:23, 14.78s/it]
 10%|▉         | 3736/37963 [16:00:35<139:09:29, 14.64s/it]
 10%|▉         | 3737/37963 [16:00:50<138:18:45, 14.55s/it]
 10%|▉         | 3738/37963 [16:01:04<137:51:47, 14.50s/it]
 10%|▉         | 3739/37963 [16:01:18<136:25:24, 14.35s/it]
 10%|▉         | 3740/37963 [16:01:32<136:23:28, 14.35s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '1.722', 'learning_rate': '1.975e-05', 'epoch': '0.09852'}

 10%|▉         | 3740/37963 [16:01:32<136:23:28, 14.35s/it]
 10%|▉         | 3741/37963 [16:01:47<136:48:07, 14.39s/it]
 10%|▉         | 3742/37963 [16:02:07<153:44:16, 16.17s/it]
 10%|▉         | 3743/37963 [16:02:22<148:29:36, 15.62s/it]
 10%|▉         | 3744/37963 [16:02:36<144:59:21, 15.25s/it]
 10%|▉         | 3745/37963 [16:02:57<160:16:52, 16.86s/it]
 10%|▉         | 3746/37963 [16:03:17<169:29:10, 17.83s/it]
 10%|▉         | 3747/37963 [16:03:31<159:25:52, 16.77s/it]
 10%|▉         | 3748/37963 [16:03:45<151:33:45, 15.95s/it]
 10%|▉         | 3749/37963 [16:04:06<166:12:28, 17.49s/it]
 10%|▉         | 3750/37963 [16:04:27<174:59:12, 18.41s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '2.938', 'learning_rate': '1.975e-05', 'epoch': '0.09878'}

 10%|▉         | 3750/37963 [16:04:27<174:59:12, 18.41s/it]
 10%|▉         | 3751/37963 [16:04:41<163:24:53, 17.20s/it]
 10%|▉         | 3752/37963 [16:04:55<154:23:10, 16.25s/it]
 10%|▉         | 3753/37963 [16:05:09<148:50:05, 15.66s/it]
 10%|▉         | 3754/37963 [16:05:23<144:05:08, 15.16s/it]
 10%|▉         | 3755/37963 [16:05:44<160:38:11, 16.91s/it]
 10%|▉         | 3756/37963 [16:05:59<153:29:05, 16.15s/it]
 10%|▉         | 3757/37963 [16:06:13<148:27:05, 15.62s/it]
 10%|▉         | 3758/37963 [16:06:34<162:44:24, 17.13s/it]
 10%|▉         | 3759/37963 [16:06:48<154:20:30, 16.24s/it]
 10%|▉         | 3760/37963 [16:07:02<148:55:01, 15.67s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '1.289', 'learning_rate': '1.975e-05', 'epoch': '0.09904'}

 10%|▉         | 3760/37963 [16:07:02<148:55:01, 15.67s/it]
 10%|▉         | 3761/37963 [16:07:17<144:57:56, 15.26s/it]
 10%|▉         | 3762/37963 [16:07:31<142:33:42, 15.01s/it]
 10%|▉         | 3763/37963 [16:07:45<141:07:26, 14.86s/it]
 10%|▉         | 3764/37963 [16:07:59<138:13:17, 14.55s/it]
 10%|▉         | 3765/37963 [16:08:13<136:10:08, 14.33s/it]
 10%|▉         | 3766/37963 [16:08:27<135:30:52, 14.27s/it]
 10%|▉         | 3767/37963 [16:08:41<134:52:16, 14.20s/it]
 10%|▉         | 3768/37963 [16:08:56<135:05:02, 14.22s/it]
 10%|▉         | 3769/37963 [16:09:10<135:28:32, 14.26s/it]
 10%|▉         | 3770/37963 [16:09:24<135:06:31, 14.22s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '2.536', 'learning_rate': '1.975e-05', 'epoch': '0.09931'}

 10%|▉         | 3770/37963 [16:09:24<135:06:31, 14.22s/it]
 10%|▉         | 3771/37963 [16:09:38<134:08:52, 14.12s/it]
 10%|▉         | 3772/37963 [16:09:52<134:54:58, 14.21s/it]
 10%|▉         | 3773/37963 [16:10:07<135:37:54, 14.28s/it]
 10%|▉         | 3774/37963 [16:10:21<136:03:50, 14.33s/it]
 10%|▉         | 3775/37963 [16:10:35<135:24:25, 14.26s/it]
 10%|▉         | 3776/37963 [16:10:50<136:03:38, 14.33s/it]
 10%|▉         | 3777/37963 [16:11:04<136:19:23, 14.36s/it]
 10%|▉         | 3778/37963 [16:11:19<136:24:51, 14.37s/it]
 10%|▉         | 3779/37963 [16:11:33<136:23:48, 14.36s/it]
 10%|▉         | 3780/37963 [16:11:54<154:44:53, 16.30s/it]
                                                           
{'loss': '0.1633', 'grad_norm': '3.032', 'learning_rate': '1.975e-05', 'epoch': '0.09957'}

 10%|▉         | 3780/37963 [16:11:54<154:44:53, 16.30s/it]
 10%|▉         | 3781/37963 [16:12:08<149:06:42, 15.70s/it]
 10%|▉         | 3782/37963 [16:12:23<145:30:34, 15.33s/it]
 10%|▉         | 3783/37963 [16:12:37<142:49:32, 15.04s/it]
 10%|▉         | 3784/37963 [16:12:51<141:02:03, 14.85s/it]
 10%|▉         | 3785/37963 [16:13:06<140:01:38, 14.75s/it]
 10%|▉         | 3786/37963 [16:13:20<139:01:03, 14.64s/it]
 10%|▉         | 3787/37963 [16:13:35<138:00:16, 14.54s/it]
 10%|▉         | 3788/37963 [16:13:49<136:25:23, 14.37s/it]
 10%|▉         | 3789/37963 [16:14:03<136:39:24, 14.40s/it]
 10%|▉         | 3790/37963 [16:14:17<136:29:56, 14.38s/it]
                                                           
{'loss': '0.1686', 'grad_norm': '3.344', 'learning_rate': '1.975e-05', 'epoch': '0.09983'}

 10%|▉         | 3790/37963 [16:14:17<136:29:56, 14.38s/it]
 10%|▉         | 3791/37963 [16:14:32<136:15:28, 14.35s/it]
 10%|▉         | 3792/37963 [16:14:52<154:24:45, 16.27s/it]
 10%|▉         | 3793/37963 [16:15:07<149:02:27, 15.70s/it]
 10%|▉         | 3794/37963 [16:15:28<163:54:32, 17.27s/it]
 10%|▉         | 3795/37963 [16:15:42<155:41:57, 16.40s/it]
 10%|▉         | 3796/37963 [16:16:03<168:03:49, 17.71s/it]
 10%|█         | 3797/37963 [16:16:23<176:22:04, 18.58s/it]
 10%|█         | 3798/37963 [16:16:38<163:34:20, 17.24s/it]
 10%|█         | 3799/37963 [16:16:52<155:43:16, 16.41s/it]
 10%|█         | 3800/37963 [16:17:06<150:11:50, 15.83s/it]
                                                           
{'loss': '0.1717', 'grad_norm': '3.316', 'learning_rate': '1.974e-05', 'epoch': '0.1001'}

 10%|█         | 3800/37963 [16:17:06<150:11:50, 15.83s/it]
 10%|█         | 3801/37963 [16:17:20<144:57:07, 15.28s/it]
 10%|█         | 3802/37963 [16:17:41<160:22:46, 16.90s/it]
 10%|█         | 3803/37963 [16:17:56<153:09:48, 16.14s/it]
 10%|█         | 3804/37963 [16:18:17<167:14:45, 17.63s/it]
 10%|█         | 3805/37963 [16:18:31<156:55:41, 16.54s/it]
 10%|█         | 3806/37963 [16:18:45<150:38:46, 15.88s/it]
 10%|█         | 3807/37963 [16:19:06<164:53:26, 17.38s/it]
 10%|█         | 3808/37963 [16:19:20<156:27:26, 16.49s/it]
 10%|█         | 3809/37963 [16:19:35<150:16:19, 15.84s/it]
 10%|█         | 3810/37963 [16:19:49<145:49:28, 15.37s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '2.653', 'learning_rate': '1.974e-05', 'epoch': '0.1004'}

 10%|█         | 3810/37963 [16:19:49<145:49:28, 15.37s/it]
 10%|█         | 3811/37963 [16:20:03<141:19:08, 14.90s/it]
 10%|█         | 3812/37963 [16:20:17<139:54:26, 14.75s/it]
 10%|█         | 3813/37963 [16:20:31<137:38:48, 14.51s/it]
 10%|█         | 3814/37963 [16:20:45<137:13:14, 14.47s/it]
 10%|█         | 3815/37963 [16:21:00<136:50:29, 14.43s/it]
 10%|█         | 3816/37963 [16:21:13<135:00:59, 14.23s/it]
 10%|█         | 3817/37963 [16:21:27<132:47:30, 14.00s/it]
 10%|█         | 3818/37963 [16:21:41<133:44:16, 14.10s/it]
 10%|█         | 3819/37963 [16:21:55<132:23:37, 13.96s/it]
 10%|█         | 3820/37963 [16:22:09<133:32:50, 14.08s/it]
                                                           
{'loss': '0.1693', 'grad_norm': '4.877', 'learning_rate': '1.974e-05', 'epoch': '0.1006'}

 10%|█         | 3820/37963 [16:22:09<133:32:50, 14.08s/it]
 10%|█         | 3821/37963 [16:22:24<134:22:43, 14.17s/it]
 10%|█         | 3822/37963 [16:22:38<134:13:37, 14.15s/it]
 10%|█         | 3823/37963 [16:22:52<135:02:04, 14.24s/it]
 10%|█         | 3824/37963 [16:23:06<133:48:23, 14.11s/it]
 10%|█         | 3825/37963 [16:23:21<134:54:31, 14.23s/it]
 10%|█         | 3826/37963 [16:23:34<133:59:30, 14.13s/it]
 10%|█         | 3827/37963 [16:23:49<134:33:35, 14.19s/it]
 10%|█         | 3828/37963 [16:24:03<134:49:35, 14.22s/it]
 10%|█         | 3829/37963 [16:24:17<135:21:54, 14.28s/it]
 10%|█         | 3830/37963 [16:24:38<152:37:59, 16.10s/it]
                                                           
{'loss': '0.1724', 'grad_norm': '2.734', 'learning_rate': '1.974e-05', 'epoch': '0.1009'}

 10%|█         | 3830/37963 [16:24:38<152:37:59, 16.10s/it]
 10%|█         | 3831/37963 [16:24:51<145:49:13, 15.38s/it]
 10%|█         | 3832/37963 [16:25:06<142:47:24, 15.06s/it]
 10%|█         | 3833/37963 [16:25:20<140:07:48, 14.78s/it]
 10%|█         | 3834/37963 [16:25:34<139:12:04, 14.68s/it]
 10%|█         | 3835/37963 [16:25:49<138:31:55, 14.61s/it]
 10%|█         | 3836/37963 [16:26:03<136:20:31, 14.38s/it]
 10%|█         | 3837/37963 [16:26:17<136:35:00, 14.41s/it]
 10%|█         | 3838/37963 [16:26:32<136:38:25, 14.41s/it]
 10%|█         | 3839/37963 [16:26:46<137:01:51, 14.46s/it]
 10%|█         | 3840/37963 [16:27:00<136:45:09, 14.43s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '3.273', 'learning_rate': '1.974e-05', 'epoch': '0.1012'}

 10%|█         | 3840/37963 [16:27:00<136:45:09, 14.43s/it]
 10%|█         | 3841/37963 [16:27:21<153:40:31, 16.21s/it]
 10%|█         | 3842/37963 [16:27:35<148:32:51, 15.67s/it]
 10%|█         | 3843/37963 [16:28:03<181:44:59, 19.18s/it]
 10%|█         | 3844/37963 [16:28:17<168:08:51, 17.74s/it]
 10%|█         | 3845/37963 [16:28:31<158:26:44, 16.72s/it]
 10%|█         | 3846/37963 [16:28:46<151:55:54, 16.03s/it]
 10%|█         | 3847/37963 [16:29:07<166:14:26, 17.54s/it]
 10%|█         | 3848/37963 [16:29:21<157:33:31, 16.63s/it]
 10%|█         | 3849/37963 [16:29:36<150:33:10, 15.89s/it]
 10%|█         | 3850/37963 [16:29:50<145:36:56, 15.37s/it]
                                                           
{'loss': '0.1661', 'grad_norm': '1.569', 'learning_rate': '1.973e-05', 'epoch': '0.1014'}

 10%|█         | 3850/37963 [16:29:50<145:36:56, 15.37s/it]
 10%|█         | 3851/37963 [16:30:10<160:52:33, 16.98s/it]
 10%|█         | 3852/37963 [16:30:32<172:41:08, 18.22s/it]
 10%|█         | 3853/37963 [16:30:46<162:03:25, 17.10s/it]
 10%|█         | 3854/37963 [16:31:00<154:22:52, 16.29s/it]
 10%|█         | 3855/37963 [16:31:15<148:59:58, 15.73s/it]
 10%|█         | 3856/37963 [16:31:29<145:09:15, 15.32s/it]
 10%|█         | 3857/37963 [16:31:44<142:27:49, 15.04s/it]
 10%|█         | 3858/37963 [16:32:04<158:17:21, 16.71s/it]
 10%|█         | 3859/37963 [16:32:18<151:18:51, 15.97s/it]
 10%|█         | 3860/37963 [16:32:33<146:39:30, 15.48s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '1.671', 'learning_rate': '1.973e-05', 'epoch': '0.1017'}

 10%|█         | 3860/37963 [16:32:33<146:39:30, 15.48s/it]
 10%|█         | 3861/37963 [16:32:47<143:32:22, 15.15s/it]
 10%|█         | 3862/37963 [16:33:01<140:43:48, 14.86s/it]
 10%|█         | 3863/37963 [16:33:16<139:20:40, 14.71s/it]
 10%|█         | 3864/37963 [16:33:30<137:19:07, 14.50s/it]
 10%|█         | 3865/37963 [16:33:44<137:04:31, 14.47s/it]
 10%|█         | 3866/37963 [16:33:58<135:47:42, 14.34s/it]
 10%|█         | 3867/37963 [16:34:12<135:36:09, 14.32s/it]
 10%|█         | 3868/37963 [16:34:27<135:27:03, 14.30s/it]
 10%|█         | 3869/37963 [16:34:41<135:00:42, 14.26s/it]
 10%|█         | 3870/37963 [16:34:55<135:13:28, 14.28s/it]
                                                           
{'loss': '0.1769', 'grad_norm': '1.977', 'learning_rate': '1.973e-05', 'epoch': '0.1019'}

 10%|█         | 3870/37963 [16:34:55<135:13:28, 14.28s/it]
 10%|█         | 3871/37963 [16:35:10<135:33:28, 14.31s/it]
 10%|█         | 3872/37963 [16:35:24<134:44:45, 14.23s/it]
 10%|█         | 3873/37963 [16:35:38<135:06:56, 14.27s/it]
 10%|█         | 3874/37963 [16:35:52<135:01:51, 14.26s/it]
 10%|█         | 3875/37963 [16:36:07<135:19:40, 14.29s/it]
 10%|█         | 3876/37963 [16:36:21<135:28:12, 14.31s/it]
 10%|█         | 3877/37963 [16:36:41<152:57:35, 16.15s/it]
 10%|█         | 3878/37963 [16:36:56<147:46:35, 15.61s/it]
 10%|█         | 3879/37963 [16:37:10<144:23:17, 15.25s/it]
 10%|█         | 3880/37963 [16:37:24<141:30:32, 14.95s/it]
                                                           
{'loss': '0.1767', 'grad_norm': '3.145', 'learning_rate': '1.973e-05', 'epoch': '0.1022'}

 10%|█         | 3880/37963 [16:37:24<141:30:32, 14.95s/it]
 10%|█         | 3881/37963 [16:37:39<139:47:27, 14.77s/it]
 10%|█         | 3882/37963 [16:37:53<138:57:14, 14.68s/it]
 10%|█         | 3883/37963 [16:38:07<137:04:07, 14.48s/it]
 10%|█         | 3884/37963 [16:38:21<136:03:25, 14.37s/it]
 10%|█         | 3885/37963 [16:38:36<135:57:43, 14.36s/it]
 10%|█         | 3886/37963 [16:38:50<135:27:35, 14.31s/it]
 10%|█         | 3887/37963 [16:39:04<135:44:40, 14.34s/it]
 10%|█         | 3888/37963 [16:39:25<153:11:49, 16.19s/it]
 10%|█         | 3889/37963 [16:39:39<148:02:58, 15.64s/it]
 10%|█         | 3890/37963 [16:39:54<144:36:19, 15.28s/it]
                                                           
{'loss': '0.1735', 'grad_norm': '1.261', 'learning_rate': '1.973e-05', 'epoch': '0.1025'}

 10%|█         | 3890/37963 [16:39:54<144:36:19, 15.28s/it]
 10%|█         | 3891/37963 [16:40:14<160:21:35, 16.94s/it]
 10%|█         | 3892/37963 [16:40:36<172:40:34, 18.25s/it]
 10%|█         | 3893/37963 [16:40:50<161:48:09, 17.10s/it]
 10%|█         | 3894/37963 [16:41:04<154:02:17, 16.28s/it]
 10%|█         | 3895/37963 [16:41:26<168:25:14, 17.80s/it]
 10%|█         | 3896/37963 [16:41:40<158:20:52, 16.73s/it]
 10%|█         | 3897/37963 [16:41:54<151:29:19, 16.01s/it]
 10%|█         | 3898/37963 [16:42:09<146:40:36, 15.50s/it]
 10%|█         | 3899/37963 [16:42:23<143:18:02, 15.14s/it]
 10%|█         | 3900/37963 [16:42:37<140:57:34, 14.90s/it]
                                                           
{'loss': '0.1663', 'grad_norm': '4.237', 'learning_rate': '1.972e-05', 'epoch': '0.1027'}

 10%|█         | 3900/37963 [16:42:37<140:57:34, 14.90s/it]
 10%|█         | 3901/37963 [16:42:52<139:47:53, 14.78s/it]
 10%|█         | 3902/37963 [16:43:12<156:25:38, 16.53s/it]
 10%|█         | 3903/37963 [16:43:33<167:39:40, 17.72s/it]
 10%|█         | 3904/37963 [16:43:54<176:29:52, 18.66s/it]
 10%|█         | 3905/37963 [16:44:08<164:42:53, 17.41s/it]
 10%|█         | 3906/37963 [16:44:23<155:59:57, 16.49s/it]
 10%|█         | 3907/37963 [16:44:37<150:00:32, 15.86s/it]
 10%|█         | 3908/37963 [16:44:51<145:34:02, 15.39s/it]
 10%|█         | 3909/37963 [16:45:06<142:46:34, 15.09s/it]
 10%|█         | 3910/37963 [16:45:20<140:35:03, 14.86s/it]
                                                           
{'loss': '0.1725', 'grad_norm': '2.24', 'learning_rate': '1.972e-05', 'epoch': '0.103'}

 10%|█         | 3910/37963 [16:45:20<140:35:03, 14.86s/it]
 10%|█         | 3911/37963 [16:45:34<139:01:46, 14.70s/it]
 10%|█         | 3912/37963 [16:45:48<137:21:02, 14.52s/it]
 10%|█         | 3913/37963 [16:46:03<136:24:27, 14.42s/it]
 10%|█         | 3914/37963 [16:46:17<136:25:59, 14.43s/it]
 10%|█         | 3915/37963 [16:46:31<136:10:46, 14.40s/it]
 10%|█         | 3916/37963 [16:46:46<136:24:01, 14.42s/it]
 10%|█         | 3917/37963 [16:47:00<134:52:05, 14.26s/it]
 10%|█         | 3918/37963 [16:47:14<135:15:58, 14.30s/it]
 10%|█         | 3919/37963 [16:47:28<135:18:46, 14.31s/it]
 10%|█         | 3920/37963 [16:47:43<135:44:51, 14.36s/it]
                                                           
{'loss': '0.1725', 'grad_norm': '3.951', 'learning_rate': '1.972e-05', 'epoch': '0.1033'}

 10%|█         | 3920/37963 [16:47:43<135:44:51, 14.36s/it]
 10%|█         | 3921/37963 [16:47:57<135:57:00, 14.38s/it]
 10%|█         | 3922/37963 [16:48:11<133:41:56, 14.14s/it]
 10%|█         | 3923/37963 [16:48:25<134:14:41, 14.20s/it]
 10%|█         | 3924/37963 [16:48:39<134:14:20, 14.20s/it]
 10%|█         | 3925/37963 [16:49:00<151:50:07, 16.06s/it]
 10%|█         | 3926/37963 [16:49:14<145:59:00, 15.44s/it]
 10%|█         | 3927/37963 [16:49:28<142:48:35, 15.11s/it]
 10%|█         | 3928/37963 [16:49:42<140:13:48, 14.83s/it]
 10%|█         | 3929/37963 [16:49:56<137:18:11, 14.52s/it]
 10%|█         | 3930/37963 [16:50:11<136:46:19, 14.47s/it]
                                                           
{'loss': '0.1663', 'grad_norm': '2.049', 'learning_rate': '1.972e-05', 'epoch': '0.1035'}

 10%|█         | 3930/37963 [16:50:11<136:46:19, 14.47s/it]
 10%|█         | 3931/37963 [16:50:24<134:44:34, 14.25s/it]
 10%|█         | 3932/37963 [16:50:39<135:21:01, 14.32s/it]
 10%|█         | 3933/37963 [16:50:53<135:22:52, 14.32s/it]
 10%|█         | 3934/37963 [16:51:07<135:25:03, 14.33s/it]
 10%|█         | 3935/37963 [16:51:22<135:20:22, 14.32s/it]
 10%|█         | 3936/37963 [16:51:43<153:56:43, 16.29s/it]
 10%|█         | 3937/37963 [16:51:57<148:27:54, 15.71s/it]
 10%|█         | 3938/37963 [16:52:17<159:57:28, 16.92s/it]
 10%|█         | 3939/37963 [16:52:31<151:17:03, 16.01s/it]
 10%|█         | 3940/37963 [16:52:51<164:23:25, 17.39s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '2.684', 'learning_rate': '1.972e-05', 'epoch': '0.1038'}

 10%|█         | 3940/37963 [16:52:51<164:23:25, 17.39s/it]
 10%|█         | 3941/37963 [16:53:06<155:47:40, 16.49s/it]
 10%|█         | 3942/37963 [16:53:20<149:17:56, 15.80s/it]
 10%|█         | 3943/37963 [16:53:34<145:19:27, 15.38s/it]
 10%|█         | 3944/37963 [16:53:56<162:24:44, 17.19s/it]
 10%|█         | 3945/37963 [16:54:10<153:29:26, 16.24s/it]
 10%|█         | 3946/37963 [16:54:24<148:11:01, 15.68s/it]
 10%|█         | 3947/37963 [16:54:38<144:26:18, 15.29s/it]
 10%|█         | 3948/37963 [16:54:53<141:42:49, 15.00s/it]
 10%|█         | 3949/37963 [16:55:06<138:15:11, 14.63s/it]
 10%|█         | 3950/37963 [16:55:27<155:10:03, 16.42s/it]
                                                           
{'loss': '0.1976', 'grad_norm': '1.524', 'learning_rate': '1.971e-05', 'epoch': '0.104'}

 10%|█         | 3950/37963 [16:55:27<155:10:03, 16.42s/it]
 10%|█         | 3951/37963 [16:55:48<168:45:21, 17.86s/it]
 10%|█         | 3952/37963 [16:56:09<176:46:46, 18.71s/it]
 10%|█         | 3953/37963 [16:56:23<163:49:36, 17.34s/it]
 10%|█         | 3954/37963 [16:56:37<155:23:33, 16.45s/it]
 10%|█         | 3955/37963 [16:56:52<149:09:45, 15.79s/it]
 10%|█         | 3956/37963 [16:57:06<145:25:01, 15.39s/it]
 10%|█         | 3957/37963 [16:57:21<142:43:56, 15.11s/it]
 10%|█         | 3958/37963 [16:57:35<140:22:10, 14.86s/it]
 10%|█         | 3959/37963 [16:57:49<138:58:51, 14.71s/it]
 10%|█         | 3960/37963 [16:58:03<135:50:24, 14.38s/it]
                                                           
{'loss': '0.183', 'grad_norm': '3.456', 'learning_rate': '1.971e-05', 'epoch': '0.1043'}

 10%|█         | 3960/37963 [16:58:03<135:50:24, 14.38s/it]
 10%|█         | 3961/37963 [16:58:17<135:39:57, 14.36s/it]
 10%|█         | 3962/37963 [16:58:32<135:37:58, 14.36s/it]
 10%|█         | 3963/37963 [16:58:46<134:38:44, 14.26s/it]
 10%|█         | 3964/37963 [16:59:00<134:52:47, 14.28s/it]
 10%|█         | 3965/37963 [16:59:14<135:03:20, 14.30s/it]
 10%|█         | 3966/37963 [16:59:29<135:30:11, 14.35s/it]
 10%|█         | 3967/37963 [16:59:43<135:45:38, 14.38s/it]
 10%|█         | 3968/37963 [16:59:58<135:46:39, 14.38s/it]
 10%|█         | 3969/37963 [17:00:12<135:46:26, 14.38s/it]
 10%|█         | 3970/37963 [17:00:26<135:40:21, 14.37s/it]
                                                           
{'loss': '0.1832', 'grad_norm': '5.001', 'learning_rate': '1.971e-05', 'epoch': '0.1046'}

 10%|█         | 3970/37963 [17:00:26<135:40:21, 14.37s/it]
 10%|█         | 3971/37963 [17:00:41<135:35:58, 14.36s/it]
 10%|█         | 3972/37963 [17:00:55<135:43:18, 14.37s/it]
 10%|█         | 3973/37963 [17:01:09<135:30:52, 14.35s/it]
 10%|█         | 3974/37963 [17:01:30<152:55:24, 16.20s/it]
 10%|█         | 3975/37963 [17:01:44<146:23:20, 15.51s/it]
 10%|█         | 3976/37963 [17:01:58<142:57:45, 15.14s/it]
 10%|█         | 3977/37963 [17:02:12<140:06:53, 14.84s/it]
 10%|█         | 3978/37963 [17:02:27<138:52:41, 14.71s/it]
 10%|█         | 3979/37963 [17:02:41<137:37:53, 14.58s/it]
 10%|█         | 3980/37963 [17:02:55<135:34:09, 14.36s/it]
                                                           
{'loss': '0.1747', 'grad_norm': '2.219', 'learning_rate': '1.971e-05', 'epoch': '0.1048'}

 10%|█         | 3980/37963 [17:02:55<135:34:09, 14.36s/it]
 10%|█         | 3981/37963 [17:03:09<135:29:14, 14.35s/it]
 10%|█         | 3982/37963 [17:03:23<135:27:04, 14.35s/it]
 10%|█         | 3983/37963 [17:03:38<135:34:04, 14.36s/it]
 10%|█         | 3984/37963 [17:03:52<134:57:36, 14.30s/it]
 10%|█         | 3985/37963 [17:04:06<135:16:33, 14.33s/it]
 10%|█         | 3986/37963 [17:04:27<153:22:56, 16.25s/it]
 11%|█         | 3987/37963 [17:04:41<146:19:23, 15.50s/it]
 11%|█         | 3988/37963 [17:05:08<180:25:27, 19.12s/it]
 11%|█         | 3989/37963 [17:05:22<165:27:32, 17.53s/it]
 11%|█         | 3990/37963 [17:05:37<156:21:26, 16.57s/it]
                                                           
{'loss': '0.1736', 'grad_norm': '1.984', 'learning_rate': '1.971e-05', 'epoch': '0.1051'}

 11%|█         | 3990/37963 [17:05:37<156:21:26, 16.57s/it]
 11%|█         | 3991/37963 [17:05:51<149:26:02, 15.84s/it]
 11%|█         | 3992/37963 [17:06:13<166:39:16, 17.66s/it]
 11%|█         | 3993/37963 [17:06:27<156:58:53, 16.64s/it]
 11%|█         | 3994/37963 [17:06:41<150:43:28, 15.97s/it]
 11%|█         | 3995/37963 [17:06:55<144:38:43, 15.33s/it]
 11%|█         | 3996/37963 [17:07:09<141:26:50, 14.99s/it]
 11%|█         | 3997/37963 [17:07:24<139:47:22, 14.82s/it]
 11%|█         | 3998/37963 [17:07:44<156:27:36, 16.58s/it]
 11%|█         | 3999/37963 [17:08:05<168:02:15, 17.81s/it]
 11%|█         | 4000/37963 [17:08:20<158:46:42, 16.83s/it]
                                                           
{'loss': '0.159', 'grad_norm': '2.423', 'learning_rate': '1.97e-05', 'epoch': '0.1054'}

 11%|█         | 4000/37963 [17:08:20<158:46:42, 16.83s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:16<00:00, 16.11s/it]
Writing model shards: 100%|██████████| 1/1 [00:16<00:00, 16.11s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 11%|█         | 4001/37963 [17:10:03<403:23:42, 42.76s/it]
 11%|█         | 4002/37963 [17:10:17<323:05:57, 34.25s/it]
 11%|█         | 4003/37963 [17:10:38<285:34:41, 30.27s/it]
 11%|█         | 4004/37963 [17:10:53<240:28:21, 25.49s/it]
 11%|█         | 4005/37963 [17:11:07<209:05:12, 22.17s/it]
 11%|█         | 4006/37963 [17:11:21<187:05:42, 19.84s/it]
 11%|█         | 4007/37963 [17:11:36<171:31:41, 18.19s/it]
 11%|█         | 4008/37963 [17:11:50<160:33:00, 17.02s/it]
 11%|█         | 4009/37963 [17:12:04<152:54:31, 16.21s/it]
 11%|█         | 4010/37963 [17:12:19<147:36:54, 15.65s/it]
                                                           
{'loss': '0.1746', 'grad_norm': '2.64', 'learning_rate': '1.97e-05', 'epoch': '0.1056'}

 11%|█         | 4010/37963 [17:12:19<147:36:54, 15.65s/it]
 11%|█         | 4011/37963 [17:12:33<144:03:02, 15.27s/it]
 11%|█         | 4012/37963 [17:12:47<141:02:57, 14.96s/it]
 11%|█         | 4013/37963 [17:13:02<139:41:49, 14.81s/it]
 11%|█         | 4014/37963 [17:13:16<137:47:40, 14.61s/it]
 11%|█         | 4015/37963 [17:13:30<137:20:50, 14.56s/it]
 11%|█         | 4016/37963 [17:13:45<136:47:08, 14.51s/it]
 11%|█         | 4017/37963 [17:13:59<136:19:35, 14.46s/it]
 11%|█         | 4018/37963 [17:14:13<136:02:37, 14.43s/it]
 11%|█         | 4019/37963 [17:14:28<136:00:13, 14.42s/it]
 11%|█         | 4020/37963 [17:14:42<135:53:09, 14.41s/it]
                                                           
{'loss': '0.1621', 'grad_norm': '3.771', 'learning_rate': '1.97e-05', 'epoch': '0.1059'}

 11%|█         | 4020/37963 [17:14:42<135:53:09, 14.41s/it]
 11%|█         | 4021/37963 [17:15:02<152:03:12, 16.13s/it]
 11%|█         | 4022/37963 [17:15:17<147:08:34, 15.61s/it]
 11%|█         | 4023/37963 [17:15:31<143:37:32, 15.23s/it]
 11%|█         | 4024/37963 [17:15:46<141:08:01, 14.97s/it]
 11%|█         | 4025/37963 [17:16:00<139:45:17, 14.82s/it]
 11%|█         | 4026/37963 [17:16:14<137:28:01, 14.58s/it]
 11%|█         | 4027/37963 [17:16:28<136:43:51, 14.50s/it]
 11%|█         | 4028/37963 [17:16:43<136:15:09, 14.45s/it]
 11%|█         | 4029/37963 [17:16:57<134:41:15, 14.29s/it]
 11%|█         | 4030/37963 [17:17:11<133:54:21, 14.21s/it]
                                                           
{'loss': '0.1717', 'grad_norm': '2.801', 'learning_rate': '1.97e-05', 'epoch': '0.1062'}

 11%|█         | 4030/37963 [17:17:11<133:54:21, 14.21s/it]
 11%|█         | 4031/37963 [17:17:25<134:05:07, 14.23s/it]
 11%|█         | 4032/37963 [17:17:39<134:12:55, 14.24s/it]
 11%|█         | 4033/37963 [17:17:54<134:38:26, 14.29s/it]
 11%|█         | 4034/37963 [17:18:14<152:21:30, 16.17s/it]
 11%|█         | 4035/37963 [17:18:28<147:04:43, 15.61s/it]
 11%|█         | 4036/37963 [17:18:56<180:26:11, 19.15s/it]
 11%|█         | 4037/37963 [17:19:10<166:02:07, 17.62s/it]
 11%|█         | 4038/37963 [17:19:24<156:49:39, 16.64s/it]
 11%|█         | 4039/37963 [17:19:39<150:30:36, 15.97s/it]
 11%|█         | 4040/37963 [17:19:53<146:00:49, 15.50s/it]
                                                           
{'loss': '0.1797', 'grad_norm': '1.571', 'learning_rate': '1.97e-05', 'epoch': '0.1064'}

 11%|█         | 4040/37963 [17:19:53<146:00:49, 15.50s/it]
 11%|█         | 4041/37963 [17:20:14<162:22:06, 17.23s/it]
 11%|█         | 4042/37963 [17:20:29<154:13:52, 16.37s/it]
 11%|█         | 4043/37963 [17:20:50<167:59:59, 17.83s/it]
 11%|█         | 4044/37963 [17:21:04<158:11:12, 16.79s/it]
 11%|█         | 4045/37963 [17:21:18<149:50:33, 15.90s/it]
 11%|█         | 4046/37963 [17:21:32<145:11:40, 15.41s/it]
 11%|█         | 4047/37963 [17:21:53<159:40:29, 16.95s/it]
 11%|█         | 4048/37963 [17:22:14<170:20:26, 18.08s/it]
 11%|█         | 4049/37963 [17:22:28<159:42:39, 16.95s/it]
 11%|█         | 4050/37963 [17:22:42<152:50:37, 16.22s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '3.832', 'learning_rate': '1.969e-05', 'epoch': '0.1067'}

 11%|█         | 4050/37963 [17:22:42<152:50:37, 16.22s/it]
 11%|█         | 4051/37963 [17:22:57<147:32:29, 15.66s/it]
 11%|█         | 4052/37963 [17:23:11<143:42:27, 15.26s/it]
 11%|█         | 4053/37963 [17:23:25<140:58:27, 14.97s/it]
 11%|█         | 4054/37963 [17:23:40<139:34:45, 14.82s/it]
 11%|█         | 4055/37963 [17:23:54<136:37:38, 14.51s/it]
 11%|█         | 4056/37963 [17:24:08<136:08:47, 14.46s/it]
 11%|█         | 4057/37963 [17:24:22<135:46:55, 14.42s/it]
 11%|█         | 4058/37963 [17:24:36<134:59:46, 14.33s/it]
 11%|█         | 4059/37963 [17:24:51<135:32:03, 14.39s/it]
 11%|█         | 4060/37963 [17:25:05<135:20:57, 14.37s/it]
                                                           
{'loss': '0.1754', 'grad_norm': '3.342', 'learning_rate': '1.969e-05', 'epoch': '0.1069'}

 11%|█         | 4060/37963 [17:25:05<135:20:57, 14.37s/it]
 11%|█         | 4061/37963 [17:25:19<134:10:37, 14.25s/it]
 11%|█         | 4062/37963 [17:25:34<134:20:03, 14.27s/it]
 11%|█         | 4063/37963 [17:25:48<134:54:19, 14.33s/it]
 11%|█         | 4064/37963 [17:26:02<135:02:31, 14.34s/it]
 11%|█         | 4065/37963 [17:26:17<135:11:08, 14.36s/it]
 11%|█         | 4066/37963 [17:26:30<132:43:51, 14.10s/it]
 11%|█         | 4067/37963 [17:26:45<133:13:18, 14.15s/it]
 11%|█         | 4068/37963 [17:26:59<134:05:13, 14.24s/it]
 11%|█         | 4069/37963 [17:27:14<134:50:34, 14.32s/it]
 11%|█         | 4070/37963 [17:27:28<135:15:47, 14.37s/it]
                                                           
{'loss': '0.1722', 'grad_norm': '2.194', 'learning_rate': '1.969e-05', 'epoch': '0.1072'}

 11%|█         | 4070/37963 [17:27:28<135:15:47, 14.37s/it]
 11%|█         | 4071/37963 [17:27:42<134:05:47, 14.24s/it]
 11%|█         | 4072/37963 [17:27:56<134:28:13, 14.28s/it]
 11%|█         | 4073/37963 [17:28:17<152:52:41, 16.24s/it]
 11%|█         | 4074/37963 [17:28:31<147:03:31, 15.62s/it]
 11%|█         | 4075/37963 [17:28:46<144:05:03, 15.31s/it]
 11%|█         | 4076/37963 [17:29:00<141:12:19, 15.00s/it]
 11%|█         | 4077/37963 [17:29:14<138:59:44, 14.77s/it]
 11%|█         | 4078/37963 [17:29:29<137:51:11, 14.65s/it]
 11%|█         | 4079/37963 [17:29:43<137:04:29, 14.56s/it]
 11%|█         | 4080/37963 [17:29:57<136:06:19, 14.46s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '2.553', 'learning_rate': '1.969e-05', 'epoch': '0.1075'}

 11%|█         | 4080/37963 [17:29:57<136:06:19, 14.46s/it]
 11%|█         | 4081/37963 [17:30:11<134:24:05, 14.28s/it]
 11%|█         | 4082/37963 [17:30:25<134:00:11, 14.24s/it]
 11%|█         | 4083/37963 [17:30:40<134:15:11, 14.27s/it]
 11%|█         | 4084/37963 [17:30:54<134:12:56, 14.26s/it]
 11%|█         | 4085/37963 [17:31:15<152:44:08, 16.23s/it]
 11%|█         | 4086/37963 [17:31:35<165:14:21, 17.56s/it]
 11%|█         | 4087/37963 [17:31:57<175:50:54, 18.69s/it]
 11%|█         | 4088/37963 [17:32:11<163:09:20, 17.34s/it]
 11%|█         | 4089/37963 [17:32:32<174:20:47, 18.53s/it]
 11%|█         | 4090/37963 [17:32:47<162:27:35, 17.27s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '1.367', 'learning_rate': '1.968e-05', 'epoch': '0.1077'}

 11%|█         | 4090/37963 [17:32:47<162:27:35, 17.27s/it]
 11%|█         | 4091/37963 [17:33:01<154:30:57, 16.42s/it]
 11%|█         | 4092/37963 [17:33:22<168:31:05, 17.91s/it]
 11%|█         | 4093/37963 [17:33:36<157:28:16, 16.74s/it]
 11%|█         | 4094/37963 [17:33:51<150:44:08, 16.02s/it]
 11%|█         | 4095/37963 [17:34:05<145:55:11, 15.51s/it]
 11%|█         | 4096/37963 [17:34:32<178:14:12, 18.95s/it]
 11%|█         | 4097/37963 [17:34:46<165:23:19, 17.58s/it]
 11%|█         | 4098/37963 [17:35:01<156:02:35, 16.59s/it]
 11%|█         | 4099/37963 [17:35:15<149:13:11, 15.86s/it]
 11%|█         | 4100/37963 [17:35:29<144:49:24, 15.40s/it]
                                                           
{'loss': '0.1856', 'grad_norm': '3.154', 'learning_rate': '1.968e-05', 'epoch': '0.108'}

 11%|█         | 4100/37963 [17:35:29<144:49:24, 15.40s/it]
 11%|█         | 4101/37963 [17:35:44<142:01:58, 15.10s/it]
 11%|█         | 4102/37963 [17:35:58<139:00:37, 14.78s/it]
 11%|█         | 4103/37963 [17:36:12<137:46:45, 14.65s/it]
 11%|█         | 4104/37963 [17:36:26<136:46:59, 14.54s/it]
 11%|█         | 4105/37963 [17:36:40<134:50:42, 14.34s/it]
 11%|█         | 4106/37963 [17:36:55<135:04:49, 14.36s/it]
 11%|█         | 4107/37963 [17:37:09<135:12:27, 14.38s/it]
 11%|█         | 4108/37963 [17:37:23<135:14:48, 14.38s/it]
 11%|█         | 4109/37963 [17:37:38<135:12:37, 14.38s/it]
 11%|█         | 4110/37963 [17:37:52<135:22:58, 14.40s/it]
                                                           
{'loss': '0.1463', 'grad_norm': '1.711', 'learning_rate': '1.968e-05', 'epoch': '0.1083'}

 11%|█         | 4110/37963 [17:37:52<135:22:58, 14.40s/it]
 11%|█         | 4111/37963 [17:38:06<135:16:17, 14.39s/it]
 11%|█         | 4112/37963 [17:38:21<135:20:55, 14.39s/it]
 11%|█         | 4113/37963 [17:38:35<135:22:47, 14.40s/it]
 11%|█         | 4114/37963 [17:38:50<135:19:22, 14.39s/it]
 11%|█         | 4115/37963 [17:39:04<135:33:46, 14.42s/it]
 11%|█         | 4116/37963 [17:39:19<135:36:47, 14.42s/it]
 11%|█         | 4117/37963 [17:39:33<135:35:39, 14.42s/it]
 11%|█         | 4118/37963 [17:39:47<134:30:19, 14.31s/it]
 11%|█         | 4119/37963 [17:40:02<135:01:00, 14.36s/it]
 11%|█         | 4120/37963 [17:40:16<135:05:39, 14.37s/it]
                                                           
{'loss': '0.1705', 'grad_norm': '1.136', 'learning_rate': '1.968e-05', 'epoch': '0.1085'}

 11%|█         | 4120/37963 [17:40:16<135:05:39, 14.37s/it]
 11%|█         | 4121/37963 [17:40:30<134:05:13, 14.26s/it]
 11%|█         | 4122/37963 [17:40:51<154:18:13, 16.41s/it]
 11%|█         | 4123/37963 [17:41:06<148:26:12, 15.79s/it]
 11%|█         | 4124/37963 [17:41:20<144:30:00, 15.37s/it]
 11%|█         | 4125/37963 [17:41:34<141:32:23, 15.06s/it]
 11%|█         | 4126/37963 [17:41:48<138:31:21, 14.74s/it]
 11%|█         | 4127/37963 [17:42:02<136:18:12, 14.50s/it]
 11%|█         | 4128/37963 [17:42:17<135:46:54, 14.45s/it]
 11%|█         | 4129/37963 [17:42:31<135:35:52, 14.43s/it]
 11%|█         | 4130/37963 [17:42:46<135:33:16, 14.42s/it]
                                                           
{'loss': '0.1634', 'grad_norm': '4.935', 'learning_rate': '1.968e-05', 'epoch': '0.1088'}

 11%|█         | 4130/37963 [17:42:46<135:33:16, 14.42s/it]
 11%|█         | 4131/37963 [17:43:00<135:34:05, 14.43s/it]
 11%|█         | 4132/37963 [17:43:21<152:54:57, 16.27s/it]
 11%|█         | 4133/37963 [17:43:42<167:07:07, 17.78s/it]
 11%|█         | 4134/37963 [17:44:03<177:04:48, 18.84s/it]
 11%|█         | 4135/37963 [17:44:17<164:22:35, 17.49s/it]
 11%|█         | 4136/37963 [17:44:32<155:38:27, 16.56s/it]
 11%|█         | 4137/37963 [17:44:46<149:18:33, 15.89s/it]
 11%|█         | 4138/37963 [17:45:08<164:42:22, 17.53s/it]
 11%|█         | 4139/37963 [17:45:21<153:44:37, 16.36s/it]
 11%|█         | 4140/37963 [17:45:42<167:34:24, 17.84s/it]
                                                           
{'loss': '0.1741', 'grad_norm': '6.265', 'learning_rate': '1.967e-05', 'epoch': '0.1091'}

 11%|█         | 4140/37963 [17:45:42<167:34:24, 17.84s/it]
 11%|█         | 4141/37963 [17:45:57<157:40:12, 16.78s/it]
 11%|█         | 4142/37963 [17:46:11<150:37:33, 16.03s/it]
 11%|█         | 4143/37963 [17:46:32<164:41:40, 17.53s/it]
 11%|█         | 4144/37963 [17:46:53<174:21:52, 18.56s/it]
 11%|█         | 4145/37963 [17:47:07<162:14:23, 17.27s/it]
 11%|█         | 4146/37963 [17:47:22<154:11:36, 16.41s/it]
 11%|█         | 4147/37963 [17:47:36<147:58:23, 15.75s/it]
 11%|█         | 4148/37963 [17:47:50<143:54:35, 15.32s/it]
 11%|█         | 4149/37963 [17:48:04<139:31:21, 14.85s/it]
 11%|█         | 4150/37963 [17:48:18<137:37:34, 14.65s/it]
                                                           
{'loss': '0.1671', 'grad_norm': '1.563', 'learning_rate': '1.967e-05', 'epoch': '0.1093'}

 11%|█         | 4150/37963 [17:48:18<137:37:34, 14.65s/it]
 11%|█         | 4151/37963 [17:48:32<136:33:56, 14.54s/it]
 11%|█         | 4152/37963 [17:48:47<136:05:18, 14.49s/it]
 11%|█         | 4153/37963 [17:49:01<135:33:00, 14.43s/it]
 11%|█         | 4154/37963 [17:49:15<135:11:38, 14.40s/it]
 11%|█         | 4155/37963 [17:49:30<134:57:00, 14.37s/it]
 11%|█         | 4156/37963 [17:49:44<134:35:49, 14.33s/it]
 11%|█         | 4157/37963 [17:49:58<134:32:12, 14.33s/it]
 11%|█         | 4158/37963 [17:50:12<134:00:51, 14.27s/it]
 11%|█         | 4159/37963 [17:50:27<133:46:42, 14.25s/it]
 11%|█         | 4160/37963 [17:50:41<134:21:45, 14.31s/it]
                                                           
{'loss': '0.1746', 'grad_norm': '5.641', 'learning_rate': '1.967e-05', 'epoch': '0.1096'}

 11%|█         | 4160/37963 [17:50:41<134:21:45, 14.31s/it]
 11%|█         | 4161/37963 [17:50:55<134:27:50, 14.32s/it]
 11%|█         | 4162/37963 [17:51:10<134:31:56, 14.33s/it]
 11%|█         | 4163/37963 [17:51:24<132:44:25, 14.14s/it]
 11%|█         | 4164/37963 [17:51:38<133:21:29, 14.20s/it]
 11%|█         | 4165/37963 [17:51:52<133:54:44, 14.26s/it]
 11%|█         | 4166/37963 [17:52:07<133:50:07, 14.26s/it]
 11%|█         | 4167/37963 [17:52:21<133:56:19, 14.27s/it]
 11%|█         | 4168/37963 [17:52:35<134:13:49, 14.30s/it]
 11%|█         | 4169/37963 [17:52:50<134:24:33, 14.32s/it]
 11%|█         | 4170/37963 [17:53:04<134:40:45, 14.35s/it]
                                                           
{'loss': '0.1663', 'grad_norm': '2.008', 'learning_rate': '1.967e-05', 'epoch': '0.1098'}

 11%|█         | 4170/37963 [17:53:04<134:40:45, 14.35s/it]
 11%|█         | 4171/37963 [17:53:24<151:24:38, 16.13s/it]
 11%|█         | 4172/37963 [17:53:39<146:16:30, 15.58s/it]
 11%|█         | 4173/37963 [17:53:53<142:36:44, 15.19s/it]
 11%|█         | 4174/37963 [17:54:07<140:06:16, 14.93s/it]
 11%|█         | 4175/37963 [17:54:22<138:45:59, 14.79s/it]
 11%|█         | 4176/37963 [17:54:36<137:26:57, 14.65s/it]
 11%|█         | 4177/37963 [17:54:50<135:36:42, 14.45s/it]
 11%|█         | 4178/37963 [17:55:04<135:05:32, 14.39s/it]
 11%|█         | 4179/37963 [17:55:19<134:57:03, 14.38s/it]
 11%|█         | 4180/37963 [17:55:33<134:34:37, 14.34s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '2.723', 'learning_rate': '1.967e-05', 'epoch': '0.1101'}

 11%|█         | 4180/37963 [17:55:33<134:34:37, 14.34s/it]
 11%|█         | 4181/37963 [17:55:53<152:12:26, 16.22s/it]
 11%|█         | 4182/37963 [17:56:14<165:05:56, 17.59s/it]
 11%|█         | 4183/37963 [17:56:29<156:20:35, 16.66s/it]
 11%|█         | 4184/37963 [17:56:43<149:35:15, 15.94s/it]
 11%|█         | 4185/37963 [17:56:57<145:02:53, 15.46s/it]
 11%|█         | 4186/37963 [17:57:19<162:34:13, 17.33s/it]
 11%|█         | 4187/37963 [17:57:40<173:18:59, 18.47s/it]
 11%|█         | 4188/37963 [17:58:01<180:39:00, 19.26s/it]
 11%|█         | 4189/37963 [17:58:22<185:10:20, 19.74s/it]
 11%|█         | 4190/37963 [17:58:42<186:10:25, 19.85s/it]
                                                           
{'loss': '0.1694', 'grad_norm': '1.737', 'learning_rate': '1.966e-05', 'epoch': '0.1104'}

 11%|█         | 4190/37963 [17:58:42<186:10:25, 19.85s/it]
 11%|█         | 4191/37963 [17:58:57<170:48:38, 18.21s/it]
 11%|█         | 4192/37963 [17:59:11<160:07:23, 17.07s/it]
 11%|█         | 4193/37963 [17:59:25<152:31:07, 16.26s/it]
 11%|█         | 4194/37963 [17:59:40<147:13:41, 15.70s/it]
 11%|█         | 4195/37963 [17:59:54<144:28:34, 15.40s/it]
 11%|█         | 4196/37963 [18:00:08<140:21:47, 14.96s/it]
 11%|█         | 4197/37963 [18:00:23<138:29:14, 14.76s/it]
 11%|█         | 4198/37963 [18:00:37<137:10:41, 14.63s/it]
 11%|█         | 4199/37963 [18:00:51<135:49:07, 14.48s/it]
 11%|█         | 4200/37963 [18:01:05<134:24:57, 14.33s/it]
                                                           
{'loss': '0.1707', 'grad_norm': '0.9378', 'learning_rate': '1.966e-05', 'epoch': '0.1106'}

 11%|█         | 4200/37963 [18:01:05<134:24:57, 14.33s/it]
 11%|█         | 4201/37963 [18:01:19<134:34:31, 14.35s/it]
 11%|█         | 4202/37963 [18:01:34<134:37:48, 14.36s/it]
 11%|█         | 4203/37963 [18:01:48<134:01:41, 14.29s/it]
 11%|█         | 4204/37963 [18:02:02<134:16:39, 14.32s/it]
 11%|█         | 4205/37963 [18:02:17<134:14:46, 14.32s/it]
 11%|█         | 4206/37963 [18:02:31<134:33:15, 14.35s/it]
 11%|█         | 4207/37963 [18:02:45<134:36:21, 14.36s/it]
 11%|█         | 4208/37963 [18:03:00<134:42:27, 14.37s/it]
 11%|█         | 4209/37963 [18:03:14<134:34:20, 14.35s/it]
 11%|█         | 4210/37963 [18:03:29<134:36:12, 14.36s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '2.764', 'learning_rate': '1.966e-05', 'epoch': '0.1109'}

 11%|█         | 4210/37963 [18:03:29<134:36:12, 14.36s/it]
 11%|█         | 4211/37963 [18:03:42<132:20:27, 14.12s/it]
 11%|█         | 4212/37963 [18:03:56<132:57:08, 14.18s/it]
 11%|█         | 4213/37963 [18:04:11<133:21:41, 14.23s/it]
 11%|█         | 4214/37963 [18:04:25<133:35:02, 14.25s/it]
 11%|█         | 4215/37963 [18:04:39<131:55:04, 14.07s/it]
 11%|█         | 4216/37963 [18:04:53<132:32:12, 14.14s/it]
 11%|█         | 4217/37963 [18:05:07<132:58:44, 14.19s/it]
 11%|█         | 4218/37963 [18:05:21<132:20:44, 14.12s/it]
 11%|█         | 4219/37963 [18:05:42<149:47:40, 15.98s/it]
 11%|█         | 4220/37963 [18:05:56<145:21:04, 15.51s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '1.891', 'learning_rate': '1.966e-05', 'epoch': '0.1112'}

 11%|█         | 4220/37963 [18:05:56<145:21:04, 15.51s/it]
 11%|█         | 4221/37963 [18:06:10<141:29:50, 15.10s/it]
 11%|█         | 4222/37963 [18:06:24<139:15:55, 14.86s/it]
 11%|█         | 4223/37963 [18:06:38<136:42:23, 14.59s/it]
 11%|█         | 4224/37963 [18:06:53<135:46:50, 14.49s/it]
 11%|█         | 4225/37963 [18:07:07<134:19:27, 14.33s/it]
 11%|█         | 4226/37963 [18:07:21<134:49:22, 14.39s/it]
 11%|█         | 4227/37963 [18:07:35<134:07:45, 14.31s/it]
 11%|█         | 4228/37963 [18:07:50<134:14:02, 14.32s/it]
 11%|█         | 4229/37963 [18:08:04<134:12:29, 14.32s/it]
 11%|█         | 4230/37963 [18:08:25<152:25:02, 16.27s/it]
                                                           
{'loss': '0.1721', 'grad_norm': '3.62', 'learning_rate': '1.965e-05', 'epoch': '0.1114'}

 11%|█         | 4230/37963 [18:08:25<152:25:02, 16.27s/it]
 11%|█         | 4231/37963 [18:08:46<166:05:32, 17.73s/it]
 11%|█         | 4232/37963 [18:09:06<173:59:13, 18.57s/it]
 11%|█         | 4233/37963 [18:09:20<161:10:07, 17.20s/it]
 11%|█         | 4234/37963 [18:09:42<173:12:14, 18.49s/it]
 11%|█         | 4235/37963 [18:09:56<161:54:44, 17.28s/it]
 11%|█         | 4236/37963 [18:10:18<173:47:44, 18.55s/it]
 11%|█         | 4237/37963 [18:10:32<161:54:03, 17.28s/it]
 11%|█         | 4238/37963 [18:10:47<153:48:24, 16.42s/it]
 11%|█         | 4239/37963 [18:11:08<166:29:10, 17.77s/it]
 11%|█         | 4240/37963 [18:11:27<172:23:47, 18.40s/it]
                                                           
{'loss': '0.1746', 'grad_norm': '3.723', 'learning_rate': '1.965e-05', 'epoch': '0.1117'}

 11%|█         | 4240/37963 [18:11:27<172:23:47, 18.40s/it]
 11%|█         | 4241/37963 [18:11:42<160:57:39, 17.18s/it]
 11%|█         | 4242/37963 [18:11:56<153:27:16, 16.38s/it]
 11%|█         | 4243/37963 [18:12:10<146:28:51, 15.64s/it]
 11%|█         | 4244/37963 [18:12:25<142:49:20, 15.25s/it]
 11%|█         | 4245/37963 [18:12:39<140:08:17, 14.96s/it]
 11%|█         | 4246/37963 [18:12:53<138:35:37, 14.80s/it]
 11%|█         | 4247/37963 [18:13:08<137:18:59, 14.66s/it]
 11%|█         | 4248/37963 [18:13:22<136:27:30, 14.57s/it]
 11%|█         | 4249/37963 [18:13:36<136:06:05, 14.53s/it]
 11%|█         | 4250/37963 [18:13:51<135:58:14, 14.52s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '2.532', 'learning_rate': '1.965e-05', 'epoch': '0.112'}

 11%|█         | 4250/37963 [18:13:51<135:58:14, 14.52s/it]
 11%|█         | 4251/37963 [18:14:05<135:29:04, 14.47s/it]
 11%|█         | 4252/37963 [18:14:19<134:26:32, 14.36s/it]
 11%|█         | 4253/37963 [18:14:34<134:07:56, 14.32s/it]
 11%|█         | 4254/37963 [18:14:48<133:53:55, 14.30s/it]
 11%|█         | 4255/37963 [18:15:02<133:58:14, 14.31s/it]
 11%|█         | 4256/37963 [18:15:16<133:01:23, 14.21s/it]
 11%|█         | 4257/37963 [18:15:31<134:11:36, 14.33s/it]
 11%|█         | 4258/37963 [18:15:45<134:29:06, 14.36s/it]
 11%|█         | 4259/37963 [18:16:00<134:25:49, 14.36s/it]
 11%|█         | 4260/37963 [18:16:13<133:21:11, 14.24s/it]
                                                           
{'loss': '0.1662', 'grad_norm': '1.623', 'learning_rate': '1.965e-05', 'epoch': '0.1122'}

 11%|█         | 4260/37963 [18:16:13<133:21:11, 14.24s/it]
 11%|█         | 4261/37963 [18:16:27<132:40:32, 14.17s/it]
 11%|█         | 4262/37963 [18:16:42<133:11:21, 14.23s/it]
 11%|█         | 4263/37963 [18:16:56<133:43:55, 14.29s/it]
 11%|█         | 4264/37963 [18:17:10<132:47:21, 14.19s/it]
 11%|█         | 4265/37963 [18:17:25<133:14:52, 14.24s/it]
 11%|█         | 4266/37963 [18:17:39<133:06:51, 14.22s/it]
 11%|█         | 4267/37963 [18:17:53<133:05:54, 14.22s/it]
 11%|█         | 4268/37963 [18:18:07<132:48:16, 14.19s/it]
 11%|█         | 4269/37963 [18:18:28<150:47:50, 16.11s/it]
 11%|█         | 4270/37963 [18:18:42<145:57:35, 15.60s/it]
                                                           
{'loss': '0.1744', 'grad_norm': '2.444', 'learning_rate': '1.965e-05', 'epoch': '0.1125'}

 11%|█         | 4270/37963 [18:18:42<145:57:35, 15.60s/it]
 11%|█▏        | 4271/37963 [18:18:56<140:55:32, 15.06s/it]
 11%|█▏        | 4272/37963 [18:19:10<137:53:41, 14.73s/it]
 11%|█▏        | 4273/37963 [18:19:24<135:46:10, 14.51s/it]
 11%|█▏        | 4274/37963 [18:19:38<135:19:00, 14.46s/it]
 11%|█▏        | 4275/37963 [18:19:53<134:52:31, 14.41s/it]
 11%|█▏        | 4276/37963 [18:20:07<134:15:05, 14.35s/it]
 11%|█▏        | 4277/37963 [18:20:27<150:02:11, 16.03s/it]
 11%|█▏        | 4278/37963 [18:20:41<144:20:57, 15.43s/it]
 11%|█▏        | 4279/37963 [18:21:01<159:07:40, 17.01s/it]
 11%|█▏        | 4280/37963 [18:21:15<150:54:06, 16.13s/it]
                                                           
{'loss': '0.1728', 'grad_norm': '5.106', 'learning_rate': '1.964e-05', 'epoch': '0.1127'}

 11%|█▏        | 4280/37963 [18:21:15<150:54:06, 16.13s/it]
 11%|█▏        | 4281/37963 [18:21:36<164:21:19, 17.57s/it]
 11%|█▏        | 4282/37963 [18:21:51<154:44:28, 16.54s/it]
 11%|█▏        | 4283/37963 [18:22:12<167:55:54, 17.95s/it]
 11%|█▏        | 4284/37963 [18:22:33<176:44:25, 18.89s/it]
 11%|█▏        | 4285/37963 [18:22:47<163:56:46, 17.52s/it]
 11%|█▏        | 4286/37963 [18:23:02<155:36:24, 16.63s/it]
 11%|█▏        | 4287/37963 [18:23:23<168:12:45, 17.98s/it]
 11%|█▏        | 4288/37963 [18:23:43<174:47:28, 18.69s/it]
 11%|█▏        | 4289/37963 [18:23:58<162:30:45, 17.37s/it]
 11%|█▏        | 4290/37963 [18:24:12<153:38:40, 16.43s/it]
                                                           
{'loss': '0.1752', 'grad_norm': '3.794', 'learning_rate': '1.964e-05', 'epoch': '0.113'}

 11%|█▏        | 4290/37963 [18:24:12<153:38:40, 16.43s/it]
 11%|█▏        | 4291/37963 [18:24:26<147:48:20, 15.80s/it]
 11%|█▏        | 4292/37963 [18:24:41<144:02:56, 15.40s/it]
 11%|█▏        | 4293/37963 [18:24:55<140:46:02, 15.05s/it]
 11%|█▏        | 4294/37963 [18:25:09<139:47:44, 14.95s/it]
 11%|█▏        | 4295/37963 [18:25:24<137:55:04, 14.75s/it]
 11%|█▏        | 4296/37963 [18:25:38<136:38:18, 14.61s/it]
 11%|█▏        | 4297/37963 [18:25:52<135:55:50, 14.54s/it]
 11%|█▏        | 4298/37963 [18:26:06<134:36:59, 14.40s/it]
 11%|█▏        | 4299/37963 [18:26:21<134:29:41, 14.38s/it]
 11%|█▏        | 4300/37963 [18:26:35<134:22:53, 14.37s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '1.101', 'learning_rate': '1.964e-05', 'epoch': '0.1133'}

 11%|█▏        | 4300/37963 [18:26:35<134:22:53, 14.37s/it]
 11%|█▏        | 4301/37963 [18:26:49<134:12:11, 14.35s/it]
 11%|█▏        | 4302/37963 [18:27:03<132:23:55, 14.16s/it]
 11%|█▏        | 4303/37963 [18:27:18<132:53:44, 14.21s/it]
 11%|█▏        | 4304/37963 [18:27:32<133:14:11, 14.25s/it]
 11%|█▏        | 4305/37963 [18:27:46<133:27:14, 14.27s/it]
 11%|█▏        | 4306/37963 [18:28:00<131:37:48, 14.08s/it]
 11%|█▏        | 4307/37963 [18:28:14<132:22:35, 14.16s/it]
 11%|█▏        | 4308/37963 [18:28:29<133:01:58, 14.23s/it]
 11%|█▏        | 4309/37963 [18:28:43<133:12:28, 14.25s/it]
 11%|█▏        | 4310/37963 [18:28:57<133:48:19, 14.31s/it]
                                                           
{'loss': '0.176', 'grad_norm': '5.188', 'learning_rate': '1.964e-05', 'epoch': '0.1135'}

 11%|█▏        | 4310/37963 [18:28:57<133:48:19, 14.31s/it]
 11%|█▏        | 4311/37963 [18:29:12<133:43:04, 14.30s/it]
 11%|█▏        | 4312/37963 [18:29:26<133:45:17, 14.31s/it]
 11%|█▏        | 4313/37963 [18:29:40<133:51:13, 14.32s/it]
 11%|█▏        | 4314/37963 [18:29:55<133:48:16, 14.32s/it]
 11%|█▏        | 4315/37963 [18:30:09<134:10:36, 14.36s/it]
 11%|█▏        | 4316/37963 [18:30:23<134:09:29, 14.35s/it]
 11%|█▏        | 4317/37963 [18:30:38<134:14:04, 14.36s/it]
 11%|█▏        | 4318/37963 [18:30:52<133:38:02, 14.30s/it]
 11%|█▏        | 4319/37963 [18:31:12<150:27:32, 16.10s/it]
 11%|█▏        | 4320/37963 [18:31:26<144:38:42, 15.48s/it]
                                                           
{'loss': '0.1725', 'grad_norm': '2.976', 'learning_rate': '1.963e-05', 'epoch': '0.1138'}

 11%|█▏        | 4320/37963 [18:31:26<144:38:42, 15.48s/it]
 11%|█▏        | 4321/37963 [18:31:41<141:33:03, 15.15s/it]
 11%|█▏        | 4322/37963 [18:31:55<139:23:27, 14.92s/it]
 11%|█▏        | 4323/37963 [18:32:09<137:46:14, 14.74s/it]
 11%|█▏        | 4324/37963 [18:32:24<136:34:53, 14.62s/it]
 11%|█▏        | 4325/37963 [18:32:38<136:09:28, 14.57s/it]
 11%|█▏        | 4326/37963 [18:32:59<154:06:05, 16.49s/it]
 11%|█▏        | 4327/37963 [18:33:13<146:55:32, 15.73s/it]
 11%|█▏        | 4328/37963 [18:33:27<143:06:10, 15.32s/it]
 11%|█▏        | 4329/37963 [18:33:48<158:20:50, 16.95s/it]
 11%|█▏        | 4330/37963 [18:34:10<170:49:56, 18.29s/it]
                                                           
{'loss': '0.1731', 'grad_norm': '1.971', 'learning_rate': '1.963e-05', 'epoch': '0.1141'}

 11%|█▏        | 4330/37963 [18:34:10<170:49:56, 18.29s/it]
 11%|█▏        | 4331/37963 [18:34:24<160:03:21, 17.13s/it]
 11%|█▏        | 4332/37963 [18:34:45<171:54:48, 18.40s/it]
 11%|█▏        | 4333/37963 [18:35:06<179:19:07, 19.20s/it]
 11%|█▏        | 4334/37963 [18:35:21<165:39:06, 17.73s/it]
 11%|█▏        | 4335/37963 [18:35:35<154:48:41, 16.57s/it]
 11%|█▏        | 4336/37963 [18:35:49<148:32:27, 15.90s/it]
 11%|█▏        | 4337/37963 [18:36:10<161:45:11, 17.32s/it]
 11%|█▏        | 4338/37963 [18:36:24<153:13:40, 16.41s/it]
 11%|█▏        | 4339/37963 [18:36:38<147:51:51, 15.83s/it]
 11%|█▏        | 4340/37963 [18:36:53<144:17:32, 15.45s/it]
                                                           
{'loss': '0.1774', 'grad_norm': '2.736', 'learning_rate': '1.963e-05', 'epoch': '0.1143'}

 11%|█▏        | 4340/37963 [18:36:53<144:17:32, 15.45s/it]
 11%|█▏        | 4341/37963 [18:37:07<141:15:21, 15.12s/it]
 11%|█▏        | 4342/37963 [18:37:22<139:23:45, 14.93s/it]
 11%|█▏        | 4343/37963 [18:37:36<137:48:02, 14.76s/it]
 11%|█▏        | 4344/37963 [18:37:50<134:52:38, 14.44s/it]
 11%|█▏        | 4345/37963 [18:38:04<134:47:16, 14.43s/it]
 11%|█▏        | 4346/37963 [18:38:18<134:05:27, 14.36s/it]
 11%|█▏        | 4347/37963 [18:38:33<134:04:02, 14.36s/it]
 11%|█▏        | 4348/37963 [18:38:47<133:33:55, 14.30s/it]
 11%|█▏        | 4349/37963 [18:39:01<133:03:57, 14.25s/it]
 11%|█▏        | 4350/37963 [18:39:15<133:22:00, 14.28s/it]
                                                           
{'loss': '0.1801', 'grad_norm': '2.818', 'learning_rate': '1.963e-05', 'epoch': '0.1146'}

 11%|█▏        | 4350/37963 [18:39:15<133:22:00, 14.28s/it]
 11%|█▏        | 4351/37963 [18:39:30<133:17:39, 14.28s/it]
 11%|█▏        | 4352/37963 [18:39:43<131:35:33, 14.09s/it]
 11%|█▏        | 4353/37963 [18:39:58<132:15:20, 14.17s/it]
 11%|█▏        | 4354/37963 [18:40:12<132:37:30, 14.21s/it]
 11%|█▏        | 4355/37963 [18:40:26<133:05:41, 14.26s/it]
 11%|█▏        | 4356/37963 [18:40:40<132:31:37, 14.20s/it]
 11%|█▏        | 4357/37963 [18:40:54<131:50:10, 14.12s/it]
 11%|█▏        | 4358/37963 [18:41:09<132:18:28, 14.17s/it]
 11%|█▏        | 4359/37963 [18:41:23<133:18:56, 14.28s/it]
 11%|█▏        | 4360/37963 [18:41:38<133:33:36, 14.31s/it]
                                                           
{'loss': '0.1796', 'grad_norm': '4.155', 'learning_rate': '1.963e-05', 'epoch': '0.1148'}

 11%|█▏        | 4360/37963 [18:41:38<133:33:36, 14.31s/it]
 11%|█▏        | 4361/37963 [18:41:52<133:36:36, 14.31s/it]
 11%|█▏        | 4362/37963 [18:42:06<133:17:10, 14.28s/it]
 11%|█▏        | 4363/37963 [18:42:21<133:58:01, 14.35s/it]
 11%|█▏        | 4364/37963 [18:42:35<134:01:33, 14.36s/it]
 11%|█▏        | 4365/37963 [18:42:49<134:11:32, 14.38s/it]
 12%|█▏        | 4366/37963 [18:43:04<133:56:14, 14.35s/it]
 12%|█▏        | 4367/37963 [18:43:24<151:28:24, 16.23s/it]
 12%|█▏        | 4368/37963 [18:43:39<146:30:22, 15.70s/it]
 12%|█▏        | 4369/37963 [18:43:53<142:50:23, 15.31s/it]
 12%|█▏        | 4370/37963 [18:44:08<140:21:44, 15.04s/it]
                                                           
{'loss': '0.1799', 'grad_norm': '6.434', 'learning_rate': '1.962e-05', 'epoch': '0.1151'}

 12%|█▏        | 4370/37963 [18:44:08<140:21:44, 15.04s/it]
 12%|█▏        | 4371/37963 [18:44:22<139:02:46, 14.90s/it]
 12%|█▏        | 4372/37963 [18:44:37<137:41:07, 14.76s/it]
 12%|█▏        | 4373/37963 [18:44:51<136:37:29, 14.64s/it]
 12%|█▏        | 4374/37963 [18:45:05<135:46:07, 14.55s/it]
 12%|█▏        | 4375/37963 [18:45:25<151:00:34, 16.19s/it]
 12%|█▏        | 4376/37963 [18:45:46<164:31:00, 17.63s/it]
 12%|█▏        | 4377/37963 [18:46:00<154:31:41, 16.56s/it]
 12%|█▏        | 4378/37963 [18:46:15<148:22:40, 15.90s/it]
 12%|█▏        | 4379/37963 [18:46:29<144:15:30, 15.46s/it]
 12%|█▏        | 4380/37963 [18:46:44<141:34:32, 15.18s/it]
                                                           
{'loss': '0.1844', 'grad_norm': '2.295', 'learning_rate': '1.962e-05', 'epoch': '0.1154'}

 12%|█▏        | 4380/37963 [18:46:44<141:34:32, 15.18s/it]
 12%|█▏        | 4381/37963 [18:47:05<158:31:01, 16.99s/it]
 12%|█▏        | 4382/37963 [18:47:26<171:13:48, 18.36s/it]
 12%|█▏        | 4383/37963 [18:47:47<178:47:34, 19.17s/it]
 12%|█▏        | 4384/37963 [18:48:01<163:03:09, 17.48s/it]
 12%|█▏        | 4385/37963 [18:48:28<189:40:42, 20.34s/it]
 12%|█▏        | 4386/37963 [18:48:43<173:21:33, 18.59s/it]
 12%|█▏        | 4387/37963 [18:48:57<161:37:58, 17.33s/it]
 12%|█▏        | 4388/37963 [18:49:11<152:49:05, 16.39s/it]
 12%|█▏        | 4389/37963 [18:49:26<147:28:33, 15.81s/it]
 12%|█▏        | 4390/37963 [18:49:40<143:33:09, 15.39s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '1.717', 'learning_rate': '1.962e-05', 'epoch': '0.1156'}

 12%|█▏        | 4390/37963 [18:49:40<143:33:09, 15.39s/it]
 12%|█▏        | 4391/37963 [18:49:54<139:00:16, 14.91s/it]
 12%|█▏        | 4392/37963 [18:50:08<137:20:34, 14.73s/it]
 12%|█▏        | 4393/37963 [18:50:22<135:04:28, 14.49s/it]
 12%|█▏        | 4394/37963 [18:50:36<134:43:21, 14.45s/it]
 12%|█▏        | 4395/37963 [18:50:51<134:18:56, 14.40s/it]
 12%|█▏        | 4396/37963 [18:51:05<133:01:40, 14.27s/it]
 12%|█▏        | 4397/37963 [18:51:19<133:05:28, 14.27s/it]
 12%|█▏        | 4398/37963 [18:51:33<133:19:21, 14.30s/it]
 12%|█▏        | 4399/37963 [18:51:47<132:32:26, 14.22s/it]
 12%|█▏        | 4400/37963 [18:52:02<132:58:01, 14.26s/it]
                                                           
{'loss': '0.1719', 'grad_norm': '3.094', 'learning_rate': '1.962e-05', 'epoch': '0.1159'}

 12%|█▏        | 4400/37963 [18:52:02<132:58:01, 14.26s/it]
 12%|█▏        | 4401/37963 [18:52:16<133:27:11, 14.31s/it]
 12%|█▏        | 4402/37963 [18:52:30<133:29:59, 14.32s/it]
 12%|█▏        | 4403/37963 [18:52:45<132:50:38, 14.25s/it]
 12%|█▏        | 4404/37963 [18:52:59<133:08:57, 14.28s/it]
 12%|█▏        | 4405/37963 [18:53:13<133:22:26, 14.31s/it]
 12%|█▏        | 4406/37963 [18:53:28<133:23:47, 14.31s/it]
 12%|█▏        | 4407/37963 [18:53:42<132:39:30, 14.23s/it]
 12%|█▏        | 4408/37963 [18:53:56<132:38:15, 14.23s/it]
 12%|█▏        | 4409/37963 [18:54:10<132:54:53, 14.26s/it]
 12%|█▏        | 4410/37963 [18:54:25<133:08:27, 14.29s/it]
                                                           
{'loss': '0.164', 'grad_norm': '4.401', 'learning_rate': '1.961e-05', 'epoch': '0.1162'}

 12%|█▏        | 4410/37963 [18:54:25<133:08:27, 14.29s/it]
 12%|█▏        | 4411/37963 [18:54:38<132:11:43, 14.18s/it]
 12%|█▏        | 4412/37963 [18:54:53<132:26:38, 14.21s/it]
 12%|█▏        | 4413/37963 [18:55:07<133:07:42, 14.29s/it]
 12%|█▏        | 4414/37963 [18:55:22<133:54:12, 14.37s/it]
 12%|█▏        | 4415/37963 [18:55:36<133:38:12, 14.34s/it]
 12%|█▏        | 4416/37963 [18:55:50<133:41:11, 14.35s/it]
 12%|█▏        | 4417/37963 [18:56:11<151:29:35, 16.26s/it]
 12%|█▏        | 4418/37963 [18:56:25<144:42:41, 15.53s/it]
 12%|█▏        | 4419/37963 [18:56:39<141:27:45, 15.18s/it]
 12%|█▏        | 4420/37963 [18:56:54<139:06:19, 14.93s/it]
                                                           
{'loss': '0.17', 'grad_norm': '1.94', 'learning_rate': '1.961e-05', 'epoch': '0.1164'}

 12%|█▏        | 4420/37963 [18:56:54<139:06:19, 14.93s/it]
 12%|█▏        | 4421/37963 [18:57:08<137:22:36, 14.74s/it]
 12%|█▏        | 4422/37963 [18:57:22<136:15:33, 14.62s/it]
 12%|█▏        | 4423/37963 [18:57:43<153:56:27, 16.52s/it]
 12%|█▏        | 4424/37963 [18:58:04<165:00:50, 17.71s/it]
 12%|█▏        | 4425/37963 [18:58:18<155:42:21, 16.71s/it]
 12%|█▏        | 4426/37963 [18:58:32<149:08:07, 16.01s/it]
 12%|█▏        | 4427/37963 [18:58:46<143:02:17, 15.35s/it]
 12%|█▏        | 4428/37963 [18:59:01<140:12:45, 15.05s/it]
 12%|█▏        | 4429/37963 [18:59:15<138:27:54, 14.86s/it]
 12%|█▏        | 4430/37963 [18:59:36<154:57:15, 16.64s/it]
                                                           
{'loss': '0.1516', 'grad_norm': '3.168', 'learning_rate': '1.961e-05', 'epoch': '0.1167'}

 12%|█▏        | 4430/37963 [18:59:36<154:57:15, 16.64s/it]
 12%|█▏        | 4431/37963 [19:00:04<187:41:20, 20.15s/it]
 12%|█▏        | 4432/37963 [19:00:26<191:01:39, 20.51s/it]
 12%|█▏        | 4433/37963 [19:00:40<173:31:28, 18.63s/it]
 12%|█▏        | 4434/37963 [19:00:54<161:33:16, 17.35s/it]
 12%|█▏        | 4435/37963 [19:01:14<169:27:32, 18.20s/it]
 12%|█▏        | 4436/37963 [19:01:29<158:44:30, 17.05s/it]
 12%|█▏        | 4437/37963 [19:01:43<151:31:07, 16.27s/it]
 12%|█▏        | 4438/37963 [19:01:57<146:06:02, 15.69s/it]
 12%|█▏        | 4439/37963 [19:02:12<142:33:33, 15.31s/it]
 12%|█▏        | 4440/37963 [19:02:26<138:56:43, 14.92s/it]
                                                           
{'loss': '0.157', 'grad_norm': '3.842', 'learning_rate': '1.961e-05', 'epoch': '0.117'}

 12%|█▏        | 4440/37963 [19:02:26<138:56:43, 14.92s/it]
 12%|█▏        | 4441/37963 [19:02:40<137:14:48, 14.74s/it]
 12%|█▏        | 4442/37963 [19:02:55<136:01:44, 14.61s/it]
 12%|█▏        | 4443/37963 [19:03:09<136:18:38, 14.64s/it]
 12%|█▏        | 4444/37963 [19:03:23<134:03:06, 14.40s/it]
 12%|█▏        | 4445/37963 [19:03:37<133:36:12, 14.35s/it]
 12%|█▏        | 4446/37963 [19:03:52<133:47:55, 14.37s/it]
 12%|█▏        | 4447/37963 [19:04:06<133:39:46, 14.36s/it]
 12%|█▏        | 4448/37963 [19:04:21<133:54:29, 14.38s/it]
 12%|█▏        | 4449/37963 [19:04:35<133:42:57, 14.36s/it]
 12%|█▏        | 4450/37963 [19:04:49<133:52:20, 14.38s/it]
                                                           
{'loss': '0.1726', 'grad_norm': '2.691', 'learning_rate': '1.96e-05', 'epoch': '0.1172'}

 12%|█▏        | 4450/37963 [19:04:49<133:52:20, 14.38s/it]
 12%|█▏        | 4451/37963 [19:05:03<132:50:56, 14.27s/it]
 12%|█▏        | 4452/37963 [19:05:17<132:02:18, 14.18s/it]
 12%|█▏        | 4453/37963 [19:05:31<131:29:28, 14.13s/it]
 12%|█▏        | 4454/37963 [19:05:46<132:11:39, 14.20s/it]
 12%|█▏        | 4455/37963 [19:06:00<132:09:25, 14.20s/it]
 12%|█▏        | 4456/37963 [19:06:14<132:26:17, 14.23s/it]
 12%|█▏        | 4457/37963 [19:06:28<132:37:22, 14.25s/it]
 12%|█▏        | 4458/37963 [19:06:43<132:53:58, 14.28s/it]
 12%|█▏        | 4459/37963 [19:06:57<132:46:37, 14.27s/it]
 12%|█▏        | 4460/37963 [19:07:11<132:58:39, 14.29s/it]
                                                           
{'loss': '0.1775', 'grad_norm': '1.737', 'learning_rate': '1.96e-05', 'epoch': '0.1175'}

 12%|█▏        | 4460/37963 [19:07:11<132:58:39, 14.29s/it]
 12%|█▏        | 4461/37963 [19:07:26<133:02:52, 14.30s/it]
 12%|█▏        | 4462/37963 [19:07:40<133:20:36, 14.33s/it]
 12%|█▏        | 4463/37963 [19:07:54<131:32:56, 14.14s/it]
 12%|█▏        | 4464/37963 [19:08:08<131:34:21, 14.14s/it]
 12%|█▏        | 4465/37963 [19:08:22<132:11:54, 14.21s/it]
 12%|█▏        | 4466/37963 [19:08:43<150:43:12, 16.20s/it]
 12%|█▏        | 4467/37963 [19:08:58<145:48:53, 15.67s/it]
 12%|█▏        | 4468/37963 [19:09:12<142:09:58, 15.28s/it]
 12%|█▏        | 4469/37963 [19:09:25<137:13:16, 14.75s/it]
 12%|█▏        | 4470/37963 [19:09:40<136:18:18, 14.65s/it]
                                                           
{'loss': '0.1666', 'grad_norm': '3.32', 'learning_rate': '1.96e-05', 'epoch': '0.1177'}

 12%|█▏        | 4470/37963 [19:09:40<136:18:18, 14.65s/it]
 12%|█▏        | 4471/37963 [19:09:54<134:11:01, 14.42s/it]
 12%|█▏        | 4472/37963 [19:10:14<151:42:22, 16.31s/it]
 12%|█▏        | 4473/37963 [19:10:35<164:11:40, 17.65s/it]
 12%|█▏        | 4474/37963 [19:10:50<154:59:31, 16.66s/it]
 12%|█▏        | 4475/37963 [19:11:04<148:35:23, 15.97s/it]
 12%|█▏        | 4476/37963 [19:11:18<143:53:29, 15.47s/it]
 12%|█▏        | 4477/37963 [19:11:33<140:41:21, 15.13s/it]
 12%|█▏        | 4478/37963 [19:11:47<138:34:52, 14.90s/it]
 12%|█▏        | 4479/37963 [19:12:08<156:33:22, 16.83s/it]
 12%|█▏        | 4480/37963 [19:12:28<165:50:43, 17.83s/it]
                                                           
{'loss': '0.165', 'grad_norm': '1.675', 'learning_rate': '1.96e-05', 'epoch': '0.118'}

 12%|█▏        | 4480/37963 [19:12:28<165:50:43, 17.83s/it]
 12%|█▏        | 4481/37963 [19:12:56<194:16:02, 20.89s/it]
 12%|█▏        | 4482/37963 [19:13:11<175:35:45, 18.88s/it]
 12%|█▏        | 4483/37963 [19:13:25<162:50:49, 17.51s/it]
 12%|█▏        | 4484/37963 [19:13:46<172:20:05, 18.53s/it]
 12%|█▏        | 4485/37963 [19:14:00<160:23:43, 17.25s/it]
 12%|█▏        | 4486/37963 [19:14:14<151:28:45, 16.29s/it]
 12%|█▏        | 4487/37963 [19:14:29<146:24:12, 15.74s/it]
 12%|█▏        | 4488/37963 [19:14:43<141:10:06, 15.18s/it]
 12%|█▏        | 4489/37963 [19:14:57<138:10:16, 14.86s/it]
 12%|█▏        | 4490/37963 [19:15:10<135:20:00, 14.56s/it]
                                                           
{'loss': '0.1739', 'grad_norm': '2.882', 'learning_rate': '1.959e-05', 'epoch': '0.1183'}

 12%|█▏        | 4490/37963 [19:15:10<135:20:00, 14.56s/it]
 12%|█▏        | 4491/37963 [19:15:25<135:04:17, 14.53s/it]
 12%|█▏        | 4492/37963 [19:15:39<133:34:55, 14.37s/it]
 12%|█▏        | 4493/37963 [19:15:53<133:33:32, 14.37s/it]
 12%|█▏        | 4494/37963 [19:16:08<133:41:28, 14.38s/it]
 12%|█▏        | 4495/37963 [19:16:22<132:38:28, 14.27s/it]
 12%|█▏        | 4496/37963 [19:16:36<132:46:41, 14.28s/it]
 12%|█▏        | 4497/37963 [19:16:50<132:53:34, 14.30s/it]
 12%|█▏        | 4498/37963 [19:17:04<130:25:18, 14.03s/it]
 12%|█▏        | 4499/37963 [19:17:18<131:16:02, 14.12s/it]
 12%|█▏        | 4500/37963 [19:17:33<132:16:49, 14.23s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '1.41', 'learning_rate': '1.959e-05', 'epoch': '0.1185'}

 12%|█▏        | 4500/37963 [19:17:33<132:16:49, 14.23s/it]
 12%|█▏        | 4501/37963 [19:17:47<132:42:11, 14.28s/it]
 12%|█▏        | 4502/37963 [19:18:01<132:59:23, 14.31s/it]
 12%|█▏        | 4503/37963 [19:18:16<133:05:57, 14.32s/it]
 12%|█▏        | 4504/37963 [19:18:30<133:12:36, 14.33s/it]
 12%|█▏        | 4505/37963 [19:18:44<131:21:37, 14.13s/it]
 12%|█▏        | 4506/37963 [19:18:58<130:52:07, 14.08s/it]
 12%|█▏        | 4507/37963 [19:19:12<131:45:00, 14.18s/it]
 12%|█▏        | 4508/37963 [19:19:26<131:01:54, 14.10s/it]
 12%|█▏        | 4509/37963 [19:19:40<131:42:42, 14.17s/it]
 12%|█▏        | 4510/37963 [19:19:55<132:07:36, 14.22s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '4.059', 'learning_rate': '1.959e-05', 'epoch': '0.1188'}

 12%|█▏        | 4510/37963 [19:19:55<132:07:36, 14.22s/it]
 12%|█▏        | 4511/37963 [19:20:09<132:22:05, 14.25s/it]
 12%|█▏        | 4512/37963 [19:20:23<132:45:31, 14.29s/it]
 12%|█▏        | 4513/37963 [19:20:38<132:29:04, 14.26s/it]
 12%|█▏        | 4514/37963 [19:20:58<149:02:07, 16.04s/it]
 12%|█▏        | 4515/37963 [19:21:12<144:24:31, 15.54s/it]
 12%|█▏        | 4516/37963 [19:21:27<141:45:22, 15.26s/it]
 12%|█▏        | 4517/37963 [19:21:41<139:21:46, 15.00s/it]
 12%|█▏        | 4518/37963 [19:21:55<136:24:22, 14.68s/it]
 12%|█▏        | 4519/37963 [19:22:10<135:45:33, 14.61s/it]
 12%|█▏        | 4520/37963 [19:22:30<153:12:00, 16.49s/it]
                                                           
{'loss': '0.174', 'grad_norm': '1.518', 'learning_rate': '1.959e-05', 'epoch': '0.1191'}

 12%|█▏        | 4520/37963 [19:22:30<153:12:00, 16.49s/it]
 12%|█▏        | 4521/37963 [19:22:45<147:45:05, 15.91s/it]
 12%|█▏        | 4522/37963 [19:22:59<143:45:29, 15.48s/it]
 12%|█▏        | 4523/37963 [19:23:20<158:27:59, 17.06s/it]
 12%|█▏        | 4524/37963 [19:23:35<150:59:20, 16.26s/it]
 12%|█▏        | 4525/37963 [19:23:49<145:36:28, 15.68s/it]
 12%|█▏        | 4526/37963 [19:24:03<140:34:42, 15.14s/it]
 12%|█▏        | 4527/37963 [19:24:24<157:45:34, 16.99s/it]
 12%|█▏        | 4528/37963 [19:24:45<167:51:36, 18.07s/it]
 12%|█▏        | 4529/37963 [19:25:06<176:38:43, 19.02s/it]
 12%|█▏        | 4530/37963 [19:25:27<182:13:48, 19.62s/it]
                                                           
{'loss': '0.1694', 'grad_norm': '3.679', 'learning_rate': '1.958e-05', 'epoch': '0.1193'}

 12%|█▏        | 4530/37963 [19:25:27<182:13:48, 19.62s/it]
 12%|█▏        | 4531/37963 [19:25:41<167:33:55, 18.04s/it]
 12%|█▏        | 4532/37963 [19:25:56<157:11:17, 16.93s/it]
 12%|█▏        | 4533/37963 [19:26:16<168:01:14, 18.09s/it]
 12%|█▏        | 4534/37963 [19:26:31<157:37:14, 16.97s/it]
 12%|█▏        | 4535/37963 [19:26:45<150:14:02, 16.18s/it]
 12%|█▏        | 4536/37963 [19:26:59<144:59:58, 15.62s/it]
 12%|█▏        | 4537/37963 [19:27:14<141:32:17, 15.24s/it]
 12%|█▏        | 4538/37963 [19:27:28<139:07:47, 14.98s/it]
 12%|█▏        | 4539/37963 [19:27:42<136:16:43, 14.68s/it]
 12%|█▏        | 4540/37963 [19:27:57<135:34:15, 14.60s/it]
                                                           
{'loss': '0.1686', 'grad_norm': '3.823', 'learning_rate': '1.958e-05', 'epoch': '0.1196'}

 12%|█▏        | 4540/37963 [19:27:57<135:34:15, 14.60s/it]
 12%|█▏        | 4541/37963 [19:28:11<134:49:58, 14.52s/it]
 12%|█▏        | 4542/37963 [19:28:25<133:56:42, 14.43s/it]
 12%|█▏        | 4543/37963 [19:28:39<131:41:51, 14.19s/it]
 12%|█▏        | 4544/37963 [19:28:53<132:28:03, 14.27s/it]
 12%|█▏        | 4545/37963 [19:29:07<132:08:17, 14.23s/it]
 12%|█▏        | 4546/37963 [19:29:21<131:43:23, 14.19s/it]
 12%|█▏        | 4547/37963 [19:29:36<132:20:23, 14.26s/it]
 12%|█▏        | 4548/37963 [19:29:50<132:11:22, 14.24s/it]
 12%|█▏        | 4549/37963 [19:30:04<132:35:45, 14.29s/it]
 12%|█▏        | 4550/37963 [19:30:19<132:52:37, 14.32s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '1.799', 'learning_rate': '1.958e-05', 'epoch': '0.1199'}

 12%|█▏        | 4550/37963 [19:30:19<132:52:37, 14.32s/it]
 12%|█▏        | 4551/37963 [19:30:33<133:04:07, 14.34s/it]
 12%|█▏        | 4552/37963 [19:30:48<133:12:14, 14.35s/it]
 12%|█▏        | 4553/37963 [19:31:02<132:55:06, 14.32s/it]
 12%|█▏        | 4554/37963 [19:31:16<132:58:42, 14.33s/it]
 12%|█▏        | 4555/37963 [19:31:30<132:25:33, 14.27s/it]
 12%|█▏        | 4556/37963 [19:31:45<132:57:43, 14.33s/it]
 12%|█▏        | 4557/37963 [19:31:59<132:57:25, 14.33s/it]
 12%|█▏        | 4558/37963 [19:32:13<132:57:20, 14.33s/it]
 12%|█▏        | 4559/37963 [19:32:28<132:48:24, 14.31s/it]
 12%|█▏        | 4560/37963 [19:32:42<132:50:24, 14.32s/it]
                                                           
{'loss': '0.1724', 'grad_norm': '1.364', 'learning_rate': '1.958e-05', 'epoch': '0.1201'}

 12%|█▏        | 4560/37963 [19:32:42<132:50:24, 14.32s/it]
 12%|█▏        | 4561/37963 [19:32:56<132:26:42, 14.27s/it]
 12%|█▏        | 4562/37963 [19:33:11<133:05:17, 14.34s/it]
 12%|█▏        | 4563/37963 [19:33:25<133:17:04, 14.37s/it]
 12%|█▏        | 4564/37963 [19:33:46<150:59:43, 16.28s/it]
 12%|█▏        | 4565/37963 [19:34:00<144:06:43, 15.53s/it]
 12%|█▏        | 4566/37963 [19:34:14<140:44:44, 15.17s/it]
 12%|█▏        | 4567/37963 [19:34:28<138:24:06, 14.92s/it]
 12%|█▏        | 4568/37963 [19:34:49<153:50:07, 16.58s/it]
 12%|█▏        | 4569/37963 [19:35:03<147:32:51, 15.91s/it]
 12%|█▏        | 4570/37963 [19:35:17<143:05:53, 15.43s/it]
                                                           
{'loss': '0.1761', 'grad_norm': '1.918', 'learning_rate': '1.957e-05', 'epoch': '0.1204'}

 12%|█▏        | 4570/37963 [19:35:17<143:05:53, 15.43s/it]
 12%|█▏        | 4571/37963 [19:35:38<157:50:07, 17.02s/it]
 12%|█▏        | 4572/37963 [19:35:52<150:17:23, 16.20s/it]
 12%|█▏        | 4573/37963 [19:36:06<143:07:33, 15.43s/it]
 12%|█▏        | 4574/37963 [19:36:20<139:51:01, 15.08s/it]
 12%|█▏        | 4575/37963 [19:36:41<155:31:06, 16.77s/it]
 12%|█▏        | 4576/37963 [19:37:02<168:24:00, 18.16s/it]
 12%|█▏        | 4577/37963 [19:37:24<176:37:23, 19.05s/it]
 12%|█▏        | 4578/37963 [19:37:38<162:25:49, 17.52s/it]
 12%|█▏        | 4579/37963 [19:37:52<153:35:05, 16.56s/it]
 12%|█▏        | 4580/37963 [19:38:06<147:41:46, 15.93s/it]
                                                           
{'loss': '0.1708', 'grad_norm': '1.9', 'learning_rate': '1.957e-05', 'epoch': '0.1206'}

 12%|█▏        | 4580/37963 [19:38:06<147:41:46, 15.93s/it]
 12%|█▏        | 4581/37963 [19:38:27<160:58:26, 17.36s/it]
 12%|█▏        | 4582/37963 [19:38:41<152:20:36, 16.43s/it]
 12%|█▏        | 4583/37963 [19:38:56<146:25:25, 15.79s/it]
 12%|█▏        | 4584/37963 [19:39:10<142:53:10, 15.41s/it]
 12%|█▏        | 4585/37963 [19:39:24<138:55:51, 14.98s/it]
 12%|█▏        | 4586/37963 [19:39:38<137:18:38, 14.81s/it]
 12%|█▏        | 4587/37963 [19:39:53<135:30:42, 14.62s/it]
 12%|█▏        | 4588/37963 [19:40:07<134:38:38, 14.52s/it]
 12%|█▏        | 4589/37963 [19:40:21<132:37:48, 14.31s/it]
 12%|█▏        | 4590/37963 [19:40:35<132:41:55, 14.31s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '2.756', 'learning_rate': '1.957e-05', 'epoch': '0.1209'}

 12%|█▏        | 4590/37963 [19:40:35<132:41:55, 14.31s/it]
 12%|█▏        | 4591/37963 [19:40:49<132:50:44, 14.33s/it]
 12%|█▏        | 4592/37963 [19:41:03<131:41:11, 14.21s/it]
 12%|█▏        | 4593/37963 [19:41:18<131:39:02, 14.20s/it]
 12%|█▏        | 4594/37963 [19:41:32<132:05:12, 14.25s/it]
 12%|█▏        | 4595/37963 [19:41:46<132:20:31, 14.28s/it]
 12%|█▏        | 4596/37963 [19:42:01<132:30:04, 14.30s/it]
 12%|█▏        | 4597/37963 [19:42:15<131:49:41, 14.22s/it]
 12%|█▏        | 4598/37963 [19:42:29<132:24:30, 14.29s/it]
 12%|█▏        | 4599/37963 [19:42:44<132:46:37, 14.33s/it]
 12%|█▏        | 4600/37963 [19:42:58<132:41:47, 14.32s/it]
                                                           
{'loss': '0.1786', 'grad_norm': '3.665', 'learning_rate': '1.957e-05', 'epoch': '0.1212'}

 12%|█▏        | 4600/37963 [19:42:58<132:41:47, 14.32s/it]
 12%|█▏        | 4601/37963 [19:43:12<132:54:44, 14.34s/it]
 12%|█▏        | 4602/37963 [19:43:27<133:07:01, 14.36s/it]
 12%|█▏        | 4603/37963 [19:43:41<132:47:50, 14.33s/it]
 12%|█▏        | 4604/37963 [19:43:55<133:15:17, 14.38s/it]
 12%|█▏        | 4605/37963 [19:44:10<133:10:29, 14.37s/it]
 12%|█▏        | 4606/37963 [19:44:24<132:47:06, 14.33s/it]
 12%|█▏        | 4607/37963 [19:44:38<132:57:13, 14.35s/it]
 12%|█▏        | 4608/37963 [19:44:53<133:17:07, 14.39s/it]
 12%|█▏        | 4609/37963 [19:45:06<131:15:13, 14.17s/it]
 12%|█▏        | 4610/37963 [19:45:27<149:33:21, 16.14s/it]
                                                           
{'loss': '0.1706', 'grad_norm': '4.369', 'learning_rate': '1.956e-05', 'epoch': '0.1214'}

 12%|█▏        | 4610/37963 [19:45:27<149:33:21, 16.14s/it]
 12%|█▏        | 4611/37963 [19:45:42<144:44:16, 15.62s/it]
 12%|█▏        | 4612/37963 [19:45:56<141:19:46, 15.26s/it]
 12%|█▏        | 4613/37963 [19:46:11<139:56:13, 15.11s/it]
 12%|█▏        | 4614/37963 [19:46:25<137:25:53, 14.84s/it]
 12%|█▏        | 4615/37963 [19:46:39<136:17:52, 14.71s/it]
 12%|█▏        | 4616/37963 [19:46:53<133:04:28, 14.37s/it]
 12%|█▏        | 4617/37963 [19:47:14<151:06:54, 16.31s/it]
 12%|█▏        | 4618/37963 [19:47:28<145:01:36, 15.66s/it]
 12%|█▏        | 4619/37963 [19:47:42<140:52:50, 15.21s/it]
 12%|█▏        | 4620/37963 [19:48:03<156:01:11, 16.85s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '2.755', 'learning_rate': '1.956e-05', 'epoch': '0.1217'}

 12%|█▏        | 4620/37963 [19:48:03<156:01:11, 16.85s/it]
 12%|█▏        | 4621/37963 [19:48:17<149:05:57, 16.10s/it]
 12%|█▏        | 4622/37963 [19:48:32<144:15:09, 15.58s/it]
 12%|█▏        | 4623/37963 [19:48:53<160:13:50, 17.30s/it]
 12%|█▏        | 4624/37963 [19:49:14<171:18:26, 18.50s/it]
 12%|█▏        | 4625/37963 [19:49:35<178:35:47, 19.29s/it]
 12%|█▏        | 4626/37963 [19:49:56<182:11:24, 19.67s/it]
 12%|█▏        | 4627/37963 [19:50:10<167:18:30, 18.07s/it]
 12%|█▏        | 4628/37963 [19:50:24<156:46:36, 16.93s/it]
 12%|█▏        | 4629/37963 [19:50:38<147:50:36, 15.97s/it]
 12%|█▏        | 4630/37963 [19:50:59<161:10:11, 17.41s/it]
                                                           
{'loss': '0.1663', 'grad_norm': '2.969', 'learning_rate': '1.956e-05', 'epoch': '0.122'}

 12%|█▏        | 4630/37963 [19:50:59<161:10:11, 17.41s/it]
 12%|█▏        | 4631/37963 [19:51:13<152:38:02, 16.49s/it]
 12%|█▏        | 4632/37963 [19:51:27<146:10:54, 15.79s/it]
 12%|█▏        | 4633/37963 [19:51:42<142:23:32, 15.38s/it]
 12%|█▏        | 4634/37963 [19:51:56<139:38:20, 15.08s/it]
 12%|█▏        | 4635/37963 [19:52:11<137:39:47, 14.87s/it]
 12%|█▏        | 4636/37963 [19:52:25<136:05:19, 14.70s/it]
 12%|█▏        | 4637/37963 [19:52:39<135:11:12, 14.60s/it]
 12%|█▏        | 4638/37963 [19:52:54<134:30:31, 14.53s/it]
 12%|█▏        | 4639/37963 [19:53:08<134:01:55, 14.48s/it]
 12%|█▏        | 4640/37963 [19:53:22<133:20:07, 14.40s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '2.036', 'learning_rate': '1.956e-05', 'epoch': '0.1222'}

 12%|█▏        | 4640/37963 [19:53:22<133:20:07, 14.40s/it]
 12%|█▏        | 4641/37963 [19:53:36<132:44:11, 14.34s/it]
 12%|█▏        | 4642/37963 [19:53:50<131:26:10, 14.20s/it]
 12%|█▏        | 4643/37963 [19:54:05<131:45:20, 14.24s/it]
 12%|█▏        | 4644/37963 [19:54:19<132:28:50, 14.31s/it]
 12%|█▏        | 4645/37963 [19:54:33<132:31:18, 14.32s/it]
 12%|█▏        | 4646/37963 [19:54:48<132:43:49, 14.34s/it]
 12%|█▏        | 4647/37963 [19:55:02<133:00:35, 14.37s/it]
 12%|█▏        | 4648/37963 [19:55:17<133:06:22, 14.38s/it]
 12%|█▏        | 4649/37963 [19:55:31<132:34:24, 14.33s/it]
 12%|█▏        | 4650/37963 [19:55:45<132:48:19, 14.35s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '2.37', 'learning_rate': '1.955e-05', 'epoch': '0.1225'}

 12%|█▏        | 4650/37963 [19:55:45<132:48:19, 14.35s/it]
 12%|█▏        | 4651/37963 [19:56:00<133:06:24, 14.38s/it]
 12%|█▏        | 4652/37963 [19:56:14<132:41:46, 14.34s/it]
 12%|█▏        | 4653/37963 [19:56:28<132:46:39, 14.35s/it]
 12%|█▏        | 4654/37963 [19:56:42<131:11:55, 14.18s/it]
 12%|█▏        | 4655/37963 [19:56:57<131:48:48, 14.25s/it]
 12%|█▏        | 4656/37963 [19:57:11<132:03:15, 14.27s/it]
 12%|█▏        | 4657/37963 [19:57:25<132:29:12, 14.32s/it]
 12%|█▏        | 4658/37963 [19:57:46<150:09:52, 16.23s/it]
 12%|█▏        | 4659/37963 [19:58:00<144:50:01, 15.66s/it]
 12%|█▏        | 4660/37963 [19:58:15<141:13:15, 15.27s/it]
                                                           
{'loss': '0.1785', 'grad_norm': '1.381', 'learning_rate': '1.955e-05', 'epoch': '0.1228'}

 12%|█▏        | 4660/37963 [19:58:15<141:13:15, 15.27s/it]
 12%|█▏        | 4661/37963 [19:58:29<139:15:21, 15.05s/it]
 12%|█▏        | 4662/37963 [19:58:44<137:06:21, 14.82s/it]
 12%|█▏        | 4663/37963 [19:58:58<136:19:43, 14.74s/it]
 12%|█▏        | 4664/37963 [19:59:12<135:05:35, 14.61s/it]
 12%|█▏        | 4665/37963 [19:59:33<152:15:30, 16.46s/it]
 12%|█▏        | 4666/37963 [19:59:47<145:35:50, 15.74s/it]
 12%|█▏        | 4667/37963 [20:00:01<140:43:08, 15.21s/it]
 12%|█▏        | 4668/37963 [20:00:16<138:17:52, 14.95s/it]
 12%|█▏        | 4669/37963 [20:00:36<154:42:14, 16.73s/it]
 12%|█▏        | 4670/37963 [20:00:51<147:51:22, 15.99s/it]
                                                           
{'loss': '0.1769', 'grad_norm': '1.694', 'learning_rate': '1.955e-05', 'epoch': '0.123'}

 12%|█▏        | 4670/37963 [20:00:51<147:51:22, 15.99s/it]
 12%|█▏        | 4671/37963 [20:01:12<162:29:59, 17.57s/it]
 12%|█▏        | 4672/37963 [20:01:26<153:33:22, 16.61s/it]
 12%|█▏        | 4673/37963 [20:01:48<167:07:14, 18.07s/it]
 12%|█▏        | 4674/37963 [20:02:02<156:54:00, 16.97s/it]
 12%|█▏        | 4675/37963 [20:02:23<168:42:16, 18.24s/it]
 12%|█▏        | 4676/37963 [20:02:37<156:58:37, 16.98s/it]
 12%|█▏        | 4677/37963 [20:02:58<168:05:34, 18.18s/it]
 12%|█▏        | 4678/37963 [20:03:13<157:53:19, 17.08s/it]
 12%|█▏        | 4679/37963 [20:03:27<150:05:53, 16.23s/it]
 12%|█▏        | 4680/37963 [20:03:42<144:52:51, 15.67s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '6.664', 'learning_rate': '1.955e-05', 'epoch': '0.1233'}

 12%|█▏        | 4680/37963 [20:03:42<144:52:51, 15.67s/it]
 12%|█▏        | 4681/37963 [20:03:56<141:17:29, 15.28s/it]
 12%|█▏        | 4682/37963 [20:04:10<138:08:04, 14.94s/it]
 12%|█▏        | 4683/37963 [20:04:24<136:21:19, 14.75s/it]
 12%|█▏        | 4684/37963 [20:04:39<135:04:44, 14.61s/it]
 12%|█▏        | 4685/37963 [20:04:53<134:12:10, 14.52s/it]
 12%|█▏        | 4686/37963 [20:05:07<132:00:21, 14.28s/it]
 12%|█▏        | 4687/37963 [20:05:21<131:27:45, 14.22s/it]
 12%|█▏        | 4688/37963 [20:05:35<131:05:03, 14.18s/it]
 12%|█▏        | 4689/37963 [20:05:49<131:47:15, 14.26s/it]
 12%|█▏        | 4690/37963 [20:06:04<131:56:33, 14.28s/it]
                                                           
{'loss': '0.1625', 'grad_norm': '1.093', 'learning_rate': '1.954e-05', 'epoch': '0.1235'}

 12%|█▏        | 4690/37963 [20:06:04<131:56:33, 14.28s/it]
 12%|█▏        | 4691/37963 [20:06:18<132:16:26, 14.31s/it]
 12%|█▏        | 4692/37963 [20:06:32<132:10:53, 14.30s/it]
 12%|█▏        | 4693/37963 [20:06:46<131:48:43, 14.26s/it]
 12%|█▏        | 4694/37963 [20:07:01<132:14:56, 14.31s/it]
 12%|█▏        | 4695/37963 [20:07:15<132:30:36, 14.34s/it]
 12%|█▏        | 4696/37963 [20:07:29<130:55:49, 14.17s/it]
 12%|█▏        | 4697/37963 [20:07:43<131:25:21, 14.22s/it]
 12%|█▏        | 4698/37963 [20:07:57<130:29:39, 14.12s/it]
 12%|█▏        | 4699/37963 [20:08:11<130:14:04, 14.09s/it]
 12%|█▏        | 4700/37963 [20:08:26<130:58:02, 14.17s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '1.47', 'learning_rate': '1.954e-05', 'epoch': '0.1238'}

 12%|█▏        | 4700/37963 [20:08:26<130:58:02, 14.17s/it]
 12%|█▏        | 4701/37963 [20:08:40<131:29:24, 14.23s/it]
 12%|█▏        | 4702/37963 [20:08:54<131:59:46, 14.29s/it]
 12%|█▏        | 4703/37963 [20:09:08<130:49:26, 14.16s/it]
 12%|█▏        | 4704/37963 [20:09:23<131:03:12, 14.19s/it]
 12%|█▏        | 4705/37963 [20:09:37<131:34:49, 14.24s/it]
 12%|█▏        | 4706/37963 [20:09:57<147:02:56, 15.92s/it]
 12%|█▏        | 4707/37963 [20:10:11<142:56:40, 15.47s/it]
 12%|█▏        | 4708/37963 [20:10:26<139:48:22, 15.13s/it]
 12%|█▏        | 4709/37963 [20:10:40<137:55:56, 14.93s/it]
 12%|█▏        | 4710/37963 [20:10:54<136:08:25, 14.74s/it]
                                                           
{'loss': '0.1717', 'grad_norm': '3.14', 'learning_rate': '1.954e-05', 'epoch': '0.1241'}

 12%|█▏        | 4710/37963 [20:10:54<136:08:25, 14.74s/it]
 12%|█▏        | 4711/37963 [20:11:08<134:31:21, 14.56s/it]
 12%|█▏        | 4712/37963 [20:11:23<133:53:02, 14.50s/it]
 12%|█▏        | 4713/37963 [20:11:37<133:24:57, 14.45s/it]
 12%|█▏        | 4714/37963 [20:11:57<148:44:24, 16.10s/it]
 12%|█▏        | 4715/37963 [20:12:12<144:01:29, 15.59s/it]
 12%|█▏        | 4716/37963 [20:12:25<139:06:05, 15.06s/it]
 12%|█▏        | 4717/37963 [20:12:40<137:06:09, 14.85s/it]
 12%|█▏        | 4718/37963 [20:13:00<151:56:08, 16.45s/it]
 12%|█▏        | 4719/37963 [20:13:14<146:33:38, 15.87s/it]
 12%|█▏        | 4720/37963 [20:13:29<141:47:19, 15.35s/it]
                                                           
{'loss': '0.1644', 'grad_norm': '4.631', 'learning_rate': '1.954e-05', 'epoch': '0.1243'}

 12%|█▏        | 4720/37963 [20:13:29<141:47:19, 15.35s/it]
 12%|█▏        | 4721/37963 [20:13:50<158:56:18, 17.21s/it]
 12%|█▏        | 4722/37963 [20:14:04<150:48:49, 16.33s/it]
 12%|█▏        | 4723/37963 [20:14:39<200:32:33, 21.72s/it]
 12%|█▏        | 4724/37963 [20:15:00<198:22:25, 21.49s/it]
 12%|█▏        | 4725/37963 [20:15:14<178:39:32, 19.35s/it]
 12%|█▏        | 4726/37963 [20:15:28<165:08:02, 17.89s/it]
 12%|█▏        | 4727/37963 [20:15:43<155:11:21, 16.81s/it]
 12%|█▏        | 4728/37963 [20:15:57<148:17:17, 16.06s/it]
 12%|█▏        | 4729/37963 [20:16:11<142:10:06, 15.40s/it]
 12%|█▏        | 4730/37963 [20:16:25<139:09:04, 15.07s/it]
                                                           
{'loss': '0.1792', 'grad_norm': '4.398', 'learning_rate': '1.953e-05', 'epoch': '0.1246'}

 12%|█▏        | 4730/37963 [20:16:25<139:09:04, 15.07s/it]
 12%|█▏        | 4731/37963 [20:16:39<136:24:39, 14.78s/it]
 12%|█▏        | 4732/37963 [20:16:54<135:08:28, 14.64s/it]
 12%|█▏        | 4733/37963 [20:17:08<134:31:26, 14.57s/it]
 12%|█▏        | 4734/37963 [20:17:22<133:50:36, 14.50s/it]
 12%|█▏        | 4735/37963 [20:17:37<133:21:25, 14.45s/it]
 12%|█▏        | 4736/37963 [20:17:51<132:23:11, 14.34s/it]
 12%|█▏        | 4737/37963 [20:18:05<131:48:22, 14.28s/it]
 12%|█▏        | 4738/37963 [20:18:19<131:49:09, 14.28s/it]
 12%|█▏        | 4739/37963 [20:18:33<131:30:20, 14.25s/it]
 12%|█▏        | 4740/37963 [20:18:48<131:44:28, 14.28s/it]
                                                           
{'loss': '0.1726', 'grad_norm': '2.738', 'learning_rate': '1.953e-05', 'epoch': '0.1249'}

 12%|█▏        | 4740/37963 [20:18:48<131:44:28, 14.28s/it]
 12%|█▏        | 4741/37963 [20:19:02<130:32:56, 14.15s/it]
 12%|█▏        | 4742/37963 [20:19:16<130:03:53, 14.09s/it]
 12%|█▏        | 4743/37963 [20:19:30<131:02:16, 14.20s/it]
 12%|█▏        | 4744/37963 [20:19:44<130:55:16, 14.19s/it]
 12%|█▏        | 4745/37963 [20:19:58<131:22:48, 14.24s/it]
 13%|█▎        | 4746/37963 [20:20:13<131:32:50, 14.26s/it]
 13%|█▎        | 4747/37963 [20:20:27<130:03:05, 14.10s/it]
 13%|█▎        | 4748/37963 [20:20:41<130:39:32, 14.16s/it]
 13%|█▎        | 4749/37963 [20:20:55<130:09:43, 14.11s/it]
 13%|█▎        | 4750/37963 [20:21:09<130:48:08, 14.18s/it]
                                                           
{'loss': '0.183', 'grad_norm': '3.922', 'learning_rate': '1.953e-05', 'epoch': '0.1251'}

 13%|█▎        | 4750/37963 [20:21:09<130:48:08, 14.18s/it]
 13%|█▎        | 4751/37963 [20:21:24<131:32:03, 14.26s/it]
 13%|█▎        | 4752/37963 [20:21:38<131:15:45, 14.23s/it]
 13%|█▎        | 4753/37963 [20:21:52<131:25:31, 14.25s/it]
 13%|█▎        | 4754/37963 [20:22:06<130:02:28, 14.10s/it]
 13%|█▎        | 4755/37963 [20:22:20<130:47:25, 14.18s/it]
 13%|█▎        | 4756/37963 [20:22:34<129:07:37, 14.00s/it]
 13%|█▎        | 4757/37963 [20:22:54<147:30:56, 15.99s/it]
 13%|█▎        | 4758/37963 [20:23:09<142:51:37, 15.49s/it]
 13%|█▎        | 4759/37963 [20:23:23<139:21:50, 15.11s/it]
 13%|█▎        | 4760/37963 [20:23:37<137:27:19, 14.90s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '2.742', 'learning_rate': '1.953e-05', 'epoch': '0.1254'}

 13%|█▎        | 4760/37963 [20:23:37<137:27:19, 14.90s/it]
 13%|█▎        | 4761/37963 [20:23:52<135:25:39, 14.68s/it]
 13%|█▎        | 4762/37963 [20:24:06<134:30:38, 14.59s/it]
 13%|█▎        | 4763/37963 [20:24:27<151:49:34, 16.46s/it]
 13%|█▎        | 4764/37963 [20:24:41<145:53:36, 15.82s/it]
 13%|█▎        | 4765/37963 [20:25:02<158:43:30, 17.21s/it]
 13%|█▎        | 4766/37963 [20:25:16<150:43:14, 16.34s/it]
 13%|█▎        | 4767/37963 [20:25:30<145:29:37, 15.78s/it]
 13%|█▎        | 4768/37963 [20:25:45<141:25:05, 15.34s/it]
 13%|█▎        | 4769/37963 [20:26:06<157:48:56, 17.12s/it]
 13%|█▎        | 4770/37963 [20:26:20<150:01:13, 16.27s/it]
                                                           
{'loss': '0.18', 'grad_norm': '2.47', 'learning_rate': '1.952e-05', 'epoch': '0.1256'}

 13%|█▎        | 4770/37963 [20:26:20<150:01:13, 16.27s/it]
 13%|█▎        | 4771/37963 [20:26:35<145:17:15, 15.76s/it]
 13%|█▎        | 4772/37963 [20:26:56<160:46:06, 17.44s/it]
 13%|█▎        | 4773/37963 [20:27:24<189:44:03, 20.58s/it]
 13%|█▎        | 4774/37963 [20:27:38<172:49:27, 18.75s/it]
 13%|█▎        | 4775/37963 [20:27:53<160:45:57, 17.44s/it]
 13%|█▎        | 4776/37963 [20:28:06<148:50:37, 16.15s/it]
 13%|█▎        | 4777/37963 [20:28:20<143:41:18, 15.59s/it]
 13%|█▎        | 4778/37963 [20:28:35<140:26:36, 15.24s/it]
 13%|█▎        | 4779/37963 [20:28:49<138:05:41, 14.98s/it]
 13%|█▎        | 4780/37963 [20:29:04<136:38:52, 14.82s/it]
                                                           
{'loss': '0.1707', 'grad_norm': '2.377', 'learning_rate': '1.952e-05', 'epoch': '0.1259'}

 13%|█▎        | 4780/37963 [20:29:04<136:38:52, 14.82s/it]
 13%|█▎        | 4781/37963 [20:29:18<135:33:17, 14.71s/it]
 13%|█▎        | 4782/37963 [20:29:32<132:55:33, 14.42s/it]
 13%|█▎        | 4783/37963 [20:29:46<132:33:31, 14.38s/it]
 13%|█▎        | 4784/37963 [20:30:00<131:31:17, 14.27s/it]
 13%|█▎        | 4785/37963 [20:30:14<131:44:44, 14.30s/it]
 13%|█▎        | 4786/37963 [20:30:29<131:51:03, 14.31s/it]
 13%|█▎        | 4787/37963 [20:30:43<130:32:33, 14.17s/it]
 13%|█▎        | 4788/37963 [20:30:56<129:52:22, 14.09s/it]
 13%|█▎        | 4789/37963 [20:31:11<130:12:34, 14.13s/it]
 13%|█▎        | 4790/37963 [20:31:25<130:49:50, 14.20s/it]
                                                           
{'loss': '0.1714', 'grad_norm': '2.563', 'learning_rate': '1.952e-05', 'epoch': '0.1262'}

 13%|█▎        | 4790/37963 [20:31:25<130:49:50, 14.20s/it]
 13%|█▎        | 4791/37963 [20:31:39<131:28:11, 14.27s/it]
 13%|█▎        | 4792/37963 [20:31:54<131:30:36, 14.27s/it]
 13%|█▎        | 4793/37963 [20:32:08<131:32:44, 14.28s/it]
 13%|█▎        | 4794/37963 [20:32:22<131:12:03, 14.24s/it]
 13%|█▎        | 4795/37963 [20:32:37<131:31:09, 14.27s/it]
 13%|█▎        | 4796/37963 [20:32:50<130:26:59, 14.16s/it]
 13%|█▎        | 4797/37963 [20:33:05<130:48:13, 14.20s/it]
 13%|█▎        | 4798/37963 [20:33:19<131:23:44, 14.26s/it]
 13%|█▎        | 4799/37963 [20:33:33<131:31:55, 14.28s/it]
 13%|█▎        | 4800/37963 [20:33:48<131:45:09, 14.30s/it]
                                                           
{'loss': '0.1676', 'grad_norm': '1.468', 'learning_rate': '1.952e-05', 'epoch': '0.1264'}

 13%|█▎        | 4800/37963 [20:33:48<131:45:09, 14.30s/it]
 13%|█▎        | 4801/37963 [20:34:02<130:58:15, 14.22s/it]
 13%|█▎        | 4802/37963 [20:34:16<131:02:22, 14.23s/it]
 13%|█▎        | 4803/37963 [20:34:30<131:20:31, 14.26s/it]
 13%|█▎        | 4804/37963 [20:34:45<131:28:57, 14.27s/it]
 13%|█▎        | 4805/37963 [20:34:59<131:05:38, 14.23s/it]
 13%|█▎        | 4806/37963 [20:35:13<131:14:34, 14.25s/it]
 13%|█▎        | 4807/37963 [20:35:34<149:10:33, 16.20s/it]
 13%|█▎        | 4808/37963 [20:35:48<143:44:35, 15.61s/it]
 13%|█▎        | 4809/37963 [20:36:02<139:14:33, 15.12s/it]
 13%|█▎        | 4810/37963 [20:36:16<136:06:05, 14.78s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '2.117', 'learning_rate': '1.951e-05', 'epoch': '0.1267'}

 13%|█▎        | 4810/37963 [20:36:16<136:06:05, 14.78s/it]
 13%|█▎        | 4811/37963 [20:36:37<152:43:19, 16.58s/it]
 13%|█▎        | 4812/37963 [20:36:51<146:40:50, 15.93s/it]
 13%|█▎        | 4813/37963 [20:37:12<159:58:57, 17.37s/it]
 13%|█▎        | 4814/37963 [20:37:26<151:49:19, 16.49s/it]
 13%|█▎        | 4815/37963 [20:37:41<146:57:58, 15.96s/it]
 13%|█▎        | 4816/37963 [20:37:56<142:33:16, 15.48s/it]
 13%|█▎        | 4817/37963 [20:38:10<139:31:08, 15.15s/it]
 13%|█▎        | 4818/37963 [20:38:31<156:16:03, 16.97s/it]
 13%|█▎        | 4819/37963 [20:38:46<149:12:04, 16.21s/it]
 13%|█▎        | 4820/37963 [20:39:13<179:21:43, 19.48s/it]
                                                           
{'loss': '0.1831', 'grad_norm': '1.377', 'learning_rate': '1.951e-05', 'epoch': '0.127'}

 13%|█▎        | 4820/37963 [20:39:13<179:21:43, 19.48s/it]
 13%|█▎        | 4821/37963 [20:39:34<183:18:40, 19.91s/it]
 13%|█▎        | 4822/37963 [20:39:48<168:11:37, 18.27s/it]
 13%|█▎        | 4823/37963 [20:40:09<176:08:48, 19.13s/it]
 13%|█▎        | 4824/37963 [20:40:23<162:39:25, 17.67s/it]
 13%|█▎        | 4825/37963 [20:40:37<151:32:03, 16.46s/it]
 13%|█▎        | 4826/37963 [20:40:51<145:09:13, 15.77s/it]
 13%|█▎        | 4827/37963 [20:41:06<141:08:24, 15.33s/it]
 13%|█▎        | 4828/37963 [20:41:20<138:40:31, 15.07s/it]
 13%|█▎        | 4829/37963 [20:41:34<135:48:42, 14.76s/it]
 13%|█▎        | 4830/37963 [20:41:48<134:15:21, 14.59s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '2.019', 'learning_rate': '1.951e-05', 'epoch': '0.1272'}

 13%|█▎        | 4830/37963 [20:41:48<134:15:21, 14.59s/it]
 13%|█▎        | 4831/37963 [20:42:03<133:30:37, 14.51s/it]
 13%|█▎        | 4832/37963 [20:42:17<133:36:54, 14.52s/it]
 13%|█▎        | 4833/37963 [20:42:31<133:03:25, 14.46s/it]
 13%|█▎        | 4834/37963 [20:42:45<131:08:54, 14.25s/it]
 13%|█▎        | 4835/37963 [20:42:59<129:44:58, 14.10s/it]
 13%|█▎        | 4836/37963 [20:43:13<129:51:00, 14.11s/it]
 13%|█▎        | 4837/37963 [20:43:27<130:33:21, 14.19s/it]
 13%|█▎        | 4838/37963 [20:43:42<131:03:34, 14.24s/it]
 13%|█▎        | 4839/37963 [20:43:56<129:36:39, 14.09s/it]
 13%|█▎        | 4840/37963 [20:44:10<130:43:01, 14.21s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '1.316', 'learning_rate': '1.951e-05', 'epoch': '0.1275'}

 13%|█▎        | 4840/37963 [20:44:10<130:43:01, 14.21s/it]
 13%|█▎        | 4841/37963 [20:44:24<130:50:28, 14.22s/it]
 13%|█▎        | 4842/37963 [20:44:39<131:08:01, 14.25s/it]
 13%|█▎        | 4843/37963 [20:44:53<131:22:07, 14.28s/it]
 13%|█▎        | 4844/37963 [20:45:07<130:00:44, 14.13s/it]
 13%|█▎        | 4845/37963 [20:45:21<130:03:16, 14.14s/it]
 13%|█▎        | 4846/37963 [20:45:35<129:43:32, 14.10s/it]
 13%|█▎        | 4847/37963 [20:45:49<129:57:24, 14.13s/it]
 13%|█▎        | 4848/37963 [20:46:03<130:45:52, 14.22s/it]
 13%|█▎        | 4849/37963 [20:46:18<130:59:28, 14.24s/it]
 13%|█▎        | 4850/37963 [20:46:32<130:16:23, 14.16s/it]
                                                           
{'loss': '0.1702', 'grad_norm': '1.244', 'learning_rate': '1.95e-05', 'epoch': '0.1278'}

 13%|█▎        | 4850/37963 [20:46:32<130:16:23, 14.16s/it]
 13%|█▎        | 4851/37963 [20:46:46<130:33:41, 14.19s/it]
 13%|█▎        | 4852/37963 [20:47:00<131:13:12, 14.27s/it]
 13%|█▎        | 4853/37963 [20:47:15<130:49:00, 14.22s/it]
 13%|█▎        | 4854/37963 [20:47:35<148:53:01, 16.19s/it]
 13%|█▎        | 4855/37963 [20:47:50<143:53:12, 15.65s/it]
 13%|█▎        | 4856/37963 [20:48:04<140:20:59, 15.26s/it]
 13%|█▎        | 4857/37963 [20:48:19<138:15:23, 15.03s/it]
 13%|█▎        | 4858/37963 [20:48:33<136:11:04, 14.81s/it]
 13%|█▎        | 4859/37963 [20:48:47<133:31:58, 14.52s/it]
 13%|█▎        | 4860/37963 [20:49:07<148:33:41, 16.16s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '2.495', 'learning_rate': '1.95e-05', 'epoch': '0.128'}

 13%|█▎        | 4860/37963 [20:49:07<148:33:41, 16.16s/it]
 13%|█▎        | 4861/37963 [20:49:27<161:02:50, 17.51s/it]
 13%|█▎        | 4862/37963 [20:49:42<152:25:02, 16.58s/it]
 13%|█▎        | 4863/37963 [20:49:55<144:26:59, 15.71s/it]
 13%|█▎        | 4864/37963 [20:50:10<141:00:07, 15.34s/it]
 13%|█▎        | 4865/37963 [20:50:24<138:26:12, 15.06s/it]
 13%|█▎        | 4866/37963 [20:50:39<136:29:37, 14.85s/it]
 13%|█▎        | 4867/37963 [20:51:06<170:59:05, 18.60s/it]
 13%|█▎        | 4868/37963 [20:51:27<177:40:13, 19.33s/it]
 13%|█▎        | 4869/37963 [20:51:47<179:55:25, 19.57s/it]
 13%|█▎        | 4870/37963 [20:52:01<164:58:59, 17.95s/it]
                                                           
{'loss': '0.1725', 'grad_norm': '1.226', 'learning_rate': '1.95e-05', 'epoch': '0.1283'}

 13%|█▎        | 4870/37963 [20:52:01<164:58:59, 17.95s/it]
 13%|█▎        | 4871/37963 [20:52:16<154:54:31, 16.85s/it]
 13%|█▎        | 4872/37963 [20:52:37<167:18:08, 18.20s/it]
 13%|█▎        | 4873/37963 [20:52:51<156:44:40, 17.05s/it]
 13%|█▎        | 4874/37963 [20:53:06<149:05:28, 16.22s/it]
 13%|█▎        | 4875/37963 [20:53:20<142:38:53, 15.52s/it]
 13%|█▎        | 4876/37963 [20:53:34<139:32:05, 15.18s/it]
 13%|█▎        | 4877/37963 [20:53:48<137:22:03, 14.95s/it]
 13%|█▎        | 4878/37963 [20:54:03<135:45:40, 14.77s/it]
 13%|█▎        | 4879/37963 [20:54:17<134:35:41, 14.65s/it]
 13%|█▎        | 4880/37963 [20:54:31<133:47:01, 14.56s/it]
                                                           
{'loss': '0.1648', 'grad_norm': '4.724', 'learning_rate': '1.95e-05', 'epoch': '0.1285'}

 13%|█▎        | 4880/37963 [20:54:31<133:47:01, 14.56s/it]
 13%|█▎        | 4881/37963 [20:54:46<133:07:05, 14.49s/it]
 13%|█▎        | 4882/37963 [20:55:00<132:53:48, 14.46s/it]
 13%|█▎        | 4883/37963 [20:55:14<132:11:46, 14.39s/it]
 13%|█▎        | 4884/37963 [20:55:29<131:57:14, 14.36s/it]
 13%|█▎        | 4885/37963 [20:55:43<132:08:04, 14.38s/it]
 13%|█▎        | 4886/37963 [20:55:57<130:54:09, 14.25s/it]
 13%|█▎        | 4887/37963 [20:56:12<131:31:45, 14.32s/it]
 13%|█▎        | 4888/37963 [20:56:25<129:33:33, 14.10s/it]
 13%|█▎        | 4889/37963 [20:56:39<129:23:56, 14.08s/it]
 13%|█▎        | 4890/37963 [20:56:54<130:08:33, 14.17s/it]
                                                           
{'loss': '0.1806', 'grad_norm': '2.829', 'learning_rate': '1.949e-05', 'epoch': '0.1288'}

 13%|█▎        | 4890/37963 [20:56:54<130:08:33, 14.17s/it]
 13%|█▎        | 4891/37963 [20:57:08<129:57:18, 14.15s/it]
 13%|█▎        | 4892/37963 [20:57:22<130:21:03, 14.19s/it]
 13%|█▎        | 4893/37963 [20:57:36<130:56:55, 14.26s/it]
 13%|█▎        | 4894/37963 [20:57:51<131:35:35, 14.33s/it]
 13%|█▎        | 4895/37963 [20:58:05<131:57:46, 14.37s/it]
 13%|█▎        | 4896/37963 [20:58:20<131:59:04, 14.37s/it]
 13%|█▎        | 4897/37963 [20:58:34<131:56:51, 14.37s/it]
 13%|█▎        | 4898/37963 [20:58:48<130:20:14, 14.19s/it]
 13%|█▎        | 4899/37963 [20:59:02<130:49:47, 14.24s/it]
 13%|█▎        | 4900/37963 [20:59:17<131:08:48, 14.28s/it]
                                                           
{'loss': '0.175', 'grad_norm': '4.333', 'learning_rate': '1.949e-05', 'epoch': '0.1291'}

 13%|█▎        | 4900/37963 [20:59:17<131:08:48, 14.28s/it]
 13%|█▎        | 4901/37963 [20:59:30<129:48:50, 14.13s/it]
 13%|█▎        | 4902/37963 [20:59:45<130:34:37, 14.22s/it]
 13%|█▎        | 4903/37963 [21:00:05<148:18:28, 16.15s/it]
 13%|█▎        | 4904/37963 [21:00:20<143:18:22, 15.61s/it]
 13%|█▎        | 4905/37963 [21:00:34<139:44:36, 15.22s/it]
 13%|█▎        | 4906/37963 [21:00:48<137:19:40, 14.96s/it]
 13%|█▎        | 4907/37963 [21:01:09<153:24:06, 16.71s/it]
 13%|█▎        | 4908/37963 [21:01:23<146:44:53, 15.98s/it]
 13%|█▎        | 4909/37963 [21:01:38<142:14:12, 15.49s/it]
 13%|█▎        | 4910/37963 [21:01:58<155:40:53, 16.96s/it]
                                                           
{'loss': '0.1706', 'grad_norm': '3.755', 'learning_rate': '1.949e-05', 'epoch': '0.1293'}

 13%|█▎        | 4910/37963 [21:01:58<155:40:53, 16.96s/it]
 13%|█▎        | 4911/37963 [21:02:12<147:58:35, 16.12s/it]
 13%|█▎        | 4912/37963 [21:02:27<142:57:19, 15.57s/it]
 13%|█▎        | 4913/37963 [21:02:41<139:54:52, 15.24s/it]
 13%|█▎        | 4914/37963 [21:03:02<155:33:14, 16.94s/it]
 13%|█▎        | 4915/37963 [21:03:23<167:35:28, 18.26s/it]
 13%|█▎        | 4916/37963 [21:03:38<156:32:09, 17.05s/it]
 13%|█▎        | 4917/37963 [21:03:52<149:11:57, 16.25s/it]
 13%|█▎        | 4918/37963 [21:04:20<180:32:02, 19.67s/it]
 13%|█▎        | 4919/37963 [21:04:34<166:13:12, 18.11s/it]
 13%|█▎        | 4920/37963 [21:04:48<156:00:35, 17.00s/it]
                                                           
{'loss': '0.1756', 'grad_norm': '6.286', 'learning_rate': '1.948e-05', 'epoch': '0.1296'}

 13%|█▎        | 4920/37963 [21:04:48<156:00:35, 17.00s/it]
 13%|█▎        | 4921/37963 [21:05:09<166:09:31, 18.10s/it]
 13%|█▎        | 4922/37963 [21:05:24<155:49:11, 16.98s/it]
 13%|█▎        | 4923/37963 [21:05:38<148:18:42, 16.16s/it]
 13%|█▎        | 4924/37963 [21:05:52<143:20:18, 15.62s/it]
 13%|█▎        | 4925/37963 [21:06:07<140:03:01, 15.26s/it]
 13%|█▎        | 4926/37963 [21:06:21<137:45:25, 15.01s/it]
 13%|█▎        | 4927/37963 [21:06:35<135:58:39, 14.82s/it]
 13%|█▎        | 4928/37963 [21:06:50<134:41:49, 14.68s/it]
 13%|█▎        | 4929/37963 [21:07:04<133:48:43, 14.58s/it]
 13%|█▎        | 4930/37963 [21:07:18<131:41:53, 14.35s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '5.205', 'learning_rate': '1.948e-05', 'epoch': '0.1299'}

 13%|█▎        | 4930/37963 [21:07:18<131:41:53, 14.35s/it]
 13%|█▎        | 4931/37963 [21:07:32<131:28:49, 14.33s/it]
 13%|█▎        | 4932/37963 [21:07:47<131:32:25, 14.34s/it]
 13%|█▎        | 4933/37963 [21:08:01<131:27:45, 14.33s/it]
 13%|█▎        | 4934/37963 [21:08:15<129:54:25, 14.16s/it]
 13%|█▎        | 4935/37963 [21:08:29<130:22:25, 14.21s/it]
 13%|█▎        | 4936/37963 [21:08:43<130:48:23, 14.26s/it]
 13%|█▎        | 4937/37963 [21:08:57<130:28:16, 14.22s/it]
 13%|█▎        | 4938/37963 [21:09:12<130:38:38, 14.24s/it]
 13%|█▎        | 4939/37963 [21:09:26<130:33:31, 14.23s/it]
 13%|█▎        | 4940/37963 [21:09:40<130:56:01, 14.27s/it]
                                                           
{'loss': '0.1602', 'grad_norm': '1.664', 'learning_rate': '1.948e-05', 'epoch': '0.1301'}

 13%|█▎        | 4940/37963 [21:09:40<130:56:01, 14.27s/it]
 13%|█▎        | 4941/37963 [21:09:55<130:58:04, 14.28s/it]
 13%|█▎        | 4942/37963 [21:10:09<130:17:23, 14.20s/it]
 13%|█▎        | 4943/37963 [21:10:23<130:55:01, 14.27s/it]
 13%|█▎        | 4944/37963 [21:10:38<131:40:07, 14.36s/it]
 13%|█▎        | 4945/37963 [21:10:52<131:34:54, 14.35s/it]
 13%|█▎        | 4946/37963 [21:11:06<131:32:30, 14.34s/it]
 13%|█▎        | 4947/37963 [21:11:21<131:28:48, 14.34s/it]
 13%|█▎        | 4948/37963 [21:11:35<131:19:26, 14.32s/it]
 13%|█▎        | 4949/37963 [21:11:49<131:12:41, 14.31s/it]
 13%|█▎        | 4950/37963 [21:12:04<131:24:59, 14.33s/it]
                                                           
{'loss': '0.168', 'grad_norm': '1.003', 'learning_rate': '1.948e-05', 'epoch': '0.1304'}

 13%|█▎        | 4950/37963 [21:12:04<131:24:59, 14.33s/it]
 13%|█▎        | 4951/37963 [21:12:18<131:03:33, 14.29s/it]
 13%|█▎        | 4952/37963 [21:12:32<131:17:25, 14.32s/it]
 13%|█▎        | 4953/37963 [21:12:53<148:54:28, 16.24s/it]
 13%|█▎        | 4954/37963 [21:13:07<143:39:09, 15.67s/it]
 13%|█▎        | 4955/37963 [21:13:21<139:44:54, 15.24s/it]
 13%|█▎        | 4956/37963 [21:13:42<155:34:16, 16.97s/it]
 13%|█▎        | 4957/37963 [21:14:03<166:14:27, 18.13s/it]
 13%|█▎        | 4958/37963 [21:14:18<155:51:43, 17.00s/it]
 13%|█▎        | 4959/37963 [21:14:32<149:03:55, 16.26s/it]
 13%|█▎        | 4960/37963 [21:14:46<143:44:53, 15.68s/it]
                                                           
{'loss': '0.1747', 'grad_norm': '1.304', 'learning_rate': '1.947e-05', 'epoch': '0.1307'}

 13%|█▎        | 4960/37963 [21:14:46<143:44:53, 15.68s/it]
 13%|█▎        | 4961/37963 [21:15:07<158:05:36, 17.25s/it]
 13%|█▎        | 4962/37963 [21:15:22<149:57:20, 16.36s/it]
 13%|█▎        | 4963/37963 [21:15:36<143:13:15, 15.62s/it]
 13%|█▎        | 4964/37963 [21:15:49<138:14:59, 15.08s/it]
 13%|█▎        | 4965/37963 [21:16:11<155:21:30, 16.95s/it]
 13%|█▎        | 4966/37963 [21:16:32<166:53:04, 18.21s/it]
 13%|█▎        | 4967/37963 [21:16:52<173:31:20, 18.93s/it]
 13%|█▎        | 4968/37963 [21:17:07<161:06:22, 17.58s/it]
 13%|█▎        | 4969/37963 [21:17:28<170:16:51, 18.58s/it]
 13%|█▎        | 4970/37963 [21:17:42<158:07:41, 17.25s/it]
                                                           
{'loss': '0.1765', 'grad_norm': '5.66', 'learning_rate': '1.947e-05', 'epoch': '0.1309'}

 13%|█▎        | 4970/37963 [21:17:42<158:07:41, 17.25s/it]
 13%|█▎        | 4971/37963 [21:17:56<149:21:16, 16.30s/it]
 13%|█▎        | 4972/37963 [21:18:10<144:16:26, 15.74s/it]
 13%|█▎        | 4973/37963 [21:18:25<139:49:31, 15.26s/it]
 13%|█▎        | 4974/37963 [21:18:39<137:27:22, 15.00s/it]
 13%|█▎        | 4975/37963 [21:18:53<134:54:05, 14.72s/it]
 13%|█▎        | 4976/37963 [21:19:07<133:44:12, 14.60s/it]
 13%|█▎        | 4977/37963 [21:19:22<133:05:23, 14.53s/it]
 13%|█▎        | 4978/37963 [21:19:36<131:11:42, 14.32s/it]
 13%|█▎        | 4979/37963 [21:19:50<131:37:46, 14.37s/it]
 13%|█▎        | 4980/37963 [21:20:04<130:20:01, 14.23s/it]
                                                           
{'loss': '0.1758', 'grad_norm': '2.308', 'learning_rate': '1.947e-05', 'epoch': '0.1312'}

 13%|█▎        | 4980/37963 [21:20:04<130:20:01, 14.23s/it]
 13%|█▎        | 4981/37963 [21:20:18<130:38:06, 14.26s/it]
 13%|█▎        | 4982/37963 [21:20:32<130:27:34, 14.24s/it]
 13%|█▎        | 4983/37963 [21:20:47<130:54:14, 14.29s/it]
 13%|█▎        | 4984/37963 [21:21:01<130:56:18, 14.29s/it]
 13%|█▎        | 4985/37963 [21:21:15<131:00:54, 14.30s/it]
 13%|█▎        | 4986/37963 [21:21:29<130:11:26, 14.21s/it]
 13%|█▎        | 4987/37963 [21:21:43<128:53:04, 14.07s/it]
 13%|█▎        | 4988/37963 [21:21:58<129:39:06, 14.15s/it]
 13%|█▎        | 4989/37963 [21:22:12<130:22:13, 14.23s/it]
 13%|█▎        | 4990/37963 [21:22:26<130:48:11, 14.28s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '3.883', 'learning_rate': '1.947e-05', 'epoch': '0.1314'}

 13%|█▎        | 4990/37963 [21:22:26<130:48:11, 14.28s/it]
 13%|█▎        | 4991/37963 [21:22:41<130:50:49, 14.29s/it]
 13%|█▎        | 4992/37963 [21:22:55<130:38:23, 14.26s/it]
 13%|█▎        | 4993/37963 [21:23:09<130:55:30, 14.30s/it]
 13%|█▎        | 4994/37963 [21:23:23<129:32:52, 14.15s/it]
 13%|█▎        | 4995/37963 [21:23:37<129:36:27, 14.15s/it]
 13%|█▎        | 4996/37963 [21:23:51<129:00:41, 14.09s/it]
 13%|█▎        | 4997/37963 [21:24:06<129:52:15, 14.18s/it]
 13%|█▎        | 4998/37963 [21:24:20<129:45:45, 14.17s/it]
 13%|█▎        | 4999/37963 [21:24:34<130:08:14, 14.21s/it]
 13%|█▎        | 5000/37963 [21:24:48<130:35:29, 14.26s/it]
                                                           
{'loss': '0.1723', 'grad_norm': '0.9636', 'learning_rate': '1.946e-05', 'epoch': '0.1317'}

 13%|█▎        | 5000/37963 [21:24:48<130:35:29, 14.26s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:17<00:00, 17.92s/it]
Writing model shards: 100%|██████████| 1/1 [00:17<00:00, 17.92s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 13%|█▎        | 5001/37963 [21:26:42<403:22:57, 44.06s/it]
 13%|█▎        | 5002/37963 [21:27:03<340:06:36, 37.15s/it]
 13%|█▎        | 5003/37963 [21:27:17<276:58:11, 30.25s/it]
 13%|█▎        | 5004/37963 [21:27:32<233:28:17, 25.50s/it]
 13%|█▎        | 5005/37963 [21:27:52<220:02:46, 24.04s/it]
 13%|█▎        | 5006/37963 [21:28:06<192:15:18, 21.00s/it]
 13%|█▎        | 5007/37963 [21:28:27<191:42:23, 20.94s/it]
 13%|█▎        | 5008/37963 [21:28:41<173:31:58, 18.96s/it]
 13%|█▎        | 5009/37963 [21:28:56<160:55:48, 17.58s/it]
 13%|█▎        | 5010/37963 [21:29:10<152:09:45, 16.62s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '2.547', 'learning_rate': '1.946e-05', 'epoch': '0.132'}

 13%|█▎        | 5010/37963 [21:29:10<152:09:45, 16.62s/it]
 13%|█▎        | 5011/37963 [21:29:31<163:48:47, 17.90s/it]
 13%|█▎        | 5012/37963 [21:29:45<154:09:54, 16.84s/it]
 13%|█▎        | 5013/37963 [21:30:14<185:27:27, 20.26s/it]
 13%|█▎        | 5014/37963 [21:30:28<169:06:52, 18.48s/it]
 13%|█▎        | 5015/37963 [21:30:48<173:32:28, 18.96s/it]
 13%|█▎        | 5016/37963 [21:31:09<178:25:04, 19.50s/it]
 13%|█▎        | 5017/37963 [21:31:23<164:27:38, 17.97s/it]
 13%|█▎        | 5018/37963 [21:31:37<152:57:06, 16.71s/it]
 13%|█▎        | 5019/37963 [21:31:51<146:33:32, 16.02s/it]
 13%|█▎        | 5020/37963 [21:32:06<142:04:54, 15.53s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '1.165', 'learning_rate': '1.946e-05', 'epoch': '0.1322'}

 13%|█▎        | 5020/37963 [21:32:06<142:04:54, 15.53s/it]
 13%|█▎        | 5021/37963 [21:32:20<138:36:17, 15.15s/it]
 13%|█▎        | 5022/37963 [21:32:34<136:11:32, 14.88s/it]
 13%|█▎        | 5023/37963 [21:32:48<134:08:22, 14.66s/it]
 13%|█▎        | 5024/37963 [21:33:03<133:34:49, 14.60s/it]
 13%|█▎        | 5025/37963 [21:33:17<132:25:39, 14.47s/it]
 13%|█▎        | 5026/37963 [21:33:31<132:03:50, 14.43s/it]
 13%|█▎        | 5027/37963 [21:33:46<131:53:22, 14.42s/it]
 13%|█▎        | 5028/37963 [21:34:00<130:47:47, 14.30s/it]
 13%|█▎        | 5029/37963 [21:34:14<131:01:03, 14.32s/it]
 13%|█▎        | 5030/37963 [21:34:28<131:16:19, 14.35s/it]
                                                           
{'loss': '0.1811', 'grad_norm': '4.119', 'learning_rate': '1.945e-05', 'epoch': '0.1325'}

 13%|█▎        | 5030/37963 [21:34:28<131:16:19, 14.35s/it]
 13%|█▎        | 5031/37963 [21:34:43<132:17:18, 14.46s/it]
 13%|█▎        | 5032/37963 [21:34:58<131:57:05, 14.42s/it]
 13%|█▎        | 5033/37963 [21:35:12<131:32:35, 14.38s/it]
 13%|█▎        | 5034/37963 [21:35:26<131:17:15, 14.35s/it]
 13%|█▎        | 5035/37963 [21:35:41<131:29:25, 14.38s/it]
 13%|█▎        | 5036/37963 [21:35:55<131:52:54, 14.42s/it]
 13%|█▎        | 5037/37963 [21:36:09<131:28:56, 14.38s/it]
 13%|█▎        | 5038/37963 [21:36:24<131:26:14, 14.37s/it]
 13%|█▎        | 5039/37963 [21:36:38<130:52:13, 14.31s/it]
 13%|█▎        | 5040/37963 [21:36:51<128:47:15, 14.08s/it]
                                                           
{'loss': '0.1744', 'grad_norm': '1.519', 'learning_rate': '1.945e-05', 'epoch': '0.1328'}

 13%|█▎        | 5040/37963 [21:36:51<128:47:15, 14.08s/it]
 13%|█▎        | 5041/37963 [21:37:06<129:36:21, 14.17s/it]
 13%|█▎        | 5042/37963 [21:37:20<128:39:25, 14.07s/it]
 13%|█▎        | 5043/37963 [21:37:34<129:53:49, 14.21s/it]
 13%|█▎        | 5044/37963 [21:37:48<130:14:34, 14.24s/it]
 13%|█▎        | 5045/37963 [21:38:02<128:55:22, 14.10s/it]
 13%|█▎        | 5046/37963 [21:38:16<129:01:52, 14.11s/it]
 13%|█▎        | 5047/37963 [21:38:31<129:39:37, 14.18s/it]
 13%|█▎        | 5048/37963 [21:38:45<130:02:51, 14.22s/it]
 13%|█▎        | 5049/37963 [21:38:59<130:17:12, 14.25s/it]
 13%|█▎        | 5050/37963 [21:39:14<130:32:58, 14.28s/it]
                                                           
{'loss': '0.1791', 'grad_norm': '1.958', 'learning_rate': '1.945e-05', 'epoch': '0.133'}

 13%|█▎        | 5050/37963 [21:39:14<130:32:58, 14.28s/it]
 13%|█▎        | 5051/37963 [21:39:28<131:07:03, 14.34s/it]
 13%|█▎        | 5052/37963 [21:39:49<148:31:39, 16.25s/it]
 13%|█▎        | 5053/37963 [21:40:03<143:03:37, 15.65s/it]
 13%|█▎        | 5054/37963 [21:40:17<138:33:19, 15.16s/it]
 13%|█▎        | 5055/37963 [21:40:44<171:03:58, 18.71s/it]
 13%|█▎        | 5056/37963 [21:40:58<157:28:50, 17.23s/it]
 13%|█▎        | 5057/37963 [21:41:12<149:01:28, 16.30s/it]
 13%|█▎        | 5058/37963 [21:41:33<161:42:39, 17.69s/it]
 13%|█▎        | 5059/37963 [21:41:47<152:32:58, 16.69s/it]
 13%|█▎        | 5060/37963 [21:42:02<146:29:52, 16.03s/it]
                                                           
{'loss': '0.1638', 'grad_norm': '1.785', 'learning_rate': '1.945e-05', 'epoch': '0.1333'}

 13%|█▎        | 5060/37963 [21:42:02<146:29:52, 16.03s/it]
 13%|█▎        | 5061/37963 [21:42:16<141:55:20, 15.53s/it]
 13%|█▎        | 5062/37963 [21:42:38<158:10:53, 17.31s/it]
 13%|█▎        | 5063/37963 [21:42:59<168:53:37, 18.48s/it]
 13%|█▎        | 5064/37963 [21:43:20<175:26:45, 19.20s/it]
 13%|█▎        | 5065/37963 [21:43:34<162:04:10, 17.74s/it]
 13%|█▎        | 5066/37963 [21:43:48<151:35:23, 16.59s/it]
 13%|█▎        | 5067/37963 [21:44:02<145:21:45, 15.91s/it]
 13%|█▎        | 5068/37963 [21:44:17<141:07:47, 15.45s/it]
 13%|█▎        | 5069/37963 [21:44:31<137:43:11, 15.07s/it]
 13%|█▎        | 5070/37963 [21:44:45<136:05:46, 14.90s/it]
                                                           
{'loss': '0.1524', 'grad_norm': '1.756', 'learning_rate': '1.944e-05', 'epoch': '0.1336'}

 13%|█▎        | 5070/37963 [21:44:45<136:05:46, 14.90s/it]
 13%|█▎        | 5071/37963 [21:45:00<134:34:26, 14.73s/it]
 13%|█▎        | 5072/37963 [21:45:14<133:37:33, 14.63s/it]
 13%|█▎        | 5073/37963 [21:45:29<133:19:31, 14.59s/it]
 13%|█▎        | 5074/37963 [21:45:43<132:32:24, 14.51s/it]
 13%|█▎        | 5075/37963 [21:45:57<132:03:29, 14.46s/it]
 13%|█▎        | 5076/37963 [21:46:12<131:47:03, 14.43s/it]
 13%|█▎        | 5077/37963 [21:46:26<131:28:30, 14.39s/it]
 13%|█▎        | 5078/37963 [21:46:40<131:21:25, 14.38s/it]
 13%|█▎        | 5079/37963 [21:46:54<130:18:31, 14.27s/it]
 13%|█▎        | 5080/37963 [21:47:08<129:55:05, 14.22s/it]
                                                           
{'loss': '0.1739', 'grad_norm': '2.435', 'learning_rate': '1.944e-05', 'epoch': '0.1338'}

 13%|█▎        | 5080/37963 [21:47:08<129:55:05, 14.22s/it]
 13%|█▎        | 5081/37963 [21:47:22<128:00:22, 14.01s/it]
 13%|█▎        | 5082/37963 [21:47:37<129:46:07, 14.21s/it]
 13%|█▎        | 5083/37963 [21:47:51<130:17:58, 14.27s/it]
 13%|█▎        | 5084/37963 [21:48:05<129:18:20, 14.16s/it]
 13%|█▎        | 5085/37963 [21:48:19<128:58:09, 14.12s/it]
 13%|█▎        | 5086/37963 [21:48:33<129:37:15, 14.19s/it]
 13%|█▎        | 5087/37963 [21:48:48<130:03:10, 14.24s/it]
 13%|█▎        | 5088/37963 [21:49:02<130:22:15, 14.28s/it]
 13%|█▎        | 5089/37963 [21:49:16<130:17:22, 14.27s/it]
 13%|█▎        | 5090/37963 [21:49:31<130:21:45, 14.28s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '1.723', 'learning_rate': '1.944e-05', 'epoch': '0.1341'}

 13%|█▎        | 5090/37963 [21:49:31<130:21:45, 14.28s/it]
 13%|█▎        | 5091/37963 [21:49:45<130:23:43, 14.28s/it]
 13%|█▎        | 5092/37963 [21:49:59<130:52:34, 14.33s/it]
 13%|█▎        | 5093/37963 [21:50:13<130:27:22, 14.29s/it]
 13%|█▎        | 5094/37963 [21:50:28<130:39:44, 14.31s/it]
 13%|█▎        | 5095/37963 [21:50:42<131:04:01, 14.36s/it]
 13%|█▎        | 5096/37963 [21:50:57<130:59:16, 14.35s/it]
 13%|█▎        | 5097/37963 [21:51:11<131:02:00, 14.35s/it]
 13%|█▎        | 5098/37963 [21:51:25<130:45:56, 14.32s/it]
 13%|█▎        | 5099/37963 [21:51:40<130:48:20, 14.33s/it]
 13%|█▎        | 5100/37963 [21:52:01<149:11:05, 16.34s/it]
                                                           
{'loss': '0.1683', 'grad_norm': '3.708', 'learning_rate': '1.943e-05', 'epoch': '0.1343'}

 13%|█▎        | 5100/37963 [21:52:01<149:11:05, 16.34s/it]
 13%|█▎        | 5101/37963 [21:52:15<144:09:47, 15.79s/it]
 13%|█▎        | 5102/37963 [21:52:37<159:35:50, 17.48s/it]
 13%|█▎        | 5103/37963 [21:52:51<151:09:10, 16.56s/it]
 13%|█▎        | 5104/37963 [21:53:12<162:56:47, 17.85s/it]
 13%|█▎        | 5105/37963 [21:53:26<153:19:09, 16.80s/it]
 13%|█▎        | 5106/37963 [21:53:46<162:50:26, 17.84s/it]
 13%|█▎        | 5107/37963 [21:54:00<152:09:19, 16.67s/it]
 13%|█▎        | 5108/37963 [21:54:15<145:50:31, 15.98s/it]
 13%|█▎        | 5109/37963 [21:54:29<141:22:39, 15.49s/it]
 13%|█▎        | 5110/37963 [21:54:43<137:22:55, 15.05s/it]
                                                           
{'loss': '0.1776', 'grad_norm': '2.846', 'learning_rate': '1.943e-05', 'epoch': '0.1346'}

 13%|█▎        | 5110/37963 [21:54:43<137:22:55, 15.05s/it]
 13%|█▎        | 5111/37963 [21:55:04<154:10:28, 16.89s/it]
 13%|█▎        | 5112/37963 [21:55:25<165:17:17, 18.11s/it]
 13%|█▎        | 5113/37963 [21:55:45<170:54:18, 18.73s/it]
 13%|█▎        | 5114/37963 [21:56:07<178:09:46, 19.53s/it]
 13%|█▎        | 5115/37963 [21:56:21<164:09:41, 17.99s/it]
 13%|█▎        | 5116/37963 [21:56:35<153:47:16, 16.86s/it]
 13%|█▎        | 5117/37963 [21:56:50<146:26:30, 16.05s/it]
 13%|█▎        | 5118/37963 [21:57:04<140:40:48, 15.42s/it]
 13%|█▎        | 5119/37963 [21:57:18<137:49:47, 15.11s/it]
 13%|█▎        | 5120/37963 [21:57:31<132:52:19, 14.56s/it]
                                                           
{'loss': '0.1657', 'grad_norm': '3.404', 'learning_rate': '1.943e-05', 'epoch': '0.1349'}

 13%|█▎        | 5120/37963 [21:57:31<132:52:19, 14.56s/it]
 13%|█▎        | 5121/37963 [21:57:46<132:16:18, 14.50s/it]
 13%|█▎        | 5122/37963 [21:58:00<131:53:40, 14.46s/it]
 13%|█▎        | 5123/37963 [21:58:14<131:44:23, 14.44s/it]
 13%|█▎        | 5124/37963 [21:58:29<131:20:08, 14.40s/it]
 13%|█▎        | 5125/37963 [21:58:43<131:06:41, 14.37s/it]
 14%|█▎        | 5126/37963 [21:58:57<130:34:26, 14.32s/it]
 14%|█▎        | 5127/37963 [21:59:12<130:56:54, 14.36s/it]
 14%|█▎        | 5128/37963 [21:59:26<130:21:43, 14.29s/it]
 14%|█▎        | 5129/37963 [21:59:40<130:28:12, 14.31s/it]
 14%|█▎        | 5130/37963 [21:59:54<129:52:50, 14.24s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '4.17', 'learning_rate': '1.943e-05', 'epoch': '0.1351'}

 14%|█▎        | 5130/37963 [21:59:54<129:52:50, 14.24s/it]
 14%|█▎        | 5131/37963 [22:00:09<130:36:02, 14.32s/it]
 14%|█▎        | 5132/37963 [22:00:23<131:00:42, 14.37s/it]
 14%|█▎        | 5133/37963 [22:00:38<131:20:49, 14.40s/it]
 14%|█▎        | 5134/37963 [22:00:52<131:05:33, 14.38s/it]
 14%|█▎        | 5135/37963 [22:01:06<131:06:25, 14.38s/it]
 14%|█▎        | 5136/37963 [22:01:21<131:18:05, 14.40s/it]
 14%|█▎        | 5137/37963 [22:01:35<131:17:30, 14.40s/it]
 14%|█▎        | 5138/37963 [22:01:49<131:04:34, 14.38s/it]
 14%|█▎        | 5139/37963 [22:02:03<129:56:34, 14.25s/it]
 14%|█▎        | 5140/37963 [22:02:18<130:24:18, 14.30s/it]
                                                           
{'loss': '0.1725', 'grad_norm': '1.359', 'learning_rate': '1.942e-05', 'epoch': '0.1354'}

 14%|█▎        | 5140/37963 [22:02:18<130:24:18, 14.30s/it]
 14%|█▎        | 5141/37963 [22:02:32<130:44:58, 14.34s/it]
 14%|█▎        | 5142/37963 [22:02:47<130:48:13, 14.35s/it]
 14%|█▎        | 5143/37963 [22:03:01<130:56:05, 14.36s/it]
 14%|█▎        | 5144/37963 [22:03:15<131:07:33, 14.38s/it]
 14%|█▎        | 5145/37963 [22:03:30<131:00:51, 14.37s/it]
 14%|█▎        | 5146/37963 [22:03:44<130:52:34, 14.36s/it]
 14%|█▎        | 5147/37963 [22:04:05<147:47:29, 16.21s/it]
 14%|█▎        | 5148/37963 [22:04:19<142:56:39, 15.68s/it]
 14%|█▎        | 5149/37963 [22:04:33<138:38:29, 15.21s/it]
 14%|█▎        | 5150/37963 [22:04:54<153:43:12, 16.87s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '2.134', 'learning_rate': '1.942e-05', 'epoch': '0.1357'}

 14%|█▎        | 5150/37963 [22:04:54<153:43:12, 16.87s/it]
 14%|█▎        | 5151/37963 [22:05:08<146:10:06, 16.04s/it]
 14%|█▎        | 5152/37963 [22:05:22<141:35:41, 15.54s/it]
 14%|█▎        | 5153/37963 [22:05:43<156:35:08, 17.18s/it]
 14%|█▎        | 5154/37963 [22:05:58<149:00:50, 16.35s/it]
 14%|█▎        | 5155/37963 [22:06:12<143:42:09, 15.77s/it]
 14%|█▎        | 5156/37963 [22:06:27<139:48:40, 15.34s/it]
 14%|█▎        | 5157/37963 [22:06:47<152:50:53, 16.77s/it]
 14%|█▎        | 5158/37963 [22:07:01<146:09:07, 16.04s/it]
 14%|█▎        | 5159/37963 [22:07:15<141:39:36, 15.55s/it]
 14%|█▎        | 5160/37963 [22:07:36<156:39:18, 17.19s/it]
                                                           
{'loss': '0.1648', 'grad_norm': '1.45', 'learning_rate': '1.942e-05', 'epoch': '0.1359'}

 14%|█▎        | 5160/37963 [22:07:36<156:39:18, 17.19s/it]
 14%|█▎        | 5161/37963 [22:08:04<184:44:33, 20.28s/it]
 14%|█▎        | 5162/37963 [22:08:18<168:35:01, 18.50s/it]
 14%|█▎        | 5163/37963 [22:08:33<157:09:51, 17.25s/it]
 14%|█▎        | 5164/37963 [22:08:54<167:06:58, 18.34s/it]
 14%|█▎        | 5165/37963 [22:09:08<156:17:13, 17.15s/it]
 14%|█▎        | 5166/37963 [22:09:22<147:43:57, 16.22s/it]
 14%|█▎        | 5167/37963 [22:09:36<141:59:03, 15.59s/it]
 14%|█▎        | 5168/37963 [22:09:50<138:36:52, 15.22s/it]
 14%|█▎        | 5169/37963 [22:10:04<134:37:28, 14.78s/it]
 14%|█▎        | 5170/37963 [22:10:19<133:51:55, 14.70s/it]
                                                           
{'loss': '0.183', 'grad_norm': '2.862', 'learning_rate': '1.941e-05', 'epoch': '0.1362'}

 14%|█▎        | 5170/37963 [22:10:19<133:51:55, 14.70s/it]
 14%|█▎        | 5171/37963 [22:10:33<132:28:05, 14.54s/it]
 14%|█▎        | 5172/37963 [22:10:47<131:51:51, 14.48s/it]
 14%|█▎        | 5173/37963 [22:11:02<131:33:10, 14.44s/it]
 14%|█▎        | 5174/37963 [22:11:16<131:16:02, 14.41s/it]
 14%|█▎        | 5175/37963 [22:11:30<131:03:38, 14.39s/it]
 14%|█▎        | 5176/37963 [22:11:45<131:18:04, 14.42s/it]
 14%|█▎        | 5177/37963 [22:11:59<130:59:21, 14.38s/it]
 14%|█▎        | 5178/37963 [22:12:13<130:42:25, 14.35s/it]
 14%|█▎        | 5179/37963 [22:12:28<130:31:13, 14.33s/it]
 14%|█▎        | 5180/37963 [22:12:42<130:35:07, 14.34s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '2.836', 'learning_rate': '1.941e-05', 'epoch': '0.1364'}

 14%|█▎        | 5180/37963 [22:12:42<130:35:07, 14.34s/it]
 14%|█▎        | 5181/37963 [22:12:56<130:23:48, 14.32s/it]
 14%|█▎        | 5182/37963 [22:13:11<130:31:04, 14.33s/it]
 14%|█▎        | 5183/37963 [22:13:25<130:27:47, 14.33s/it]
 14%|█▎        | 5184/37963 [22:13:39<130:34:31, 14.34s/it]
 14%|█▎        | 5185/37963 [22:13:53<130:10:28, 14.30s/it]
 14%|█▎        | 5186/37963 [22:14:08<129:50:19, 14.26s/it]
 14%|█▎        | 5187/37963 [22:14:22<130:01:08, 14.28s/it]
 14%|█▎        | 5188/37963 [22:14:36<130:04:29, 14.29s/it]
 14%|█▎        | 5189/37963 [22:14:51<130:16:06, 14.31s/it]
 14%|█▎        | 5190/37963 [22:15:05<130:25:26, 14.33s/it]
                                                           
{'loss': '0.1715', 'grad_norm': '1.161', 'learning_rate': '1.941e-05', 'epoch': '0.1367'}

 14%|█▎        | 5190/37963 [22:15:05<130:25:26, 14.33s/it]
 14%|█▎        | 5191/37963 [22:15:19<129:47:35, 14.26s/it]
 14%|█▎        | 5192/37963 [22:15:33<130:01:56, 14.28s/it]
 14%|█▎        | 5193/37963 [22:15:48<130:31:41, 14.34s/it]
 14%|█▎        | 5194/37963 [22:16:08<146:50:11, 16.13s/it]
 14%|█▎        | 5195/37963 [22:16:23<141:52:20, 15.59s/it]
 14%|█▎        | 5196/37963 [22:16:36<137:23:20, 15.09s/it]
 14%|█▎        | 5197/37963 [22:16:50<134:14:17, 14.75s/it]
 14%|█▎        | 5198/37963 [22:17:05<133:11:06, 14.63s/it]
 14%|█▎        | 5199/37963 [22:17:19<132:45:05, 14.59s/it]
 14%|█▎        | 5200/37963 [22:17:40<149:43:21, 16.45s/it]
                                                           
{'loss': '0.1676', 'grad_norm': '2.94', 'learning_rate': '1.941e-05', 'epoch': '0.137'}

 14%|█▎        | 5200/37963 [22:17:40<149:43:21, 16.45s/it]
 14%|█▎        | 5201/37963 [22:17:54<143:31:18, 15.77s/it]
 14%|█▎        | 5202/37963 [22:18:15<157:43:15, 17.33s/it]
 14%|█▎        | 5203/37963 [22:18:29<148:28:57, 16.32s/it]
 14%|█▎        | 5204/37963 [22:18:44<143:22:15, 15.76s/it]
 14%|█▎        | 5205/37963 [22:18:58<139:21:07, 15.31s/it]
 14%|█▎        | 5206/37963 [22:19:19<155:01:03, 17.04s/it]
 14%|█▎        | 5207/37963 [22:19:33<146:17:27, 16.08s/it]
 14%|█▎        | 5208/37963 [22:19:47<142:06:55, 15.62s/it]
 14%|█▎        | 5209/37963 [22:20:15<175:41:18, 19.31s/it]
 14%|█▎        | 5210/37963 [22:20:30<162:15:01, 17.83s/it]
                                                           
{'loss': '0.1707', 'grad_norm': '7.545', 'learning_rate': '1.94e-05', 'epoch': '0.1372'}

 14%|█▎        | 5210/37963 [22:20:30<162:15:01, 17.83s/it]
 14%|█▎        | 5211/37963 [22:20:44<152:43:31, 16.79s/it]
 14%|█▎        | 5212/37963 [22:20:58<146:17:25, 16.08s/it]
 14%|█▎        | 5213/37963 [22:21:20<162:14:10, 17.83s/it]
 14%|█▎        | 5214/37963 [22:21:34<151:37:30, 16.67s/it]
 14%|█▎        | 5215/37963 [22:21:49<145:29:42, 15.99s/it]
 14%|█▎        | 5216/37963 [22:22:03<141:00:03, 15.50s/it]
 14%|█▎        | 5217/37963 [22:22:17<137:26:25, 15.11s/it]
 14%|█▎        | 5218/37963 [22:22:32<135:09:21, 14.86s/it]
 14%|█▎        | 5219/37963 [22:22:46<133:25:17, 14.67s/it]
 14%|█▍        | 5220/37963 [22:23:00<131:45:36, 14.49s/it]
                                                           
{'loss': '0.1772', 'grad_norm': '3.067', 'learning_rate': '1.94e-05', 'epoch': '0.1375'}

 14%|█▍        | 5220/37963 [22:23:00<131:45:36, 14.49s/it]
 14%|█▍        | 5221/37963 [22:23:14<131:22:57, 14.45s/it]
 14%|█▍        | 5222/37963 [22:23:29<131:15:55, 14.43s/it]
 14%|█▍        | 5223/37963 [22:23:42<129:44:02, 14.27s/it]
 14%|█▍        | 5224/37963 [22:23:57<129:43:43, 14.27s/it]
 14%|█▍        | 5225/37963 [22:24:11<130:08:13, 14.31s/it]
 14%|█▍        | 5226/37963 [22:24:26<130:15:02, 14.32s/it]
 14%|█▍        | 5227/37963 [22:24:40<130:35:46, 14.36s/it]
 14%|█▍        | 5228/37963 [22:24:54<130:45:38, 14.38s/it]
 14%|█▍        | 5229/37963 [22:25:09<130:54:40, 14.40s/it]
 14%|█▍        | 5230/37963 [22:25:23<130:55:49, 14.40s/it]
                                                           
{'loss': '0.1732', 'grad_norm': '1.315', 'learning_rate': '1.94e-05', 'epoch': '0.1378'}

 14%|█▍        | 5230/37963 [22:25:23<130:55:49, 14.40s/it]
 14%|█▍        | 5231/37963 [22:25:38<130:36:17, 14.36s/it]
 14%|█▍        | 5232/37963 [22:25:52<130:31:30, 14.36s/it]
 14%|█▍        | 5233/37963 [22:26:06<131:21:09, 14.45s/it]
 14%|█▍        | 5234/37963 [22:26:21<131:22:47, 14.45s/it]
 14%|█▍        | 5235/37963 [22:26:35<131:17:21, 14.44s/it]
 14%|█▍        | 5236/37963 [22:26:49<129:34:37, 14.25s/it]
 14%|█▍        | 5237/37963 [22:27:04<130:00:56, 14.30s/it]
 14%|█▍        | 5238/37963 [22:27:18<130:15:02, 14.33s/it]
 14%|█▍        | 5239/37963 [22:27:32<130:11:47, 14.32s/it]
 14%|█▍        | 5240/37963 [22:27:53<147:18:13, 16.21s/it]
                                                           
{'loss': '0.1674', 'grad_norm': '4.046', 'learning_rate': '1.939e-05', 'epoch': '0.138'}

 14%|█▍        | 5240/37963 [22:27:53<147:18:13, 16.21s/it]
 14%|█▍        | 5241/37963 [22:28:07<142:14:38, 15.65s/it]
 14%|█▍        | 5242/37963 [22:28:22<138:41:27, 15.26s/it]
 14%|█▍        | 5243/37963 [22:28:36<136:16:48, 14.99s/it]
 14%|█▍        | 5244/37963 [22:28:50<134:30:48, 14.80s/it]
 14%|█▍        | 5245/37963 [22:29:04<132:30:36, 14.58s/it]
 14%|█▍        | 5246/37963 [22:29:18<131:03:28, 14.42s/it]
 14%|█▍        | 5247/37963 [22:29:33<131:00:57, 14.42s/it]
 14%|█▍        | 5248/37963 [22:29:53<147:42:27, 16.25s/it]
 14%|█▍        | 5249/37963 [22:30:14<160:34:09, 17.67s/it]
 14%|█▍        | 5250/37963 [22:30:29<151:24:53, 16.66s/it]
                                                           
{'loss': '0.1727', 'grad_norm': '1.985', 'learning_rate': '1.939e-05', 'epoch': '0.1383'}

 14%|█▍        | 5250/37963 [22:30:29<151:24:53, 16.66s/it]
 14%|█▍        | 5251/37963 [22:30:43<144:55:39, 15.95s/it]
 14%|█▍        | 5252/37963 [22:30:57<139:55:31, 15.40s/it]
 14%|█▍        | 5253/37963 [22:31:11<137:08:38, 15.09s/it]
 14%|█▍        | 5254/37963 [22:31:32<152:46:01, 16.81s/it]
 14%|█▍        | 5255/37963 [22:31:47<146:12:35, 16.09s/it]
 14%|█▍        | 5256/37963 [22:32:01<141:25:14, 15.57s/it]
 14%|█▍        | 5257/37963 [22:32:22<155:30:48, 17.12s/it]
 14%|█▍        | 5258/37963 [22:32:36<148:20:22, 16.33s/it]
 14%|█▍        | 5259/37963 [22:32:57<161:28:42, 17.78s/it]
 14%|█▍        | 5260/37963 [22:33:18<169:38:46, 18.67s/it]
                                                           
{'loss': '0.1754', 'grad_norm': '2.736', 'learning_rate': '1.939e-05', 'epoch': '0.1386'}

 14%|█▍        | 5260/37963 [22:33:18<169:38:46, 18.67s/it]
 14%|█▍        | 5261/37963 [22:33:33<158:28:16, 17.45s/it]
 14%|█▍        | 5262/37963 [22:33:47<149:38:37, 16.47s/it]
 14%|█▍        | 5263/37963 [22:34:08<161:41:55, 17.80s/it]
 14%|█▍        | 5264/37963 [22:34:22<152:26:36, 16.78s/it]
 14%|█▍        | 5265/37963 [22:34:36<144:32:40, 15.91s/it]
 14%|█▍        | 5266/37963 [22:34:50<139:50:00, 15.40s/it]
 14%|█▍        | 5267/37963 [22:35:05<136:53:11, 15.07s/it]
 14%|█▍        | 5268/37963 [22:35:19<134:25:39, 14.80s/it]
 14%|█▍        | 5269/37963 [22:35:33<133:05:48, 14.66s/it]
 14%|█▍        | 5270/37963 [22:35:47<131:03:18, 14.43s/it]
                                                           
{'loss': '0.1699', 'grad_norm': '2.265', 'learning_rate': '1.939e-05', 'epoch': '0.1388'}

 14%|█▍        | 5270/37963 [22:35:47<131:03:18, 14.43s/it]
 14%|█▍        | 5271/37963 [22:36:01<130:55:10, 14.42s/it]
 14%|█▍        | 5272/37963 [22:36:16<130:49:54, 14.41s/it]
 14%|█▍        | 5273/37963 [22:36:30<130:47:53, 14.40s/it]
 14%|█▍        | 5274/37963 [22:36:45<131:02:25, 14.43s/it]
 14%|█▍        | 5275/37963 [22:36:59<130:57:42, 14.42s/it]
 14%|█▍        | 5276/37963 [22:37:13<130:39:11, 14.39s/it]
 14%|█▍        | 5277/37963 [22:37:28<130:29:45, 14.37s/it]
 14%|█▍        | 5278/37963 [22:37:41<128:43:49, 14.18s/it]
 14%|█▍        | 5279/37963 [22:37:56<129:12:03, 14.23s/it]
 14%|█▍        | 5280/37963 [22:38:10<129:50:30, 14.30s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '1.593', 'learning_rate': '1.938e-05', 'epoch': '0.1391'}

 14%|█▍        | 5280/37963 [22:38:10<129:50:30, 14.30s/it]
 14%|█▍        | 5281/37963 [22:38:25<129:58:12, 14.32s/it]
 14%|█▍        | 5282/37963 [22:38:39<130:07:02, 14.33s/it]
 14%|█▍        | 5283/37963 [22:38:53<130:25:49, 14.37s/it]
 14%|█▍        | 5284/37963 [22:39:08<130:25:50, 14.37s/it]
 14%|█▍        | 5285/37963 [22:39:22<130:36:11, 14.39s/it]
 14%|█▍        | 5286/37963 [22:39:37<130:49:25, 14.41s/it]
 14%|█▍        | 5287/37963 [22:39:51<130:41:29, 14.40s/it]
 14%|█▍        | 5288/37963 [22:40:05<129:35:04, 14.28s/it]
 14%|█▍        | 5289/37963 [22:40:19<129:12:34, 14.24s/it]
 14%|█▍        | 5290/37963 [22:40:34<129:34:54, 14.28s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '1.789', 'learning_rate': '1.938e-05', 'epoch': '0.1393'}

 14%|█▍        | 5290/37963 [22:40:34<129:34:54, 14.28s/it]
 14%|█▍        | 5291/37963 [22:40:54<146:51:24, 16.18s/it]
 14%|█▍        | 5292/37963 [22:41:09<142:22:13, 15.69s/it]
 14%|█▍        | 5293/37963 [22:41:23<138:34:06, 15.27s/it]
 14%|█▍        | 5294/37963 [22:41:37<136:12:49, 15.01s/it]
 14%|█▍        | 5295/37963 [22:41:52<134:12:53, 14.79s/it]
 14%|█▍        | 5296/37963 [22:42:13<150:52:05, 16.63s/it]
 14%|█▍        | 5297/37963 [22:42:27<144:48:30, 15.96s/it]
 14%|█▍        | 5298/37963 [22:42:41<140:21:08, 15.47s/it]
 14%|█▍        | 5299/37963 [22:43:02<155:15:15, 17.11s/it]
 14%|█▍        | 5300/37963 [22:43:17<147:53:31, 16.30s/it]
                                                           
{'loss': '0.1652', 'grad_norm': '2.799', 'learning_rate': '1.938e-05', 'epoch': '0.1396'}

 14%|█▍        | 5300/37963 [22:43:17<147:53:31, 16.30s/it]
 14%|█▍        | 5301/37963 [22:43:37<158:42:57, 17.49s/it]
 14%|█▍        | 5302/37963 [22:43:51<149:30:01, 16.48s/it]
 14%|█▍        | 5303/37963 [22:44:06<143:46:22, 15.85s/it]
 14%|█▍        | 5304/37963 [22:44:20<139:39:01, 15.39s/it]
 14%|█▍        | 5305/37963 [22:44:41<154:32:17, 17.04s/it]
 14%|█▍        | 5306/37963 [22:44:55<147:30:36, 16.26s/it]
 14%|█▍        | 5307/37963 [22:45:16<160:02:02, 17.64s/it]
 14%|█▍        | 5308/37963 [22:45:30<151:17:24, 16.68s/it]
 14%|█▍        | 5309/37963 [22:45:52<163:33:08, 18.03s/it]
 14%|█▍        | 5310/37963 [22:46:06<153:34:33, 16.93s/it]
                                                           
{'loss': '0.1673', 'grad_norm': '1.218', 'learning_rate': '1.937e-05', 'epoch': '0.1399'}

 14%|█▍        | 5310/37963 [22:46:06<153:34:33, 16.93s/it]
 14%|█▍        | 5311/37963 [22:46:27<164:56:47, 18.19s/it]
 14%|█▍        | 5312/37963 [22:46:42<154:33:41, 17.04s/it]
 14%|█▍        | 5313/37963 [22:46:56<147:32:10, 16.27s/it]
 14%|█▍        | 5314/37963 [22:47:10<141:54:09, 15.65s/it]
 14%|█▍        | 5315/37963 [22:47:24<137:53:44, 15.21s/it]
 14%|█▍        | 5316/37963 [22:47:39<135:42:34, 14.96s/it]
 14%|█▍        | 5317/37963 [22:47:53<133:57:34, 14.77s/it]
 14%|█▍        | 5318/37963 [22:48:07<132:13:01, 14.58s/it]
 14%|█▍        | 5319/37963 [22:48:22<131:47:51, 14.53s/it]
 14%|█▍        | 5320/37963 [22:48:36<131:25:23, 14.49s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '2.288', 'learning_rate': '1.937e-05', 'epoch': '0.1401'}

 14%|█▍        | 5320/37963 [22:48:36<131:25:23, 14.49s/it]
 14%|█▍        | 5321/37963 [22:48:50<131:05:15, 14.46s/it]
 14%|█▍        | 5322/37963 [22:49:05<130:36:00, 14.40s/it]
 14%|█▍        | 5323/37963 [22:49:19<130:39:40, 14.41s/it]
 14%|█▍        | 5324/37963 [22:49:34<130:37:56, 14.41s/it]
 14%|█▍        | 5325/37963 [22:49:47<127:59:54, 14.12s/it]
 14%|█▍        | 5326/37963 [22:50:01<128:29:22, 14.17s/it]
 14%|█▍        | 5327/37963 [22:50:15<128:01:50, 14.12s/it]
 14%|█▍        | 5328/37963 [22:50:29<128:10:47, 14.14s/it]
 14%|█▍        | 5329/37963 [22:50:44<128:18:07, 14.15s/it]
 14%|█▍        | 5330/37963 [22:50:58<128:37:59, 14.19s/it]
                                                           
{'loss': '0.1742', 'grad_norm': '6.245', 'learning_rate': '1.937e-05', 'epoch': '0.1404'}

 14%|█▍        | 5330/37963 [22:50:58<128:37:59, 14.19s/it]
 14%|█▍        | 5331/37963 [22:51:12<129:10:52, 14.25s/it]
 14%|█▍        | 5332/37963 [22:51:27<129:33:49, 14.29s/it]
 14%|█▍        | 5333/37963 [22:51:41<128:47:18, 14.21s/it]
 14%|█▍        | 5334/37963 [22:51:55<129:12:01, 14.25s/it]
 14%|█▍        | 5335/37963 [22:52:10<130:00:45, 14.34s/it]
 14%|█▍        | 5336/37963 [22:52:24<129:38:19, 14.30s/it]
 14%|█▍        | 5337/37963 [22:52:38<129:49:59, 14.33s/it]
 14%|█▍        | 5338/37963 [22:52:53<129:49:55, 14.33s/it]
 14%|█▍        | 5339/37963 [22:53:07<129:53:44, 14.33s/it]
 14%|█▍        | 5340/37963 [22:53:28<148:30:16, 16.39s/it]
                                                           
{'loss': '0.1724', 'grad_norm': '1.135', 'learning_rate': '1.936e-05', 'epoch': '0.1407'}

 14%|█▍        | 5340/37963 [22:53:28<148:30:16, 16.39s/it]
 14%|█▍        | 5341/37963 [22:53:42<142:14:12, 15.70s/it]
 14%|█▍        | 5342/37963 [22:53:56<138:27:29, 15.28s/it]
 14%|█▍        | 5343/37963 [22:54:11<135:16:56, 14.93s/it]
 14%|█▍        | 5344/37963 [22:54:31<151:22:28, 16.71s/it]
 14%|█▍        | 5345/37963 [22:54:46<144:54:46, 15.99s/it]
 14%|█▍        | 5346/37963 [22:55:00<140:28:37, 15.50s/it]
 14%|█▍        | 5347/37963 [22:55:14<137:19:31, 15.16s/it]
 14%|█▍        | 5348/37963 [22:55:29<134:48:23, 14.88s/it]
 14%|█▍        | 5349/37963 [22:55:49<150:13:17, 16.58s/it]
 14%|█▍        | 5350/37963 [22:56:10<161:48:00, 17.86s/it]
                                                           
{'loss': '0.162', 'grad_norm': '3.782', 'learning_rate': '1.936e-05', 'epoch': '0.1409'}

 14%|█▍        | 5350/37963 [22:56:10<161:48:00, 17.86s/it]
 14%|█▍        | 5351/37963 [22:56:24<152:17:43, 16.81s/it]
 14%|█▍        | 5352/37963 [22:56:39<145:27:41, 16.06s/it]
 14%|█▍        | 5353/37963 [22:57:00<158:59:25, 17.55s/it]
 14%|█▍        | 5354/37963 [22:57:14<149:11:55, 16.47s/it]
 14%|█▍        | 5355/37963 [22:57:27<141:41:26, 15.64s/it]
 14%|█▍        | 5356/37963 [22:57:41<136:31:41, 15.07s/it]
 14%|█▍        | 5357/37963 [22:58:02<150:58:55, 16.67s/it]
 14%|█▍        | 5358/37963 [22:58:23<163:36:14, 18.06s/it]
 14%|█▍        | 5359/37963 [22:58:37<153:39:41, 16.97s/it]
 14%|█▍        | 5360/37963 [22:58:58<163:52:27, 18.09s/it]
                                                           
{'loss': '0.1681', 'grad_norm': '1.34', 'learning_rate': '1.936e-05', 'epoch': '0.1412'}

 14%|█▍        | 5360/37963 [22:58:58<163:52:27, 18.09s/it]
 14%|█▍        | 5361/37963 [22:59:12<153:46:14, 16.98s/it]
 14%|█▍        | 5362/37963 [22:59:27<146:30:12, 16.18s/it]
 14%|█▍        | 5363/37963 [22:59:41<141:34:01, 15.63s/it]
 14%|█▍        | 5364/37963 [22:59:55<138:13:06, 15.26s/it]
 14%|█▍        | 5365/37963 [23:00:10<135:48:07, 15.00s/it]
 14%|█▍        | 5366/37963 [23:00:24<133:06:54, 14.70s/it]
 14%|█▍        | 5367/37963 [23:00:38<132:02:28, 14.58s/it]
 14%|█▍        | 5368/37963 [23:00:53<131:29:08, 14.52s/it]
 14%|█▍        | 5369/37963 [23:01:07<130:41:42, 14.44s/it]
 14%|█▍        | 5370/37963 [23:01:21<130:23:45, 14.40s/it]
                                                           
{'loss': '0.1631', 'grad_norm': '1.917', 'learning_rate': '1.936e-05', 'epoch': '0.1415'}

 14%|█▍        | 5370/37963 [23:01:21<130:23:45, 14.40s/it]
 14%|█▍        | 5371/37963 [23:01:35<130:12:04, 14.38s/it]
 14%|█▍        | 5372/37963 [23:01:49<129:12:51, 14.27s/it]
 14%|█▍        | 5373/37963 [23:02:04<129:20:47, 14.29s/it]
 14%|█▍        | 5374/37963 [23:02:18<127:51:20, 14.12s/it]
 14%|█▍        | 5375/37963 [23:02:32<128:22:40, 14.18s/it]
 14%|█▍        | 5376/37963 [23:02:45<125:19:24, 13.84s/it]
 14%|█▍        | 5377/37963 [23:02:59<126:55:45, 14.02s/it]
 14%|█▍        | 5378/37963 [23:03:13<127:05:03, 14.04s/it]
 14%|█▍        | 5379/37963 [23:03:28<128:08:49, 14.16s/it]
 14%|█▍        | 5380/37963 [23:03:42<128:09:07, 14.16s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '1.562', 'learning_rate': '1.935e-05', 'epoch': '0.1417'}

 14%|█▍        | 5380/37963 [23:03:42<128:09:07, 14.16s/it]
 14%|█▍        | 5381/37963 [23:03:55<125:40:31, 13.89s/it]
 14%|█▍        | 5382/37963 [23:04:10<127:17:15, 14.06s/it]
 14%|█▍        | 5383/37963 [23:04:24<128:07:28, 14.16s/it]
 14%|█▍        | 5384/37963 [23:04:38<128:12:26, 14.17s/it]
 14%|█▍        | 5385/37963 [23:04:53<128:46:03, 14.23s/it]
 14%|█▍        | 5386/37963 [23:05:07<129:28:10, 14.31s/it]
 14%|█▍        | 5387/37963 [23:05:22<129:48:26, 14.35s/it]
 14%|█▍        | 5388/37963 [23:05:43<147:43:33, 16.33s/it]
 14%|█▍        | 5389/37963 [23:05:57<142:13:16, 15.72s/it]
 14%|█▍        | 5390/37963 [23:06:11<138:22:27, 15.29s/it]
                                                           
{'loss': '0.1736', 'grad_norm': '1.201', 'learning_rate': '1.935e-05', 'epoch': '0.142'}

 14%|█▍        | 5390/37963 [23:06:11<138:22:27, 15.29s/it]
 14%|█▍        | 5391/37963 [23:06:26<135:51:32, 15.02s/it]
 14%|█▍        | 5392/37963 [23:06:40<134:01:45, 14.81s/it]
 14%|█▍        | 5393/37963 [23:07:01<151:31:38, 16.75s/it]
 14%|█▍        | 5394/37963 [23:07:15<145:00:11, 16.03s/it]
 14%|█▍        | 5395/37963 [23:07:30<140:33:52, 15.54s/it]
 14%|█▍        | 5396/37963 [23:07:44<137:26:55, 15.19s/it]
 14%|█▍        | 5397/37963 [23:07:59<135:33:31, 14.99s/it]
 14%|█▍        | 5398/37963 [23:08:19<151:00:13, 16.69s/it]
 14%|█▍        | 5399/37963 [23:08:40<160:17:19, 17.72s/it]
 14%|█▍        | 5400/37963 [23:08:53<149:33:31, 16.53s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '2.69', 'learning_rate': '1.935e-05', 'epoch': '0.1422'}

 14%|█▍        | 5400/37963 [23:08:53<149:33:31, 16.53s/it]
 14%|█▍        | 5401/37963 [23:09:14<160:55:08, 17.79s/it]
 14%|█▍        | 5402/37963 [23:09:28<150:38:57, 16.66s/it]
 14%|█▍        | 5403/37963 [23:09:42<143:21:40, 15.85s/it]
 14%|█▍        | 5404/37963 [23:09:57<139:44:01, 15.45s/it]
 14%|█▍        | 5405/37963 [23:10:17<154:08:22, 17.04s/it]
 14%|█▍        | 5406/37963 [23:10:38<165:14:07, 18.27s/it]
 14%|█▍        | 5407/37963 [23:10:53<154:10:09, 17.05s/it]
 14%|█▍        | 5408/37963 [23:11:07<147:09:35, 16.27s/it]
 14%|█▍        | 5409/37963 [23:11:29<161:09:21, 17.82s/it]
 14%|█▍        | 5410/37963 [23:11:43<151:45:59, 16.78s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '6.497', 'learning_rate': '1.934e-05', 'epoch': '0.1425'}

 14%|█▍        | 5410/37963 [23:11:43<151:45:59, 16.78s/it]
 14%|█▍        | 5411/37963 [23:11:57<145:08:30, 16.05s/it]
 14%|█▍        | 5412/37963 [23:12:12<140:21:48, 15.52s/it]
 14%|█▍        | 5413/37963 [23:12:26<137:08:01, 15.17s/it]
 14%|█▍        | 5414/37963 [23:12:40<134:53:04, 14.92s/it]
 14%|█▍        | 5415/37963 [23:12:55<133:17:24, 14.74s/it]
 14%|█▍        | 5416/37963 [23:13:09<132:11:23, 14.62s/it]
 14%|█▍        | 5417/37963 [23:13:23<131:34:05, 14.55s/it]
 14%|█▍        | 5418/37963 [23:13:38<130:59:05, 14.49s/it]
 14%|█▍        | 5419/37963 [23:13:52<130:46:08, 14.47s/it]
 14%|█▍        | 5420/37963 [23:14:06<129:58:23, 14.38s/it]
                                                           
{'loss': '0.1749', 'grad_norm': '1.806', 'learning_rate': '1.934e-05', 'epoch': '0.1428'}

 14%|█▍        | 5420/37963 [23:14:06<129:58:23, 14.38s/it]
 14%|█▍        | 5421/37963 [23:14:20<129:09:37, 14.29s/it]
 14%|█▍        | 5422/37963 [23:14:35<129:16:32, 14.30s/it]
 14%|█▍        | 5423/37963 [23:14:49<129:29:24, 14.33s/it]
 14%|█▍        | 5424/37963 [23:15:03<128:57:37, 14.27s/it]
 14%|█▍        | 5425/37963 [23:15:17<128:16:26, 14.19s/it]
 14%|█▍        | 5426/37963 [23:15:32<129:04:04, 14.28s/it]
 14%|█▍        | 5427/37963 [23:15:46<129:09:39, 14.29s/it]
 14%|█▍        | 5428/37963 [23:16:00<129:04:02, 14.28s/it]
 14%|█▍        | 5429/37963 [23:16:15<129:11:30, 14.30s/it]
 14%|█▍        | 5430/37963 [23:16:29<129:24:23, 14.32s/it]
                                                           
{'loss': '0.1709', 'grad_norm': '2.337', 'learning_rate': '1.934e-05', 'epoch': '0.143'}

 14%|█▍        | 5430/37963 [23:16:29<129:24:23, 14.32s/it]
 14%|█▍        | 5431/37963 [23:16:43<129:38:11, 14.35s/it]
 14%|█▍        | 5432/37963 [23:16:57<127:49:11, 14.15s/it]
 14%|█▍        | 5433/37963 [23:17:11<128:22:40, 14.21s/it]
 14%|█▍        | 5434/37963 [23:17:26<128:41:22, 14.24s/it]
 14%|█▍        | 5435/37963 [23:17:40<129:05:40, 14.29s/it]
 14%|█▍        | 5436/37963 [23:17:54<129:16:47, 14.31s/it]
 14%|█▍        | 5437/37963 [23:18:09<129:15:59, 14.31s/it]
 14%|█▍        | 5438/37963 [23:18:30<148:13:46, 16.41s/it]
 14%|█▍        | 5439/37963 [23:18:44<141:27:51, 15.66s/it]
 14%|█▍        | 5440/37963 [23:19:05<155:19:26, 17.19s/it]
                                                           
{'loss': '0.168', 'grad_norm': '3.416', 'learning_rate': '1.933e-05', 'epoch': '0.1433'}

 14%|█▍        | 5440/37963 [23:19:05<155:19:26, 17.19s/it]
 14%|█▍        | 5441/37963 [23:19:19<148:39:28, 16.46s/it]
 14%|█▍        | 5442/37963 [23:19:34<142:51:53, 15.81s/it]
 14%|█▍        | 5443/37963 [23:19:48<139:01:56, 15.39s/it]
 14%|█▍        | 5444/37963 [23:20:09<153:04:09, 16.95s/it]
 14%|█▍        | 5445/37963 [23:20:23<145:44:03, 16.13s/it]
 14%|█▍        | 5446/37963 [23:20:37<140:49:54, 15.59s/it]
 14%|█▍        | 5447/37963 [23:20:52<137:38:41, 15.24s/it]
 14%|█▍        | 5448/37963 [23:21:05<132:42:52, 14.69s/it]
 14%|█▍        | 5449/37963 [23:21:20<132:22:41, 14.66s/it]
 14%|█▍        | 5450/37963 [23:21:47<165:25:46, 18.32s/it]
                                                           
{'loss': '0.1685', 'grad_norm': '2.39', 'learning_rate': '1.933e-05', 'epoch': '0.1436'}

 14%|█▍        | 5450/37963 [23:21:47<165:25:46, 18.32s/it]
 14%|█▍        | 5451/37963 [23:22:01<154:49:10, 17.14s/it]
 14%|█▍        | 5452/37963 [23:22:15<145:49:05, 16.15s/it]
 14%|█▍        | 5453/37963 [23:22:36<160:00:11, 17.72s/it]
 14%|█▍        | 5454/37963 [23:22:50<150:36:20, 16.68s/it]
 14%|█▍        | 5455/37963 [23:23:05<144:05:57, 15.96s/it]
 14%|█▍        | 5456/37963 [23:23:25<156:13:56, 17.30s/it]
 14%|█▍        | 5457/37963 [23:23:39<148:08:16, 16.41s/it]
 14%|█▍        | 5458/37963 [23:24:01<160:57:11, 17.83s/it]
 14%|█▍        | 5459/37963 [23:24:15<151:37:48, 16.79s/it]
 14%|█▍        | 5460/37963 [23:24:29<143:41:43, 15.92s/it]
                                                           
{'loss': '0.1708', 'grad_norm': '3.351', 'learning_rate': '1.933e-05', 'epoch': '0.1438'}

 14%|█▍        | 5460/37963 [23:24:29<143:41:43, 15.92s/it]
 14%|█▍        | 5461/37963 [23:24:43<139:30:00, 15.45s/it]
 14%|█▍        | 5462/37963 [23:24:58<136:26:24, 15.11s/it]
 14%|█▍        | 5463/37963 [23:25:12<134:20:40, 14.88s/it]
 14%|█▍        | 5464/37963 [23:25:26<132:52:22, 14.72s/it]
 14%|█▍        | 5465/37963 [23:25:40<130:47:48, 14.49s/it]
 14%|█▍        | 5466/37963 [23:25:55<130:35:56, 14.47s/it]
 14%|█▍        | 5467/37963 [23:26:09<130:51:59, 14.50s/it]
 14%|█▍        | 5468/37963 [23:26:23<130:23:04, 14.44s/it]
 14%|█▍        | 5469/37963 [23:26:38<129:17:14, 14.32s/it]
 14%|█▍        | 5470/37963 [23:26:52<129:31:52, 14.35s/it]
                                                           
{'loss': '0.1721', 'grad_norm': '2.468', 'learning_rate': '1.933e-05', 'epoch': '0.1441'}

 14%|█▍        | 5470/37963 [23:26:52<129:31:52, 14.35s/it]
 14%|█▍        | 5471/37963 [23:27:06<129:33:08, 14.35s/it]
 14%|█▍        | 5472/37963 [23:27:20<128:30:24, 14.24s/it]
 14%|█▍        | 5473/37963 [23:27:35<128:37:09, 14.25s/it]
 14%|█▍        | 5474/37963 [23:27:49<128:46:06, 14.27s/it]
 14%|█▍        | 5475/37963 [23:28:03<129:07:23, 14.31s/it]
 14%|█▍        | 5476/37963 [23:28:17<127:27:39, 14.12s/it]
 14%|█▍        | 5477/37963 [23:28:31<128:10:03, 14.20s/it]
 14%|█▍        | 5478/37963 [23:28:46<128:21:29, 14.22s/it]
 14%|█▍        | 5479/37963 [23:29:00<128:38:12, 14.26s/it]
 14%|█▍        | 5480/37963 [23:29:14<128:47:50, 14.27s/it]
                                                           
{'loss': '0.1696', 'grad_norm': '1.088', 'learning_rate': '1.932e-05', 'epoch': '0.1444'}

 14%|█▍        | 5480/37963 [23:29:14<128:47:50, 14.27s/it]
 14%|█▍        | 5481/37963 [23:29:29<128:51:36, 14.28s/it]
 14%|█▍        | 5482/37963 [23:29:43<128:51:31, 14.28s/it]
 14%|█▍        | 5483/37963 [23:29:57<129:06:17, 14.31s/it]
 14%|█▍        | 5484/37963 [23:30:11<127:04:58, 14.09s/it]
 14%|█▍        | 5485/37963 [23:30:30<142:04:53, 15.75s/it]
 14%|█▍        | 5486/37963 [23:30:45<138:08:41, 15.31s/it]
 14%|█▍        | 5487/37963 [23:30:59<135:04:26, 14.97s/it]
 14%|█▍        | 5488/37963 [23:31:13<132:57:52, 14.74s/it]
 14%|█▍        | 5489/37963 [23:31:34<149:46:36, 16.60s/it]
 14%|█▍        | 5490/37963 [23:31:48<143:12:56, 15.88s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '2.749', 'learning_rate': '1.932e-05', 'epoch': '0.1446'}

 14%|█▍        | 5490/37963 [23:31:48<143:12:56, 15.88s/it]
 14%|█▍        | 5491/37963 [23:32:03<139:20:54, 15.45s/it]
 14%|█▍        | 5492/37963 [23:32:24<153:55:13, 17.06s/it]
 14%|█▍        | 5493/37963 [23:32:38<146:54:40, 16.29s/it]
 14%|█▍        | 5494/37963 [23:32:52<141:30:31, 15.69s/it]
 14%|█▍        | 5495/37963 [23:33:06<137:20:30, 15.23s/it]
 14%|█▍        | 5496/37963 [23:33:20<133:05:39, 14.76s/it]
 14%|█▍        | 5497/37963 [23:33:34<131:00:27, 14.53s/it]
 14%|█▍        | 5498/37963 [23:33:55<148:02:13, 16.42s/it]
 14%|█▍        | 5499/37963 [23:34:16<160:55:52, 17.85s/it]
 14%|█▍        | 5500/37963 [23:34:30<151:20:06, 16.78s/it]
                                                           
{'loss': '0.1657', 'grad_norm': '1.244', 'learning_rate': '1.932e-05', 'epoch': '0.1449'}

 14%|█▍        | 5500/37963 [23:34:30<151:20:06, 16.78s/it]
 14%|█▍        | 5501/37963 [23:34:51<163:01:08, 18.08s/it]
 14%|█▍        | 5502/37963 [23:35:05<150:38:36, 16.71s/it]
 14%|█▍        | 5503/37963 [23:35:19<143:13:23, 15.88s/it]
 14%|█▍        | 5504/37963 [23:35:39<154:43:03, 17.16s/it]
 15%|█▍        | 5505/37963 [23:35:53<146:22:03, 16.23s/it]
 15%|█▍        | 5506/37963 [23:36:07<140:47:45, 15.62s/it]
 15%|█▍        | 5507/37963 [23:36:28<154:26:55, 17.13s/it]
 15%|█▍        | 5508/37963 [23:36:42<146:59:37, 16.30s/it]
 15%|█▍        | 5509/37963 [23:36:57<141:14:05, 15.67s/it]
 15%|█▍        | 5510/37963 [23:37:11<137:44:21, 15.28s/it]
                                                           
{'loss': '0.173', 'grad_norm': '2.607', 'learning_rate': '1.931e-05', 'epoch': '0.1451'}

 15%|█▍        | 5510/37963 [23:37:11<137:44:21, 15.28s/it]
 15%|█▍        | 5511/37963 [23:37:25<135:28:19, 15.03s/it]
 15%|█▍        | 5512/37963 [23:37:40<134:11:59, 14.89s/it]
 15%|█▍        | 5513/37963 [23:37:54<133:07:20, 14.77s/it]
 15%|█▍        | 5514/37963 [23:38:09<131:46:33, 14.62s/it]
 15%|█▍        | 5515/37963 [23:38:23<130:55:21, 14.53s/it]
 15%|█▍        | 5516/37963 [23:38:37<130:19:06, 14.46s/it]
 15%|█▍        | 5517/37963 [23:38:52<130:44:55, 14.51s/it]
 15%|█▍        | 5518/37963 [23:39:06<128:57:52, 14.31s/it]
 15%|█▍        | 5519/37963 [23:39:20<129:14:27, 14.34s/it]
 15%|█▍        | 5520/37963 [23:39:34<128:57:07, 14.31s/it]
                                                           
{'loss': '0.1708', 'grad_norm': '1.863', 'learning_rate': '1.931e-05', 'epoch': '0.1454'}

 15%|█▍        | 5520/37963 [23:39:34<128:57:07, 14.31s/it]
 15%|█▍        | 5521/37963 [23:39:49<129:01:15, 14.32s/it]
 15%|█▍        | 5522/37963 [23:40:03<128:04:10, 14.21s/it]
 15%|█▍        | 5523/37963 [23:40:17<128:29:43, 14.26s/it]
 15%|█▍        | 5524/37963 [23:40:31<128:37:01, 14.27s/it]
 15%|█▍        | 5525/37963 [23:40:46<128:47:57, 14.29s/it]
 15%|█▍        | 5526/37963 [23:41:00<129:40:14, 14.39s/it]
 15%|█▍        | 5527/37963 [23:41:15<129:43:48, 14.40s/it]
 15%|█▍        | 5528/37963 [23:41:29<129:27:43, 14.37s/it]
 15%|█▍        | 5529/37963 [23:41:44<129:43:36, 14.40s/it]
 15%|█▍        | 5530/37963 [23:41:58<129:33:50, 14.38s/it]
                                                           
{'loss': '0.1699', 'grad_norm': '4.204', 'learning_rate': '1.931e-05', 'epoch': '0.1457'}

 15%|█▍        | 5530/37963 [23:41:58<129:33:50, 14.38s/it]
 15%|█▍        | 5531/37963 [23:42:12<129:13:21, 14.34s/it]
 15%|█▍        | 5532/37963 [23:42:26<127:07:04, 14.11s/it]
 15%|█▍        | 5533/37963 [23:42:40<127:04:03, 14.11s/it]
 15%|█▍        | 5534/37963 [23:43:01<145:38:51, 16.17s/it]
 15%|█▍        | 5535/37963 [23:43:14<138:50:27, 15.41s/it]
 15%|█▍        | 5536/37963 [23:43:29<136:05:19, 15.11s/it]
 15%|█▍        | 5537/37963 [23:43:43<133:36:56, 14.83s/it]
 15%|█▍        | 5538/37963 [23:43:58<132:42:03, 14.73s/it]
 15%|█▍        | 5539/37963 [23:44:25<165:57:21, 18.43s/it]
 15%|█▍        | 5540/37963 [23:44:39<154:47:29, 17.19s/it]
                                                           
{'loss': '0.176', 'grad_norm': '2.343', 'learning_rate': '1.93e-05', 'epoch': '0.1459'}

 15%|█▍        | 5540/37963 [23:44:39<154:47:29, 17.19s/it]
 15%|█▍        | 5541/37963 [23:44:53<147:22:52, 16.36s/it]
 15%|█▍        | 5542/37963 [23:45:08<141:53:02, 15.75s/it]
 15%|█▍        | 5543/37963 [23:45:22<138:03:35, 15.33s/it]
 15%|█▍        | 5544/37963 [23:45:36<135:42:28, 15.07s/it]
 15%|█▍        | 5545/37963 [23:45:51<133:44:21, 14.85s/it]
 15%|█▍        | 5546/37963 [23:46:12<150:05:17, 16.67s/it]
 15%|█▍        | 5547/37963 [23:46:26<143:13:58, 15.91s/it]
 15%|█▍        | 5548/37963 [23:46:47<157:48:42, 17.53s/it]
 15%|█▍        | 5549/37963 [23:47:02<149:24:03, 16.59s/it]
 15%|█▍        | 5550/37963 [23:47:23<162:05:49, 18.00s/it]
                                                           
{'loss': '0.1676', 'grad_norm': '2.078', 'learning_rate': '1.93e-05', 'epoch': '0.1462'}

 15%|█▍        | 5550/37963 [23:47:23<162:05:49, 18.00s/it]
 15%|█▍        | 5551/37963 [23:47:37<152:13:20, 16.91s/it]
 15%|█▍        | 5552/37963 [23:47:58<163:08:11, 18.12s/it]
 15%|█▍        | 5553/37963 [23:48:13<153:00:10, 17.00s/it]
 15%|█▍        | 5554/37963 [23:48:27<145:48:45, 16.20s/it]
 15%|█▍        | 5555/37963 [23:48:41<141:31:05, 15.72s/it]
 15%|█▍        | 5556/37963 [23:49:02<155:17:44, 17.25s/it]
 15%|█▍        | 5557/37963 [23:49:17<147:36:39, 16.40s/it]
 15%|█▍        | 5558/37963 [23:49:31<141:42:55, 15.74s/it]
 15%|█▍        | 5559/37963 [23:49:45<137:01:19, 15.22s/it]
 15%|█▍        | 5560/37963 [23:49:59<134:41:55, 14.97s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '3.34', 'learning_rate': '1.93e-05', 'epoch': '0.1465'}

 15%|█▍        | 5560/37963 [23:49:59<134:41:55, 14.97s/it]
 15%|█▍        | 5561/37963 [23:50:14<132:57:58, 14.77s/it]
 15%|█▍        | 5562/37963 [23:50:28<131:54:17, 14.66s/it]
 15%|█▍        | 5563/37963 [23:50:42<131:18:20, 14.59s/it]
 15%|█▍        | 5564/37963 [23:50:57<130:40:37, 14.52s/it]
 15%|█▍        | 5565/37963 [23:51:11<129:52:50, 14.43s/it]
 15%|█▍        | 5566/37963 [23:51:25<129:41:54, 14.41s/it]
 15%|█▍        | 5567/37963 [23:51:39<128:36:35, 14.29s/it]
 15%|█▍        | 5568/37963 [23:51:53<128:04:34, 14.23s/it]
 15%|█▍        | 5569/37963 [23:52:08<128:02:25, 14.23s/it]
 15%|█▍        | 5570/37963 [23:52:21<126:03:40, 14.01s/it]
                                                           
{'loss': '0.1633', 'grad_norm': '4.123', 'learning_rate': '1.929e-05', 'epoch': '0.1467'}

 15%|█▍        | 5570/37963 [23:52:21<126:03:40, 14.01s/it]
 15%|█▍        | 5571/37963 [23:52:36<127:01:17, 14.12s/it]
 15%|█▍        | 5572/37963 [23:52:50<127:46:25, 14.20s/it]
 15%|█▍        | 5573/37963 [23:53:04<127:45:38, 14.20s/it]
 15%|█▍        | 5574/37963 [23:53:19<128:29:16, 14.28s/it]
 15%|█▍        | 5575/37963 [23:53:33<128:47:17, 14.32s/it]
 15%|█▍        | 5576/37963 [23:53:47<128:28:02, 14.28s/it]
 15%|█▍        | 5577/37963 [23:54:01<128:22:36, 14.27s/it]
 15%|█▍        | 5578/37963 [23:54:15<127:40:26, 14.19s/it]
 15%|█▍        | 5579/37963 [23:54:36<143:41:31, 15.97s/it]
 15%|█▍        | 5580/37963 [23:54:50<138:40:53, 15.42s/it]
                                                           
{'loss': '0.1827', 'grad_norm': '3.349', 'learning_rate': '1.929e-05', 'epoch': '0.147'}

 15%|█▍        | 5580/37963 [23:54:50<138:40:53, 15.42s/it]
 15%|█▍        | 5581/37963 [23:55:04<135:41:01, 15.08s/it]
 15%|█▍        | 5582/37963 [23:55:18<133:35:57, 14.85s/it]
 15%|█▍        | 5583/37963 [23:55:32<131:41:46, 14.64s/it]
 15%|█▍        | 5584/37963 [23:55:47<130:47:21, 14.54s/it]
 15%|█▍        | 5585/37963 [23:56:01<130:29:25, 14.51s/it]
 15%|█▍        | 5586/37963 [23:56:15<129:31:24, 14.40s/it]
 15%|█▍        | 5587/37963 [23:56:36<146:50:09, 16.33s/it]
 15%|█▍        | 5588/37963 [23:56:50<141:19:11, 15.71s/it]
 15%|█▍        | 5589/37963 [23:57:05<137:34:29, 15.30s/it]
 15%|█▍        | 5590/37963 [23:57:19<134:57:49, 15.01s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '1.24', 'learning_rate': '1.929e-05', 'epoch': '0.1472'}

 15%|█▍        | 5590/37963 [23:57:19<134:57:49, 15.01s/it]
 15%|█▍        | 5591/37963 [23:57:33<131:47:50, 14.66s/it]
 15%|█▍        | 5592/37963 [23:57:47<130:41:18, 14.53s/it]
 15%|█▍        | 5593/37963 [23:58:08<146:12:47, 16.26s/it]
 15%|█▍        | 5594/37963 [23:58:22<141:11:49, 15.70s/it]
 15%|█▍        | 5595/37963 [23:58:36<137:24:19, 15.28s/it]
 15%|█▍        | 5596/37963 [23:58:50<133:34:56, 14.86s/it]
 15%|█▍        | 5597/37963 [23:59:11<150:44:18, 16.77s/it]
 15%|█▍        | 5598/37963 [23:59:26<144:08:35, 16.03s/it]
 15%|█▍        | 5599/37963 [23:59:40<139:54:09, 15.56s/it]
 15%|█▍        | 5600/37963 [24:00:01<154:56:46, 17.24s/it]
                                                           
{'loss': '0.1723', 'grad_norm': '3.166', 'learning_rate': '1.928e-05', 'epoch': '0.1475'}

 15%|█▍        | 5600/37963 [24:00:01<154:56:46, 17.24s/it]
 15%|█▍        | 5601/37963 [24:00:16<147:06:34, 16.36s/it]
 15%|█▍        | 5602/37963 [24:00:37<160:00:31, 17.80s/it]
 15%|█▍        | 5603/37963 [24:00:51<150:43:51, 16.77s/it]
 15%|█▍        | 5604/37963 [24:01:05<144:04:42, 16.03s/it]
 15%|█▍        | 5605/37963 [24:01:27<157:48:28, 17.56s/it]
 15%|█▍        | 5606/37963 [24:01:40<147:19:23, 16.39s/it]
 15%|█▍        | 5607/37963 [24:01:54<141:32:13, 15.75s/it]
 15%|█▍        | 5608/37963 [24:02:09<137:25:38, 15.29s/it]
 15%|█▍        | 5609/37963 [24:02:23<134:51:11, 15.00s/it]
 15%|█▍        | 5610/37963 [24:02:37<132:55:03, 14.79s/it]
                                                           
{'loss': '0.1736', 'grad_norm': '4.347', 'learning_rate': '1.928e-05', 'epoch': '0.1478'}

 15%|█▍        | 5610/37963 [24:02:37<132:55:03, 14.79s/it]
 15%|█▍        | 5611/37963 [24:02:52<132:06:21, 14.70s/it]
 15%|█▍        | 5612/37963 [24:03:06<131:12:25, 14.60s/it]
 15%|█▍        | 5613/37963 [24:03:20<130:26:49, 14.52s/it]
 15%|█▍        | 5614/37963 [24:03:35<129:46:00, 14.44s/it]
 15%|█▍        | 5615/37963 [24:03:49<129:34:25, 14.42s/it]
 15%|█▍        | 5616/37963 [24:04:03<129:16:10, 14.39s/it]
 15%|█▍        | 5617/37963 [24:04:18<129:05:53, 14.37s/it]
 15%|█▍        | 5618/37963 [24:04:32<129:03:07, 14.36s/it]
 15%|█▍        | 5619/37963 [24:04:46<129:03:53, 14.37s/it]
 15%|█▍        | 5620/37963 [24:05:01<128:54:27, 14.35s/it]
                                                           
{'loss': '0.1562', 'grad_norm': '1.827', 'learning_rate': '1.928e-05', 'epoch': '0.148'}

 15%|█▍        | 5620/37963 [24:05:01<128:54:27, 14.35s/it]
 15%|█▍        | 5621/37963 [24:05:15<129:04:39, 14.37s/it]
 15%|█▍        | 5622/37963 [24:05:29<128:02:18, 14.25s/it]
 15%|█▍        | 5623/37963 [24:05:44<128:45:08, 14.33s/it]
 15%|█▍        | 5624/37963 [24:05:58<128:55:23, 14.35s/it]
 15%|█▍        | 5625/37963 [24:06:13<129:09:47, 14.38s/it]
 15%|█▍        | 5626/37963 [24:06:27<129:11:27, 14.38s/it]
 15%|█▍        | 5627/37963 [24:06:48<146:10:40, 16.27s/it]
 15%|█▍        | 5628/37963 [24:07:02<141:11:51, 15.72s/it]
 15%|█▍        | 5629/37963 [24:07:16<137:49:13, 15.34s/it]
 15%|█▍        | 5630/37963 [24:07:31<135:07:13, 15.04s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '3.46', 'learning_rate': '1.928e-05', 'epoch': '0.1483'}

 15%|█▍        | 5630/37963 [24:07:31<135:07:13, 15.04s/it]
 15%|█▍        | 5631/37963 [24:07:45<133:21:09, 14.85s/it]
 15%|█▍        | 5632/37963 [24:07:59<130:21:30, 14.52s/it]
 15%|█▍        | 5633/37963 [24:08:14<130:31:24, 14.53s/it]
 15%|█▍        | 5634/37963 [24:08:28<130:03:07, 14.48s/it]
 15%|█▍        | 5635/37963 [24:08:48<144:57:08, 16.14s/it]
 15%|█▍        | 5636/37963 [24:09:02<140:27:42, 15.64s/it]
 15%|█▍        | 5637/37963 [24:09:23<154:09:04, 17.17s/it]
 15%|█▍        | 5638/37963 [24:09:38<146:40:36, 16.34s/it]
 15%|█▍        | 5639/37963 [24:09:52<141:33:14, 15.77s/it]
 15%|█▍        | 5640/37963 [24:10:13<155:22:31, 17.31s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '4.831', 'learning_rate': '1.927e-05', 'epoch': '0.1486'}

 15%|█▍        | 5640/37963 [24:10:13<155:22:31, 17.31s/it]
 15%|█▍        | 5641/37963 [24:10:27<147:16:52, 16.40s/it]
 15%|█▍        | 5642/37963 [24:10:42<141:56:01, 15.81s/it]
 15%|█▍        | 5643/37963 [24:10:56<137:37:07, 15.33s/it]
 15%|█▍        | 5644/37963 [24:11:10<135:17:02, 15.07s/it]
 15%|█▍        | 5645/37963 [24:11:32<153:43:00, 17.12s/it]
 15%|█▍        | 5646/37963 [24:11:47<146:44:35, 16.35s/it]
 15%|█▍        | 5647/37963 [24:12:01<140:48:04, 15.69s/it]
 15%|█▍        | 5648/37963 [24:12:15<137:29:54, 15.32s/it]
 15%|█▍        | 5649/37963 [24:12:36<152:12:16, 16.96s/it]
 15%|█▍        | 5650/37963 [24:12:51<145:30:05, 16.21s/it]
                                                           
{'loss': '0.165', 'grad_norm': '4.825', 'learning_rate': '1.927e-05', 'epoch': '0.1488'}

 15%|█▍        | 5650/37963 [24:12:51<145:30:05, 16.21s/it]
 15%|█▍        | 5651/37963 [24:13:11<157:05:47, 17.50s/it]
 15%|█▍        | 5652/37963 [24:13:33<167:55:25, 18.71s/it]
 15%|█▍        | 5653/37963 [24:13:47<156:08:15, 17.40s/it]
 15%|█▍        | 5654/37963 [24:14:01<148:06:41, 16.50s/it]
 15%|█▍        | 5655/37963 [24:14:16<141:54:59, 15.81s/it]
 15%|█▍        | 5656/37963 [24:14:30<137:55:44, 15.37s/it]
 15%|█▍        | 5657/37963 [24:14:44<134:39:58, 15.01s/it]
 15%|█▍        | 5658/37963 [24:14:58<133:02:13, 14.83s/it]
 15%|█▍        | 5659/37963 [24:15:13<131:23:55, 14.64s/it]
 15%|█▍        | 5660/37963 [24:15:27<130:14:15, 14.51s/it]
                                                           
{'loss': '0.1842', 'grad_norm': '2.146', 'learning_rate': '1.927e-05', 'epoch': '0.1491'}

 15%|█▍        | 5660/37963 [24:15:27<130:14:15, 14.51s/it]
 15%|█▍        | 5661/37963 [24:15:41<128:30:48, 14.32s/it]
 15%|█▍        | 5662/37963 [24:15:55<128:32:43, 14.33s/it]
 15%|█▍        | 5663/37963 [24:16:10<128:48:44, 14.36s/it]
 15%|█▍        | 5664/37963 [24:16:24<128:55:32, 14.37s/it]
 15%|█▍        | 5665/37963 [24:16:38<129:14:51, 14.41s/it]
 15%|█▍        | 5666/37963 [24:16:53<129:07:40, 14.39s/it]
 15%|█▍        | 5667/37963 [24:17:07<128:55:27, 14.37s/it]
 15%|█▍        | 5668/37963 [24:17:21<128:57:52, 14.38s/it]
 15%|█▍        | 5669/37963 [24:17:36<128:55:37, 14.37s/it]
 15%|█▍        | 5670/37963 [24:17:50<129:38:14, 14.45s/it]
                                                           
{'loss': '0.185', 'grad_norm': '7.353', 'learning_rate': '1.926e-05', 'epoch': '0.1494'}

 15%|█▍        | 5670/37963 [24:17:50<129:38:14, 14.45s/it]
 15%|█▍        | 5671/37963 [24:18:04<128:17:42, 14.30s/it]
 15%|█▍        | 5672/37963 [24:18:19<128:21:22, 14.31s/it]
 15%|█▍        | 5673/37963 [24:18:33<128:24:54, 14.32s/it]
 15%|█▍        | 5674/37963 [24:18:47<128:31:49, 14.33s/it]
 15%|█▍        | 5675/37963 [24:19:08<146:14:04, 16.30s/it]
 15%|█▍        | 5676/37963 [24:19:23<141:20:11, 15.76s/it]
 15%|█▍        | 5677/37963 [24:19:37<137:35:59, 15.34s/it]
 15%|█▍        | 5678/37963 [24:19:51<133:37:43, 14.90s/it]
 15%|█▍        | 5679/37963 [24:20:05<131:57:42, 14.72s/it]
 15%|█▍        | 5680/37963 [24:20:20<130:57:10, 14.60s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '0.876', 'learning_rate': '1.926e-05', 'epoch': '0.1496'}

 15%|█▍        | 5680/37963 [24:20:20<130:57:10, 14.60s/it]
 15%|█▍        | 5681/37963 [24:20:33<128:25:31, 14.32s/it]
 15%|█▍        | 5682/37963 [24:20:54<146:11:58, 16.30s/it]
 15%|█▍        | 5683/37963 [24:21:09<141:04:16, 15.73s/it]
 15%|█▍        | 5684/37963 [24:21:23<137:14:16, 15.31s/it]
 15%|█▍        | 5685/37963 [24:21:38<135:06:58, 15.07s/it]
 15%|█▍        | 5686/37963 [24:21:58<149:24:22, 16.66s/it]
 15%|█▍        | 5687/37963 [24:22:12<143:21:08, 15.99s/it]
 15%|█▍        | 5688/37963 [24:22:33<156:22:06, 17.44s/it]
 15%|█▍        | 5689/37963 [24:22:47<147:15:08, 16.43s/it]
 15%|█▍        | 5690/37963 [24:23:02<142:11:33, 15.86s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '1.64', 'learning_rate': '1.926e-05', 'epoch': '0.1499'}

 15%|█▍        | 5690/37963 [24:23:02<142:11:33, 15.86s/it]
 15%|█▍        | 5691/37963 [24:23:16<138:14:44, 15.42s/it]
 15%|█▍        | 5692/37963 [24:23:31<135:40:09, 15.13s/it]
 15%|█▍        | 5693/37963 [24:23:44<131:56:31, 14.72s/it]
 15%|█▍        | 5694/37963 [24:24:06<150:23:31, 16.78s/it]
 15%|█▌        | 5695/37963 [24:24:20<143:52:28, 16.05s/it]
 15%|█▌        | 5696/37963 [24:24:35<139:30:51, 15.57s/it]
 15%|█▌        | 5697/37963 [24:24:55<151:18:06, 16.88s/it]
 15%|█▌        | 5698/37963 [24:25:09<144:21:26, 16.11s/it]
 15%|█▌        | 5699/37963 [24:25:30<157:27:02, 17.57s/it]
 15%|█▌        | 5700/37963 [24:25:44<148:26:13, 16.56s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '3.821', 'learning_rate': '1.925e-05', 'epoch': '0.1501'}

 15%|█▌        | 5700/37963 [24:25:44<148:26:13, 16.56s/it]
 15%|█▌        | 5701/37963 [24:26:05<161:10:17, 17.98s/it]
 15%|█▌        | 5702/37963 [24:26:20<151:33:25, 16.91s/it]
 15%|█▌        | 5703/37963 [24:26:34<144:33:27, 16.13s/it]
 15%|█▌        | 5704/37963 [24:26:49<139:40:54, 15.59s/it]
 15%|█▌        | 5705/37963 [24:27:03<136:21:07, 15.22s/it]
 15%|█▌        | 5706/37963 [24:27:17<134:06:20, 14.97s/it]
 15%|█▌        | 5707/37963 [24:27:32<132:35:36, 14.80s/it]
 15%|█▌        | 5708/37963 [24:27:46<130:54:34, 14.61s/it]
 15%|█▌        | 5709/37963 [24:28:00<130:14:20, 14.54s/it]
 15%|█▌        | 5710/37963 [24:28:15<129:39:30, 14.47s/it]
                                                           
{'loss': '0.1654', 'grad_norm': '7.499', 'learning_rate': '1.925e-05', 'epoch': '0.1504'}

 15%|█▌        | 5710/37963 [24:28:15<129:39:30, 14.47s/it]
 15%|█▌        | 5711/37963 [24:28:29<129:25:34, 14.45s/it]
 15%|█▌        | 5712/37963 [24:28:43<129:16:28, 14.43s/it]
 15%|█▌        | 5713/37963 [24:28:58<128:43:07, 14.37s/it]
 15%|█▌        | 5714/37963 [24:29:12<128:56:26, 14.39s/it]
 15%|█▌        | 5715/37963 [24:29:26<128:42:30, 14.37s/it]
 15%|█▌        | 5716/37963 [24:29:40<128:08:31, 14.31s/it]
 15%|█▌        | 5717/37963 [24:29:55<127:50:06, 14.27s/it]
 15%|█▌        | 5718/37963 [24:30:09<128:24:44, 14.34s/it]
 15%|█▌        | 5719/37963 [24:30:23<127:34:45, 14.24s/it]
 15%|█▌        | 5720/37963 [24:30:38<128:01:58, 14.30s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '6.288', 'learning_rate': '1.925e-05', 'epoch': '0.1507'}

 15%|█▌        | 5720/37963 [24:30:38<128:01:58, 14.30s/it]
 15%|█▌        | 5721/37963 [24:30:52<128:05:59, 14.30s/it]
 15%|█▌        | 5722/37963 [24:31:06<128:20:39, 14.33s/it]
 15%|█▌        | 5723/37963 [24:31:21<128:42:22, 14.37s/it]
 15%|█▌        | 5724/37963 [24:31:42<145:50:02, 16.28s/it]
 15%|█▌        | 5725/37963 [24:31:56<139:47:11, 15.61s/it]
 15%|█▌        | 5726/37963 [24:32:10<136:31:39, 15.25s/it]
 15%|█▌        | 5727/37963 [24:32:23<131:49:00, 14.72s/it]
 15%|█▌        | 5728/37963 [24:32:38<130:14:17, 14.54s/it]
 15%|█▌        | 5729/37963 [24:32:52<129:46:27, 14.49s/it]
 15%|█▌        | 5730/37963 [24:33:06<129:26:57, 14.46s/it]
                                                           
{'loss': '0.1729', 'grad_norm': '3.472', 'learning_rate': '1.924e-05', 'epoch': '0.1509'}

 15%|█▌        | 5730/37963 [24:33:06<129:26:57, 14.46s/it]
 15%|█▌        | 5731/37963 [24:33:27<146:46:44, 16.39s/it]
 15%|█▌        | 5732/37963 [24:33:42<141:45:30, 15.83s/it]
 15%|█▌        | 5733/37963 [24:33:56<138:12:44, 15.44s/it]
 15%|█▌        | 5734/37963 [24:34:11<135:00:37, 15.08s/it]
 15%|█▌        | 5735/37963 [24:34:31<150:18:14, 16.79s/it]
 15%|█▌        | 5736/37963 [24:34:46<143:36:57, 16.04s/it]
 15%|█▌        | 5737/37963 [24:35:07<157:02:28, 17.54s/it]
 15%|█▌        | 5738/37963 [24:35:21<147:19:31, 16.46s/it]
 15%|█▌        | 5739/37963 [24:35:34<140:29:36, 15.70s/it]
 15%|█▌        | 5740/37963 [24:35:49<136:24:39, 15.24s/it]
                                                           
{'loss': '0.1773', 'grad_norm': '5.838', 'learning_rate': '1.924e-05', 'epoch': '0.1512'}

 15%|█▌        | 5740/37963 [24:35:49<136:24:39, 15.24s/it]
 15%|█▌        | 5741/37963 [24:36:03<133:54:21, 14.96s/it]
 15%|█▌        | 5742/37963 [24:36:25<151:42:15, 16.95s/it]
 15%|█▌        | 5743/37963 [24:36:39<144:31:41, 16.15s/it]
 15%|█▌        | 5744/37963 [24:36:59<156:10:42, 17.45s/it]
 15%|█▌        | 5745/37963 [24:37:14<147:58:20, 16.53s/it]
 15%|█▌        | 5746/37963 [24:37:28<142:31:22, 15.93s/it]
 15%|█▌        | 5747/37963 [24:37:43<138:04:40, 15.43s/it]
 15%|█▌        | 5748/37963 [24:38:04<153:20:29, 17.14s/it]
 15%|█▌        | 5749/37963 [24:38:18<145:02:59, 16.21s/it]
 15%|█▌        | 5750/37963 [24:38:32<139:01:33, 15.54s/it]
                                                           
{'loss': '0.1621', 'grad_norm': '5.276', 'learning_rate': '1.924e-05', 'epoch': '0.1515'}

 15%|█▌        | 5750/37963 [24:38:32<139:01:33, 15.54s/it]
 15%|█▌        | 5751/37963 [24:38:46<135:59:08, 15.20s/it]
 15%|█▌        | 5752/37963 [24:39:00<133:31:51, 14.92s/it]
 15%|█▌        | 5753/37963 [24:39:21<149:18:34, 16.69s/it]
 15%|█▌        | 5754/37963 [24:39:36<143:45:21, 16.07s/it]
 15%|█▌        | 5755/37963 [24:39:50<138:50:00, 15.52s/it]
 15%|█▌        | 5756/37963 [24:40:04<135:44:01, 15.17s/it]
 15%|█▌        | 5757/37963 [24:40:19<133:24:57, 14.91s/it]
 15%|█▌        | 5758/37963 [24:40:33<131:58:37, 14.75s/it]
 15%|█▌        | 5759/37963 [24:40:48<131:24:35, 14.69s/it]
 15%|█▌        | 5760/37963 [24:41:02<130:36:21, 14.60s/it]
                                                           
{'loss': '0.163', 'grad_norm': '4.675', 'learning_rate': '1.923e-05', 'epoch': '0.1517'}

 15%|█▌        | 5760/37963 [24:41:02<130:36:21, 14.60s/it]
 15%|█▌        | 5761/37963 [24:41:16<129:53:20, 14.52s/it]
 15%|█▌        | 5762/37963 [24:41:30<128:44:57, 14.39s/it]
 15%|█▌        | 5763/37963 [24:41:45<128:35:39, 14.38s/it]
 15%|█▌        | 5764/37963 [24:41:59<128:31:34, 14.37s/it]
 15%|█▌        | 5765/37963 [24:42:13<128:09:40, 14.33s/it]
 15%|█▌        | 5766/37963 [24:42:27<127:32:07, 14.26s/it]
 15%|█▌        | 5767/37963 [24:42:42<127:57:52, 14.31s/it]
 15%|█▌        | 5768/37963 [24:42:56<128:07:33, 14.33s/it]
 15%|█▌        | 5769/37963 [24:43:11<128:12:35, 14.34s/it]
 15%|█▌        | 5770/37963 [24:43:25<128:21:45, 14.35s/it]
                                                           
{'loss': '0.1654', 'grad_norm': '1.023', 'learning_rate': '1.923e-05', 'epoch': '0.152'}

 15%|█▌        | 5770/37963 [24:43:25<128:21:45, 14.35s/it]
 15%|█▌        | 5771/37963 [24:43:39<126:44:25, 14.17s/it]
 15%|█▌        | 5772/37963 [24:43:53<126:59:41, 14.20s/it]
 15%|█▌        | 5773/37963 [24:44:14<144:08:55, 16.12s/it]
 15%|█▌        | 5774/37963 [24:44:28<139:39:39, 15.62s/it]
 15%|█▌        | 5775/37963 [24:44:42<134:46:33, 15.07s/it]
 15%|█▌        | 5776/37963 [24:44:56<132:46:51, 14.85s/it]
 15%|█▌        | 5777/37963 [24:45:11<131:28:12, 14.70s/it]
 15%|█▌        | 5778/37963 [24:45:25<130:38:30, 14.61s/it]
 15%|█▌        | 5779/37963 [24:45:39<129:58:15, 14.54s/it]
 15%|█▌        | 5780/37963 [24:46:00<146:36:46, 16.40s/it]
                                                           
{'loss': '0.1655', 'grad_norm': '2.327', 'learning_rate': '1.923e-05', 'epoch': '0.1523'}

 15%|█▌        | 5780/37963 [24:46:00<146:36:46, 16.40s/it]
 15%|█▌        | 5781/37963 [24:46:14<140:55:26, 15.76s/it]
 15%|█▌        | 5782/37963 [24:46:35<152:59:47, 17.12s/it]
 15%|█▌        | 5783/37963 [24:46:49<145:52:05, 16.32s/it]
 15%|█▌        | 5784/37963 [24:47:10<158:01:25, 17.68s/it]
 15%|█▌        | 5785/37963 [24:47:24<148:59:48, 16.67s/it]
 15%|█▌        | 5786/37963 [24:47:39<142:49:54, 15.98s/it]
 15%|█▌        | 5787/37963 [24:47:53<138:28:35, 15.49s/it]
 15%|█▌        | 5788/37963 [24:48:07<135:21:29, 15.14s/it]
 15%|█▌        | 5789/37963 [24:48:22<133:25:30, 14.93s/it]
 15%|█▌        | 5790/37963 [24:48:36<131:38:59, 14.73s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '2.102', 'learning_rate': '1.922e-05', 'epoch': '0.1525'}

 15%|█▌        | 5790/37963 [24:48:36<131:38:59, 14.73s/it]
 15%|█▌        | 5791/37963 [24:48:58<150:38:30, 16.86s/it]
 15%|█▌        | 5792/37963 [24:49:19<161:12:38, 18.04s/it]
 15%|█▌        | 5793/37963 [24:49:33<151:26:24, 16.95s/it]
 15%|█▌        | 5794/37963 [24:49:47<144:34:55, 16.18s/it]
 15%|█▌        | 5795/37963 [24:50:02<139:36:44, 15.62s/it]
 15%|█▌        | 5796/37963 [24:50:23<154:10:18, 17.25s/it]
 15%|█▌        | 5797/37963 [24:50:37<146:38:42, 16.41s/it]
 15%|█▌        | 5798/37963 [24:50:52<141:07:54, 15.80s/it]
 15%|█▌        | 5799/37963 [24:51:06<137:07:33, 15.35s/it]
 15%|█▌        | 5800/37963 [24:51:20<134:22:48, 15.04s/it]
                                                           
{'loss': '0.1715', 'grad_norm': '8.608', 'learning_rate': '1.922e-05', 'epoch': '0.1528'}

 15%|█▌        | 5800/37963 [24:51:20<134:22:48, 15.04s/it]
 15%|█▌        | 5801/37963 [24:51:35<132:45:54, 14.86s/it]
 15%|█▌        | 5802/37963 [24:51:49<130:19:19, 14.59s/it]
 15%|█▌        | 5803/37963 [24:52:10<147:38:08, 16.53s/it]
 15%|█▌        | 5804/37963 [24:52:23<140:27:54, 15.72s/it]
 15%|█▌        | 5805/37963 [24:52:38<137:27:04, 15.39s/it]
 15%|█▌        | 5806/37963 [24:52:52<133:52:22, 14.99s/it]
 15%|█▌        | 5807/37963 [24:53:06<131:59:13, 14.78s/it]
 15%|█▌        | 5808/37963 [24:53:21<130:43:43, 14.64s/it]
 15%|█▌        | 5809/37963 [24:53:35<129:05:19, 14.45s/it]
 15%|█▌        | 5810/37963 [24:53:49<128:48:45, 14.42s/it]
                                                           
{'loss': '0.169', 'grad_norm': '4.208', 'learning_rate': '1.922e-05', 'epoch': '0.153'}

 15%|█▌        | 5810/37963 [24:53:49<128:48:45, 14.42s/it]
 15%|█▌        | 5811/37963 [24:54:03<128:38:08, 14.40s/it]
 15%|█▌        | 5812/37963 [24:54:18<127:59:06, 14.33s/it]
 15%|█▌        | 5813/37963 [24:54:32<128:30:10, 14.39s/it]
 15%|█▌        | 5814/37963 [24:54:46<128:18:00, 14.37s/it]
 15%|█▌        | 5815/37963 [24:55:01<128:22:35, 14.38s/it]
 15%|█▌        | 5816/37963 [24:55:15<127:38:15, 14.29s/it]
 15%|█▌        | 5817/37963 [24:55:29<127:49:21, 14.31s/it]
 15%|█▌        | 5818/37963 [24:55:44<128:11:13, 14.36s/it]
 15%|█▌        | 5819/37963 [24:55:58<128:02:51, 14.34s/it]
 15%|█▌        | 5820/37963 [24:56:12<128:05:25, 14.35s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '1.11', 'learning_rate': '1.921e-05', 'epoch': '0.1533'}

 15%|█▌        | 5820/37963 [24:56:12<128:05:25, 14.35s/it]
 15%|█▌        | 5821/37963 [24:56:27<127:58:06, 14.33s/it]
 15%|█▌        | 5822/37963 [24:56:41<127:58:56, 14.33s/it]
 15%|█▌        | 5823/37963 [24:56:55<127:38:46, 14.30s/it]
 15%|█▌        | 5824/37963 [24:57:16<143:50:15, 16.11s/it]
 15%|█▌        | 5825/37963 [24:57:30<139:19:27, 15.61s/it]
 15%|█▌        | 5826/37963 [24:57:44<135:54:34, 15.22s/it]
 15%|█▌        | 5827/37963 [24:57:59<133:58:57, 15.01s/it]
 15%|█▌        | 5828/37963 [24:58:13<132:39:18, 14.86s/it]
 15%|█▌        | 5829/37963 [24:58:28<131:29:58, 14.73s/it]
 15%|█▌        | 5830/37963 [24:58:42<130:10:46, 14.58s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '2.1', 'learning_rate': '1.921e-05', 'epoch': '0.1536'}

 15%|█▌        | 5830/37963 [24:58:42<130:10:46, 14.58s/it]
 15%|█▌        | 5831/37963 [24:59:03<146:43:25, 16.44s/it]
 15%|█▌        | 5832/37963 [24:59:24<159:15:10, 17.84s/it]
 15%|█▌        | 5833/37963 [24:59:45<168:03:28, 18.83s/it]
 15%|█▌        | 5834/37963 [24:59:59<156:00:30, 17.48s/it]
 15%|█▌        | 5835/37963 [25:00:14<147:27:43, 16.52s/it]
 15%|█▌        | 5836/37963 [25:00:28<140:32:40, 15.75s/it]
 15%|█▌        | 5837/37963 [25:00:42<137:07:43, 15.37s/it]
 15%|█▌        | 5838/37963 [25:01:03<151:50:05, 17.01s/it]
 15%|█▌        | 5839/37963 [25:01:24<162:41:01, 18.23s/it]
 15%|█▌        | 5840/37963 [25:01:39<152:27:55, 17.09s/it]
                                                           
{'loss': '0.156', 'grad_norm': '4.76', 'learning_rate': '1.921e-05', 'epoch': '0.1538'}

 15%|█▌        | 5840/37963 [25:01:39<152:27:55, 17.09s/it]
 15%|█▌        | 5841/37963 [25:01:53<145:26:29, 16.30s/it]
 15%|█▌        | 5842/37963 [25:02:07<140:11:14, 15.71s/it]
 15%|█▌        | 5843/37963 [25:02:22<136:25:38, 15.29s/it]
 15%|█▌        | 5844/37963 [25:02:43<152:30:31, 17.09s/it]
 15%|█▌        | 5845/37963 [25:02:57<144:12:28, 16.16s/it]
 15%|█▌        | 5846/37963 [25:03:11<138:35:24, 15.53s/it]
 15%|█▌        | 5847/37963 [25:03:25<133:50:15, 15.00s/it]
 15%|█▌        | 5848/37963 [25:03:39<132:10:58, 14.82s/it]
 15%|█▌        | 5849/37963 [25:03:54<131:02:25, 14.69s/it]
 15%|█▌        | 5850/37963 [25:04:08<129:58:54, 14.57s/it]
                                                           
{'loss': '0.1595', 'grad_norm': '2.21', 'learning_rate': '1.92e-05', 'epoch': '0.1541'}

 15%|█▌        | 5850/37963 [25:04:08<129:58:54, 14.57s/it]
 15%|█▌        | 5851/37963 [25:04:22<128:22:54, 14.39s/it]
 15%|█▌        | 5852/37963 [25:04:36<128:13:47, 14.38s/it]
 15%|█▌        | 5853/37963 [25:04:51<128:15:50, 14.38s/it]
 15%|█▌        | 5854/37963 [25:05:11<143:52:23, 16.13s/it]
 15%|█▌        | 5855/37963 [25:05:25<139:01:25, 15.59s/it]
 15%|█▌        | 5856/37963 [25:05:39<135:48:05, 15.23s/it]
 15%|█▌        | 5857/37963 [25:05:53<132:25:55, 14.85s/it]
 15%|█▌        | 5858/37963 [25:06:07<130:11:25, 14.60s/it]
 15%|█▌        | 5859/37963 [25:06:22<129:58:18, 14.57s/it]
 15%|█▌        | 5860/37963 [25:06:36<129:18:35, 14.50s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '1.261', 'learning_rate': '1.92e-05', 'epoch': '0.1544'}

 15%|█▌        | 5860/37963 [25:06:36<129:18:35, 14.50s/it]
 15%|█▌        | 5861/37963 [25:06:51<129:02:38, 14.47s/it]
 15%|█▌        | 5862/37963 [25:07:05<128:38:17, 14.43s/it]
 15%|█▌        | 5863/37963 [25:07:19<128:47:37, 14.44s/it]
 15%|█▌        | 5864/37963 [25:07:34<128:03:36, 14.36s/it]
 15%|█▌        | 5865/37963 [25:07:48<128:07:58, 14.37s/it]
 15%|█▌        | 5866/37963 [25:08:02<126:58:56, 14.24s/it]
 15%|█▌        | 5867/37963 [25:08:16<125:48:31, 14.11s/it]
 15%|█▌        | 5868/37963 [25:08:30<126:21:16, 14.17s/it]
 15%|█▌        | 5869/37963 [25:08:45<127:11:54, 14.27s/it]
 15%|█▌        | 5870/37963 [25:08:59<127:50:05, 14.34s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '1.973', 'learning_rate': '1.92e-05', 'epoch': '0.1546'}

 15%|█▌        | 5870/37963 [25:08:59<127:50:05, 14.34s/it]
 15%|█▌        | 5871/37963 [25:09:13<127:30:23, 14.30s/it]
 15%|█▌        | 5872/37963 [25:09:27<126:28:01, 14.19s/it]
 15%|█▌        | 5873/37963 [25:09:48<142:59:25, 16.04s/it]
 15%|█▌        | 5874/37963 [25:10:01<136:57:39, 15.37s/it]
 15%|█▌        | 5875/37963 [25:10:15<132:40:50, 14.89s/it]
 15%|█▌        | 5876/37963 [25:10:30<131:20:31, 14.74s/it]
 15%|█▌        | 5877/37963 [25:10:44<130:33:25, 14.65s/it]
 15%|█▌        | 5878/37963 [25:10:58<128:50:38, 14.46s/it]
 15%|█▌        | 5879/37963 [25:11:13<129:00:13, 14.47s/it]
 15%|█▌        | 5880/37963 [25:11:40<163:18:17, 18.32s/it]
                                                           
{'loss': '0.158', 'grad_norm': '3.714', 'learning_rate': '1.919e-05', 'epoch': '0.1549'}

 15%|█▌        | 5880/37963 [25:11:40<163:18:17, 18.32s/it]
 15%|█▌        | 5881/37963 [25:12:01<170:15:12, 19.10s/it]
 15%|█▌        | 5882/37963 [25:12:15<157:25:46, 17.67s/it]
 15%|█▌        | 5883/37963 [25:12:36<165:20:03, 18.55s/it]
 15%|█▌        | 5884/37963 [25:12:50<153:08:51, 17.19s/it]
 16%|█▌        | 5885/37963 [25:13:04<145:43:28, 16.35s/it]
 16%|█▌        | 5886/37963 [25:13:18<140:20:57, 15.75s/it]
 16%|█▌        | 5887/37963 [25:13:33<136:26:49, 15.31s/it]
 16%|█▌        | 5888/37963 [25:13:53<150:16:33, 16.87s/it]
 16%|█▌        | 5889/37963 [25:14:07<142:26:36, 15.99s/it]
 16%|█▌        | 5890/37963 [25:14:21<138:00:37, 15.49s/it]
                                                           
{'loss': '0.159', 'grad_norm': '4.763', 'learning_rate': '1.919e-05', 'epoch': '0.1552'}

 16%|█▌        | 5890/37963 [25:14:21<138:00:37, 15.49s/it]
 16%|█▌        | 5891/37963 [25:14:36<135:04:30, 15.16s/it]
 16%|█▌        | 5892/37963 [25:14:50<131:58:47, 14.81s/it]
 16%|█▌        | 5893/37963 [25:15:11<149:22:21, 16.77s/it]
 16%|█▌        | 5894/37963 [25:15:25<142:43:08, 16.02s/it]
 16%|█▌        | 5895/37963 [25:15:40<137:52:18, 15.48s/it]
 16%|█▌        | 5896/37963 [25:15:54<134:46:12, 15.13s/it]
 16%|█▌        | 5897/37963 [25:16:08<132:55:52, 14.92s/it]
 16%|█▌        | 5898/37963 [25:16:23<131:07:38, 14.72s/it]
 16%|█▌        | 5899/37963 [25:16:37<129:25:09, 14.53s/it]
 16%|█▌        | 5900/37963 [25:16:51<129:13:45, 14.51s/it]
                                                           
{'loss': '0.1624', 'grad_norm': '0.9979', 'learning_rate': '1.919e-05', 'epoch': '0.1554'}

 16%|█▌        | 5900/37963 [25:16:51<129:13:45, 14.51s/it]
 16%|█▌        | 5901/37963 [25:17:12<147:04:31, 16.51s/it]
 16%|█▌        | 5902/37963 [25:17:27<141:28:01, 15.88s/it]
 16%|█▌        | 5903/37963 [25:17:41<137:53:16, 15.48s/it]
 16%|█▌        | 5904/37963 [25:17:56<134:42:58, 15.13s/it]
 16%|█▌        | 5905/37963 [25:18:10<132:54:28, 14.93s/it]
 16%|█▌        | 5906/37963 [25:18:25<132:13:34, 14.85s/it]
 16%|█▌        | 5907/37963 [25:18:39<130:52:58, 14.70s/it]
 16%|█▌        | 5908/37963 [25:18:54<129:54:11, 14.59s/it]
 16%|█▌        | 5909/37963 [25:19:07<127:54:40, 14.37s/it]
 16%|█▌        | 5910/37963 [25:19:22<127:45:54, 14.35s/it]
                                                           
{'loss': '0.163', 'grad_norm': '5.25', 'learning_rate': '1.918e-05', 'epoch': '0.1557'}

 16%|█▌        | 5910/37963 [25:19:22<127:45:54, 14.35s/it]
 16%|█▌        | 5911/37963 [25:19:36<127:43:04, 14.34s/it]
 16%|█▌        | 5912/37963 [25:19:50<127:16:22, 14.30s/it]
 16%|█▌        | 5913/37963 [25:20:04<127:08:53, 14.28s/it]
 16%|█▌        | 5914/37963 [25:20:19<127:24:21, 14.31s/it]
 16%|█▌        | 5915/37963 [25:20:33<127:44:40, 14.35s/it]
 16%|█▌        | 5916/37963 [25:20:48<127:46:28, 14.35s/it]
 16%|█▌        | 5917/37963 [25:21:02<127:48:57, 14.36s/it]
 16%|█▌        | 5918/37963 [25:21:16<127:32:51, 14.33s/it]
 16%|█▌        | 5919/37963 [25:21:31<127:53:38, 14.37s/it]
 16%|█▌        | 5920/37963 [25:21:45<127:45:18, 14.35s/it]
                                                           
{'loss': '0.1644', 'grad_norm': '1.867', 'learning_rate': '1.918e-05', 'epoch': '0.1559'}

 16%|█▌        | 5920/37963 [25:21:45<127:45:18, 14.35s/it]
 16%|█▌        | 5921/37963 [25:21:59<127:38:21, 14.34s/it]
 16%|█▌        | 5922/37963 [25:22:13<126:27:51, 14.21s/it]
 16%|█▌        | 5923/37963 [25:22:27<125:45:45, 14.13s/it]
 16%|█▌        | 5924/37963 [25:22:48<144:33:54, 16.24s/it]
 16%|█▌        | 5925/37963 [25:23:02<137:05:52, 15.41s/it]
 16%|█▌        | 5926/37963 [25:23:16<132:44:38, 14.92s/it]
 16%|█▌        | 5927/37963 [25:23:36<147:19:34, 16.56s/it]
 16%|█▌        | 5928/37963 [25:23:57<158:34:14, 17.82s/it]
 16%|█▌        | 5929/37963 [25:24:11<147:48:14, 16.61s/it]
 16%|█▌        | 5930/37963 [25:24:25<141:05:16, 15.86s/it]
                                                           
{'loss': '0.1757', 'grad_norm': '1.024', 'learning_rate': '1.918e-05', 'epoch': '0.1562'}

 16%|█▌        | 5930/37963 [25:24:25<141:05:16, 15.86s/it]
 16%|█▌        | 5931/37963 [25:24:45<154:12:12, 17.33s/it]
 16%|█▌        | 5932/37963 [25:25:00<146:22:48, 16.45s/it]
 16%|█▌        | 5933/37963 [25:25:14<140:46:17, 15.82s/it]
 16%|█▌        | 5934/37963 [25:25:35<154:20:31, 17.35s/it]
 16%|█▌        | 5935/37963 [25:25:49<145:53:00, 16.40s/it]
 16%|█▌        | 5936/37963 [25:26:04<140:32:03, 15.80s/it]
 16%|█▌        | 5937/37963 [25:26:18<136:46:46, 15.38s/it]
 16%|█▌        | 5938/37963 [25:26:39<151:50:22, 17.07s/it]
 16%|█▌        | 5939/37963 [25:26:53<144:32:57, 16.25s/it]
 16%|█▌        | 5940/37963 [25:27:07<138:30:28, 15.57s/it]
                                                           
{'loss': '0.1721', 'grad_norm': '1.552', 'learning_rate': '1.917e-05', 'epoch': '0.1565'}

 16%|█▌        | 5940/37963 [25:27:07<138:30:28, 15.57s/it]
 16%|█▌        | 5941/37963 [25:27:28<152:38:46, 17.16s/it]
 16%|█▌        | 5942/37963 [25:27:43<145:17:06, 16.33s/it]
 16%|█▌        | 5943/37963 [25:27:57<139:36:21, 15.70s/it]
 16%|█▌        | 5944/37963 [25:28:11<136:22:24, 15.33s/it]
 16%|█▌        | 5945/37963 [25:28:26<133:47:31, 15.04s/it]
 16%|█▌        | 5946/37963 [25:28:40<132:07:16, 14.86s/it]
 16%|█▌        | 5947/37963 [25:28:55<131:03:18, 14.74s/it]
 16%|█▌        | 5948/37963 [25:29:09<129:56:38, 14.61s/it]
 16%|█▌        | 5949/37963 [25:29:30<148:00:02, 16.64s/it]
 16%|█▌        | 5950/37963 [25:29:45<142:03:13, 15.97s/it]
                                                           
{'loss': '0.171', 'grad_norm': '3.021', 'learning_rate': '1.917e-05', 'epoch': '0.1567'}

 16%|█▌        | 5950/37963 [25:29:45<142:03:13, 15.97s/it]
 16%|█▌        | 5951/37963 [25:29:59<137:51:28, 15.50s/it]
 16%|█▌        | 5952/37963 [25:30:14<135:18:51, 15.22s/it]
 16%|█▌        | 5953/37963 [25:30:28<132:10:22, 14.86s/it]
 16%|█▌        | 5954/37963 [25:30:42<130:49:31, 14.71s/it]
 16%|█▌        | 5955/37963 [25:30:56<128:18:37, 14.43s/it]
 16%|█▌        | 5956/37963 [25:31:10<127:43:04, 14.37s/it]
 16%|█▌        | 5957/37963 [25:31:24<127:46:53, 14.37s/it]
 16%|█▌        | 5958/37963 [25:31:39<127:57:43, 14.39s/it]
 16%|█▌        | 5959/37963 [25:31:53<128:21:43, 14.44s/it]
 16%|█▌        | 5960/37963 [25:32:08<128:10:01, 14.42s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '2.482', 'learning_rate': '1.917e-05', 'epoch': '0.157'}

 16%|█▌        | 5960/37963 [25:32:08<128:10:01, 14.42s/it]
 16%|█▌        | 5961/37963 [25:32:22<127:51:32, 14.38s/it]
 16%|█▌        | 5962/37963 [25:32:37<128:04:11, 14.41s/it]
 16%|█▌        | 5963/37963 [25:32:51<127:52:39, 14.39s/it]
 16%|█▌        | 5964/37963 [25:33:05<127:53:14, 14.39s/it]
 16%|█▌        | 5965/37963 [25:33:20<127:55:00, 14.39s/it]
 16%|█▌        | 5966/37963 [25:33:34<127:44:31, 14.37s/it]
 16%|█▌        | 5967/37963 [25:33:48<127:08:36, 14.31s/it]
 16%|█▌        | 5968/37963 [25:34:03<127:21:27, 14.33s/it]
 16%|█▌        | 5969/37963 [25:34:17<127:41:33, 14.37s/it]
 16%|█▌        | 5970/37963 [25:34:31<127:36:40, 14.36s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '2.064', 'learning_rate': '1.916e-05', 'epoch': '0.1573'}

 16%|█▌        | 5970/37963 [25:34:31<127:36:40, 14.36s/it]
 16%|█▌        | 5971/37963 [25:34:46<127:22:33, 14.33s/it]
 16%|█▌        | 5972/37963 [25:35:00<127:23:28, 14.34s/it]
 16%|█▌        | 5973/37963 [25:35:21<145:03:48, 16.32s/it]
 16%|█▌        | 5974/37963 [25:35:35<138:13:15, 15.56s/it]
 16%|█▌        | 5975/37963 [25:35:56<152:22:28, 17.15s/it]
 16%|█▌        | 5976/37963 [25:36:16<162:29:57, 18.29s/it]
 16%|█▌        | 5977/37963 [25:36:31<151:41:33, 17.07s/it]
 16%|█▌        | 5978/37963 [25:36:45<143:38:45, 16.17s/it]
 16%|█▌        | 5979/37963 [25:37:05<155:16:44, 17.48s/it]
 16%|█▌        | 5980/37963 [25:37:20<146:32:08, 16.49s/it]
                                                           
{'loss': '0.167', 'grad_norm': '1.204', 'learning_rate': '1.916e-05', 'epoch': '0.1575'}

 16%|█▌        | 5980/37963 [25:37:20<146:32:08, 16.49s/it]
 16%|█▌        | 5981/37963 [25:37:34<140:56:43, 15.87s/it]
 16%|█▌        | 5982/37963 [25:37:48<135:15:35, 15.23s/it]
 16%|█▌        | 5983/37963 [25:38:02<133:00:24, 14.97s/it]
 16%|█▌        | 5984/37963 [25:38:16<131:16:22, 14.78s/it]
 16%|█▌        | 5985/37963 [25:38:37<147:15:08, 16.58s/it]
 16%|█▌        | 5986/37963 [25:38:52<141:47:41, 15.96s/it]
 16%|█▌        | 5987/37963 [25:39:06<137:33:50, 15.49s/it]
 16%|█▌        | 5988/37963 [25:39:20<134:31:49, 15.15s/it]
 16%|█▌        | 5989/37963 [25:39:41<150:11:43, 16.91s/it]
 16%|█▌        | 5990/37963 [25:40:03<161:51:16, 18.22s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '2.414', 'learning_rate': '1.916e-05', 'epoch': '0.1578'}

 16%|█▌        | 5990/37963 [25:40:03<161:51:16, 18.22s/it]
 16%|█▌        | 5991/37963 [25:40:17<151:29:35, 17.06s/it]
 16%|█▌        | 5992/37963 [25:40:31<144:15:25, 16.24s/it]
 16%|█▌        | 5993/37963 [25:40:45<137:10:51, 15.45s/it]
 16%|█▌        | 5994/37963 [25:40:59<133:50:46, 15.07s/it]
 16%|█▌        | 5995/37963 [25:41:14<132:03:15, 14.87s/it]
 16%|█▌        | 5996/37963 [25:41:28<129:33:49, 14.59s/it]
 16%|█▌        | 5997/37963 [25:41:48<145:12:39, 16.35s/it]
 16%|█▌        | 5998/37963 [25:42:02<139:22:16, 15.70s/it]
 16%|█▌        | 5999/37963 [25:42:17<135:49:06, 15.30s/it]
 16%|█▌        | 6000/37963 [25:42:31<133:31:28, 15.04s/it]
                                                           
{'loss': '0.1696', 'grad_norm': '1.605', 'learning_rate': '1.915e-05', 'epoch': '0.158'}

 16%|█▌        | 6000/37963 [25:42:31<133:31:28, 15.04s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.75s/it]
Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.75s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 16%|█▌        | 6001/37963 [25:44:23<391:28:03, 44.09s/it]
 16%|█▌        | 6002/37963 [25:44:37<312:09:44, 35.16s/it]
 16%|█▌        | 6003/37963 [25:44:52<256:50:41, 28.93s/it]
 16%|█▌        | 6004/37963 [25:45:06<217:49:13, 24.54s/it]
 16%|█▌        | 6005/37963 [25:45:20<190:44:33, 21.49s/it]
 16%|█▌        | 6006/37963 [25:45:35<171:53:10, 19.36s/it]
 16%|█▌        | 6007/37963 [25:45:49<158:25:43, 17.85s/it]
 16%|█▌        | 6008/37963 [25:46:03<148:36:24, 16.74s/it]
 16%|█▌        | 6009/37963 [25:46:17<141:27:55, 15.94s/it]
 16%|█▌        | 6010/37963 [25:46:31<137:14:48, 15.46s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '6.047', 'learning_rate': '1.915e-05', 'epoch': '0.1583'}

 16%|█▌        | 6010/37963 [25:46:31<137:14:48, 15.46s/it]
 16%|█▌        | 6011/37963 [25:46:46<134:14:46, 15.13s/it]
 16%|█▌        | 6012/37963 [25:47:00<132:09:53, 14.89s/it]
 16%|█▌        | 6013/37963 [25:47:15<130:53:14, 14.75s/it]
 16%|█▌        | 6014/37963 [25:47:29<129:50:57, 14.63s/it]
 16%|█▌        | 6015/37963 [25:47:43<129:18:27, 14.57s/it]
 16%|█▌        | 6016/37963 [25:47:58<128:29:40, 14.48s/it]
 16%|█▌        | 6017/37963 [25:48:12<128:13:48, 14.45s/it]
 16%|█▌        | 6018/37963 [25:48:26<127:27:27, 14.36s/it]
 16%|█▌        | 6019/37963 [25:48:47<144:02:33, 16.23s/it]
 16%|█▌        | 6020/37963 [25:49:01<138:59:11, 15.66s/it]
                                                           
{'loss': '0.1776', 'grad_norm': '2.69', 'learning_rate': '1.915e-05', 'epoch': '0.1586'}

 16%|█▌        | 6020/37963 [25:49:01<138:59:11, 15.66s/it]
 16%|█▌        | 6021/37963 [25:49:15<135:26:41, 15.27s/it]
 16%|█▌        | 6022/37963 [25:49:30<133:07:24, 15.00s/it]
 16%|█▌        | 6023/37963 [25:49:44<131:02:46, 14.77s/it]
 16%|█▌        | 6024/37963 [25:50:05<147:20:18, 16.61s/it]
 16%|█▌        | 6025/37963 [25:50:26<158:33:56, 17.87s/it]
 16%|█▌        | 6026/37963 [25:50:40<149:11:03, 16.82s/it]
 16%|█▌        | 6027/37963 [25:50:54<141:12:30, 15.92s/it]
 16%|█▌        | 6028/37963 [25:51:08<136:14:21, 15.36s/it]
 16%|█▌        | 6029/37963 [25:51:29<151:26:02, 17.07s/it]
 16%|█▌        | 6030/37963 [25:51:43<143:47:41, 16.21s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '1.411', 'learning_rate': '1.914e-05', 'epoch': '0.1588'}

 16%|█▌        | 6030/37963 [25:51:43<143:47:41, 16.21s/it]
 16%|█▌        | 6031/37963 [25:51:58<139:01:30, 15.67s/it]
 16%|█▌        | 6032/37963 [25:52:12<134:52:21, 15.21s/it]
 16%|█▌        | 6033/37963 [25:52:26<132:58:19, 14.99s/it]
 16%|█▌        | 6034/37963 [25:52:47<146:57:30, 16.57s/it]
 16%|█▌        | 6035/37963 [25:53:01<141:12:00, 15.92s/it]
 16%|█▌        | 6036/37963 [25:53:22<155:10:07, 17.50s/it]
 16%|█▌        | 6037/37963 [25:53:36<146:03:59, 16.47s/it]
 16%|█▌        | 6038/37963 [25:53:58<160:36:00, 18.11s/it]
 16%|█▌        | 6039/37963 [25:54:12<150:23:12, 16.96s/it]
 16%|█▌        | 6040/37963 [25:54:27<143:27:03, 16.18s/it]
                                                           
{'loss': '0.1675', 'grad_norm': '2.931', 'learning_rate': '1.914e-05', 'epoch': '0.1591'}

 16%|█▌        | 6040/37963 [25:54:27<143:27:03, 16.18s/it]
 16%|█▌        | 6041/37963 [25:54:41<137:05:10, 15.46s/it]
 16%|█▌        | 6042/37963 [25:54:55<134:13:12, 15.14s/it]
 16%|█▌        | 6043/37963 [25:55:09<131:40:12, 14.85s/it]
 16%|█▌        | 6044/37963 [25:55:23<130:05:35, 14.67s/it]
 16%|█▌        | 6045/37963 [25:55:38<129:22:24, 14.59s/it]
 16%|█▌        | 6046/37963 [25:55:52<127:09:08, 14.34s/it]
 16%|█▌        | 6047/37963 [25:56:12<144:34:31, 16.31s/it]
 16%|█▌        | 6048/37963 [25:56:26<138:25:20, 15.61s/it]
 16%|█▌        | 6049/37963 [25:56:41<134:59:09, 15.23s/it]
 16%|█▌        | 6050/37963 [25:56:55<133:17:29, 15.04s/it]
                                                           
{'loss': '0.1685', 'grad_norm': '4.534', 'learning_rate': '1.914e-05', 'epoch': '0.1594'}

 16%|█▌        | 6050/37963 [25:56:55<133:17:29, 15.04s/it]
 16%|█▌        | 6051/37963 [25:57:09<130:02:57, 14.67s/it]
 16%|█▌        | 6052/37963 [25:57:23<127:46:25, 14.41s/it]
 16%|█▌        | 6053/37963 [25:57:37<127:44:00, 14.41s/it]
 16%|█▌        | 6054/37963 [25:57:52<127:18:42, 14.36s/it]
 16%|█▌        | 6055/37963 [25:58:06<127:17:14, 14.36s/it]
 16%|█▌        | 6056/37963 [25:58:20<127:01:54, 14.33s/it]
 16%|█▌        | 6057/37963 [25:58:34<126:11:05, 14.24s/it]
 16%|█▌        | 6058/37963 [25:58:49<126:26:24, 14.27s/it]
 16%|█▌        | 6059/37963 [25:59:03<125:47:22, 14.19s/it]
 16%|█▌        | 6060/37963 [25:59:17<126:09:33, 14.24s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '2.097', 'learning_rate': '1.913e-05', 'epoch': '0.1596'}

 16%|█▌        | 6060/37963 [25:59:17<126:09:33, 14.24s/it]
 16%|█▌        | 6061/37963 [25:59:31<125:04:19, 14.11s/it]
 16%|█▌        | 6062/37963 [25:59:45<125:57:31, 14.21s/it]
 16%|█▌        | 6063/37963 [25:59:59<125:21:39, 14.15s/it]
 16%|█▌        | 6064/37963 [26:00:14<125:58:42, 14.22s/it]
 16%|█▌        | 6065/37963 [26:00:28<126:17:29, 14.25s/it]
 16%|█▌        | 6066/37963 [26:00:48<141:46:21, 16.00s/it]
 16%|█▌        | 6067/37963 [26:01:02<137:26:50, 15.51s/it]
 16%|█▌        | 6068/37963 [26:01:17<133:49:22, 15.10s/it]
 16%|█▌        | 6069/37963 [26:01:31<131:41:08, 14.86s/it]
 16%|█▌        | 6070/37963 [26:01:45<130:35:22, 14.74s/it]
                                                           
{'loss': '0.162', 'grad_norm': '1.306', 'learning_rate': '1.913e-05', 'epoch': '0.1599'}

 16%|█▌        | 6070/37963 [26:01:45<130:35:22, 14.74s/it]
 16%|█▌        | 6071/37963 [26:01:59<128:58:58, 14.56s/it]
 16%|█▌        | 6072/37963 [26:02:20<145:49:10, 16.46s/it]
 16%|█▌        | 6073/37963 [26:02:35<139:42:32, 15.77s/it]
 16%|█▌        | 6074/37963 [26:02:55<152:37:02, 17.23s/it]
 16%|█▌        | 6075/37963 [26:03:09<144:28:01, 16.31s/it]
 16%|█▌        | 6076/37963 [26:03:24<139:40:28, 15.77s/it]
 16%|█▌        | 6077/37963 [26:03:38<136:02:38, 15.36s/it]
 16%|█▌        | 6078/37963 [26:03:53<133:15:29, 15.05s/it]
 16%|█▌        | 6079/37963 [26:04:13<148:25:04, 16.76s/it]
 16%|█▌        | 6080/37963 [26:04:28<142:02:28, 16.04s/it]
                                                           
{'loss': '0.1673', 'grad_norm': '4.695', 'learning_rate': '1.912e-05', 'epoch': '0.1602'}

 16%|█▌        | 6080/37963 [26:04:28<142:02:28, 16.04s/it]
 16%|█▌        | 6081/37963 [26:04:42<136:42:03, 15.44s/it]
 16%|█▌        | 6082/37963 [26:05:03<151:23:29, 17.10s/it]
 16%|█▌        | 6083/37963 [26:05:17<144:27:57, 16.31s/it]
 16%|█▌        | 6084/37963 [26:05:31<139:06:12, 15.71s/it]
 16%|█▌        | 6085/37963 [26:05:45<134:17:32, 15.17s/it]
 16%|█▌        | 6086/37963 [26:06:13<168:08:25, 18.99s/it]
 16%|█▌        | 6087/37963 [26:06:28<156:02:14, 17.62s/it]
 16%|█▌        | 6088/37963 [26:06:42<147:21:53, 16.64s/it]
 16%|█▌        | 6089/37963 [26:06:56<141:25:39, 15.97s/it]
 16%|█▌        | 6090/37963 [26:07:11<136:35:29, 15.43s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '5.077', 'learning_rate': '1.912e-05', 'epoch': '0.1604'}

 16%|█▌        | 6090/37963 [26:07:11<136:35:29, 15.43s/it]
 16%|█▌        | 6091/37963 [26:07:25<133:25:08, 15.07s/it]
 16%|█▌        | 6092/37963 [26:07:39<131:23:52, 14.84s/it]
 16%|█▌        | 6093/37963 [26:07:53<128:30:13, 14.52s/it]
 16%|█▌        | 6094/37963 [26:08:07<127:14:14, 14.37s/it]
 16%|█▌        | 6095/37963 [26:08:21<127:29:45, 14.40s/it]
 16%|█▌        | 6096/37963 [26:08:36<127:25:10, 14.39s/it]
 16%|█▌        | 6097/37963 [26:08:57<144:56:58, 16.38s/it]
 16%|█▌        | 6098/37963 [26:09:11<139:56:20, 15.81s/it]
 16%|█▌        | 6099/37963 [26:09:26<135:55:53, 15.36s/it]
 16%|█▌        | 6100/37963 [26:09:40<133:29:43, 15.08s/it]
                                                           
{'loss': '0.1654', 'grad_norm': '3.449', 'learning_rate': '1.912e-05', 'epoch': '0.1607'}

 16%|█▌        | 6100/37963 [26:09:40<133:29:43, 15.08s/it]
 16%|█▌        | 6101/37963 [26:09:54<131:38:02, 14.87s/it]
 16%|█▌        | 6102/37963 [26:10:09<130:21:08, 14.73s/it]
 16%|█▌        | 6103/37963 [26:10:23<129:29:53, 14.63s/it]
 16%|█▌        | 6104/37963 [26:10:38<128:46:34, 14.55s/it]
 16%|█▌        | 6105/37963 [26:10:52<128:29:20, 14.52s/it]
 16%|█▌        | 6106/37963 [26:11:06<128:11:54, 14.49s/it]
 16%|█▌        | 6107/37963 [26:11:21<127:48:54, 14.44s/it]
 16%|█▌        | 6108/37963 [26:11:35<127:35:18, 14.42s/it]
 16%|█▌        | 6109/37963 [26:11:50<127:29:43, 14.41s/it]
 16%|█▌        | 6110/37963 [26:12:04<127:19:29, 14.39s/it]
                                                           
{'loss': '0.1739', 'grad_norm': '2.397', 'learning_rate': '1.911e-05', 'epoch': '0.1609'}

 16%|█▌        | 6110/37963 [26:12:04<127:19:29, 14.39s/it]
 16%|█▌        | 6111/37963 [26:12:18<127:14:45, 14.38s/it]
 16%|█▌        | 6112/37963 [26:12:33<127:20:32, 14.39s/it]
 16%|█▌        | 6113/37963 [26:12:47<127:20:42, 14.39s/it]
 16%|█▌        | 6114/37963 [26:13:01<127:06:21, 14.37s/it]
 16%|█▌        | 6115/37963 [26:13:16<126:58:41, 14.35s/it]
 16%|█▌        | 6116/37963 [26:13:37<144:13:04, 16.30s/it]
 16%|█▌        | 6117/37963 [26:13:51<138:07:09, 15.61s/it]
 16%|█▌        | 6118/37963 [26:14:05<135:23:26, 15.31s/it]
 16%|█▌        | 6119/37963 [26:14:20<133:13:43, 15.06s/it]
 16%|█▌        | 6120/37963 [26:14:34<131:15:06, 14.84s/it]
                                                           
{'loss': '0.1744', 'grad_norm': '1.272', 'learning_rate': '1.911e-05', 'epoch': '0.1612'}

 16%|█▌        | 6120/37963 [26:14:34<131:15:06, 14.84s/it]
 16%|█▌        | 6121/37963 [26:14:48<129:57:16, 14.69s/it]
 16%|█▌        | 6122/37963 [26:15:02<127:14:54, 14.39s/it]
 16%|█▌        | 6123/37963 [26:15:29<161:56:06, 18.31s/it]
 16%|█▌        | 6124/37963 [26:15:44<151:16:29, 17.10s/it]
 16%|█▌        | 6125/37963 [26:15:58<143:49:58, 16.26s/it]
 16%|█▌        | 6126/37963 [26:16:12<138:52:19, 15.70s/it]
 16%|█▌        | 6127/37963 [26:16:26<134:22:11, 15.19s/it]
 16%|█▌        | 6128/37963 [26:16:47<149:00:02, 16.85s/it]
 16%|█▌        | 6129/37963 [26:17:02<142:31:49, 16.12s/it]
 16%|█▌        | 6130/37963 [26:17:15<136:45:12, 15.47s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '3.045', 'learning_rate': '1.911e-05', 'epoch': '0.1615'}

 16%|█▌        | 6130/37963 [26:17:15<136:45:12, 15.47s/it]
 16%|█▌        | 6131/37963 [26:17:36<151:08:32, 17.09s/it]
 16%|█▌        | 6132/37963 [26:17:50<142:19:57, 16.10s/it]
 16%|█▌        | 6133/37963 [26:18:05<137:52:58, 15.59s/it]
 16%|█▌        | 6134/37963 [26:18:25<151:53:18, 17.18s/it]
 16%|█▌        | 6135/37963 [26:18:47<162:18:30, 18.36s/it]
 16%|█▌        | 6136/37963 [26:19:01<151:34:33, 17.14s/it]
 16%|█▌        | 6137/37963 [26:19:15<144:08:59, 16.31s/it]
 16%|█▌        | 6138/37963 [26:19:29<137:17:02, 15.53s/it]
 16%|█▌        | 6139/37963 [26:19:43<132:32:26, 14.99s/it]
 16%|█▌        | 6140/37963 [26:19:56<129:22:47, 14.64s/it]
                                                           
{'loss': '0.1741', 'grad_norm': '1.676', 'learning_rate': '1.91e-05', 'epoch': '0.1617'}

 16%|█▌        | 6140/37963 [26:19:56<129:22:47, 14.64s/it]
 16%|█▌        | 6141/37963 [26:20:10<127:23:53, 14.41s/it]
 16%|█▌        | 6142/37963 [26:20:24<126:30:44, 14.31s/it]
 16%|█▌        | 6143/37963 [26:20:39<126:40:10, 14.33s/it]
 16%|█▌        | 6144/37963 [26:21:00<144:18:32, 16.33s/it]
 16%|█▌        | 6145/37963 [26:21:14<139:20:29, 15.77s/it]
 16%|█▌        | 6146/37963 [26:21:28<134:08:09, 15.18s/it]
 16%|█▌        | 6147/37963 [26:21:42<132:04:38, 14.94s/it]
 16%|█▌        | 6148/37963 [26:21:57<130:17:29, 14.74s/it]
 16%|█▌        | 6149/37963 [26:22:11<127:53:36, 14.47s/it]
 16%|█▌        | 6150/37963 [26:22:25<128:07:34, 14.50s/it]
                                                           
{'loss': '0.1535', 'grad_norm': '3.515', 'learning_rate': '1.91e-05', 'epoch': '0.162'}

 16%|█▌        | 6150/37963 [26:22:25<128:07:34, 14.50s/it]
 16%|█▌        | 6151/37963 [26:22:39<126:17:46, 14.29s/it]
 16%|█▌        | 6152/37963 [26:22:53<124:39:53, 14.11s/it]
 16%|█▌        | 6153/37963 [26:23:07<125:07:40, 14.16s/it]
 16%|█▌        | 6154/37963 [26:23:21<125:09:56, 14.17s/it]
 16%|█▌        | 6155/37963 [26:23:35<125:41:04, 14.22s/it]
 16%|█▌        | 6156/37963 [26:23:50<125:41:33, 14.23s/it]
 16%|█▌        | 6157/37963 [26:24:04<125:43:53, 14.23s/it]
 16%|█▌        | 6158/37963 [26:24:18<125:50:14, 14.24s/it]
 16%|█▌        | 6159/37963 [26:24:33<126:15:40, 14.29s/it]
 16%|█▌        | 6160/37963 [26:24:47<125:43:34, 14.23s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '3.72', 'learning_rate': '1.91e-05', 'epoch': '0.1623'}

 16%|█▌        | 6160/37963 [26:24:47<125:43:34, 14.23s/it]
 16%|█▌        | 6161/37963 [26:25:00<124:31:08, 14.10s/it]
 16%|█▌        | 6162/37963 [26:25:14<123:21:13, 13.96s/it]
 16%|█▌        | 6163/37963 [26:25:29<124:42:34, 14.12s/it]
 16%|█▌        | 6164/37963 [26:25:43<125:17:05, 14.18s/it]
 16%|█▌        | 6165/37963 [26:25:57<125:46:52, 14.24s/it]
 16%|█▌        | 6166/37963 [26:26:11<124:19:55, 14.08s/it]
 16%|█▌        | 6167/37963 [26:26:32<143:10:29, 16.21s/it]
 16%|█▌        | 6168/37963 [26:26:46<136:18:08, 15.43s/it]
 16%|█▋        | 6169/37963 [26:27:06<148:00:21, 16.76s/it]
 16%|█▋        | 6170/37963 [26:27:27<158:54:27, 17.99s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '3.08', 'learning_rate': '1.909e-05', 'epoch': '0.1625'}

 16%|█▋        | 6170/37963 [26:27:27<158:54:27, 17.99s/it]
 16%|█▋        | 6171/37963 [26:27:41<148:58:10, 16.87s/it]
 16%|█▋        | 6172/37963 [26:27:55<142:18:14, 16.11s/it]
 16%|█▋        | 6173/37963 [26:28:09<136:22:28, 15.44s/it]
 16%|█▋        | 6174/37963 [26:28:23<133:23:45, 15.11s/it]
 16%|█▋        | 6175/37963 [26:28:43<146:42:40, 16.62s/it]
 16%|█▋        | 6176/37963 [26:28:58<140:48:23, 15.95s/it]
 16%|█▋        | 6177/37963 [26:29:12<136:19:40, 15.44s/it]
 16%|█▋        | 6178/37963 [26:29:33<149:31:25, 16.94s/it]
 16%|█▋        | 6179/37963 [26:29:47<142:43:55, 16.17s/it]
 16%|█▋        | 6180/37963 [26:30:01<138:32:37, 15.69s/it]
                                                           
{'loss': '0.1672', 'grad_norm': '2.175', 'learning_rate': '1.909e-05', 'epoch': '0.1628'}

 16%|█▋        | 6180/37963 [26:30:01<138:32:37, 15.69s/it]
 16%|█▋        | 6181/37963 [26:30:16<135:11:32, 15.31s/it]
 16%|█▋        | 6182/37963 [26:30:37<150:43:50, 17.07s/it]
 16%|█▋        | 6183/37963 [26:30:58<160:14:24, 18.15s/it]
 16%|█▋        | 6184/37963 [26:31:12<150:27:16, 17.04s/it]
 16%|█▋        | 6185/37963 [26:31:26<142:44:03, 16.17s/it]
 16%|█▋        | 6186/37963 [26:31:41<138:22:20, 15.68s/it]
 16%|█▋        | 6187/37963 [26:31:55<134:53:30, 15.28s/it]
 16%|█▋        | 6188/37963 [26:32:10<133:32:13, 15.13s/it]
 16%|█▋        | 6189/37963 [26:32:24<131:39:44, 14.92s/it]
 16%|█▋        | 6190/37963 [26:32:39<130:11:50, 14.75s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '0.8811', 'learning_rate': '1.909e-05', 'epoch': '0.1631'}

 16%|█▋        | 6190/37963 [26:32:39<130:11:50, 14.75s/it]
 16%|█▋        | 6191/37963 [26:32:53<129:40:58, 14.69s/it]
 16%|█▋        | 6192/37963 [26:33:08<128:45:11, 14.59s/it]
 16%|█▋        | 6193/37963 [26:33:22<128:29:08, 14.56s/it]
 16%|█▋        | 6194/37963 [26:33:43<145:33:52, 16.50s/it]
 16%|█▋        | 6195/37963 [26:33:58<139:43:24, 15.83s/it]
 16%|█▋        | 6196/37963 [26:34:12<135:24:03, 15.34s/it]
 16%|█▋        | 6197/37963 [26:34:26<132:50:44, 15.06s/it]
 16%|█▋        | 6198/37963 [26:34:40<130:59:42, 14.85s/it]
 16%|█▋        | 6199/37963 [26:34:55<129:38:58, 14.69s/it]
 16%|█▋        | 6200/37963 [26:35:09<128:40:13, 14.58s/it]
                                                           
{'loss': '0.1795', 'grad_norm': '7.888', 'learning_rate': '1.908e-05', 'epoch': '0.1633'}

 16%|█▋        | 6200/37963 [26:35:09<128:40:13, 14.58s/it]
 16%|█▋        | 6201/37963 [26:35:24<128:10:47, 14.53s/it]
 16%|█▋        | 6202/37963 [26:35:38<127:45:03, 14.48s/it]
 16%|█▋        | 6203/37963 [26:35:52<127:24:14, 14.44s/it]
 16%|█▋        | 6204/37963 [26:36:07<127:04:45, 14.40s/it]
 16%|█▋        | 6205/37963 [26:36:21<126:48:32, 14.37s/it]
 16%|█▋        | 6206/37963 [26:36:35<126:35:29, 14.35s/it]
 16%|█▋        | 6207/37963 [26:36:48<123:54:13, 14.05s/it]
 16%|█▋        | 6208/37963 [26:37:03<124:37:41, 14.13s/it]
 16%|█▋        | 6209/37963 [26:37:17<124:51:58, 14.16s/it]
 16%|█▋        | 6210/37963 [26:37:31<125:25:36, 14.22s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '2.866', 'learning_rate': '1.908e-05', 'epoch': '0.1636'}

 16%|█▋        | 6210/37963 [26:37:31<125:25:36, 14.22s/it]
 16%|█▋        | 6211/37963 [26:37:46<125:47:13, 14.26s/it]
 16%|█▋        | 6212/37963 [26:38:00<126:07:02, 14.30s/it]
 16%|█▋        | 6213/37963 [26:38:21<143:57:18, 16.32s/it]
 16%|█▋        | 6214/37963 [26:38:36<138:49:36, 15.74s/it]
 16%|█▋        | 6215/37963 [26:38:50<135:42:46, 15.39s/it]
 16%|█▋        | 6216/37963 [26:39:11<150:38:55, 17.08s/it]
 16%|█▋        | 6217/37963 [26:39:26<143:46:44, 16.30s/it]
 16%|█▋        | 6218/37963 [26:39:40<139:05:48, 15.77s/it]
 16%|█▋        | 6219/37963 [26:40:01<151:49:26, 17.22s/it]
 16%|█▋        | 6220/37963 [26:40:15<144:14:09, 16.36s/it]
                                                           
{'loss': '0.1743', 'grad_norm': '1.266', 'learning_rate': '1.908e-05', 'epoch': '0.1638'}

 16%|█▋        | 6220/37963 [26:40:15<144:14:09, 16.36s/it]
 16%|█▋        | 6221/37963 [26:40:29<138:53:20, 15.75s/it]
 16%|█▋        | 6222/37963 [26:40:43<134:05:04, 15.21s/it]
 16%|█▋        | 6223/37963 [26:40:58<131:43:20, 14.94s/it]
 16%|█▋        | 6224/37963 [26:41:18<144:54:18, 16.44s/it]
 16%|█▋        | 6225/37963 [26:41:32<139:20:32, 15.81s/it]
 16%|█▋        | 6226/37963 [26:41:53<153:30:13, 17.41s/it]
 16%|█▋        | 6227/37963 [26:42:07<145:13:04, 16.47s/it]
 16%|█▋        | 6228/37963 [26:42:22<139:48:12, 15.86s/it]
 16%|█▋        | 6229/37963 [26:42:36<135:57:13, 15.42s/it]
 16%|█▋        | 6230/37963 [26:42:51<133:19:38, 15.13s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '1.473', 'learning_rate': '1.907e-05', 'epoch': '0.1641'}

 16%|█▋        | 6230/37963 [26:42:51<133:19:38, 15.13s/it]
 16%|█▋        | 6231/37963 [26:43:19<167:49:49, 19.04s/it]
 16%|█▋        | 6232/37963 [26:43:33<155:41:28, 17.66s/it]
 16%|█▋        | 6233/37963 [26:43:48<146:53:39, 16.67s/it]
 16%|█▋        | 6234/37963 [26:44:02<140:40:36, 15.96s/it]
 16%|█▋        | 6235/37963 [26:44:16<135:49:15, 15.41s/it]
 16%|█▋        | 6236/37963 [26:44:30<132:56:44, 15.09s/it]
 16%|█▋        | 6237/37963 [26:44:45<130:56:54, 14.86s/it]
 16%|█▋        | 6238/37963 [26:44:58<127:39:32, 14.49s/it]
 16%|█▋        | 6239/37963 [26:45:13<127:25:49, 14.46s/it]
 16%|█▋        | 6240/37963 [26:45:27<126:20:42, 14.34s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '1.546', 'learning_rate': '1.907e-05', 'epoch': '0.1644'}

 16%|█▋        | 6240/37963 [26:45:27<126:20:42, 14.34s/it]
 16%|█▋        | 6241/37963 [26:45:41<126:17:18, 14.33s/it]
 16%|█▋        | 6242/37963 [26:45:56<126:24:48, 14.35s/it]
 16%|█▋        | 6243/37963 [26:46:10<126:33:09, 14.36s/it]
 16%|█▋        | 6244/37963 [26:46:31<144:59:48, 16.46s/it]
 16%|█▋        | 6245/37963 [26:46:46<139:38:00, 15.85s/it]
 16%|█▋        | 6246/37963 [26:47:00<135:27:07, 15.37s/it]
 16%|█▋        | 6247/37963 [26:47:14<132:22:16, 15.03s/it]
 16%|█▋        | 6248/37963 [26:47:29<130:55:46, 14.86s/it]
 16%|█▋        | 6249/37963 [26:47:42<127:13:21, 14.44s/it]
 16%|█▋        | 6250/37963 [26:47:57<127:05:18, 14.43s/it]
                                                           
{'loss': '0.1667', 'grad_norm': '5.577', 'learning_rate': '1.906e-05', 'epoch': '0.1646'}

 16%|█▋        | 6250/37963 [26:47:57<127:05:18, 14.43s/it]
 16%|█▋        | 6251/37963 [26:48:11<126:19:28, 14.34s/it]
 16%|█▋        | 6252/37963 [26:48:25<125:40:53, 14.27s/it]
 16%|█▋        | 6253/37963 [26:48:39<125:02:35, 14.20s/it]
 16%|█▋        | 6254/37963 [26:48:53<125:54:56, 14.30s/it]
 16%|█▋        | 6255/37963 [26:49:08<126:38:33, 14.38s/it]
 16%|█▋        | 6256/37963 [26:49:22<126:45:26, 14.39s/it]
 16%|█▋        | 6257/37963 [26:49:37<126:41:12, 14.38s/it]
 16%|█▋        | 6258/37963 [26:49:51<126:11:54, 14.33s/it]
 16%|█▋        | 6259/37963 [26:50:05<125:47:24, 14.28s/it]
 16%|█▋        | 6260/37963 [26:50:20<126:21:11, 14.35s/it]
                                                           
{'loss': '0.1686', 'grad_norm': '2.765', 'learning_rate': '1.906e-05', 'epoch': '0.1649'}

 16%|█▋        | 6260/37963 [26:50:20<126:21:11, 14.35s/it]
 16%|█▋        | 6261/37963 [26:50:40<142:32:47, 16.19s/it]
 16%|█▋        | 6262/37963 [26:50:54<136:50:36, 15.54s/it]
 16%|█▋        | 6263/37963 [26:51:15<150:09:28, 17.05s/it]
 17%|█▋        | 6264/37963 [26:51:29<143:04:26, 16.25s/it]
 17%|█▋        | 6265/37963 [26:51:43<138:05:38, 15.68s/it]
 17%|█▋        | 6266/37963 [26:51:58<134:02:46, 15.22s/it]
 17%|█▋        | 6267/37963 [26:52:12<131:43:59, 14.96s/it]
 17%|█▋        | 6268/37963 [26:52:26<130:00:12, 14.77s/it]
 17%|█▋        | 6269/37963 [26:52:46<143:25:38, 16.29s/it]
 17%|█▋        | 6270/37963 [26:53:00<138:11:33, 15.70s/it]
                                                           
{'loss': '0.1813', 'grad_norm': '1.31', 'learning_rate': '1.906e-05', 'epoch': '0.1652'}

 17%|█▋        | 6270/37963 [26:53:00<138:11:33, 15.70s/it]
 17%|█▋        | 6271/37963 [26:53:14<133:43:52, 15.19s/it]
 17%|█▋        | 6272/37963 [26:53:35<148:33:58, 16.88s/it]
 17%|█▋        | 6273/37963 [26:53:50<142:25:24, 16.18s/it]
 17%|█▋        | 6274/37963 [26:54:04<136:05:43, 15.46s/it]
 17%|█▋        | 6275/37963 [26:54:18<132:30:39, 15.05s/it]
 17%|█▋        | 6276/37963 [26:54:32<130:04:15, 14.78s/it]
 17%|█▋        | 6277/37963 [26:54:46<129:08:25, 14.67s/it]
 17%|█▋        | 6278/37963 [26:55:01<128:23:16, 14.59s/it]
 17%|█▋        | 6279/37963 [26:55:15<127:45:49, 14.52s/it]
 17%|█▋        | 6280/37963 [26:55:43<163:58:34, 18.63s/it]
                                                           
{'loss': '0.1761', 'grad_norm': '2.682', 'learning_rate': '1.905e-05', 'epoch': '0.1654'}

 17%|█▋        | 6280/37963 [26:55:43<163:58:34, 18.63s/it]
 17%|█▋        | 6281/37963 [26:55:57<151:43:53, 17.24s/it]
 17%|█▋        | 6282/37963 [26:56:11<143:43:43, 16.33s/it]
 17%|█▋        | 6283/37963 [26:56:26<138:22:33, 15.72s/it]
 17%|█▋        | 6284/37963 [26:56:40<135:00:19, 15.34s/it]
 17%|█▋        | 6285/37963 [26:56:54<132:26:39, 15.05s/it]
 17%|█▋        | 6286/37963 [26:57:09<129:49:23, 14.75s/it]
 17%|█▋        | 6287/37963 [26:57:21<125:01:05, 14.21s/it]
 17%|█▋        | 6288/37963 [26:57:36<124:36:30, 14.16s/it]
 17%|█▋        | 6289/37963 [26:57:49<123:40:22, 14.06s/it]
 17%|█▋        | 6290/37963 [26:58:04<124:29:05, 14.15s/it]
                                                           
{'loss': '0.168', 'grad_norm': '4.395', 'learning_rate': '1.905e-05', 'epoch': '0.1657'}

 17%|█▋        | 6290/37963 [26:58:04<124:29:05, 14.15s/it]
 17%|█▋        | 6291/37963 [26:58:18<125:48:01, 14.30s/it]
 17%|█▋        | 6292/37963 [26:58:40<143:56:35, 16.36s/it]
 17%|█▋        | 6293/37963 [26:58:54<138:37:04, 15.76s/it]
 17%|█▋        | 6294/37963 [26:59:08<135:01:36, 15.35s/it]
 17%|█▋        | 6295/37963 [26:59:23<133:14:50, 15.15s/it]
 17%|█▋        | 6296/37963 [26:59:37<130:21:55, 14.82s/it]
 17%|█▋        | 6297/37963 [26:59:51<127:34:19, 14.50s/it]
 17%|█▋        | 6298/37963 [27:00:05<127:10:50, 14.46s/it]
 17%|█▋        | 6299/37963 [27:00:20<127:12:59, 14.46s/it]
 17%|█▋        | 6300/37963 [27:00:34<126:54:30, 14.43s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '3.913', 'learning_rate': '1.905e-05', 'epoch': '0.166'}

 17%|█▋        | 6300/37963 [27:00:34<126:54:30, 14.43s/it]
 17%|█▋        | 6301/37963 [27:00:48<126:56:27, 14.43s/it]
 17%|█▋        | 6302/37963 [27:01:03<126:37:43, 14.40s/it]
 17%|█▋        | 6303/37963 [27:01:17<125:12:44, 14.24s/it]
 17%|█▋        | 6304/37963 [27:01:31<125:26:19, 14.26s/it]
 17%|█▋        | 6305/37963 [27:01:45<125:18:06, 14.25s/it]
 17%|█▋        | 6306/37963 [27:01:59<125:36:47, 14.28s/it]
 17%|█▋        | 6307/37963 [27:02:14<125:41:40, 14.29s/it]
 17%|█▋        | 6308/37963 [27:02:28<126:04:36, 14.34s/it]
 17%|█▋        | 6309/37963 [27:02:43<125:58:01, 14.33s/it]
 17%|█▋        | 6310/37963 [27:02:57<125:42:06, 14.30s/it]
                                                           
{'loss': '0.157', 'grad_norm': '2.63', 'learning_rate': '1.904e-05', 'epoch': '0.1662'}

 17%|█▋        | 6310/37963 [27:02:57<125:42:06, 14.30s/it]
 17%|█▋        | 6311/37963 [27:03:11<126:00:55, 14.33s/it]
 17%|█▋        | 6312/37963 [27:03:39<161:31:08, 18.37s/it]
 17%|█▋        | 6313/37963 [27:03:53<151:14:36, 17.20s/it]
 17%|█▋        | 6314/37963 [27:04:08<143:49:36, 16.36s/it]
 17%|█▋        | 6315/37963 [27:04:22<138:21:36, 15.74s/it]
 17%|█▋        | 6316/37963 [27:04:37<134:56:15, 15.35s/it]
 17%|█▋        | 6317/37963 [27:04:51<132:26:05, 15.07s/it]
 17%|█▋        | 6318/37963 [27:05:05<130:31:50, 14.85s/it]
 17%|█▋        | 6319/37963 [27:05:32<162:11:40, 18.45s/it]
 17%|█▋        | 6320/37963 [27:05:53<169:04:22, 19.24s/it]
                                                           
{'loss': '0.1536', 'grad_norm': '2.221', 'learning_rate': '1.904e-05', 'epoch': '0.1665'}

 17%|█▋        | 6320/37963 [27:05:53<169:04:22, 19.24s/it]
 17%|█▋        | 6321/37963 [27:06:08<156:03:28, 17.76s/it]
 17%|█▋        | 6322/37963 [27:06:22<147:19:40, 16.76s/it]
 17%|█▋        | 6323/37963 [27:06:36<141:13:23, 16.07s/it]
 17%|█▋        | 6324/37963 [27:06:51<136:58:57, 15.59s/it]
 17%|█▋        | 6325/37963 [27:07:05<134:18:39, 15.28s/it]
 17%|█▋        | 6326/37963 [27:07:20<131:57:05, 15.01s/it]
 17%|█▋        | 6327/37963 [27:07:41<148:33:08, 16.90s/it]
 17%|█▋        | 6328/37963 [27:07:56<142:06:42, 16.17s/it]
 17%|█▋        | 6329/37963 [27:08:09<135:11:17, 15.38s/it]
 17%|█▋        | 6330/37963 [27:08:31<151:20:18, 17.22s/it]
                                                           
{'loss': '0.1715', 'grad_norm': '3.367', 'learning_rate': '1.904e-05', 'epoch': '0.1667'}

 17%|█▋        | 6330/37963 [27:08:31<151:20:18, 17.22s/it]
 17%|█▋        | 6331/37963 [27:08:45<143:14:09, 16.30s/it]
 17%|█▋        | 6332/37963 [27:08:59<137:01:46, 15.60s/it]
 17%|█▋        | 6333/37963 [27:09:13<133:16:16, 15.17s/it]
 17%|█▋        | 6334/37963 [27:09:27<131:24:56, 14.96s/it]
 17%|█▋        | 6335/37963 [27:09:42<129:55:04, 14.79s/it]
 17%|█▋        | 6336/37963 [27:09:56<128:49:54, 14.66s/it]
 17%|█▋        | 6337/37963 [27:10:10<127:13:24, 14.48s/it]
 17%|█▋        | 6338/37963 [27:10:25<127:03:25, 14.46s/it]
 17%|█▋        | 6339/37963 [27:10:39<127:44:26, 14.54s/it]
 17%|█▋        | 6340/37963 [27:10:54<127:14:06, 14.48s/it]
                                                           
{'loss': '0.158', 'grad_norm': '1.966', 'learning_rate': '1.903e-05', 'epoch': '0.167'}

 17%|█▋        | 6340/37963 [27:10:54<127:14:06, 14.48s/it]
 17%|█▋        | 6341/37963 [27:11:15<145:20:03, 16.55s/it]
 17%|█▋        | 6342/37963 [27:11:29<138:24:55, 15.76s/it]
 17%|█▋        | 6343/37963 [27:11:44<135:04:30, 15.38s/it]
 17%|█▋        | 6344/37963 [27:11:58<132:18:16, 15.06s/it]
 17%|█▋        | 6345/37963 [27:12:12<130:14:11, 14.83s/it]
 17%|█▋        | 6346/37963 [27:12:26<126:47:29, 14.44s/it]
 17%|█▋        | 6347/37963 [27:12:40<126:36:15, 14.42s/it]
 17%|█▋        | 6348/37963 [27:12:54<126:24:43, 14.39s/it]
 17%|█▋        | 6349/37963 [27:13:09<126:25:56, 14.40s/it]
 17%|█▋        | 6350/37963 [27:13:23<126:12:31, 14.37s/it]
                                                           
{'loss': '0.1525', 'grad_norm': '1.036', 'learning_rate': '1.903e-05', 'epoch': '0.1673'}

 17%|█▋        | 6350/37963 [27:13:23<126:12:31, 14.37s/it]
 17%|█▋        | 6351/37963 [27:13:38<126:20:04, 14.39s/it]
 17%|█▋        | 6352/37963 [27:13:51<124:29:06, 14.18s/it]
 17%|█▋        | 6353/37963 [27:14:05<123:25:14, 14.06s/it]
 17%|█▋        | 6354/37963 [27:14:19<124:15:11, 14.15s/it]
 17%|█▋        | 6355/37963 [27:14:34<124:51:46, 14.22s/it]
 17%|█▋        | 6356/37963 [27:14:48<125:22:48, 14.28s/it]
 17%|█▋        | 6357/37963 [27:15:02<123:11:57, 14.03s/it]
 17%|█▋        | 6358/37963 [27:15:16<124:13:20, 14.15s/it]
 17%|█▋        | 6359/37963 [27:15:37<141:43:04, 16.14s/it]
 17%|█▋        | 6360/37963 [27:15:51<136:55:00, 15.60s/it]
                                                           
{'loss': '0.1474', 'grad_norm': '2.006', 'learning_rate': '1.902e-05', 'epoch': '0.1675'}

 17%|█▋        | 6360/37963 [27:15:51<136:55:00, 15.60s/it]
 17%|█▋        | 6361/37963 [27:16:05<132:10:12, 15.06s/it]
 17%|█▋        | 6362/37963 [27:16:26<147:34:22, 16.81s/it]
 17%|█▋        | 6363/37963 [27:16:40<141:19:57, 16.10s/it]
 17%|█▋        | 6364/37963 [27:16:55<136:56:46, 15.60s/it]
 17%|█▋        | 6365/37963 [27:17:09<133:12:06, 15.18s/it]
 17%|█▋        | 6366/37963 [27:17:23<131:01:42, 14.93s/it]
 17%|█▋        | 6367/37963 [27:17:44<146:22:28, 16.68s/it]
 17%|█▋        | 6368/37963 [27:17:58<140:14:52, 15.98s/it]
 17%|█▋        | 6369/37963 [27:18:19<152:50:13, 17.42s/it]
 17%|█▋        | 6370/37963 [27:18:33<144:48:28, 16.50s/it]
                                                           
{'loss': '0.1666', 'grad_norm': '1.42', 'learning_rate': '1.902e-05', 'epoch': '0.1678'}

 17%|█▋        | 6370/37963 [27:18:34<144:48:28, 16.50s/it]
 17%|█▋        | 6371/37963 [27:18:54<156:19:19, 17.81s/it]
 17%|█▋        | 6372/37963 [27:19:09<147:16:15, 16.78s/it]
 17%|█▋        | 6373/37963 [27:19:23<140:30:26, 16.01s/it]
 17%|█▋        | 6374/37963 [27:19:37<136:06:11, 15.51s/it]
 17%|█▋        | 6375/37963 [27:19:52<133:16:51, 15.19s/it]
 17%|█▋        | 6376/37963 [27:20:13<149:04:07, 16.99s/it]
 17%|█▋        | 6377/37963 [27:20:27<142:26:15, 16.23s/it]
 17%|█▋        | 6378/37963 [27:20:42<138:14:38, 15.76s/it]
 17%|█▋        | 6379/37963 [27:20:56<134:01:43, 15.28s/it]
 17%|█▋        | 6380/37963 [27:21:18<151:18:18, 17.25s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '3.314', 'learning_rate': '1.902e-05', 'epoch': '0.1681'}

 17%|█▋        | 6380/37963 [27:21:18<151:18:18, 17.25s/it]
 17%|█▋        | 6381/37963 [27:21:32<143:47:16, 16.39s/it]
 17%|█▋        | 6382/37963 [27:21:46<137:31:06, 15.68s/it]
 17%|█▋        | 6383/37963 [27:22:01<134:05:38, 15.29s/it]
 17%|█▋        | 6384/37963 [27:22:15<131:18:45, 14.97s/it]
 17%|█▋        | 6385/37963 [27:22:29<129:35:03, 14.77s/it]
 17%|█▋        | 6386/37963 [27:22:44<128:21:47, 14.63s/it]
 17%|█▋        | 6387/37963 [27:22:57<125:55:50, 14.36s/it]
 17%|█▋        | 6388/37963 [27:23:12<125:37:52, 14.32s/it]
 17%|█▋        | 6389/37963 [27:23:33<143:47:07, 16.39s/it]
 17%|█▋        | 6390/37963 [27:23:47<138:00:28, 15.74s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '2.202', 'learning_rate': '1.901e-05', 'epoch': '0.1683'}

 17%|█▋        | 6390/37963 [27:23:47<138:00:28, 15.74s/it]
 17%|█▋        | 6391/37963 [27:24:01<134:31:02, 15.34s/it]
 17%|█▋        | 6392/37963 [27:24:15<130:10:45, 14.84s/it]
 17%|█▋        | 6393/37963 [27:24:30<128:54:06, 14.70s/it]
 17%|█▋        | 6394/37963 [27:24:44<127:33:08, 14.55s/it]
 17%|█▋        | 6395/37963 [27:24:58<126:58:28, 14.48s/it]
 17%|█▋        | 6396/37963 [27:25:12<125:35:08, 14.32s/it]
 17%|█▋        | 6397/37963 [27:25:26<125:09:41, 14.27s/it]
 17%|█▋        | 6398/37963 [27:25:40<124:57:49, 14.25s/it]
 17%|█▋        | 6399/37963 [27:25:54<124:18:55, 14.18s/it]
 17%|█▋        | 6400/37963 [27:26:09<124:43:43, 14.23s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '5.164', 'learning_rate': '1.901e-05', 'epoch': '0.1686'}

 17%|█▋        | 6400/37963 [27:26:09<124:43:43, 14.23s/it]
 17%|█▋        | 6401/37963 [27:26:23<124:24:10, 14.19s/it]
 17%|█▋        | 6402/37963 [27:26:37<123:27:36, 14.08s/it]
 17%|█▋        | 6403/37963 [27:26:51<123:41:10, 14.11s/it]
 17%|█▋        | 6404/37963 [27:27:05<124:27:15, 14.20s/it]
 17%|█▋        | 6405/37963 [27:27:20<125:07:50, 14.27s/it]
 17%|█▋        | 6406/37963 [27:27:34<125:17:17, 14.29s/it]
 17%|█▋        | 6407/37963 [27:27:49<125:50:00, 14.36s/it]
 17%|█▋        | 6408/37963 [27:28:03<126:00:54, 14.38s/it]
 17%|█▋        | 6409/37963 [27:28:17<126:16:00, 14.41s/it]
 17%|█▋        | 6410/37963 [27:28:38<143:49:12, 16.41s/it]
                                                           
{'loss': '0.1488', 'grad_norm': '2.311', 'learning_rate': '1.901e-05', 'epoch': '0.1688'}

 17%|█▋        | 6410/37963 [27:28:38<143:49:12, 16.41s/it]
 17%|█▋        | 6411/37963 [27:28:53<138:29:41, 15.80s/it]
 17%|█▋        | 6412/37963 [27:29:14<152:37:30, 17.41s/it]
 17%|█▋        | 6413/37963 [27:29:28<144:34:31, 16.50s/it]
 17%|█▋        | 6414/37963 [27:29:42<137:38:59, 15.71s/it]
 17%|█▋        | 6415/37963 [27:29:57<134:02:34, 15.30s/it]
 17%|█▋        | 6416/37963 [27:30:18<148:51:20, 16.99s/it]
 17%|█▋        | 6417/37963 [27:30:38<159:02:45, 18.15s/it]
 17%|█▋        | 6418/37963 [27:30:53<148:51:02, 16.99s/it]
 17%|█▋        | 6419/37963 [27:31:07<142:02:44, 16.21s/it]
 17%|█▋        | 6420/37963 [27:31:28<154:25:51, 17.63s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '1.093', 'learning_rate': '1.9e-05', 'epoch': '0.1691'}

 17%|█▋        | 6420/37963 [27:31:28<154:25:51, 17.63s/it]
 17%|█▋        | 6421/37963 [27:31:42<145:40:47, 16.63s/it]
 17%|█▋        | 6422/37963 [27:31:56<138:42:46, 15.83s/it]
 17%|█▋        | 6423/37963 [27:32:11<134:59:56, 15.41s/it]
 17%|█▋        | 6424/37963 [27:32:32<150:02:29, 17.13s/it]
 17%|█▋        | 6425/37963 [27:32:46<142:49:37, 16.30s/it]
 17%|█▋        | 6426/37963 [27:33:00<136:22:01, 15.57s/it]
 17%|█▋        | 6427/37963 [27:33:14<133:13:36, 15.21s/it]
 17%|█▋        | 6428/37963 [27:33:36<148:50:42, 16.99s/it]
 17%|█▋        | 6429/37963 [27:33:50<142:26:08, 16.26s/it]
 17%|█▋        | 6430/37963 [27:34:04<137:22:51, 15.68s/it]
                                                           
{'loss': '0.1675', 'grad_norm': '4.957', 'learning_rate': '1.9e-05', 'epoch': '0.1694'}

 17%|█▋        | 6430/37963 [27:34:04<137:22:51, 15.68s/it]
 17%|█▋        | 6431/37963 [27:34:19<134:01:18, 15.30s/it]
 17%|█▋        | 6432/37963 [27:34:33<131:28:40, 15.01s/it]
 17%|█▋        | 6433/37963 [27:34:48<129:51:06, 14.83s/it]
 17%|█▋        | 6434/37963 [27:35:02<127:40:22, 14.58s/it]
 17%|█▋        | 6435/37963 [27:35:16<126:54:21, 14.49s/it]
 17%|█▋        | 6436/37963 [27:35:30<126:35:42, 14.46s/it]
 17%|█▋        | 6437/37963 [27:35:44<125:54:57, 14.38s/it]
 17%|█▋        | 6438/37963 [27:36:06<143:27:28, 16.38s/it]
 17%|█▋        | 6439/37963 [27:36:20<137:44:14, 15.73s/it]
 17%|█▋        | 6440/37963 [27:36:34<134:10:28, 15.32s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '2.229', 'learning_rate': '1.9e-05', 'epoch': '0.1696'}

 17%|█▋        | 6440/37963 [27:36:34<134:10:28, 15.32s/it]
 17%|█▋        | 6441/37963 [27:36:48<131:33:11, 15.02s/it]
 17%|█▋        | 6442/37963 [27:37:02<128:38:32, 14.69s/it]
 17%|█▋        | 6443/37963 [27:37:16<126:20:56, 14.43s/it]
 17%|█▋        | 6444/37963 [27:37:30<126:00:07, 14.39s/it]
 17%|█▋        | 6445/37963 [27:37:45<125:51:55, 14.38s/it]
 17%|█▋        | 6446/37963 [27:37:59<126:09:04, 14.41s/it]
 17%|█▋        | 6447/37963 [27:38:14<126:01:42, 14.40s/it]
 17%|█▋        | 6448/37963 [27:38:28<125:55:42, 14.38s/it]
 17%|█▋        | 6449/37963 [27:38:43<126:14:23, 14.42s/it]
 17%|█▋        | 6450/37963 [27:38:57<125:37:15, 14.35s/it]
                                                           
{'loss': '0.1689', 'grad_norm': '4.741', 'learning_rate': '1.899e-05', 'epoch': '0.1699'}

 17%|█▋        | 6450/37963 [27:38:57<125:37:15, 14.35s/it]
 17%|█▋        | 6451/37963 [27:39:11<125:59:52, 14.39s/it]
 17%|█▋        | 6452/37963 [27:39:26<125:41:23, 14.36s/it]
 17%|█▋        | 6453/37963 [27:39:40<125:36:36, 14.35s/it]
 17%|█▋        | 6454/37963 [27:39:54<125:38:08, 14.35s/it]
 17%|█▋        | 6455/37963 [27:40:09<125:43:12, 14.36s/it]
 17%|█▋        | 6456/37963 [27:40:23<125:37:20, 14.35s/it]
 17%|█▋        | 6457/37963 [27:40:37<125:51:04, 14.38s/it]
 17%|█▋        | 6458/37963 [27:40:51<123:45:35, 14.14s/it]
 17%|█▋        | 6459/37963 [27:41:05<123:26:17, 14.11s/it]
 17%|█▋        | 6460/37963 [27:41:19<123:33:52, 14.12s/it]
                                                           
{'loss': '0.1818', 'grad_norm': '1.532', 'learning_rate': '1.899e-05', 'epoch': '0.1702'}

 17%|█▋        | 6460/37963 [27:41:19<123:33:52, 14.12s/it]
 17%|█▋        | 6461/37963 [27:41:40<141:50:29, 16.21s/it]
 17%|█▋        | 6462/37963 [27:42:01<152:53:27, 17.47s/it]
 17%|█▋        | 6463/37963 [27:42:15<143:53:04, 16.44s/it]
 17%|█▋        | 6464/37963 [27:42:29<138:21:53, 15.81s/it]
 17%|█▋        | 6465/37963 [27:42:50<150:56:29, 17.25s/it]
 17%|█▋        | 6466/37963 [27:43:10<158:10:52, 18.08s/it]
 17%|█▋        | 6467/37963 [27:43:24<148:18:44, 16.95s/it]
 17%|█▋        | 6468/37963 [27:43:45<158:12:51, 18.08s/it]
 17%|█▋        | 6469/37963 [27:43:59<148:45:39, 17.00s/it]
 17%|█▋        | 6470/37963 [27:44:13<141:18:09, 16.15s/it]
                                                           
{'loss': '0.175', 'grad_norm': '6.602', 'learning_rate': '1.898e-05', 'epoch': '0.1704'}

 17%|█▋        | 6470/37963 [27:44:13<141:18:09, 16.15s/it]
 17%|█▋        | 6471/37963 [27:44:28<136:14:06, 15.57s/it]
 17%|█▋        | 6472/37963 [27:44:48<149:48:31, 17.13s/it]
 17%|█▋        | 6473/37963 [27:45:02<141:25:32, 16.17s/it]
 17%|█▋        | 6474/37963 [27:45:16<136:17:28, 15.58s/it]
 17%|█▋        | 6475/37963 [27:45:31<133:14:50, 15.23s/it]
 17%|█▋        | 6476/37963 [27:45:45<130:50:24, 14.96s/it]
 17%|█▋        | 6477/37963 [27:46:06<147:15:56, 16.84s/it]
 17%|█▋        | 6478/37963 [27:46:20<138:44:32, 15.86s/it]
 17%|█▋        | 6479/37963 [27:46:34<134:39:22, 15.40s/it]
 17%|█▋        | 6480/37963 [27:46:48<130:16:16, 14.90s/it]
                                                           
{'loss': '0.174', 'grad_norm': '4.164', 'learning_rate': '1.898e-05', 'epoch': '0.1707'}

 17%|█▋        | 6480/37963 [27:46:48<130:16:16, 14.90s/it]
 17%|█▋        | 6481/37963 [27:47:03<129:10:36, 14.77s/it]
 17%|█▋        | 6482/37963 [27:47:17<128:12:59, 14.66s/it]
 17%|█▋        | 6483/37963 [27:47:31<127:17:49, 14.56s/it]
 17%|█▋        | 6484/37963 [27:47:46<126:54:14, 14.51s/it]
 17%|█▋        | 6485/37963 [27:47:59<124:20:40, 14.22s/it]
 17%|█▋        | 6486/37963 [27:48:20<142:54:41, 16.34s/it]
 17%|█▋        | 6487/37963 [27:48:35<136:58:55, 15.67s/it]
 17%|█▋        | 6488/37963 [27:48:48<131:53:03, 15.08s/it]
 17%|█▋        | 6489/37963 [27:49:02<128:05:06, 14.65s/it]
 17%|█▋        | 6490/37963 [27:49:16<127:20:53, 14.57s/it]
                                                           
{'loss': '0.1753', 'grad_norm': '4.738', 'learning_rate': '1.898e-05', 'epoch': '0.171'}

 17%|█▋        | 6490/37963 [27:49:16<127:20:53, 14.57s/it]
 17%|█▋        | 6491/37963 [27:49:31<126:56:09, 14.52s/it]
 17%|█▋        | 6492/37963 [27:49:45<126:35:10, 14.48s/it]
 17%|█▋        | 6493/37963 [27:49:59<124:43:01, 14.27s/it]
 17%|█▋        | 6494/37963 [27:50:13<124:32:15, 14.25s/it]
 17%|█▋        | 6495/37963 [27:50:27<124:37:35, 14.26s/it]
 17%|█▋        | 6496/37963 [27:50:42<124:59:45, 14.30s/it]
 17%|█▋        | 6497/37963 [27:50:56<124:36:27, 14.26s/it]
 17%|█▋        | 6498/37963 [27:51:10<123:17:32, 14.11s/it]
 17%|█▋        | 6499/37963 [27:51:24<122:57:11, 14.07s/it]
 17%|█▋        | 6500/37963 [27:51:38<123:41:23, 14.15s/it]
                                                           
{'loss': '0.179', 'grad_norm': '2.917', 'learning_rate': '1.897e-05', 'epoch': '0.1712'}

 17%|█▋        | 6500/37963 [27:51:38<123:41:23, 14.15s/it]
 17%|█▋        | 6501/37963 [27:51:52<123:52:16, 14.17s/it]
 17%|█▋        | 6502/37963 [27:52:07<124:27:51, 14.24s/it]
 17%|█▋        | 6503/37963 [27:52:21<124:27:55, 14.24s/it]
 17%|█▋        | 6504/37963 [27:52:35<124:19:06, 14.23s/it]
 17%|█▋        | 6505/37963 [27:52:49<124:34:48, 14.26s/it]
 17%|█▋        | 6506/37963 [27:53:03<122:41:02, 14.04s/it]
 17%|█▋        | 6507/37963 [27:53:17<122:32:59, 14.03s/it]
 17%|█▋        | 6508/37963 [27:53:45<158:11:51, 18.11s/it]
 17%|█▋        | 6509/37963 [27:53:59<148:42:31, 17.02s/it]
 17%|█▋        | 6510/37963 [27:54:13<141:27:24, 16.19s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '6.996', 'learning_rate': '1.897e-05', 'epoch': '0.1715'}

 17%|█▋        | 6510/37963 [27:54:13<141:27:24, 16.19s/it]
 17%|█▋        | 6511/37963 [27:54:28<136:52:27, 15.67s/it]
 17%|█▋        | 6512/37963 [27:54:42<133:43:38, 15.31s/it]
 17%|█▋        | 6513/37963 [27:54:56<130:40:14, 14.96s/it]
 17%|█▋        | 6514/37963 [27:55:17<145:54:41, 16.70s/it]
 17%|█▋        | 6515/37963 [27:55:31<137:50:17, 15.78s/it]
 17%|█▋        | 6516/37963 [27:55:58<168:17:09, 19.27s/it]
 17%|█▋        | 6517/37963 [27:56:12<155:18:58, 17.78s/it]
 17%|█▋        | 6518/37963 [27:56:27<146:20:40, 16.75s/it]
 17%|█▋        | 6519/37963 [27:56:41<138:23:21, 15.84s/it]
 17%|█▋        | 6520/37963 [27:56:55<134:24:51, 15.39s/it]
                                                           
{'loss': '0.1703', 'grad_norm': '1.864', 'learning_rate': '1.897e-05', 'epoch': '0.1717'}

 17%|█▋        | 6520/37963 [27:56:55<134:24:51, 15.39s/it]
 17%|█▋        | 6521/37963 [27:57:16<148:54:57, 17.05s/it]
 17%|█▋        | 6522/37963 [27:57:30<141:02:26, 16.15s/it]
 17%|█▋        | 6523/37963 [27:57:44<136:32:11, 15.63s/it]
 17%|█▋        | 6524/37963 [27:57:59<133:13:05, 15.25s/it]
 17%|█▋        | 6525/37963 [27:58:13<130:56:56, 15.00s/it]
 17%|█▋        | 6526/37963 [27:58:34<145:54:38, 16.71s/it]
 17%|█▋        | 6527/37963 [27:58:48<139:46:21, 16.01s/it]
 17%|█▋        | 6528/37963 [27:59:02<133:55:59, 15.34s/it]
 17%|█▋        | 6529/37963 [27:59:16<131:21:56, 15.04s/it]
 17%|█▋        | 6530/37963 [27:59:31<129:22:58, 14.82s/it]
                                                           
{'loss': '0.169', 'grad_norm': '2.193', 'learning_rate': '1.896e-05', 'epoch': '0.172'}

 17%|█▋        | 6530/37963 [27:59:31<129:22:58, 14.82s/it]
 17%|█▋        | 6531/37963 [27:59:45<128:27:29, 14.71s/it]
 17%|█▋        | 6532/37963 [27:59:59<127:57:02, 14.66s/it]
 17%|█▋        | 6533/37963 [28:00:14<126:15:51, 14.46s/it]
 17%|█▋        | 6534/37963 [28:00:34<141:44:11, 16.24s/it]
 17%|█▋        | 6535/37963 [28:00:48<135:29:41, 15.52s/it]
 17%|█▋        | 6536/37963 [28:01:02<131:24:52, 15.05s/it]
 17%|█▋        | 6537/37963 [28:01:16<129:40:29, 14.85s/it]
 17%|█▋        | 6538/37963 [28:01:30<128:23:59, 14.71s/it]
 17%|█▋        | 6539/37963 [28:01:44<126:16:26, 14.47s/it]
 17%|█▋        | 6540/37963 [28:01:59<125:54:00, 14.42s/it]
                                                           
{'loss': '0.1732', 'grad_norm': '2.449', 'learning_rate': '1.896e-05', 'epoch': '0.1723'}

 17%|█▋        | 6540/37963 [28:01:59<125:54:00, 14.42s/it]
 17%|█▋        | 6541/37963 [28:02:13<125:12:06, 14.34s/it]
 17%|█▋        | 6542/37963 [28:02:27<125:12:11, 14.34s/it]
 17%|█▋        | 6543/37963 [28:02:41<124:04:50, 14.22s/it]
 17%|█▋        | 6544/37963 [28:02:55<122:44:02, 14.06s/it]
 17%|█▋        | 6545/37963 [28:03:09<123:27:20, 14.15s/it]
 17%|█▋        | 6546/37963 [28:03:23<123:51:37, 14.19s/it]
 17%|█▋        | 6547/37963 [28:03:38<124:28:37, 14.26s/it]
 17%|█▋        | 6548/37963 [28:03:52<124:14:17, 14.24s/it]
 17%|█▋        | 6549/37963 [28:04:06<123:43:06, 14.18s/it]
 17%|█▋        | 6550/37963 [28:04:20<124:07:42, 14.23s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '1.177', 'learning_rate': '1.895e-05', 'epoch': '0.1725'}

 17%|█▋        | 6550/37963 [28:04:20<124:07:42, 14.23s/it]
 17%|█▋        | 6551/37963 [28:04:35<124:50:31, 14.31s/it]
 17%|█▋        | 6552/37963 [28:04:49<123:50:06, 14.19s/it]
 17%|█▋        | 6553/37963 [28:05:03<123:35:23, 14.17s/it]
 17%|█▋        | 6554/37963 [28:05:17<123:34:45, 14.16s/it]
 17%|█▋        | 6555/37963 [28:05:37<139:38:20, 16.01s/it]
 17%|█▋        | 6556/37963 [28:05:58<152:20:29, 17.46s/it]
 17%|█▋        | 6557/37963 [28:06:13<144:16:07, 16.54s/it]
 17%|█▋        | 6558/37963 [28:06:27<137:37:01, 15.78s/it]
 17%|█▋        | 6559/37963 [28:06:41<133:56:54, 15.36s/it]
 17%|█▋        | 6560/37963 [28:06:55<131:12:30, 15.04s/it]
                                                           
{'loss': '0.1723', 'grad_norm': '1.642', 'learning_rate': '1.895e-05', 'epoch': '0.1728'}

 17%|█▋        | 6560/37963 [28:06:55<131:12:30, 15.04s/it]
 17%|█▋        | 6561/37963 [28:07:16<146:14:26, 16.77s/it]
 17%|█▋        | 6562/37963 [28:07:37<156:43:09, 17.97s/it]
 17%|█▋        | 6563/37963 [28:07:51<147:12:28, 16.88s/it]
 17%|█▋        | 6564/37963 [28:08:06<140:40:50, 16.13s/it]
 17%|█▋        | 6565/37963 [28:08:20<136:22:33, 15.64s/it]
 17%|█▋        | 6566/37963 [28:08:41<149:28:14, 17.14s/it]
 17%|█▋        | 6567/37963 [28:08:55<142:22:38, 16.33s/it]
 17%|█▋        | 6568/37963 [28:09:10<137:09:17, 15.73s/it]
 17%|█▋        | 6569/37963 [28:09:24<133:38:04, 15.32s/it]
 17%|█▋        | 6570/37963 [28:09:38<131:08:32, 15.04s/it]
                                                           
{'loss': '0.156', 'grad_norm': '1.663', 'learning_rate': '1.895e-05', 'epoch': '0.1731'}

 17%|█▋        | 6570/37963 [28:09:38<131:08:32, 15.04s/it]
 17%|█▋        | 6571/37963 [28:10:00<148:16:05, 17.00s/it]
 17%|█▋        | 6572/37963 [28:10:14<141:15:20, 16.20s/it]
 17%|█▋        | 6573/37963 [28:10:29<136:22:39, 15.64s/it]
 17%|█▋        | 6574/37963 [28:10:43<133:04:03, 15.26s/it]
 17%|█▋        | 6575/37963 [28:11:04<148:32:42, 17.04s/it]
 17%|█▋        | 6576/37963 [28:11:18<141:38:44, 16.25s/it]
 17%|█▋        | 6577/37963 [28:11:33<137:07:44, 15.73s/it]
 17%|█▋        | 6578/37963 [28:11:47<133:30:47, 15.31s/it]
 17%|█▋        | 6579/37963 [28:12:02<130:55:09, 15.02s/it]
 17%|█▋        | 6580/37963 [28:12:16<129:06:36, 14.81s/it]
                                                           
{'loss': '0.1662', 'grad_norm': '1.147', 'learning_rate': '1.894e-05', 'epoch': '0.1733'}

 17%|█▋        | 6580/37963 [28:12:16<129:06:36, 14.81s/it]
 17%|█▋        | 6581/37963 [28:12:31<128:24:09, 14.73s/it]
 17%|█▋        | 6582/37963 [28:12:45<127:42:03, 14.65s/it]
 17%|█▋        | 6583/37963 [28:12:59<125:51:23, 14.44s/it]
 17%|█▋        | 6584/37963 [28:13:20<143:15:15, 16.44s/it]
 17%|█▋        | 6585/37963 [28:13:34<137:41:34, 15.80s/it]
 17%|█▋        | 6586/37963 [28:13:49<133:44:17, 15.34s/it]
 17%|█▋        | 6587/37963 [28:14:03<129:57:35, 14.91s/it]
 17%|█▋        | 6588/37963 [28:14:17<128:22:51, 14.73s/it]
 17%|█▋        | 6589/37963 [28:14:31<127:43:32, 14.66s/it]
 17%|█▋        | 6590/37963 [28:14:46<126:51:24, 14.56s/it]
                                                           
{'loss': '0.1712', 'grad_norm': '3.531', 'learning_rate': '1.894e-05', 'epoch': '0.1736'}

 17%|█▋        | 6590/37963 [28:14:46<126:51:24, 14.56s/it]
 17%|█▋        | 6591/37963 [28:15:00<126:24:48, 14.51s/it]
 17%|█▋        | 6592/37963 [28:15:14<125:54:06, 14.45s/it]
 17%|█▋        | 6593/37963 [28:15:29<125:55:39, 14.45s/it]
 17%|█▋        | 6594/37963 [28:15:43<125:14:11, 14.37s/it]
 17%|█▋        | 6595/37963 [28:15:57<125:12:00, 14.37s/it]
 17%|█▋        | 6596/37963 [28:16:12<125:33:42, 14.41s/it]
 17%|█▋        | 6597/37963 [28:16:26<125:30:29, 14.41s/it]
 17%|█▋        | 6598/37963 [28:16:40<124:47:16, 14.32s/it]
 17%|█▋        | 6599/37963 [28:16:55<124:53:04, 14.33s/it]
 17%|█▋        | 6600/37963 [28:17:09<124:55:40, 14.34s/it]
                                                           
{'loss': '0.1771', 'grad_norm': '1.52', 'learning_rate': '1.893e-05', 'epoch': '0.1739'}

 17%|█▋        | 6600/37963 [28:17:09<124:55:40, 14.34s/it]
 17%|█▋        | 6601/37963 [28:17:30<142:20:22, 16.34s/it]
 17%|█▋        | 6602/37963 [28:17:44<136:30:56, 15.67s/it]
 17%|█▋        | 6603/37963 [28:17:59<133:05:57, 15.28s/it]
 17%|█▋        | 6604/37963 [28:18:19<146:32:39, 16.82s/it]
 17%|█▋        | 6605/37963 [28:18:33<139:38:09, 16.03s/it]
 17%|█▋        | 6606/37963 [28:18:48<135:29:21, 15.56s/it]
 17%|█▋        | 6607/37963 [28:19:01<130:14:34, 14.95s/it]
 17%|█▋        | 6608/37963 [28:19:16<129:04:08, 14.82s/it]
 17%|█▋        | 6609/37963 [28:19:30<126:49:53, 14.56s/it]
 17%|█▋        | 6610/37963 [28:19:51<143:26:58, 16.47s/it]
                                                           
{'loss': '0.1552', 'grad_norm': '2.16', 'learning_rate': '1.893e-05', 'epoch': '0.1741'}

 17%|█▋        | 6610/37963 [28:19:51<143:26:58, 16.47s/it]
 17%|█▋        | 6611/37963 [28:20:11<154:48:07, 17.78s/it]
 17%|█▋        | 6612/37963 [28:20:26<145:46:51, 16.74s/it]
 17%|█▋        | 6613/37963 [28:20:40<139:35:12, 16.03s/it]
 17%|█▋        | 6614/37963 [28:20:55<135:31:39, 15.56s/it]
 17%|█▋        | 6615/37963 [28:21:09<132:15:07, 15.19s/it]
 17%|█▋        | 6616/37963 [28:21:30<146:29:34, 16.82s/it]
 17%|█▋        | 6617/37963 [28:21:44<140:17:01, 16.11s/it]
 17%|█▋        | 6618/37963 [28:21:58<135:36:51, 15.58s/it]
 17%|█▋        | 6619/37963 [28:22:13<132:35:20, 15.23s/it]
 17%|█▋        | 6620/37963 [28:22:34<148:16:40, 17.03s/it]
                                                           
{'loss': '0.1632', 'grad_norm': '4.892', 'learning_rate': '1.893e-05', 'epoch': '0.1744'}

 17%|█▋        | 6620/37963 [28:22:34<148:16:40, 17.03s/it]
 17%|█▋        | 6621/37963 [28:22:48<141:16:58, 16.23s/it]
 17%|█▋        | 6622/37963 [28:23:02<135:44:47, 15.59s/it]
 17%|█▋        | 6623/37963 [28:23:24<151:52:30, 17.45s/it]
 17%|█▋        | 6624/37963 [28:23:39<143:49:46, 16.52s/it]
 17%|█▋        | 6625/37963 [28:23:53<137:24:40, 15.79s/it]
 17%|█▋        | 6626/37963 [28:24:07<133:44:33, 15.36s/it]
 17%|█▋        | 6627/37963 [28:24:21<131:04:00, 15.06s/it]
 17%|█▋        | 6628/37963 [28:24:36<129:08:42, 14.84s/it]
 17%|█▋        | 6629/37963 [28:24:50<127:05:16, 14.60s/it]
 17%|█▋        | 6630/37963 [28:25:04<126:30:30, 14.54s/it]
                                                           
{'loss': '0.1655', 'grad_norm': '1.799', 'learning_rate': '1.892e-05', 'epoch': '0.1746'}

 17%|█▋        | 6630/37963 [28:25:04<126:30:30, 14.54s/it]
 17%|█▋        | 6631/37963 [28:25:18<125:56:03, 14.47s/it]
 17%|█▋        | 6632/37963 [28:25:40<143:46:32, 16.52s/it]
 17%|█▋        | 6633/37963 [28:25:54<138:12:21, 15.88s/it]
 17%|█▋        | 6634/37963 [28:26:09<134:23:24, 15.44s/it]
 17%|█▋        | 6635/37963 [28:26:23<131:16:33, 15.09s/it]
 17%|█▋        | 6636/37963 [28:26:37<129:13:42, 14.85s/it]
 17%|█▋        | 6637/37963 [28:26:51<128:03:40, 14.72s/it]
 17%|█▋        | 6638/37963 [28:27:06<127:07:52, 14.61s/it]
 17%|█▋        | 6639/37963 [28:27:20<126:51:15, 14.58s/it]
 17%|█▋        | 6640/37963 [28:27:35<126:25:21, 14.53s/it]
                                                           
{'loss': '0.1729', 'grad_norm': '5.791', 'learning_rate': '1.892e-05', 'epoch': '0.1749'}

 17%|█▋        | 6640/37963 [28:27:35<126:25:21, 14.53s/it]
 17%|█▋        | 6641/37963 [28:27:49<126:25:28, 14.53s/it]
 17%|█▋        | 6642/37963 [28:28:03<124:04:52, 14.26s/it]
 17%|█▋        | 6643/37963 [28:28:17<124:26:28, 14.30s/it]
 18%|█▊        | 6644/37963 [28:28:31<123:11:16, 14.16s/it]
 18%|█▊        | 6645/37963 [28:28:45<121:23:02, 13.95s/it]
 18%|█▊        | 6646/37963 [28:28:59<122:17:49, 14.06s/it]
 18%|█▊        | 6647/37963 [28:29:13<123:11:41, 14.16s/it]
 18%|█▊        | 6648/37963 [28:29:27<123:08:15, 14.16s/it]
 18%|█▊        | 6649/37963 [28:29:42<123:51:44, 14.24s/it]
 18%|█▊        | 6650/37963 [28:30:03<141:09:13, 16.23s/it]
                                                           
{'loss': '0.1455', 'grad_norm': '1.205', 'learning_rate': '1.892e-05', 'epoch': '0.1752'}

 18%|█▊        | 6650/37963 [28:30:03<141:09:13, 16.23s/it]
 18%|█▊        | 6651/37963 [28:30:17<136:07:54, 15.65s/it]
 18%|█▊        | 6652/37963 [28:30:31<131:41:55, 15.14s/it]
 18%|█▊        | 6653/37963 [28:30:45<128:53:51, 14.82s/it]
 18%|█▊        | 6654/37963 [28:30:59<127:42:19, 14.68s/it]
 18%|█▊        | 6655/37963 [28:31:20<144:07:55, 16.57s/it]
 18%|█▊        | 6656/37963 [28:31:35<138:13:26, 15.89s/it]
 18%|█▊        | 6657/37963 [28:31:49<134:02:19, 15.41s/it]
 18%|█▊        | 6658/37963 [28:32:03<131:25:21, 15.11s/it]
 18%|█▊        | 6659/37963 [28:32:24<145:39:53, 16.75s/it]
 18%|█▊        | 6660/37963 [28:32:45<155:43:47, 17.91s/it]
                                                           
{'loss': '0.1748', 'grad_norm': '5.557', 'learning_rate': '1.891e-05', 'epoch': '0.1754'}

 18%|█▊        | 6660/37963 [28:32:45<155:43:47, 17.91s/it]
 18%|█▊        | 6661/37963 [28:32:59<146:38:01, 16.86s/it]
 18%|█▊        | 6662/37963 [28:33:14<140:21:09, 16.14s/it]
 18%|█▊        | 6663/37963 [28:33:28<135:44:51, 15.61s/it]
 18%|█▊        | 6664/37963 [28:33:42<132:24:46, 15.23s/it]
 18%|█▊        | 6665/37963 [28:33:57<130:22:07, 15.00s/it]
 18%|█▊        | 6666/37963 [28:34:11<127:59:51, 14.72s/it]
 18%|█▊        | 6667/37963 [28:34:31<143:30:54, 16.51s/it]
 18%|█▊        | 6668/37963 [28:34:46<137:47:24, 15.85s/it]
 18%|█▊        | 6669/37963 [28:35:06<150:04:16, 17.26s/it]
 18%|█▊        | 6670/37963 [28:35:21<142:19:48, 16.37s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '2.382', 'learning_rate': '1.891e-05', 'epoch': '0.1757'}

 18%|█▊        | 6670/37963 [28:35:21<142:19:48, 16.37s/it]
 18%|█▊        | 6671/37963 [28:35:35<137:22:46, 15.80s/it]
 18%|█▊        | 6672/37963 [28:35:56<151:08:51, 17.39s/it]
 18%|█▊        | 6673/37963 [28:36:10<142:53:26, 16.44s/it]
 18%|█▊        | 6674/37963 [28:36:25<137:23:00, 15.81s/it]
 18%|█▊        | 6675/37963 [28:36:39<133:48:36, 15.40s/it]
 18%|█▊        | 6676/37963 [28:36:54<131:09:05, 15.09s/it]
 18%|█▊        | 6677/37963 [28:37:08<129:12:41, 14.87s/it]
 18%|█▊        | 6678/37963 [28:37:22<127:56:23, 14.72s/it]
 18%|█▊        | 6679/37963 [28:37:37<127:07:59, 14.63s/it]
 18%|█▊        | 6680/37963 [28:37:51<126:25:17, 14.55s/it]
                                                           
{'loss': '0.1649', 'grad_norm': '4.008', 'learning_rate': '1.89e-05', 'epoch': '0.176'}

 18%|█▊        | 6680/37963 [28:37:51<126:25:17, 14.55s/it]
 18%|█▊        | 6681/37963 [28:38:12<143:17:39, 16.49s/it]
 18%|█▊        | 6682/37963 [28:38:26<137:47:33, 15.86s/it]
 18%|█▊        | 6683/37963 [28:38:41<134:18:14, 15.46s/it]
 18%|█▊        | 6684/37963 [28:38:55<130:45:19, 15.05s/it]
 18%|█▊        | 6685/37963 [28:39:09<127:34:17, 14.68s/it]
 18%|█▊        | 6686/37963 [28:39:23<125:53:48, 14.49s/it]
 18%|█▊        | 6687/37963 [28:39:37<125:31:31, 14.45s/it]
 18%|█▊        | 6688/37963 [28:39:51<123:54:18, 14.26s/it]
 18%|█▊        | 6689/37963 [28:40:05<123:42:53, 14.24s/it]
 18%|█▊        | 6690/37963 [28:40:20<123:57:04, 14.27s/it]
                                                           
{'loss': '0.1717', 'grad_norm': '4.651', 'learning_rate': '1.89e-05', 'epoch': '0.1762'}

 18%|█▊        | 6690/37963 [28:40:20<123:57:04, 14.27s/it]
 18%|█▊        | 6691/37963 [28:40:34<124:14:03, 14.30s/it]
 18%|█▊        | 6692/37963 [28:40:48<123:32:05, 14.22s/it]
 18%|█▊        | 6693/37963 [28:41:03<124:07:17, 14.29s/it]
 18%|█▊        | 6694/37963 [28:41:17<124:19:06, 14.31s/it]
 18%|█▊        | 6695/37963 [28:41:31<122:51:59, 14.15s/it]
 18%|█▊        | 6696/37963 [28:41:45<123:24:49, 14.21s/it]
 18%|█▊        | 6697/37963 [28:41:59<122:41:21, 14.13s/it]
 18%|█▊        | 6698/37963 [28:42:13<123:18:16, 14.20s/it]
 18%|█▊        | 6699/37963 [28:42:34<138:56:52, 16.00s/it]
 18%|█▊        | 6700/37963 [28:42:48<134:37:51, 15.50s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '1.482', 'learning_rate': '1.89e-05', 'epoch': '0.1765'}

 18%|█▊        | 6700/37963 [28:42:48<134:37:51, 15.50s/it]
 18%|█▊        | 6701/37963 [28:43:02<131:51:50, 15.18s/it]
 18%|█▊        | 6702/37963 [28:43:17<129:20:55, 14.90s/it]
 18%|█▊        | 6703/37963 [28:43:37<144:02:27, 16.59s/it]
 18%|█▊        | 6704/37963 [28:43:51<138:04:08, 15.90s/it]
 18%|█▊        | 6705/37963 [28:44:06<134:15:37, 15.46s/it]
 18%|█▊        | 6706/37963 [28:44:20<131:30:46, 15.15s/it]
 18%|█▊        | 6707/37963 [28:44:35<129:17:12, 14.89s/it]
 18%|█▊        | 6708/37963 [28:44:49<127:47:32, 14.72s/it]
 18%|█▊        | 6709/37963 [28:45:03<126:41:19, 14.59s/it]
 18%|█▊        | 6710/37963 [28:45:18<126:24:15, 14.56s/it]
                                                           
{'loss': '0.1783', 'grad_norm': '1.298', 'learning_rate': '1.889e-05', 'epoch': '0.1768'}

 18%|█▊        | 6710/37963 [28:45:18<126:24:15, 14.56s/it]
 18%|█▊        | 6711/37963 [28:45:38<141:22:21, 16.29s/it]
 18%|█▊        | 6712/37963 [28:45:59<153:13:25, 17.65s/it]
 18%|█▊        | 6713/37963 [28:46:13<144:45:07, 16.68s/it]
 18%|█▊        | 6714/37963 [28:46:35<156:57:50, 18.08s/it]
 18%|█▊        | 6715/37963 [28:46:49<146:41:47, 16.90s/it]
 18%|█▊        | 6716/37963 [28:47:03<139:58:19, 16.13s/it]
 18%|█▊        | 6717/37963 [28:47:17<133:37:06, 15.39s/it]
 18%|█▊        | 6718/37963 [28:47:38<148:39:48, 17.13s/it]
 18%|█▊        | 6719/37963 [28:47:52<141:21:55, 16.29s/it]
 18%|█▊        | 6720/37963 [28:48:07<136:29:47, 15.73s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '5.152', 'learning_rate': '1.889e-05', 'epoch': '0.177'}

 18%|█▊        | 6720/37963 [28:48:07<136:29:47, 15.73s/it]
 18%|█▊        | 6721/37963 [28:48:28<150:58:19, 17.40s/it]
 18%|█▊        | 6722/37963 [28:48:42<142:42:18, 16.44s/it]
 18%|█▊        | 6723/37963 [28:48:56<136:42:48, 15.75s/it]
 18%|█▊        | 6724/37963 [28:49:11<133:40:32, 15.40s/it]
 18%|█▊        | 6725/37963 [28:49:25<131:03:46, 15.10s/it]
 18%|█▊        | 6726/37963 [28:49:40<128:59:28, 14.87s/it]
 18%|█▊        | 6727/37963 [28:49:53<126:18:12, 14.56s/it]
 18%|█▊        | 6728/37963 [28:50:07<124:08:26, 14.31s/it]
 18%|█▊        | 6729/37963 [28:50:29<143:26:54, 16.53s/it]
 18%|█▊        | 6730/37963 [28:50:43<137:24:09, 15.84s/it]
                                                           
{'loss': '0.1672', 'grad_norm': '2.177', 'learning_rate': '1.888e-05', 'epoch': '0.1773'}

 18%|█▊        | 6730/37963 [28:50:43<137:24:09, 15.84s/it]
 18%|█▊        | 6731/37963 [28:50:57<133:09:04, 15.35s/it]
 18%|█▊        | 6732/37963 [28:51:12<130:30:24, 15.04s/it]
 18%|█▊        | 6733/37963 [28:51:26<128:35:06, 14.82s/it]
 18%|█▊        | 6734/37963 [28:51:40<126:45:08, 14.61s/it]
 18%|█▊        | 6735/37963 [28:51:54<124:04:47, 14.30s/it]
 18%|█▊        | 6736/37963 [28:52:08<124:25:40, 14.34s/it]
 18%|█▊        | 6737/37963 [28:52:22<124:37:59, 14.37s/it]
 18%|█▊        | 6738/37963 [28:52:37<125:06:32, 14.42s/it]
 18%|█▊        | 6739/37963 [28:52:51<124:44:00, 14.38s/it]
 18%|█▊        | 6740/37963 [28:53:05<123:32:56, 14.25s/it]
                                                           
{'loss': '0.1618', 'grad_norm': '4.293', 'learning_rate': '1.888e-05', 'epoch': '0.1775'}

 18%|█▊        | 6740/37963 [28:53:05<123:32:56, 14.25s/it]
 18%|█▊        | 6741/37963 [28:53:20<123:53:40, 14.29s/it]
 18%|█▊        | 6742/37963 [28:53:34<124:01:13, 14.30s/it]
 18%|█▊        | 6743/37963 [28:53:48<122:47:02, 14.16s/it]
 18%|█▊        | 6744/37963 [28:54:02<123:07:26, 14.20s/it]
 18%|█▊        | 6745/37963 [28:54:17<123:46:30, 14.27s/it]
 18%|█▊        | 6746/37963 [28:54:31<123:42:41, 14.27s/it]
 18%|█▊        | 6747/37963 [28:54:45<123:51:28, 14.28s/it]
 18%|█▊        | 6748/37963 [28:55:06<141:23:29, 16.31s/it]
 18%|█▊        | 6749/37963 [28:55:21<136:36:42, 15.76s/it]
 18%|█▊        | 6750/37963 [28:55:35<132:25:49, 15.27s/it]
                                                           
{'loss': '0.1773', 'grad_norm': '3.932', 'learning_rate': '1.888e-05', 'epoch': '0.1778'}

 18%|█▊        | 6750/37963 [28:55:35<132:25:49, 15.27s/it]
 18%|█▊        | 6751/37963 [28:55:49<130:06:12, 15.01s/it]
 18%|█▊        | 6752/37963 [28:56:04<128:41:16, 14.84s/it]
 18%|█▊        | 6753/37963 [28:56:24<143:13:25, 16.52s/it]
 18%|█▊        | 6754/37963 [28:56:38<137:23:07, 15.85s/it]
 18%|█▊        | 6755/37963 [28:56:53<133:32:47, 15.41s/it]
 18%|█▊        | 6756/37963 [28:57:07<130:55:31, 15.10s/it]
 18%|█▊        | 6757/37963 [28:57:22<129:29:49, 14.94s/it]
 18%|█▊        | 6758/37963 [28:57:42<144:35:56, 16.68s/it]
 18%|█▊        | 6759/37963 [28:58:03<155:29:02, 17.94s/it]
 18%|█▊        | 6760/37963 [28:58:18<146:04:14, 16.85s/it]
                                                           
{'loss': '0.166', 'grad_norm': '1.451', 'learning_rate': '1.887e-05', 'epoch': '0.1781'}

 18%|█▊        | 6760/37963 [28:58:18<146:04:14, 16.85s/it]
 18%|█▊        | 6761/37963 [28:58:32<139:32:06, 16.10s/it]
 18%|█▊        | 6762/37963 [28:58:46<134:32:15, 15.52s/it]
 18%|█▊        | 6763/37963 [28:59:00<130:12:29, 15.02s/it]
 18%|█▊        | 6764/37963 [28:59:14<128:15:50, 14.80s/it]
 18%|█▊        | 6765/37963 [28:59:29<127:11:00, 14.68s/it]
 18%|█▊        | 6766/37963 [28:59:49<143:00:55, 16.50s/it]
 18%|█▊        | 6767/37963 [29:00:04<137:28:57, 15.87s/it]
 18%|█▊        | 6768/37963 [29:00:18<133:27:30, 15.40s/it]
 18%|█▊        | 6769/37963 [29:00:39<148:28:03, 17.13s/it]
 18%|█▊        | 6770/37963 [29:00:54<141:18:50, 16.31s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '1.476', 'learning_rate': '1.887e-05', 'epoch': '0.1783'}

 18%|█▊        | 6770/37963 [29:00:54<141:18:50, 16.31s/it]
 18%|█▊        | 6771/37963 [29:01:08<136:13:41, 15.72s/it]
 18%|█▊        | 6772/37963 [29:01:22<132:32:45, 15.30s/it]
 18%|█▊        | 6773/37963 [29:01:37<130:08:24, 15.02s/it]
 18%|█▊        | 6774/37963 [29:01:51<128:49:17, 14.87s/it]
 18%|█▊        | 6775/37963 [29:02:05<125:43:06, 14.51s/it]
 18%|█▊        | 6776/37963 [29:02:26<143:20:27, 16.55s/it]
 18%|█▊        | 6777/37963 [29:02:40<135:59:45, 15.70s/it]
 18%|█▊        | 6778/37963 [29:02:54<131:59:38, 15.24s/it]
 18%|█▊        | 6779/37963 [29:03:08<128:58:27, 14.89s/it]
 18%|█▊        | 6780/37963 [29:03:22<126:26:52, 14.60s/it]
                                                           
{'loss': '0.1715', 'grad_norm': '2.771', 'learning_rate': '1.886e-05', 'epoch': '0.1786'}

 18%|█▊        | 6780/37963 [29:03:22<126:26:52, 14.60s/it]
 18%|█▊        | 6781/37963 [29:03:36<125:47:43, 14.52s/it]
 18%|█▊        | 6782/37963 [29:03:51<125:30:26, 14.49s/it]
 18%|█▊        | 6783/37963 [29:04:05<124:53:47, 14.42s/it]
 18%|█▊        | 6784/37963 [29:04:19<124:51:11, 14.42s/it]
 18%|█▊        | 6785/37963 [29:04:34<124:35:54, 14.39s/it]
 18%|█▊        | 6786/37963 [29:04:48<124:41:04, 14.40s/it]
 18%|█▊        | 6787/37963 [29:05:03<124:28:12, 14.37s/it]
 18%|█▊        | 6788/37963 [29:05:17<124:09:55, 14.34s/it]
 18%|█▊        | 6789/37963 [29:05:31<124:18:09, 14.35s/it]
 18%|█▊        | 6790/37963 [29:05:45<123:47:04, 14.30s/it]
                                                           
{'loss': '0.174', 'grad_norm': '7.222', 'learning_rate': '1.886e-05', 'epoch': '0.1789'}

 18%|█▊        | 6790/37963 [29:05:45<123:47:04, 14.30s/it]
 18%|█▊        | 6791/37963 [29:06:00<124:27:16, 14.37s/it]
 18%|█▊        | 6792/37963 [29:06:14<124:19:21, 14.36s/it]
 18%|█▊        | 6793/37963 [29:06:28<122:43:51, 14.17s/it]
 18%|█▊        | 6794/37963 [29:06:42<122:53:58, 14.19s/it]
 18%|█▊        | 6795/37963 [29:06:56<123:08:20, 14.22s/it]
 18%|█▊        | 6796/37963 [29:07:17<140:04:13, 16.18s/it]
 18%|█▊        | 6797/37963 [29:07:32<135:14:33, 15.62s/it]
 18%|█▊        | 6798/37963 [29:07:45<130:44:59, 15.10s/it]
 18%|█▊        | 6799/37963 [29:08:00<128:42:26, 14.87s/it]
 18%|█▊        | 6800/37963 [29:08:14<127:26:35, 14.72s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '1.748', 'learning_rate': '1.886e-05', 'epoch': '0.1791'}

 18%|█▊        | 6800/37963 [29:08:14<127:26:35, 14.72s/it]
 18%|█▊        | 6801/37963 [29:08:28<126:28:52, 14.61s/it]
 18%|█▊        | 6802/37963 [29:08:49<142:47:37, 16.50s/it]
 18%|█▊        | 6803/37963 [29:09:04<137:10:24, 15.85s/it]
 18%|█▊        | 6804/37963 [29:09:18<133:33:41, 15.43s/it]
 18%|█▊        | 6805/37963 [29:09:32<128:50:11, 14.89s/it]
 18%|█▊        | 6806/37963 [29:09:53<144:05:15, 16.65s/it]
 18%|█▊        | 6807/37963 [29:10:13<154:17:40, 17.83s/it]
 18%|█▊        | 6808/37963 [29:10:34<162:15:51, 18.75s/it]
 18%|█▊        | 6809/37963 [29:10:48<149:57:04, 17.33s/it]
 18%|█▊        | 6810/37963 [29:11:02<142:17:04, 16.44s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '1.704', 'learning_rate': '1.885e-05', 'epoch': '0.1794'}

 18%|█▊        | 6810/37963 [29:11:02<142:17:04, 16.44s/it]
 18%|█▊        | 6811/37963 [29:11:17<136:53:41, 15.82s/it]
 18%|█▊        | 6812/37963 [29:11:31<133:06:54, 15.38s/it]
 18%|█▊        | 6813/37963 [29:11:52<146:30:23, 16.93s/it]
 18%|█▊        | 6814/37963 [29:12:06<140:08:57, 16.20s/it]
 18%|█▊        | 6815/37963 [29:12:20<133:48:46, 15.47s/it]
 18%|█▊        | 6816/37963 [29:12:34<130:53:19, 15.13s/it]
 18%|█▊        | 6817/37963 [29:12:55<146:22:28, 16.92s/it]
 18%|█▊        | 6818/37963 [29:13:10<139:52:06, 16.17s/it]
 18%|█▊        | 6819/37963 [29:13:24<135:16:57, 15.64s/it]
 18%|█▊        | 6820/37963 [29:13:39<131:55:20, 15.25s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '2.845', 'learning_rate': '1.885e-05', 'epoch': '0.1796'}

 18%|█▊        | 6820/37963 [29:13:39<131:55:20, 15.25s/it]
 18%|█▊        | 6821/37963 [29:13:52<128:28:44, 14.85s/it]
 18%|█▊        | 6822/37963 [29:14:07<127:46:09, 14.77s/it]
 18%|█▊        | 6823/37963 [29:14:21<125:44:27, 14.54s/it]
 18%|█▊        | 6824/37963 [29:14:35<125:09:25, 14.47s/it]
 18%|█▊        | 6825/37963 [29:14:50<125:10:19, 14.47s/it]
 18%|█▊        | 6826/37963 [29:15:04<124:49:39, 14.43s/it]
 18%|█▊        | 6827/37963 [29:15:25<142:29:51, 16.48s/it]
 18%|█▊        | 6828/37963 [29:15:39<135:05:25, 15.62s/it]
 18%|█▊        | 6829/37963 [29:15:53<131:52:12, 15.25s/it]
 18%|█▊        | 6830/37963 [29:16:08<129:34:36, 14.98s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '1.98', 'learning_rate': '1.884e-05', 'epoch': '0.1799'}

 18%|█▊        | 6830/37963 [29:16:08<129:34:36, 14.98s/it]
 18%|█▊        | 6831/37963 [29:16:22<128:03:26, 14.81s/it]
 18%|█▊        | 6832/37963 [29:16:37<126:59:04, 14.68s/it]
 18%|█▊        | 6833/37963 [29:16:51<126:09:41, 14.59s/it]
 18%|█▊        | 6834/37963 [29:17:05<125:39:43, 14.53s/it]
 18%|█▊        | 6835/37963 [29:17:20<125:09:22, 14.47s/it]
 18%|█▊        | 6836/37963 [29:17:34<124:44:50, 14.43s/it]
 18%|█▊        | 6837/37963 [29:17:48<124:07:03, 14.36s/it]
 18%|█▊        | 6838/37963 [29:18:03<124:04:02, 14.35s/it]
 18%|█▊        | 6839/37963 [29:18:17<124:26:06, 14.39s/it]
 18%|█▊        | 6840/37963 [29:18:31<124:19:18, 14.38s/it]
                                                           
{'loss': '0.1672', 'grad_norm': '2.467', 'learning_rate': '1.884e-05', 'epoch': '0.1802'}

 18%|█▊        | 6840/37963 [29:18:31<124:19:18, 14.38s/it]
 18%|█▊        | 6841/37963 [29:18:45<123:22:26, 14.27s/it]
 18%|█▊        | 6842/37963 [29:19:00<123:42:03, 14.31s/it]
 18%|█▊        | 6843/37963 [29:19:21<141:33:05, 16.37s/it]
 18%|█▊        | 6844/37963 [29:19:35<135:16:00, 15.65s/it]
 18%|█▊        | 6845/37963 [29:19:48<129:48:31, 15.02s/it]
 18%|█▊        | 6846/37963 [29:20:03<127:46:24, 14.78s/it]
 18%|█▊        | 6847/37963 [29:20:17<125:14:36, 14.49s/it]
 18%|█▊        | 6848/37963 [29:20:31<124:47:33, 14.44s/it]
 18%|█▊        | 6849/37963 [29:20:45<124:39:47, 14.42s/it]
 18%|█▊        | 6850/37963 [29:20:59<123:21:13, 14.27s/it]
                                                           
{'loss': '0.1694', 'grad_norm': '3.842', 'learning_rate': '1.884e-05', 'epoch': '0.1804'}

 18%|█▊        | 6850/37963 [29:20:59<123:21:13, 14.27s/it]
 18%|█▊        | 6851/37963 [29:21:20<140:49:51, 16.30s/it]
 18%|█▊        | 6852/37963 [29:21:34<135:16:19, 15.65s/it]
 18%|█▊        | 6853/37963 [29:21:48<130:30:45, 15.10s/it]
 18%|█▊        | 6854/37963 [29:22:02<127:47:11, 14.79s/it]
 18%|█▊        | 6855/37963 [29:22:23<143:45:58, 16.64s/it]
 18%|█▊        | 6856/37963 [29:22:44<155:02:57, 17.94s/it]
 18%|█▊        | 6857/37963 [29:22:59<146:05:29, 16.91s/it]
 18%|█▊        | 6858/37963 [29:23:19<156:16:04, 18.09s/it]
 18%|█▊        | 6859/37963 [29:23:34<146:23:58, 16.94s/it]
 18%|█▊        | 6860/37963 [29:23:48<138:21:49, 16.01s/it]
                                                           
{'loss': '0.1701', 'grad_norm': '1.564', 'learning_rate': '1.883e-05', 'epoch': '0.1807'}

 18%|█▊        | 6860/37963 [29:23:48<138:21:49, 16.01s/it]
 18%|█▊        | 6861/37963 [29:24:08<150:41:29, 17.44s/it]
 18%|█▊        | 6862/37963 [29:24:22<141:23:03, 16.37s/it]
 18%|█▊        | 6863/37963 [29:24:36<134:36:13, 15.58s/it]
 18%|█▊        | 6864/37963 [29:24:57<147:47:10, 17.11s/it]
 18%|█▊        | 6865/37963 [29:25:11<140:36:43, 16.28s/it]
 18%|█▊        | 6866/37963 [29:25:25<135:33:55, 15.69s/it]
 18%|█▊        | 6867/37963 [29:25:40<131:47:25, 15.26s/it]
 18%|█▊        | 6868/37963 [29:25:54<129:29:08, 14.99s/it]
 18%|█▊        | 6869/37963 [29:26:08<127:52:51, 14.81s/it]
 18%|█▊        | 6870/37963 [29:26:23<126:42:28, 14.67s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '3.047', 'learning_rate': '1.883e-05', 'epoch': '0.181'}

 18%|█▊        | 6870/37963 [29:26:23<126:42:28, 14.67s/it]
 18%|█▊        | 6871/37963 [29:26:37<125:52:55, 14.58s/it]
 18%|█▊        | 6872/37963 [29:26:51<125:25:15, 14.52s/it]
 18%|█▊        | 6873/37963 [29:27:05<123:39:12, 14.32s/it]
 18%|█▊        | 6874/37963 [29:27:20<123:39:51, 14.32s/it]
 18%|█▊        | 6875/37963 [29:27:34<123:20:09, 14.28s/it]
 18%|█▊        | 6876/37963 [29:27:48<123:40:47, 14.32s/it]
 18%|█▊        | 6877/37963 [29:28:09<141:23:17, 16.37s/it]
 18%|█▊        | 6878/37963 [29:28:23<134:29:58, 15.58s/it]
 18%|█▊        | 6879/37963 [29:28:37<131:17:41, 15.21s/it]
 18%|█▊        | 6880/37963 [29:28:52<129:08:58, 14.96s/it]
                                                           
{'loss': '0.168', 'grad_norm': '0.8588', 'learning_rate': '1.882e-05', 'epoch': '0.1812'}

 18%|█▊        | 6880/37963 [29:28:52<129:08:58, 14.96s/it]
 18%|█▊        | 6881/37963 [29:29:06<127:37:40, 14.78s/it]
 18%|█▊        | 6882/37963 [29:29:21<126:37:35, 14.67s/it]
 18%|█▊        | 6883/37963 [29:29:35<125:46:21, 14.57s/it]
 18%|█▊        | 6884/37963 [29:29:49<125:27:06, 14.53s/it]
 18%|█▊        | 6885/37963 [29:30:04<125:05:44, 14.49s/it]
 18%|█▊        | 6886/37963 [29:30:18<124:55:40, 14.47s/it]
 18%|█▊        | 6887/37963 [29:30:32<124:34:37, 14.43s/it]
 18%|█▊        | 6888/37963 [29:30:47<124:33:34, 14.43s/it]
 18%|█▊        | 6889/37963 [29:31:01<123:03:20, 14.26s/it]
 18%|█▊        | 6890/37963 [29:31:15<122:59:56, 14.25s/it]
                                                           
{'loss': '0.164', 'grad_norm': '4.39', 'learning_rate': '1.882e-05', 'epoch': '0.1815'}

 18%|█▊        | 6890/37963 [29:31:15<122:59:56, 14.25s/it]
 18%|█▊        | 6891/37963 [29:31:29<123:15:15, 14.28s/it]
 18%|█▊        | 6892/37963 [29:31:44<123:36:12, 14.32s/it]
 18%|█▊        | 6893/37963 [29:31:58<123:42:33, 14.33s/it]
 18%|█▊        | 6894/37963 [29:32:12<123:18:02, 14.29s/it]
 18%|█▊        | 6895/37963 [29:32:27<123:41:49, 14.33s/it]
 18%|█▊        | 6896/37963 [29:32:48<140:32:57, 16.29s/it]
 18%|█▊        | 6897/37963 [29:33:02<135:44:39, 15.73s/it]
 18%|█▊        | 6898/37963 [29:33:16<132:17:34, 15.33s/it]
 18%|█▊        | 6899/37963 [29:33:37<144:36:31, 16.76s/it]
 18%|█▊        | 6900/37963 [29:33:51<137:30:27, 15.94s/it]
                                                           
{'loss': '0.1756', 'grad_norm': '2.615', 'learning_rate': '1.882e-05', 'epoch': '0.1818'}

 18%|█▊        | 6900/37963 [29:33:51<137:30:27, 15.94s/it]
 18%|█▊        | 6901/37963 [29:34:05<133:54:20, 15.52s/it]
 18%|█▊        | 6902/37963 [29:34:25<146:36:15, 16.99s/it]
 18%|█▊        | 6903/37963 [29:34:40<140:00:09, 16.23s/it]
 18%|█▊        | 6904/37963 [29:34:54<134:49:04, 15.63s/it]
 18%|█▊        | 6905/37963 [29:35:15<148:43:57, 17.24s/it]
 18%|█▊        | 6906/37963 [29:35:30<141:38:27, 16.42s/it]
 18%|█▊        | 6907/37963 [29:35:51<153:22:06, 17.78s/it]
 18%|█▊        | 6908/37963 [29:36:12<161:47:38, 18.76s/it]
 18%|█▊        | 6909/37963 [29:36:26<150:31:45, 17.45s/it]
 18%|█▊        | 6910/37963 [29:36:40<142:40:06, 16.54s/it]
                                                           
{'loss': '0.1707', 'grad_norm': '2.133', 'learning_rate': '1.881e-05', 'epoch': '0.182'}

 18%|█▊        | 6910/37963 [29:36:40<142:40:06, 16.54s/it]
 18%|█▊        | 6911/37963 [29:36:54<135:41:17, 15.73s/it]
 18%|█▊        | 6912/37963 [29:37:09<131:47:24, 15.28s/it]
 18%|█▊        | 6913/37963 [29:37:30<148:33:39, 17.22s/it]
 18%|█▊        | 6914/37963 [29:37:45<140:44:58, 16.32s/it]
 18%|█▊        | 6915/37963 [29:37:59<134:57:50, 15.65s/it]
 18%|█▊        | 6916/37963 [29:38:13<131:33:41, 15.25s/it]
 18%|█▊        | 6917/37963 [29:38:27<129:31:12, 15.02s/it]
 18%|█▊        | 6918/37963 [29:38:42<127:53:03, 14.83s/it]
 18%|█▊        | 6919/37963 [29:38:56<126:37:52, 14.68s/it]
 18%|█▊        | 6920/37963 [29:39:10<124:11:36, 14.40s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '1.845', 'learning_rate': '1.881e-05', 'epoch': '0.1823'}

 18%|█▊        | 6920/37963 [29:39:10<124:11:36, 14.40s/it]
 18%|█▊        | 6921/37963 [29:39:24<124:15:54, 14.41s/it]
 18%|█▊        | 6922/37963 [29:39:38<122:30:11, 14.21s/it]
 18%|█▊        | 6923/37963 [29:39:52<121:58:34, 14.15s/it]
 18%|█▊        | 6924/37963 [29:40:13<139:50:37, 16.22s/it]
 18%|█▊        | 6925/37963 [29:40:27<134:35:36, 15.61s/it]
 18%|█▊        | 6926/37963 [29:40:42<131:18:19, 15.23s/it]
 18%|█▊        | 6927/37963 [29:40:56<129:44:28, 15.05s/it]
 18%|█▊        | 6928/37963 [29:41:11<128:09:36, 14.87s/it]
 18%|█▊        | 6929/37963 [29:41:25<126:42:18, 14.70s/it]
 18%|█▊        | 6930/37963 [29:41:39<125:45:54, 14.59s/it]
                                                           
{'loss': '0.1686', 'grad_norm': '1.118', 'learning_rate': '1.88e-05', 'epoch': '0.1825'}

 18%|█▊        | 6930/37963 [29:41:39<125:45:54, 14.59s/it]
 18%|█▊        | 6931/37963 [29:41:54<125:21:01, 14.54s/it]
 18%|█▊        | 6932/37963 [29:42:08<125:12:48, 14.53s/it]
 18%|█▊        | 6933/37963 [29:42:23<124:52:45, 14.49s/it]
 18%|█▊        | 6934/37963 [29:42:37<123:57:29, 14.38s/it]
 18%|█▊        | 6935/37963 [29:42:51<123:46:50, 14.36s/it]
 18%|█▊        | 6936/37963 [29:43:06<123:53:38, 14.38s/it]
 18%|█▊        | 6937/37963 [29:43:20<123:55:58, 14.38s/it]
 18%|█▊        | 6938/37963 [29:43:34<123:58:48, 14.39s/it]
 18%|█▊        | 6939/37963 [29:43:49<124:08:49, 14.41s/it]
 18%|█▊        | 6940/37963 [29:44:03<124:35:19, 14.46s/it]
                                                           
{'loss': '0.1643', 'grad_norm': '2.702', 'learning_rate': '1.88e-05', 'epoch': '0.1828'}

 18%|█▊        | 6940/37963 [29:44:03<124:35:19, 14.46s/it]
 18%|█▊        | 6941/37963 [29:44:18<124:21:21, 14.43s/it]
 18%|█▊        | 6942/37963 [29:44:32<124:10:52, 14.41s/it]
 18%|█▊        | 6943/37963 [29:44:46<123:00:20, 14.28s/it]
 18%|█▊        | 6944/37963 [29:45:00<123:15:21, 14.30s/it]
 18%|█▊        | 6945/37963 [29:45:20<138:08:36, 16.03s/it]
 18%|█▊        | 6946/37963 [29:45:35<133:44:07, 15.52s/it]
 18%|█▊        | 6947/37963 [29:45:55<145:33:56, 16.90s/it]
 18%|█▊        | 6948/37963 [29:46:09<139:09:46, 16.15s/it]
 18%|█▊        | 6949/37963 [29:46:24<134:33:08, 15.62s/it]
 18%|█▊        | 6950/37963 [29:46:38<130:33:50, 15.16s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '2.046', 'learning_rate': '1.88e-05', 'epoch': '0.1831'}

 18%|█▊        | 6950/37963 [29:46:38<130:33:50, 15.16s/it]
 18%|█▊        | 6951/37963 [29:46:52<128:26:17, 14.91s/it]
 18%|█▊        | 6952/37963 [29:47:06<125:20:47, 14.55s/it]
 18%|█▊        | 6953/37963 [29:47:32<156:38:51, 18.19s/it]
 18%|█▊        | 6954/37963 [29:47:53<162:50:22, 18.90s/it]
 18%|█▊        | 6955/37963 [29:48:07<150:59:05, 17.53s/it]
 18%|█▊        | 6956/37963 [29:48:22<142:44:32, 16.57s/it]
 18%|█▊        | 6957/37963 [29:48:43<154:37:26, 17.95s/it]
 18%|█▊        | 6958/37963 [29:48:57<145:28:04, 16.89s/it]
 18%|█▊        | 6959/37963 [29:49:12<138:54:13, 16.13s/it]
 18%|█▊        | 6960/37963 [29:49:25<132:53:36, 15.43s/it]
                                                           
{'loss': '0.1644', 'grad_norm': '4.082', 'learning_rate': '1.879e-05', 'epoch': '0.1833'}

 18%|█▊        | 6960/37963 [29:49:25<132:53:36, 15.43s/it]
 18%|█▊        | 6961/37963 [29:49:47<148:47:01, 17.28s/it]
 18%|█▊        | 6962/37963 [29:50:01<140:14:36, 16.29s/it]
 18%|█▊        | 6963/37963 [29:50:15<134:56:36, 15.67s/it]
 18%|█▊        | 6964/37963 [29:50:29<130:21:13, 15.14s/it]
 18%|█▊        | 6965/37963 [29:50:44<128:41:43, 14.95s/it]
 18%|█▊        | 6966/37963 [29:50:58<127:02:41, 14.76s/it]
 18%|█▊        | 6967/37963 [29:51:12<125:55:11, 14.62s/it]
 18%|█▊        | 6968/37963 [29:51:26<124:35:14, 14.47s/it]
 18%|█▊        | 6969/37963 [29:51:41<124:04:21, 14.41s/it]
 18%|█▊        | 6970/37963 [29:51:55<124:11:15, 14.43s/it]
                                                           
{'loss': '0.1644', 'grad_norm': '5.051', 'learning_rate': '1.879e-05', 'epoch': '0.1836'}

 18%|█▊        | 6970/37963 [29:51:55<124:11:15, 14.43s/it]
 18%|█▊        | 6971/37963 [29:52:09<122:38:14, 14.25s/it]
 18%|█▊        | 6972/37963 [29:52:23<122:57:21, 14.28s/it]
 18%|█▊        | 6973/37963 [29:52:38<123:07:19, 14.30s/it]
 18%|█▊        | 6974/37963 [29:52:51<121:49:02, 14.15s/it]
 18%|█▊        | 6975/37963 [29:53:06<122:23:39, 14.22s/it]
 18%|█▊        | 6976/37963 [29:53:27<140:10:08, 16.28s/it]
 18%|█▊        | 6977/37963 [29:53:41<135:06:34, 15.70s/it]
 18%|█▊        | 6978/37963 [29:53:55<130:53:23, 15.21s/it]
 18%|█▊        | 6979/37963 [29:54:10<128:40:50, 14.95s/it]
 18%|█▊        | 6980/37963 [29:54:24<127:14:00, 14.78s/it]
                                                           
{'loss': '0.1781', 'grad_norm': '2.253', 'learning_rate': '1.878e-05', 'epoch': '0.1839'}

 18%|█▊        | 6980/37963 [29:54:24<127:14:00, 14.78s/it]
 18%|█▊        | 6981/37963 [29:54:38<125:53:46, 14.63s/it]
 18%|█▊        | 6982/37963 [29:54:53<125:29:49, 14.58s/it]
 18%|█▊        | 6983/37963 [29:55:07<124:18:20, 14.44s/it]
 18%|█▊        | 6984/37963 [29:55:21<124:18:38, 14.45s/it]
 18%|█▊        | 6985/37963 [29:55:36<123:32:10, 14.36s/it]
 18%|█▊        | 6986/37963 [29:55:50<123:37:13, 14.37s/it]
 18%|█▊        | 6987/37963 [29:56:04<121:54:06, 14.17s/it]
 18%|█▊        | 6988/37963 [29:56:18<122:21:56, 14.22s/it]
 18%|█▊        | 6989/37963 [29:56:32<122:55:06, 14.29s/it]
 18%|█▊        | 6990/37963 [29:56:46<122:20:13, 14.22s/it]
                                                           
{'loss': '0.1723', 'grad_norm': '5.111', 'learning_rate': '1.878e-05', 'epoch': '0.1841'}

 18%|█▊        | 6990/37963 [29:56:46<122:20:13, 14.22s/it]
 18%|█▊        | 6991/37963 [29:57:01<122:35:45, 14.25s/it]
 18%|█▊        | 6992/37963 [29:57:15<122:46:54, 14.27s/it]
 18%|█▊        | 6993/37963 [29:57:36<140:05:05, 16.28s/it]
 18%|█▊        | 6994/37963 [29:57:50<135:02:58, 15.70s/it]
 18%|█▊        | 6995/37963 [29:58:11<148:21:36, 17.25s/it]
 18%|█▊        | 6996/37963 [29:58:26<140:57:53, 16.39s/it]
 18%|█▊        | 6997/37963 [29:58:40<135:44:45, 15.78s/it]
 18%|█▊        | 6998/37963 [29:58:55<132:25:49, 15.40s/it]
 18%|█▊        | 6999/37963 [29:59:09<129:43:58, 15.08s/it]
 18%|█▊        | 7000/37963 [29:59:29<142:19:49, 16.55s/it]
                                                           
{'loss': '0.172', 'grad_norm': '2.583', 'learning_rate': '1.878e-05', 'epoch': '0.1844'}

 18%|█▊        | 7000/37963 [29:59:29<142:19:49, 16.55s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.87s/it]
Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.87s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 18%|█▊        | 7001/37963 [30:01:17<378:55:27, 44.06s/it]
 18%|█▊        | 7002/37963 [30:01:31<301:47:39, 35.09s/it]
 18%|█▊        | 7003/37963 [30:01:52<264:46:16, 30.79s/it]
 18%|█▊        | 7004/37963 [30:02:12<237:16:10, 27.59s/it]
 18%|█▊        | 7005/37963 [30:02:26<202:13:56, 23.52s/it]
 18%|█▊        | 7006/37963 [30:02:40<178:28:28, 20.75s/it]
 18%|█▊        | 7007/37963 [30:03:02<180:31:04, 20.99s/it]
 18%|█▊        | 7008/37963 [30:03:23<180:49:09, 21.03s/it]
 18%|█▊        | 7009/37963 [30:03:38<163:45:45, 19.05s/it]
 18%|█▊        | 7010/37963 [30:03:52<152:01:23, 17.68s/it]
                                                           
{'loss': '0.1661', 'grad_norm': '3.5', 'learning_rate': '1.877e-05', 'epoch': '0.1847'}

 18%|█▊        | 7010/37963 [30:03:52<152:01:23, 17.68s/it]
 18%|█▊        | 7011/37963 [30:04:06<143:27:50, 16.69s/it]
 18%|█▊        | 7012/37963 [30:04:21<137:29:04, 15.99s/it]
 18%|█▊        | 7013/37963 [30:04:35<133:20:12, 15.51s/it]
 18%|█▊        | 7014/37963 [30:04:49<130:04:41, 15.13s/it]
 18%|█▊        | 7015/37963 [30:05:04<128:01:42, 14.89s/it]
 18%|█▊        | 7016/37963 [30:05:18<126:38:18, 14.73s/it]
 18%|█▊        | 7017/37963 [30:05:32<125:31:17, 14.60s/it]
 18%|█▊        | 7018/37963 [30:05:47<124:22:29, 14.47s/it]
 18%|█▊        | 7019/37963 [30:06:01<124:01:54, 14.43s/it]
 18%|█▊        | 7020/37963 [30:06:15<123:25:29, 14.36s/it]
                                                           
{'loss': '0.1624', 'grad_norm': '5.248', 'learning_rate': '1.877e-05', 'epoch': '0.1849'}

 18%|█▊        | 7020/37963 [30:06:15<123:25:29, 14.36s/it]
 18%|█▊        | 7021/37963 [30:06:29<123:18:58, 14.35s/it]
 18%|█▊        | 7022/37963 [30:06:44<123:21:43, 14.35s/it]
 18%|█▊        | 7023/37963 [30:07:05<140:40:19, 16.37s/it]
 19%|█▊        | 7024/37963 [30:07:19<136:04:38, 15.83s/it]
 19%|█▊        | 7025/37963 [30:07:34<132:12:11, 15.38s/it]
 19%|█▊        | 7026/37963 [30:07:48<129:44:49, 15.10s/it]
 19%|█▊        | 7027/37963 [30:08:03<128:05:14, 14.91s/it]
 19%|█▊        | 7028/37963 [30:08:17<126:20:32, 14.70s/it]
 19%|█▊        | 7029/37963 [30:08:31<125:18:45, 14.58s/it]
 19%|█▊        | 7030/37963 [30:08:46<124:50:44, 14.53s/it]
                                                           
{'loss': '0.1804', 'grad_norm': '4.674', 'learning_rate': '1.876e-05', 'epoch': '0.1852'}

 19%|█▊        | 7030/37963 [30:08:46<124:50:44, 14.53s/it]
 19%|█▊        | 7031/37963 [30:09:00<124:34:16, 14.50s/it]
 19%|█▊        | 7032/37963 [30:09:14<123:08:56, 14.33s/it]
 19%|█▊        | 7033/37963 [30:09:28<123:08:48, 14.33s/it]
 19%|█▊        | 7034/37963 [30:09:43<123:07:05, 14.33s/it]
 19%|█▊        | 7035/37963 [30:09:57<123:04:24, 14.33s/it]
 19%|█▊        | 7036/37963 [30:10:11<123:15:30, 14.35s/it]
 19%|█▊        | 7037/37963 [30:10:26<123:16:34, 14.35s/it]
 19%|█▊        | 7038/37963 [30:10:40<123:21:24, 14.36s/it]
 19%|█▊        | 7039/37963 [30:10:54<123:17:35, 14.35s/it]
 19%|█▊        | 7040/37963 [30:11:09<123:14:07, 14.35s/it]
                                                           
{'loss': '0.211', 'grad_norm': '2.875', 'learning_rate': '1.876e-05', 'epoch': '0.1854'}

 19%|█▊        | 7040/37963 [30:11:09<123:14:07, 14.35s/it]
 19%|█▊        | 7041/37963 [30:11:29<138:23:04, 16.11s/it]
 19%|█▊        | 7042/37963 [30:11:43<134:06:42, 15.61s/it]
 19%|█▊        | 7043/37963 [30:11:58<131:09:29, 15.27s/it]
 19%|█▊        | 7044/37963 [30:12:12<127:27:05, 14.84s/it]
 19%|█▊        | 7045/37963 [30:12:26<126:20:37, 14.71s/it]
 19%|█▊        | 7046/37963 [30:12:40<124:45:51, 14.53s/it]
 19%|█▊        | 7047/37963 [30:13:01<139:38:18, 16.26s/it]
 19%|█▊        | 7048/37963 [30:13:15<134:53:00, 15.71s/it]
 19%|█▊        | 7049/37963 [30:13:29<131:18:32, 15.29s/it]
 19%|█▊        | 7050/37963 [30:13:50<145:31:25, 16.95s/it]
                                                           
{'loss': '0.19', 'grad_norm': '7.279', 'learning_rate': '1.876e-05', 'epoch': '0.1857'}

 19%|█▊        | 7050/37963 [30:13:50<145:31:25, 16.95s/it]
 19%|█▊        | 7051/37963 [30:14:04<136:35:56, 15.91s/it]
 19%|█▊        | 7052/37963 [30:14:24<149:04:22, 17.36s/it]
 19%|█▊        | 7053/37963 [30:14:39<141:15:53, 16.45s/it]
 19%|█▊        | 7054/37963 [30:15:00<153:19:14, 17.86s/it]
 19%|█▊        | 7055/37963 [30:15:21<160:50:47, 18.73s/it]
 19%|█▊        | 7056/37963 [30:15:35<149:41:55, 17.44s/it]
 19%|█▊        | 7057/37963 [30:15:49<141:54:11, 16.53s/it]
 19%|█▊        | 7058/37963 [30:16:04<136:16:41, 15.87s/it]
 19%|█▊        | 7059/37963 [30:16:18<132:21:59, 15.42s/it]
 19%|█▊        | 7060/37963 [30:16:32<128:50:42, 15.01s/it]
                                                           
{'loss': '0.1968', 'grad_norm': '2.66', 'learning_rate': '1.875e-05', 'epoch': '0.186'}

 19%|█▊        | 7060/37963 [30:16:32<128:50:42, 15.01s/it]
 19%|█▊        | 7061/37963 [30:16:47<127:15:54, 14.83s/it]
 19%|█▊        | 7062/37963 [30:17:00<124:08:32, 14.46s/it]
 19%|█▊        | 7063/37963 [30:17:15<123:53:34, 14.43s/it]
 19%|█▊        | 7064/37963 [30:17:29<123:30:37, 14.39s/it]
 19%|█▊        | 7065/37963 [30:17:43<123:45:08, 14.42s/it]
 19%|█▊        | 7066/37963 [30:17:58<123:24:17, 14.38s/it]
 19%|█▊        | 7067/37963 [30:18:12<123:21:55, 14.37s/it]
 19%|█▊        | 7068/37963 [30:18:26<123:20:48, 14.37s/it]
 19%|█▊        | 7069/37963 [30:18:41<123:15:54, 14.36s/it]
 19%|█▊        | 7070/37963 [30:18:55<122:43:28, 14.30s/it]
                                                           
{'loss': '0.1761', 'grad_norm': '2.98', 'learning_rate': '1.875e-05', 'epoch': '0.1862'}

 19%|█▊        | 7070/37963 [30:18:55<122:43:28, 14.30s/it]
 19%|█▊        | 7071/37963 [30:19:16<139:42:44, 16.28s/it]
 19%|█▊        | 7072/37963 [30:19:30<134:21:43, 15.66s/it]
 19%|█▊        | 7073/37963 [30:19:44<130:57:25, 15.26s/it]
 19%|█▊        | 7074/37963 [30:19:58<127:38:25, 14.88s/it]
 19%|█▊        | 7075/37963 [30:20:13<126:38:09, 14.76s/it]
 19%|█▊        | 7076/37963 [30:20:27<125:29:18, 14.63s/it]
 19%|█▊        | 7077/37963 [30:20:41<123:40:40, 14.42s/it]
 19%|█▊        | 7078/37963 [30:20:55<122:35:37, 14.29s/it]
 19%|█▊        | 7079/37963 [30:21:09<122:46:18, 14.31s/it]
 19%|█▊        | 7080/37963 [30:21:24<123:03:30, 14.34s/it]
                                                           
{'loss': '0.1655', 'grad_norm': '2.327', 'learning_rate': '1.874e-05', 'epoch': '0.1865'}

 19%|█▊        | 7080/37963 [30:21:24<123:03:30, 14.34s/it]
 19%|█▊        | 7081/37963 [30:21:38<123:46:45, 14.43s/it]
 19%|█▊        | 7082/37963 [30:21:53<123:50:12, 14.44s/it]
 19%|█▊        | 7083/37963 [30:22:07<123:24:06, 14.39s/it]
 19%|█▊        | 7084/37963 [30:22:22<123:21:22, 14.38s/it]
 19%|█▊        | 7085/37963 [30:22:36<123:06:58, 14.35s/it]
 19%|█▊        | 7086/37963 [30:22:50<122:59:14, 14.34s/it]
 19%|█▊        | 7087/37963 [30:23:04<122:50:06, 14.32s/it]
 19%|█▊        | 7088/37963 [30:23:19<122:47:12, 14.32s/it]
 19%|█▊        | 7089/37963 [30:23:33<122:58:58, 14.34s/it]
 19%|█▊        | 7090/37963 [30:23:53<138:19:29, 16.13s/it]
                                                           
{'loss': '0.1818', 'grad_norm': '3.424', 'learning_rate': '1.874e-05', 'epoch': '0.1868'}

 19%|█▊        | 7090/37963 [30:23:53<138:19:29, 16.13s/it]
 19%|█▊        | 7091/37963 [30:24:08<133:47:10, 15.60s/it]
 19%|█▊        | 7092/37963 [30:24:22<130:30:56, 15.22s/it]
 19%|█▊        | 7093/37963 [30:24:36<128:24:24, 14.97s/it]
 19%|█▊        | 7094/37963 [30:24:50<125:09:40, 14.60s/it]
 19%|█▊        | 7095/37963 [30:25:05<124:33:52, 14.53s/it]
 19%|█▊        | 7096/37963 [30:25:18<122:21:20, 14.27s/it]
 19%|█▊        | 7097/37963 [30:25:39<140:01:53, 16.33s/it]
 19%|█▊        | 7098/37963 [30:26:00<151:25:30, 17.66s/it]
 19%|█▊        | 7099/37963 [30:26:21<158:44:36, 18.52s/it]
 19%|█▊        | 7100/37963 [30:26:35<148:05:54, 17.27s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '5.612', 'learning_rate': '1.873e-05', 'epoch': '0.187'}

 19%|█▊        | 7100/37963 [30:26:35<148:05:54, 17.27s/it]
 19%|█▊        | 7101/37963 [30:26:56<157:24:55, 18.36s/it]
 19%|█▊        | 7102/37963 [30:27:10<146:41:35, 17.11s/it]
 19%|█▊        | 7103/37963 [30:27:24<139:29:05, 16.27s/it]
 19%|█▊        | 7104/37963 [30:27:52<168:58:41, 19.71s/it]
 19%|█▊        | 7105/37963 [30:28:07<155:20:09, 18.12s/it]
 19%|█▊        | 7106/37963 [30:28:21<145:32:57, 16.98s/it]
 19%|█▊        | 7107/37963 [30:28:35<138:22:58, 16.15s/it]
 19%|█▊        | 7108/37963 [30:28:49<133:36:58, 15.59s/it]
 19%|█▊        | 7109/37963 [30:29:03<129:30:02, 15.11s/it]
 19%|█▊        | 7110/37963 [30:29:18<127:30:58, 14.88s/it]
                                                           
{'loss': '0.1767', 'grad_norm': '4.593', 'learning_rate': '1.873e-05', 'epoch': '0.1873'}

 19%|█▊        | 7110/37963 [30:29:18<127:30:58, 14.88s/it]
 19%|█▊        | 7111/37963 [30:29:32<126:10:47, 14.72s/it]
 19%|█▊        | 7112/37963 [30:29:46<123:50:52, 14.45s/it]
 19%|█▊        | 7113/37963 [30:30:00<123:48:13, 14.45s/it]
 19%|█▊        | 7114/37963 [30:30:15<123:48:36, 14.45s/it]
 19%|█▊        | 7115/37963 [30:30:29<123:09:55, 14.37s/it]
 19%|█▊        | 7116/37963 [30:30:43<121:43:50, 14.21s/it]
 19%|█▊        | 7117/37963 [30:30:57<121:10:24, 14.14s/it]
 19%|█▊        | 7118/37963 [30:31:11<120:22:32, 14.05s/it]
 19%|█▉        | 7119/37963 [30:31:25<121:11:15, 14.14s/it]
 19%|█▉        | 7120/37963 [30:31:46<138:02:22, 16.11s/it]
                                                           
{'loss': '0.1971', 'grad_norm': '2.374', 'learning_rate': '1.873e-05', 'epoch': '0.1876'}

 19%|█▉        | 7120/37963 [30:31:46<138:02:22, 16.11s/it]
 19%|█▉        | 7121/37963 [30:32:00<133:10:50, 15.55s/it]
 19%|█▉        | 7122/37963 [30:32:14<130:07:11, 15.19s/it]
 19%|█▉        | 7123/37963 [30:32:29<128:00:18, 14.94s/it]
 19%|█▉        | 7124/37963 [30:32:43<126:21:23, 14.75s/it]
 19%|█▉        | 7125/37963 [30:32:57<124:55:30, 14.58s/it]
 19%|█▉        | 7126/37963 [30:33:12<124:20:56, 14.52s/it]
 19%|█▉        | 7127/37963 [30:33:26<124:03:37, 14.48s/it]
 19%|█▉        | 7128/37963 [30:33:40<123:38:17, 14.43s/it]
 19%|█▉        | 7129/37963 [30:33:55<123:33:14, 14.43s/it]
 19%|█▉        | 7130/37963 [30:34:09<123:22:28, 14.40s/it]
                                                           
{'loss': '0.1766', 'grad_norm': '1.314', 'learning_rate': '1.872e-05', 'epoch': '0.1878'}

 19%|█▉        | 7130/37963 [30:34:09<123:22:28, 14.40s/it]
 19%|█▉        | 7131/37963 [30:34:23<123:15:33, 14.39s/it]
 19%|█▉        | 7132/37963 [30:34:38<123:03:02, 14.37s/it]
 19%|█▉        | 7133/37963 [30:34:51<121:25:47, 14.18s/it]
 19%|█▉        | 7134/37963 [30:35:06<121:53:37, 14.23s/it]
 19%|█▉        | 7135/37963 [30:35:20<122:30:25, 14.31s/it]
 19%|█▉        | 7136/37963 [30:35:35<122:30:10, 14.31s/it]
 19%|█▉        | 7137/37963 [30:35:49<122:34:50, 14.32s/it]
 19%|█▉        | 7138/37963 [30:36:03<122:17:47, 14.28s/it]
 19%|█▉        | 7139/37963 [30:36:17<121:15:40, 14.16s/it]
 19%|█▉        | 7140/37963 [30:36:31<121:52:28, 14.23s/it]
                                                           
{'loss': '0.183', 'grad_norm': '2.678', 'learning_rate': '1.872e-05', 'epoch': '0.1881'}

 19%|█▉        | 7140/37963 [30:36:31<121:52:28, 14.23s/it]
 19%|█▉        | 7141/37963 [30:36:52<139:06:03, 16.25s/it]
 19%|█▉        | 7142/37963 [30:37:07<134:45:43, 15.74s/it]
 19%|█▉        | 7143/37963 [30:37:21<131:29:11, 15.36s/it]
 19%|█▉        | 7144/37963 [30:37:36<129:28:57, 15.13s/it]
 19%|█▉        | 7145/37963 [30:37:50<127:43:26, 14.92s/it]
 19%|█▉        | 7146/37963 [30:38:04<125:06:01, 14.61s/it]
 19%|█▉        | 7147/37963 [30:38:31<157:24:02, 18.39s/it]
 19%|█▉        | 7148/37963 [30:38:52<163:42:30, 19.13s/it]
 19%|█▉        | 7149/37963 [30:39:12<165:57:15, 19.39s/it]
 19%|█▉        | 7150/37963 [30:39:26<152:05:21, 17.77s/it]
                                                           
{'loss': '0.1652', 'grad_norm': '1.632', 'learning_rate': '1.871e-05', 'epoch': '0.1883'}

 19%|█▉        | 7150/37963 [30:39:26<152:05:21, 17.77s/it]
 19%|█▉        | 7151/37963 [30:39:40<141:39:09, 16.55s/it]
 19%|█▉        | 7152/37963 [30:40:01<153:06:03, 17.89s/it]
 19%|█▉        | 7153/37963 [30:40:15<143:56:59, 16.82s/it]
 19%|█▉        | 7154/37963 [30:40:37<155:27:01, 18.16s/it]
 19%|█▉        | 7155/37963 [30:40:51<145:51:53, 17.04s/it]
 19%|█▉        | 7156/37963 [30:41:05<138:28:38, 16.18s/it]
 19%|█▉        | 7157/37963 [30:41:20<133:52:34, 15.64s/it]
 19%|█▉        | 7158/37963 [30:41:34<130:24:09, 15.24s/it]
 19%|█▉        | 7159/37963 [30:41:48<128:31:08, 15.02s/it]
 19%|█▉        | 7160/37963 [30:42:03<126:58:21, 14.84s/it]
                                                           
{'loss': '0.1866', 'grad_norm': '2.576', 'learning_rate': '1.871e-05', 'epoch': '0.1886'}

 19%|█▉        | 7160/37963 [30:42:03<126:58:21, 14.84s/it]
 19%|█▉        | 7161/37963 [30:42:17<125:43:36, 14.69s/it]
 19%|█▉        | 7162/37963 [30:42:32<125:25:22, 14.66s/it]
 19%|█▉        | 7163/37963 [30:42:46<124:44:06, 14.58s/it]
 19%|█▉        | 7164/37963 [30:43:00<123:47:29, 14.47s/it]
 19%|█▉        | 7165/37963 [30:43:14<122:31:03, 14.32s/it]
 19%|█▉        | 7166/37963 [30:43:29<122:37:47, 14.33s/it]
 19%|█▉        | 7167/37963 [30:43:43<121:26:55, 14.20s/it]
 19%|█▉        | 7168/37963 [30:43:57<121:50:51, 14.24s/it]
 19%|█▉        | 7169/37963 [30:44:18<139:38:50, 16.33s/it]
 19%|█▉        | 7170/37963 [30:44:32<134:20:15, 15.71s/it]
                                                           
{'loss': '0.1689', 'grad_norm': '5.821', 'learning_rate': '1.871e-05', 'epoch': '0.1889'}

 19%|█▉        | 7170/37963 [30:44:32<134:20:15, 15.71s/it]
 19%|█▉        | 7171/37963 [30:44:46<130:05:57, 15.21s/it]
 19%|█▉        | 7172/37963 [30:45:01<127:56:02, 14.96s/it]
 19%|█▉        | 7173/37963 [30:45:15<125:44:05, 14.70s/it]
 19%|█▉        | 7174/37963 [30:45:29<124:45:12, 14.59s/it]
 19%|█▉        | 7175/37963 [30:45:44<124:13:04, 14.52s/it]
 19%|█▉        | 7176/37963 [30:45:58<123:43:06, 14.47s/it]
 19%|█▉        | 7177/37963 [30:46:12<123:18:36, 14.42s/it]
 19%|█▉        | 7178/37963 [30:46:26<121:44:11, 14.24s/it]
 19%|█▉        | 7179/37963 [30:46:40<121:57:51, 14.26s/it]
 19%|█▉        | 7180/37963 [30:46:55<122:32:42, 14.33s/it]
                                                           
{'loss': '0.167', 'grad_norm': '5.229', 'learning_rate': '1.87e-05', 'epoch': '0.1891'}

 19%|█▉        | 7180/37963 [30:46:55<122:32:42, 14.33s/it]
 19%|█▉        | 7181/37963 [30:47:10<123:26:37, 14.44s/it]
 19%|█▉        | 7182/37963 [30:47:24<123:30:40, 14.45s/it]
 19%|█▉        | 7183/37963 [30:47:39<124:02:45, 14.51s/it]
 19%|█▉        | 7184/37963 [30:47:53<122:45:26, 14.36s/it]
 19%|█▉        | 7185/37963 [30:48:07<122:43:26, 14.35s/it]
 19%|█▉        | 7186/37963 [30:48:21<121:34:26, 14.22s/it]
 19%|█▉        | 7187/37963 [30:48:35<120:37:12, 14.11s/it]
 19%|█▉        | 7188/37963 [30:48:49<121:21:21, 14.20s/it]
 19%|█▉        | 7189/37963 [30:49:04<121:42:12, 14.24s/it]
 19%|█▉        | 7190/37963 [30:49:24<138:41:11, 16.22s/it]
                                                           
{'loss': '0.1694', 'grad_norm': '3.682', 'learning_rate': '1.87e-05', 'epoch': '0.1894'}

 19%|█▉        | 7190/37963 [30:49:24<138:41:11, 16.22s/it]
 19%|█▉        | 7191/37963 [30:49:38<132:27:15, 15.50s/it]
 19%|█▉        | 7192/37963 [30:49:53<129:28:25, 15.15s/it]
 19%|█▉        | 7193/37963 [30:50:06<126:13:38, 14.77s/it]
 19%|█▉        | 7194/37963 [30:50:27<141:12:07, 16.52s/it]
 19%|█▉        | 7195/37963 [30:50:48<151:53:10, 17.77s/it]
 19%|█▉        | 7196/37963 [30:51:08<159:23:23, 18.65s/it]
 19%|█▉        | 7197/37963 [30:51:23<148:19:19, 17.36s/it]
 19%|█▉        | 7198/37963 [30:51:37<140:41:49, 16.46s/it]
 19%|█▉        | 7199/37963 [30:51:51<134:43:29, 15.77s/it]
 19%|█▉        | 7200/37963 [30:52:06<131:29:04, 15.39s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '1.828', 'learning_rate': '1.869e-05', 'epoch': '0.1897'}

 19%|█▉        | 7200/37963 [30:52:06<131:29:04, 15.39s/it]
 19%|█▉        | 7201/37963 [30:52:27<145:59:19, 17.08s/it]
 19%|█▉        | 7202/37963 [30:52:48<157:00:41, 18.38s/it]
 19%|█▉        | 7203/37963 [30:53:09<163:38:13, 19.15s/it]
 19%|█▉        | 7204/37963 [30:53:24<151:28:54, 17.73s/it]
 19%|█▉        | 7205/37963 [30:53:38<143:16:45, 16.77s/it]
 19%|█▉        | 7206/37963 [30:53:52<136:41:15, 16.00s/it]
 19%|█▉        | 7207/37963 [30:54:06<131:41:13, 15.41s/it]
 19%|█▉        | 7208/37963 [30:54:21<128:53:21, 15.09s/it]
 19%|█▉        | 7209/37963 [30:54:35<126:58:31, 14.86s/it]
 19%|█▉        | 7210/37963 [30:54:49<123:59:52, 14.52s/it]
                                                           
{'loss': '0.1727', 'grad_norm': '4.512', 'learning_rate': '1.869e-05', 'epoch': '0.1899'}

 19%|█▉        | 7210/37963 [30:54:49<123:59:52, 14.52s/it]
 19%|█▉        | 7211/37963 [30:55:03<123:13:41, 14.43s/it]
 19%|█▉        | 7212/37963 [30:55:17<123:15:31, 14.43s/it]
 19%|█▉        | 7213/37963 [30:55:32<122:45:36, 14.37s/it]
 19%|█▉        | 7214/37963 [30:55:46<122:41:47, 14.36s/it]
 19%|█▉        | 7215/37963 [30:56:00<122:40:35, 14.36s/it]
 19%|█▉        | 7216/37963 [30:56:14<121:12:36, 14.19s/it]
 19%|█▉        | 7217/37963 [30:56:28<121:13:46, 14.19s/it]
 19%|█▉        | 7218/37963 [30:56:42<121:08:46, 14.19s/it]
 19%|█▉        | 7219/37963 [30:57:04<138:37:49, 16.23s/it]
 19%|█▉        | 7220/37963 [30:57:18<134:01:47, 15.69s/it]
                                                           
{'loss': '0.1722', 'grad_norm': '1.961', 'learning_rate': '1.868e-05', 'epoch': '0.1902'}

 19%|█▉        | 7220/37963 [30:57:18<134:01:47, 15.69s/it]
 19%|█▉        | 7221/37963 [30:57:32<130:38:56, 15.30s/it]
 19%|█▉        | 7222/37963 [30:57:46<126:54:19, 14.86s/it]
 19%|█▉        | 7223/37963 [30:58:01<125:51:27, 14.74s/it]
 19%|█▉        | 7224/37963 [30:58:15<125:05:29, 14.65s/it]
 19%|█▉        | 7225/37963 [30:58:30<124:40:39, 14.60s/it]
 19%|█▉        | 7226/37963 [30:58:44<123:33:14, 14.47s/it]
 19%|█▉        | 7227/37963 [30:58:58<123:19:56, 14.45s/it]
 19%|█▉        | 7228/37963 [30:59:12<123:02:51, 14.41s/it]
 19%|█▉        | 7229/37963 [30:59:27<123:08:07, 14.42s/it]
 19%|█▉        | 7230/37963 [30:59:41<122:57:35, 14.40s/it]
                                                           
{'loss': '0.1681', 'grad_norm': '1.674', 'learning_rate': '1.868e-05', 'epoch': '0.1904'}

 19%|█▉        | 7230/37963 [30:59:41<122:57:35, 14.40s/it]
 19%|█▉        | 7231/37963 [30:59:56<122:50:00, 14.39s/it]
 19%|█▉        | 7232/37963 [31:00:09<120:48:40, 14.15s/it]
 19%|█▉        | 7233/37963 [31:00:23<120:34:37, 14.13s/it]
 19%|█▉        | 7234/37963 [31:00:38<121:21:38, 14.22s/it]
 19%|█▉        | 7235/37963 [31:00:52<121:35:46, 14.25s/it]
 19%|█▉        | 7236/37963 [31:01:06<121:40:43, 14.26s/it]
 19%|█▉        | 7237/37963 [31:01:20<121:10:59, 14.20s/it]
 19%|█▉        | 7238/37963 [31:01:35<121:35:44, 14.25s/it]
 19%|█▉        | 7239/37963 [31:01:55<136:23:28, 15.98s/it]
 19%|█▉        | 7240/37963 [31:02:09<132:37:15, 15.54s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '2.951', 'learning_rate': '1.868e-05', 'epoch': '0.1907'}

 19%|█▉        | 7240/37963 [31:02:09<132:37:15, 15.54s/it]
 19%|█▉        | 7241/37963 [31:02:29<143:47:47, 16.85s/it]
 19%|█▉        | 7242/37963 [31:02:44<137:29:43, 16.11s/it]
 19%|█▉        | 7243/37963 [31:02:58<133:03:10, 15.59s/it]
 19%|█▉        | 7244/37963 [31:03:18<144:40:23, 16.95s/it]
 19%|█▉        | 7245/37963 [31:03:32<137:57:37, 16.17s/it]
 19%|█▉        | 7246/37963 [31:03:47<132:58:46, 15.59s/it]
 19%|█▉        | 7247/37963 [31:04:08<147:08:39, 17.25s/it]
 19%|█▉        | 7248/37963 [31:04:22<139:35:36, 16.36s/it]
 19%|█▉        | 7249/37963 [31:04:36<134:27:18, 15.76s/it]
 19%|█▉        | 7250/37963 [31:04:57<146:51:33, 17.21s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '2.124', 'learning_rate': '1.867e-05', 'epoch': '0.191'}

 19%|█▉        | 7250/37963 [31:04:57<146:51:33, 17.21s/it]
 19%|█▉        | 7251/37963 [31:05:18<157:13:18, 18.43s/it]
 19%|█▉        | 7252/37963 [31:05:39<163:19:47, 19.15s/it]
 19%|█▉        | 7253/37963 [31:05:54<151:35:30, 17.77s/it]
 19%|█▉        | 7254/37963 [31:06:08<142:44:23, 16.73s/it]
 19%|█▉        | 7255/37963 [31:06:22<136:23:11, 15.99s/it]
 19%|█▉        | 7256/37963 [31:06:37<132:50:55, 15.57s/it]
 19%|█▉        | 7257/37963 [31:06:51<129:53:58, 15.23s/it]
 19%|█▉        | 7258/37963 [31:07:06<127:41:00, 14.97s/it]
 19%|█▉        | 7259/37963 [31:07:20<126:06:44, 14.79s/it]
 19%|█▉        | 7260/37963 [31:07:34<124:55:43, 14.65s/it]
                                                           
{'loss': '0.168', 'grad_norm': '4.496', 'learning_rate': '1.867e-05', 'epoch': '0.1912'}

 19%|█▉        | 7260/37963 [31:07:34<124:55:43, 14.65s/it]
 19%|█▉        | 7261/37963 [31:07:49<124:16:49, 14.57s/it]
 19%|█▉        | 7262/37963 [31:08:03<123:40:35, 14.50s/it]
 19%|█▉        | 7263/37963 [31:08:17<122:59:21, 14.42s/it]
 19%|█▉        | 7264/37963 [31:08:32<123:11:41, 14.45s/it]
 19%|█▉        | 7265/37963 [31:08:46<122:50:20, 14.41s/it]
 19%|█▉        | 7266/37963 [31:09:00<120:59:26, 14.19s/it]
 19%|█▉        | 7267/37963 [31:09:22<141:02:20, 16.54s/it]
 19%|█▉        | 7268/37963 [31:09:36<135:40:03, 15.91s/it]
 19%|█▉        | 7269/37963 [31:09:51<131:44:51, 15.45s/it]
 19%|█▉        | 7270/37963 [31:10:05<128:59:21, 15.13s/it]
                                                           
{'loss': '0.162', 'grad_norm': '3.453', 'learning_rate': '1.866e-05', 'epoch': '0.1915'}

 19%|█▉        | 7270/37963 [31:10:05<128:59:21, 15.13s/it]
 19%|█▉        | 7271/37963 [31:10:19<127:15:10, 14.93s/it]
 19%|█▉        | 7272/37963 [31:10:34<125:58:23, 14.78s/it]
 19%|█▉        | 7273/37963 [31:10:48<123:35:31, 14.50s/it]
 19%|█▉        | 7274/37963 [31:11:02<121:49:49, 14.29s/it]
 19%|█▉        | 7275/37963 [31:11:16<121:36:45, 14.27s/it]
 19%|█▉        | 7276/37963 [31:11:30<121:57:39, 14.31s/it]
 19%|█▉        | 7277/37963 [31:11:44<119:56:50, 14.07s/it]
 19%|█▉        | 7278/37963 [31:11:58<120:42:39, 14.16s/it]
 19%|█▉        | 7279/37963 [31:12:12<121:13:09, 14.22s/it]
 19%|█▉        | 7280/37963 [31:12:27<121:33:05, 14.26s/it]
                                                           
{'loss': '0.1701', 'grad_norm': '1.615', 'learning_rate': '1.866e-05', 'epoch': '0.1918'}

 19%|█▉        | 7280/37963 [31:12:27<121:33:05, 14.26s/it]
 19%|█▉        | 7281/37963 [31:12:41<120:50:45, 14.18s/it]
 19%|█▉        | 7282/37963 [31:12:55<121:33:48, 14.26s/it]
 19%|█▉        | 7283/37963 [31:13:09<121:36:13, 14.27s/it]
 19%|█▉        | 7284/37963 [31:13:24<121:16:35, 14.23s/it]
 19%|█▉        | 7285/37963 [31:13:38<121:34:48, 14.27s/it]
 19%|█▉        | 7286/37963 [31:13:52<120:50:08, 14.18s/it]
 19%|█▉        | 7287/37963 [31:14:13<137:23:49, 16.12s/it]
 19%|█▉        | 7288/37963 [31:14:27<132:57:28, 15.60s/it]
 19%|█▉        | 7289/37963 [31:14:41<129:44:59, 15.23s/it]
 19%|█▉        | 7290/37963 [31:15:01<141:43:29, 16.63s/it]
                                                           
{'loss': '0.1749', 'grad_norm': '2.042', 'learning_rate': '1.865e-05', 'epoch': '0.192'}

 19%|█▉        | 7290/37963 [31:15:01<141:43:29, 16.63s/it]
 19%|█▉        | 7291/37963 [31:15:22<151:24:20, 17.77s/it]
 19%|█▉        | 7292/37963 [31:15:36<142:27:14, 16.72s/it]
 19%|█▉        | 7293/37963 [31:15:50<136:42:39, 16.05s/it]
 19%|█▉        | 7294/37963 [31:16:05<132:04:54, 15.50s/it]
 19%|█▉        | 7295/37963 [31:16:26<146:05:56, 17.15s/it]
 19%|█▉        | 7296/37963 [31:16:40<139:06:43, 16.33s/it]
 19%|█▉        | 7297/37963 [31:16:54<132:40:53, 15.58s/it]
 19%|█▉        | 7298/37963 [31:17:08<128:21:56, 15.07s/it]
 19%|█▉        | 7299/37963 [31:17:35<160:04:38, 18.79s/it]
 19%|█▉        | 7300/37963 [31:17:50<148:56:19, 17.49s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '2.08', 'learning_rate': '1.865e-05', 'epoch': '0.1923'}

 19%|█▉        | 7300/37963 [31:17:50<148:56:19, 17.49s/it]
 19%|█▉        | 7301/37963 [31:18:11<158:36:12, 18.62s/it]
 19%|█▉        | 7302/37963 [31:18:25<147:06:35, 17.27s/it]
 19%|█▉        | 7303/37963 [31:18:39<139:37:55, 16.40s/it]
 19%|█▉        | 7304/37963 [31:18:54<134:18:42, 15.77s/it]
 19%|█▉        | 7305/37963 [31:19:08<129:42:57, 15.23s/it]
 19%|█▉        | 7306/37963 [31:19:22<127:42:50, 15.00s/it]
 19%|█▉        | 7307/37963 [31:19:36<125:57:19, 14.79s/it]
 19%|█▉        | 7308/37963 [31:19:50<123:38:30, 14.52s/it]
 19%|█▉        | 7309/37963 [31:20:05<123:08:26, 14.46s/it]
 19%|█▉        | 7310/37963 [31:20:19<123:00:36, 14.45s/it]
                                                           
{'loss': '0.158', 'grad_norm': '2.244', 'learning_rate': '1.865e-05', 'epoch': '0.1926'}

 19%|█▉        | 7310/37963 [31:20:19<123:00:36, 14.45s/it]
 19%|█▉        | 7311/37963 [31:20:34<122:53:51, 14.43s/it]
 19%|█▉        | 7312/37963 [31:20:48<122:49:56, 14.43s/it]
 19%|█▉        | 7313/37963 [31:21:02<122:09:26, 14.35s/it]
 19%|█▉        | 7314/37963 [31:21:16<120:35:26, 14.16s/it]
 19%|█▉        | 7315/37963 [31:21:30<121:05:00, 14.22s/it]
 19%|█▉        | 7316/37963 [31:21:44<121:19:01, 14.25s/it]
 19%|█▉        | 7317/37963 [31:22:06<139:15:10, 16.36s/it]
 19%|█▉        | 7318/37963 [31:22:20<134:13:34, 15.77s/it]
 19%|█▉        | 7319/37963 [31:22:35<131:02:32, 15.39s/it]
 19%|█▉        | 7320/37963 [31:22:49<129:07:24, 15.17s/it]
                                                           
{'loss': '0.1506', 'grad_norm': '7.654', 'learning_rate': '1.864e-05', 'epoch': '0.1928'}

 19%|█▉        | 7320/37963 [31:22:49<129:07:24, 15.17s/it]
 19%|█▉        | 7321/37963 [31:23:04<127:16:44, 14.95s/it]
 19%|█▉        | 7322/37963 [31:23:18<126:07:42, 14.82s/it]
 19%|█▉        | 7323/37963 [31:23:33<124:59:32, 14.69s/it]
 19%|█▉        | 7324/37963 [31:23:47<124:09:51, 14.59s/it]
 19%|█▉        | 7325/37963 [31:24:01<123:31:45, 14.51s/it]
 19%|█▉        | 7326/37963 [31:24:16<123:13:21, 14.48s/it]
 19%|█▉        | 7327/37963 [31:24:30<122:52:19, 14.44s/it]
 19%|█▉        | 7328/37963 [31:24:44<122:37:46, 14.41s/it]
 19%|█▉        | 7329/37963 [31:24:59<122:46:06, 14.43s/it]
 19%|█▉        | 7330/37963 [31:25:13<122:45:01, 14.43s/it]
                                                           
{'loss': '0.1713', 'grad_norm': '0.898', 'learning_rate': '1.864e-05', 'epoch': '0.1931'}

 19%|█▉        | 7330/37963 [31:25:13<122:45:01, 14.43s/it]
 19%|█▉        | 7331/37963 [31:25:28<122:29:03, 14.39s/it]
 19%|█▉        | 7332/37963 [31:25:42<122:19:50, 14.38s/it]
 19%|█▉        | 7333/37963 [31:25:56<122:09:54, 14.36s/it]
 19%|█▉        | 7334/37963 [31:26:11<122:04:08, 14.35s/it]
 19%|█▉        | 7335/37963 [31:26:25<121:56:28, 14.33s/it]
 19%|█▉        | 7336/37963 [31:26:46<139:42:34, 16.42s/it]
 19%|█▉        | 7337/37963 [31:27:01<134:37:29, 15.82s/it]
 19%|█▉        | 7338/37963 [31:27:15<130:47:38, 15.37s/it]
 19%|█▉        | 7339/37963 [31:27:29<128:11:54, 15.07s/it]
 19%|█▉        | 7340/37963 [31:27:57<159:24:08, 18.74s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '1.067', 'learning_rate': '1.863e-05', 'epoch': '0.1933'}

 19%|█▉        | 7340/37963 [31:27:57<159:24:08, 18.74s/it]
 19%|█▉        | 7341/37963 [31:28:11<148:07:19, 17.41s/it]
 19%|█▉        | 7342/37963 [31:28:25<140:08:28, 16.48s/it]
 19%|█▉        | 7343/37963 [31:28:46<151:45:51, 17.84s/it]
 19%|█▉        | 7344/37963 [31:29:01<142:46:07, 16.79s/it]
 19%|█▉        | 7345/37963 [31:29:15<136:56:45, 16.10s/it]
 19%|█▉        | 7346/37963 [31:29:29<132:34:25, 15.59s/it]
 19%|█▉        | 7347/37963 [31:29:50<144:00:16, 16.93s/it]
 19%|█▉        | 7348/37963 [31:30:11<154:57:05, 18.22s/it]
 19%|█▉        | 7349/37963 [31:30:32<162:12:40, 19.07s/it]
 19%|█▉        | 7350/37963 [31:30:46<148:57:34, 17.52s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '4.088', 'learning_rate': '1.863e-05', 'epoch': '0.1936'}

 19%|█▉        | 7350/37963 [31:30:46<148:57:34, 17.52s/it]
 19%|█▉        | 7351/37963 [31:31:00<140:50:51, 16.56s/it]
 19%|█▉        | 7352/37963 [31:31:14<134:13:21, 15.79s/it]
 19%|█▉        | 7353/37963 [31:31:28<130:34:31, 15.36s/it]
 19%|█▉        | 7354/37963 [31:31:43<127:52:39, 15.04s/it]
 19%|█▉        | 7355/37963 [31:31:57<125:37:49, 14.78s/it]
 19%|█▉        | 7356/37963 [31:32:11<124:29:14, 14.64s/it]
 19%|█▉        | 7357/37963 [31:32:25<121:31:42, 14.29s/it]
 19%|█▉        | 7358/37963 [31:32:39<121:36:14, 14.30s/it]
 19%|█▉        | 7359/37963 [31:32:53<121:44:46, 14.32s/it]
 19%|█▉        | 7360/37963 [31:33:08<121:51:57, 14.34s/it]
                                                           
{'loss': '0.1457', 'grad_norm': '2.302', 'learning_rate': '1.862e-05', 'epoch': '0.1939'}

 19%|█▉        | 7360/37963 [31:33:08<121:51:57, 14.34s/it]
 19%|█▉        | 7361/37963 [31:33:22<122:11:07, 14.37s/it]
 19%|█▉        | 7362/37963 [31:33:37<122:27:42, 14.41s/it]
 19%|█▉        | 7363/37963 [31:33:51<121:13:36, 14.26s/it]
 19%|█▉        | 7364/37963 [31:34:12<138:45:39, 16.33s/it]
 19%|█▉        | 7365/37963 [31:34:26<133:42:18, 15.73s/it]
 19%|█▉        | 7366/37963 [31:34:40<130:10:11, 15.32s/it]
 19%|█▉        | 7367/37963 [31:34:55<127:50:14, 15.04s/it]
 19%|█▉        | 7368/37963 [31:35:09<125:41:04, 14.79s/it]
 19%|█▉        | 7369/37963 [31:35:23<124:41:00, 14.67s/it]
 19%|█▉        | 7370/37963 [31:35:38<123:58:39, 14.59s/it]
                                                           
{'loss': '0.163', 'grad_norm': '4.166', 'learning_rate': '1.862e-05', 'epoch': '0.1941'}

 19%|█▉        | 7370/37963 [31:35:38<123:58:39, 14.59s/it]
 19%|█▉        | 7371/37963 [31:35:52<123:40:06, 14.55s/it]
 19%|█▉        | 7372/37963 [31:36:07<123:23:32, 14.52s/it]
 19%|█▉        | 7373/37963 [31:36:21<122:39:10, 14.43s/it]
 19%|█▉        | 7374/37963 [31:36:35<122:28:21, 14.41s/it]
 19%|█▉        | 7375/37963 [31:36:50<122:02:16, 14.36s/it]
 19%|█▉        | 7376/37963 [31:37:04<122:00:12, 14.36s/it]
 19%|█▉        | 7377/37963 [31:37:18<121:38:51, 14.32s/it]
 19%|█▉        | 7378/37963 [31:37:32<121:26:19, 14.29s/it]
 19%|█▉        | 7379/37963 [31:37:47<121:38:35, 14.32s/it]
 19%|█▉        | 7380/37963 [31:38:01<122:20:22, 14.40s/it]
                                                           
{'loss': '0.1624', 'grad_norm': '3.194', 'learning_rate': '1.862e-05', 'epoch': '0.1944'}

 19%|█▉        | 7380/37963 [31:38:01<122:20:22, 14.40s/it]
 19%|█▉        | 7381/37963 [31:38:16<122:30:47, 14.42s/it]
 19%|█▉        | 7382/37963 [31:38:30<121:07:38, 14.26s/it]
 19%|█▉        | 7383/37963 [31:38:44<119:55:45, 14.12s/it]
 19%|█▉        | 7384/37963 [31:39:05<137:33:54, 16.20s/it]
 19%|█▉        | 7385/37963 [31:39:19<132:13:33, 15.57s/it]
 19%|█▉        | 7386/37963 [31:39:33<129:24:13, 15.24s/it]
 19%|█▉        | 7387/37963 [31:39:47<126:58:53, 14.95s/it]
 19%|█▉        | 7388/37963 [31:40:02<125:18:55, 14.76s/it]
 19%|█▉        | 7389/37963 [31:40:23<141:16:23, 16.63s/it]
 19%|█▉        | 7390/37963 [31:40:44<152:22:48, 17.94s/it]
                                                           
{'loss': '0.1697', 'grad_norm': '1.936', 'learning_rate': '1.861e-05', 'epoch': '0.1947'}

 19%|█▉        | 7390/37963 [31:40:44<152:22:48, 17.94s/it]
 19%|█▉        | 7391/37963 [31:41:04<157:40:10, 18.57s/it]
 19%|█▉        | 7392/37963 [31:41:18<147:01:43, 17.31s/it]
 19%|█▉        | 7393/37963 [31:41:32<138:47:43, 16.34s/it]
 19%|█▉        | 7394/37963 [31:41:46<133:32:13, 15.73s/it]
 19%|█▉        | 7395/37963 [31:42:01<130:02:05, 15.31s/it]
 19%|█▉        | 7396/37963 [31:42:15<127:48:50, 15.05s/it]
 19%|█▉        | 7397/37963 [31:42:43<160:24:33, 18.89s/it]
 19%|█▉        | 7398/37963 [31:42:58<148:50:46, 17.53s/it]
 19%|█▉        | 7399/37963 [31:43:11<139:14:35, 16.40s/it]
 19%|█▉        | 7400/37963 [31:43:26<134:01:59, 15.79s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '1.006', 'learning_rate': '1.861e-05', 'epoch': '0.1949'}

 19%|█▉        | 7400/37963 [31:43:26<134:01:59, 15.79s/it]
 19%|█▉        | 7401/37963 [31:43:39<128:58:57, 15.19s/it]
 19%|█▉        | 7402/37963 [31:43:53<124:44:00, 14.69s/it]
 20%|█▉        | 7403/37963 [31:44:07<123:39:43, 14.57s/it]
 20%|█▉        | 7404/37963 [31:44:22<123:14:00, 14.52s/it]
 20%|█▉        | 7405/37963 [31:44:36<122:43:15, 14.46s/it]
 20%|█▉        | 7406/37963 [31:44:50<122:43:31, 14.46s/it]
 20%|█▉        | 7407/37963 [31:45:05<122:17:31, 14.41s/it]
 20%|█▉        | 7408/37963 [31:45:19<122:07:59, 14.39s/it]
 20%|█▉        | 7409/37963 [31:45:33<120:09:07, 14.16s/it]
 20%|█▉        | 7410/37963 [31:45:47<120:55:49, 14.25s/it]
                                                           
{'loss': '0.1649', 'grad_norm': '1.363', 'learning_rate': '1.86e-05', 'epoch': '0.1952'}

 20%|█▉        | 7410/37963 [31:45:47<120:55:49, 14.25s/it]
 20%|█▉        | 7411/37963 [31:46:02<121:16:48, 14.29s/it]
 20%|█▉        | 7412/37963 [31:46:23<138:35:09, 16.33s/it]
 20%|█▉        | 7413/37963 [31:46:37<133:13:53, 15.70s/it]
 20%|█▉        | 7414/37963 [31:46:51<128:29:32, 15.14s/it]
 20%|█▉        | 7415/37963 [31:47:05<126:18:58, 14.89s/it]
 20%|█▉        | 7416/37963 [31:47:19<125:06:11, 14.74s/it]
 20%|█▉        | 7417/37963 [31:47:33<121:31:56, 14.32s/it]
 20%|█▉        | 7418/37963 [31:47:47<120:18:43, 14.18s/it]
 20%|█▉        | 7419/37963 [31:48:01<120:50:48, 14.24s/it]
 20%|█▉        | 7420/37963 [31:48:15<119:28:11, 14.08s/it]
                                                           
{'loss': '0.1499', 'grad_norm': '3.268', 'learning_rate': '1.86e-05', 'epoch': '0.1955'}

 20%|█▉        | 7420/37963 [31:48:15<119:28:11, 14.08s/it]
 20%|█▉        | 7421/37963 [31:48:29<120:12:02, 14.17s/it]
 20%|█▉        | 7422/37963 [31:48:43<120:41:04, 14.23s/it]
 20%|█▉        | 7423/37963 [31:48:58<121:06:28, 14.28s/it]
 20%|█▉        | 7424/37963 [31:49:12<121:42:19, 14.35s/it]
 20%|█▉        | 7425/37963 [31:49:27<121:38:25, 14.34s/it]
 20%|█▉        | 7426/37963 [31:49:40<119:58:01, 14.14s/it]
 20%|█▉        | 7427/37963 [31:49:55<120:33:15, 14.21s/it]
 20%|█▉        | 7428/37963 [31:50:09<120:52:16, 14.25s/it]
 20%|█▉        | 7429/37963 [31:50:23<121:17:45, 14.30s/it]
 20%|█▉        | 7430/37963 [31:50:37<119:45:25, 14.12s/it]
                                                           
{'loss': '0.1711', 'grad_norm': '1.012', 'learning_rate': '1.859e-05', 'epoch': '0.1957'}

 20%|█▉        | 7430/37963 [31:50:37<119:45:25, 14.12s/it]
 20%|█▉        | 7431/37963 [31:50:51<120:05:20, 14.16s/it]
 20%|█▉        | 7432/37963 [31:51:12<137:08:17, 16.17s/it]
 20%|█▉        | 7433/37963 [31:51:26<131:32:04, 15.51s/it]
 20%|█▉        | 7434/37963 [31:51:41<128:40:28, 15.17s/it]
 20%|█▉        | 7435/37963 [31:51:55<126:42:36, 14.94s/it]
 20%|█▉        | 7436/37963 [31:52:09<125:28:07, 14.80s/it]
 20%|█▉        | 7437/37963 [31:52:30<140:28:46, 16.57s/it]
 20%|█▉        | 7438/37963 [31:52:50<150:03:18, 17.70s/it]
 20%|█▉        | 7439/37963 [31:53:05<141:37:15, 16.70s/it]
 20%|█▉        | 7440/37963 [31:53:26<152:01:36, 17.93s/it]
                                                           
{'loss': '0.1702', 'grad_norm': '2', 'learning_rate': '1.859e-05', 'epoch': '0.196'}

 20%|█▉        | 7440/37963 [31:53:26<152:01:36, 17.93s/it]
 20%|█▉        | 7441/37963 [31:53:40<143:55:50, 16.98s/it]
 20%|█▉        | 7442/37963 [31:53:55<137:38:21, 16.23s/it]
 20%|█▉        | 7443/37963 [31:54:09<132:28:53, 15.63s/it]
 20%|█▉        | 7444/37963 [31:54:23<129:11:20, 15.24s/it]
 20%|█▉        | 7445/37963 [31:54:52<163:38:44, 19.30s/it]
 20%|█▉        | 7446/37963 [31:55:12<165:36:10, 19.54s/it]
 20%|█▉        | 7447/37963 [31:55:27<152:07:19, 17.95s/it]
 20%|█▉        | 7448/37963 [31:55:41<142:54:53, 16.86s/it]
 20%|█▉        | 7449/37963 [31:55:55<136:35:05, 16.11s/it]
 20%|█▉        | 7450/37963 [31:56:10<132:05:51, 15.59s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '1.27', 'learning_rate': '1.859e-05', 'epoch': '0.1962'}

 20%|█▉        | 7450/37963 [31:56:10<132:05:51, 15.59s/it]
 20%|█▉        | 7451/37963 [31:56:24<128:56:21, 15.21s/it]
 20%|█▉        | 7452/37963 [31:56:38<126:01:56, 14.87s/it]
 20%|█▉        | 7453/37963 [31:56:52<124:14:22, 14.66s/it]
 20%|█▉        | 7454/37963 [31:57:06<122:57:31, 14.51s/it]
 20%|█▉        | 7455/37963 [31:57:21<122:07:24, 14.41s/it]
 20%|█▉        | 7456/37963 [31:57:34<120:30:52, 14.22s/it]
 20%|█▉        | 7457/37963 [31:57:49<120:52:08, 14.26s/it]
 20%|█▉        | 7458/37963 [31:58:03<121:17:25, 14.31s/it]
 20%|█▉        | 7459/37963 [31:58:17<121:17:51, 14.32s/it]
 20%|█▉        | 7460/37963 [31:58:39<138:53:22, 16.39s/it]
                                                           
{'loss': '0.1624', 'grad_norm': '1.307', 'learning_rate': '1.858e-05', 'epoch': '0.1965'}

 20%|█▉        | 7460/37963 [31:58:39<138:53:22, 16.39s/it]
 20%|█▉        | 7461/37963 [31:58:53<133:50:27, 15.80s/it]
 20%|█▉        | 7462/37963 [31:59:08<130:31:29, 15.41s/it]
 20%|█▉        | 7463/37963 [31:59:22<127:55:27, 15.10s/it]
 20%|█▉        | 7464/37963 [31:59:36<124:10:19, 14.66s/it]
 20%|█▉        | 7465/37963 [31:59:50<123:06:29, 14.53s/it]
 20%|█▉        | 7466/37963 [32:00:04<121:50:46, 14.38s/it]
 20%|█▉        | 7467/37963 [32:00:18<121:43:31, 14.37s/it]
 20%|█▉        | 7468/37963 [32:00:32<121:01:00, 14.29s/it]
 20%|█▉        | 7469/37963 [32:00:47<121:13:37, 14.31s/it]
 20%|█▉        | 7470/37963 [32:01:01<121:23:19, 14.33s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '5.392', 'learning_rate': '1.858e-05', 'epoch': '0.1968'}

 20%|█▉        | 7470/37963 [32:01:01<121:23:19, 14.33s/it]
 20%|█▉        | 7471/37963 [32:01:15<119:52:05, 14.15s/it]
 20%|█▉        | 7472/37963 [32:01:29<120:26:08, 14.22s/it]
 20%|█▉        | 7473/37963 [32:01:43<120:46:27, 14.26s/it]
 20%|█▉        | 7474/37963 [32:01:58<120:55:34, 14.28s/it]
 20%|█▉        | 7475/37963 [32:02:12<121:04:40, 14.30s/it]
 20%|█▉        | 7476/37963 [32:02:26<120:13:46, 14.20s/it]
 20%|█▉        | 7477/37963 [32:02:40<120:02:41, 14.18s/it]
 20%|█▉        | 7478/37963 [32:02:55<120:23:58, 14.22s/it]
 20%|█▉        | 7479/37963 [32:03:08<119:29:46, 14.11s/it]
 20%|█▉        | 7480/37963 [32:03:22<119:13:25, 14.08s/it]
                                                           
{'loss': '0.1585', 'grad_norm': '2.556', 'learning_rate': '1.857e-05', 'epoch': '0.197'}

 20%|█▉        | 7480/37963 [32:03:22<119:13:25, 14.08s/it]
 20%|█▉        | 7481/37963 [32:03:43<136:07:52, 16.08s/it]
 20%|█▉        | 7482/37963 [32:03:58<132:30:44, 15.65s/it]
 20%|█▉        | 7483/37963 [32:04:12<129:22:02, 15.28s/it]
 20%|█▉        | 7484/37963 [32:04:27<127:07:55, 15.02s/it]
 20%|█▉        | 7485/37963 [32:04:47<140:20:26, 16.58s/it]
 20%|█▉        | 7486/37963 [32:05:01<134:18:24, 15.86s/it]
 20%|█▉        | 7487/37963 [32:05:21<145:42:48, 17.21s/it]
 20%|█▉        | 7488/37963 [32:05:42<154:06:09, 18.20s/it]
 20%|█▉        | 7489/37963 [32:05:56<142:58:38, 16.89s/it]
 20%|█▉        | 7490/37963 [32:06:10<136:26:57, 16.12s/it]
                                                           
{'loss': '0.1556', 'grad_norm': '1.873', 'learning_rate': '1.857e-05', 'epoch': '0.1973'}

 20%|█▉        | 7490/37963 [32:06:10<136:26:57, 16.12s/it]
 20%|█▉        | 7491/37963 [32:06:24<131:09:32, 15.50s/it]
 20%|█▉        | 7492/37963 [32:06:39<128:23:58, 15.17s/it]
 20%|█▉        | 7493/37963 [32:07:00<143:36:17, 16.97s/it]
 20%|█▉        | 7494/37963 [32:07:27<169:41:03, 20.05s/it]
 20%|█▉        | 7495/37963 [32:07:41<155:13:43, 18.34s/it]
 20%|█▉        | 7496/37963 [32:07:56<144:58:51, 17.13s/it]
 20%|█▉        | 7497/37963 [32:08:10<138:02:37, 16.31s/it]
 20%|█▉        | 7498/37963 [32:08:24<133:01:25, 15.72s/it]
 20%|█▉        | 7499/37963 [32:08:39<129:29:12, 15.30s/it]
 20%|█▉        | 7500/37963 [32:08:53<126:57:55, 15.00s/it]
                                                           
{'loss': '0.1691', 'grad_norm': '2.335', 'learning_rate': '1.856e-05', 'epoch': '0.1976'}

 20%|█▉        | 7500/37963 [32:08:53<126:57:55, 15.00s/it]
 20%|█▉        | 7501/37963 [32:09:08<125:47:06, 14.87s/it]
 20%|█▉        | 7502/37963 [32:09:22<124:40:30, 14.73s/it]
 20%|█▉        | 7503/37963 [32:09:36<122:57:57, 14.53s/it]
 20%|█▉        | 7504/37963 [32:09:50<121:09:04, 14.32s/it]
 20%|█▉        | 7505/37963 [32:10:04<121:04:41, 14.31s/it]
 20%|█▉        | 7506/37963 [32:10:25<138:09:46, 16.33s/it]
 20%|█▉        | 7507/37963 [32:10:39<133:01:01, 15.72s/it]
 20%|█▉        | 7508/37963 [32:10:54<129:39:16, 15.33s/it]
 20%|█▉        | 7509/37963 [32:11:08<127:47:31, 15.11s/it]
 20%|█▉        | 7510/37963 [32:11:23<125:44:22, 14.86s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '4.865', 'learning_rate': '1.856e-05', 'epoch': '0.1978'}

 20%|█▉        | 7510/37963 [32:11:23<125:44:22, 14.86s/it]
 20%|█▉        | 7511/37963 [32:11:37<124:22:23, 14.70s/it]
 20%|█▉        | 7512/37963 [32:11:51<123:32:58, 14.61s/it]
 20%|█▉        | 7513/37963 [32:12:06<122:30:45, 14.48s/it]
 20%|█▉        | 7514/37963 [32:12:20<122:10:38, 14.45s/it]
 20%|█▉        | 7515/37963 [32:12:34<121:55:59, 14.42s/it]
 20%|█▉        | 7516/37963 [32:12:49<121:47:59, 14.40s/it]
 20%|█▉        | 7517/37963 [32:13:03<121:31:44, 14.37s/it]
 20%|█▉        | 7518/37963 [32:13:17<121:13:28, 14.33s/it]
 20%|█▉        | 7519/37963 [32:13:32<121:18:15, 14.34s/it]
 20%|█▉        | 7520/37963 [32:13:46<121:14:24, 14.34s/it]
                                                           
{'loss': '0.1493', 'grad_norm': '2.095', 'learning_rate': '1.855e-05', 'epoch': '0.1981'}

 20%|█▉        | 7520/37963 [32:13:46<121:14:24, 14.34s/it]
 20%|█▉        | 7521/37963 [32:14:00<119:54:32, 14.18s/it]
 20%|█▉        | 7522/37963 [32:14:14<120:34:36, 14.26s/it]
 20%|█▉        | 7523/37963 [32:14:29<121:00:34, 14.31s/it]
 20%|█▉        | 7524/37963 [32:14:43<121:09:44, 14.33s/it]
 20%|█▉        | 7525/37963 [32:14:58<121:54:28, 14.42s/it]
 20%|█▉        | 7526/37963 [32:15:11<120:18:33, 14.23s/it]
 20%|█▉        | 7527/37963 [32:15:26<120:43:30, 14.28s/it]
 20%|█▉        | 7528/37963 [32:15:39<118:44:44, 14.05s/it]
 20%|█▉        | 7529/37963 [32:15:54<119:31:17, 14.14s/it]
 20%|█▉        | 7530/37963 [32:16:15<137:48:20, 16.30s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '2.854', 'learning_rate': '1.855e-05', 'epoch': '0.1984'}

 20%|█▉        | 7530/37963 [32:16:15<137:48:20, 16.30s/it]
 20%|█▉        | 7531/37963 [32:16:29<132:55:57, 15.73s/it]
 20%|█▉        | 7532/37963 [32:16:50<145:39:56, 17.23s/it]
 20%|█▉        | 7533/37963 [32:17:04<137:31:22, 16.27s/it]
 20%|█▉        | 7534/37963 [32:17:18<132:29:45, 15.68s/it]
 20%|█▉        | 7535/37963 [32:17:39<145:56:40, 17.27s/it]
 20%|█▉        | 7536/37963 [32:17:54<138:32:41, 16.39s/it]
 20%|█▉        | 7537/37963 [32:18:08<133:31:15, 15.80s/it]
 20%|█▉        | 7538/37963 [32:18:29<146:05:53, 17.29s/it]
 20%|█▉        | 7539/37963 [32:18:43<137:26:33, 16.26s/it]
 20%|█▉        | 7540/37963 [32:18:57<131:17:24, 15.54s/it]
                                                           
{'loss': '0.1623', 'grad_norm': '1.318', 'learning_rate': '1.855e-05', 'epoch': '0.1986'}

 20%|█▉        | 7540/37963 [32:18:57<131:17:24, 15.54s/it]
 20%|█▉        | 7541/37963 [32:19:18<144:49:42, 17.14s/it]
 20%|█▉        | 7542/37963 [32:19:32<137:32:21, 16.28s/it]
 20%|█▉        | 7543/37963 [32:19:53<150:17:06, 17.79s/it]
 20%|█▉        | 7544/37963 [32:20:13<156:12:37, 18.49s/it]
 20%|█▉        | 7545/37963 [32:20:28<145:57:45, 17.27s/it]
 20%|█▉        | 7546/37963 [32:20:42<138:43:18, 16.42s/it]
 20%|█▉        | 7547/37963 [32:20:56<133:26:14, 15.79s/it]
 20%|█▉        | 7548/37963 [32:21:11<130:03:46, 15.39s/it]
 20%|█▉        | 7549/37963 [32:21:25<126:54:41, 15.02s/it]
 20%|█▉        | 7550/37963 [32:21:39<123:45:25, 14.65s/it]
                                                           
{'loss': '0.1713', 'grad_norm': '1.627', 'learning_rate': '1.854e-05', 'epoch': '0.1989'}

 20%|█▉        | 7550/37963 [32:21:39<123:45:25, 14.65s/it]
 20%|█▉        | 7551/37963 [32:21:53<123:09:53, 14.58s/it]
 20%|█▉        | 7552/37963 [32:22:08<122:39:50, 14.52s/it]
 20%|█▉        | 7553/37963 [32:22:22<122:10:16, 14.46s/it]
 20%|█▉        | 7554/37963 [32:22:36<121:50:32, 14.42s/it]
 20%|█▉        | 7555/37963 [32:22:57<138:26:38, 16.39s/it]
 20%|█▉        | 7556/37963 [32:23:12<133:43:18, 15.83s/it]
 20%|█▉        | 7557/37963 [32:23:26<129:45:47, 15.36s/it]
 20%|█▉        | 7558/37963 [32:23:40<125:05:21, 14.81s/it]
 20%|█▉        | 7559/37963 [32:23:54<123:26:05, 14.62s/it]
 20%|█▉        | 7560/37963 [32:24:08<121:13:55, 14.36s/it]
                                                           
{'loss': '0.1685', 'grad_norm': '2.849', 'learning_rate': '1.854e-05', 'epoch': '0.1991'}

 20%|█▉        | 7560/37963 [32:24:08<121:13:55, 14.36s/it]
 20%|█▉        | 7561/37963 [32:24:22<121:19:07, 14.37s/it]
 20%|█▉        | 7562/37963 [32:24:36<121:20:21, 14.37s/it]
 20%|█▉        | 7563/37963 [32:24:51<121:05:02, 14.34s/it]
 20%|█▉        | 7564/37963 [32:25:05<120:17:34, 14.25s/it]
 20%|█▉        | 7565/37963 [32:25:19<119:42:29, 14.18s/it]
 20%|█▉        | 7566/37963 [32:25:33<119:28:21, 14.15s/it]
 20%|█▉        | 7567/37963 [32:25:47<120:01:38, 14.22s/it]
 20%|█▉        | 7568/37963 [32:26:01<120:30:36, 14.27s/it]
 20%|█▉        | 7569/37963 [32:26:16<120:44:03, 14.30s/it]
 20%|█▉        | 7570/37963 [32:26:30<119:43:15, 14.18s/it]
                                                           
{'loss': '0.1721', 'grad_norm': '2.578', 'learning_rate': '1.853e-05', 'epoch': '0.1994'}

 20%|█▉        | 7570/37963 [32:26:30<119:43:15, 14.18s/it]
 20%|█▉        | 7571/37963 [32:26:44<119:29:29, 14.15s/it]
 20%|█▉        | 7572/37963 [32:26:58<120:06:39, 14.23s/it]
 20%|█▉        | 7573/37963 [32:27:13<120:52:30, 14.32s/it]
 20%|█▉        | 7574/37963 [32:27:27<120:37:06, 14.29s/it]
 20%|█▉        | 7575/37963 [32:27:42<121:34:52, 14.40s/it]
 20%|█▉        | 7576/37963 [32:27:56<121:26:45, 14.39s/it]
 20%|█▉        | 7577/37963 [32:28:10<121:34:42, 14.40s/it]
 20%|█▉        | 7578/37963 [32:28:31<135:56:21, 16.11s/it]
 20%|█▉        | 7579/37963 [32:28:51<147:41:12, 17.50s/it]
 20%|█▉        | 7580/37963 [32:29:06<140:00:24, 16.59s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '1.576', 'learning_rate': '1.853e-05', 'epoch': '0.1997'}

 20%|█▉        | 7580/37963 [32:29:06<140:00:24, 16.59s/it]
 20%|█▉        | 7581/37963 [32:29:20<133:14:49, 15.79s/it]
 20%|█▉        | 7582/37963 [32:29:34<129:38:53, 15.36s/it]
 20%|█▉        | 7583/37963 [32:29:48<127:01:58, 15.05s/it]
 20%|█▉        | 7584/37963 [32:30:09<141:58:44, 16.82s/it]
 20%|█▉        | 7585/37963 [32:30:24<135:38:19, 16.07s/it]
 20%|█▉        | 7586/37963 [32:30:44<146:34:13, 17.37s/it]
 20%|█▉        | 7587/37963 [32:30:59<139:10:20, 16.49s/it]
 20%|█▉        | 7588/37963 [32:31:13<133:31:53, 15.83s/it]
 20%|█▉        | 7589/37963 [32:31:27<129:54:06, 15.40s/it]
 20%|█▉        | 7590/37963 [32:31:48<143:14:26, 16.98s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '1.977', 'learning_rate': '1.852e-05', 'epoch': '0.1999'}

 20%|█▉        | 7590/37963 [32:31:48<143:14:26, 16.98s/it]
 20%|█▉        | 7591/37963 [32:32:02<136:32:09, 16.18s/it]
 20%|█▉        | 7592/37963 [32:32:30<166:40:13, 19.76s/it]
 20%|██        | 7593/37963 [32:32:44<151:47:00, 17.99s/it]
 20%|██        | 7594/37963 [32:32:59<142:42:21, 16.92s/it]
 20%|██        | 7595/37963 [32:33:13<136:17:34, 16.16s/it]
 20%|██        | 7596/37963 [32:33:27<131:42:00, 15.61s/it]
 20%|██        | 7597/37963 [32:33:42<128:37:46, 15.25s/it]
 20%|██        | 7598/37963 [32:33:56<126:08:02, 14.95s/it]
 20%|██        | 7599/37963 [32:34:10<124:47:31, 14.80s/it]
 20%|██        | 7600/37963 [32:34:25<123:43:49, 14.67s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '0.8653', 'learning_rate': '1.852e-05', 'epoch': '0.2002'}

 20%|██        | 7600/37963 [32:34:25<123:43:49, 14.67s/it]
 20%|██        | 7601/37963 [32:34:39<123:07:22, 14.60s/it]
 20%|██        | 7602/37963 [32:34:53<122:20:58, 14.51s/it]
 20%|██        | 7603/37963 [32:35:08<121:52:43, 14.45s/it]
 20%|██        | 7604/37963 [32:35:22<120:58:14, 14.34s/it]
 20%|██        | 7605/37963 [32:35:43<138:21:08, 16.41s/it]
 20%|██        | 7606/37963 [32:35:57<133:12:36, 15.80s/it]
 20%|██        | 7607/37963 [32:36:12<129:35:11, 15.37s/it]
 20%|██        | 7608/37963 [32:36:26<127:09:38, 15.08s/it]
 20%|██        | 7609/37963 [32:36:41<125:28:31, 14.88s/it]
 20%|██        | 7610/37963 [32:36:55<124:32:25, 14.77s/it]
                                                           
{'loss': '0.176', 'grad_norm': '2.203', 'learning_rate': '1.851e-05', 'epoch': '0.2005'}

 20%|██        | 7610/37963 [32:36:55<124:32:25, 14.77s/it]
 20%|██        | 7611/37963 [32:37:10<124:03:06, 14.71s/it]
 20%|██        | 7612/37963 [32:37:24<122:01:03, 14.47s/it]
 20%|██        | 7613/37963 [32:37:38<122:27:04, 14.52s/it]
 20%|██        | 7614/37963 [32:37:53<122:27:21, 14.53s/it]
 20%|██        | 7615/37963 [32:38:07<122:11:01, 14.49s/it]
 20%|██        | 7616/37963 [32:38:22<121:58:28, 14.47s/it]
 20%|██        | 7617/37963 [32:38:36<121:37:21, 14.43s/it]
 20%|██        | 7618/37963 [32:38:50<121:01:30, 14.36s/it]
 20%|██        | 7619/37963 [32:39:04<120:15:25, 14.27s/it]
 20%|██        | 7620/37963 [32:39:19<120:33:25, 14.30s/it]
                                                           
{'loss': '0.1693', 'grad_norm': '1.915', 'learning_rate': '1.851e-05', 'epoch': '0.2007'}

 20%|██        | 7620/37963 [32:39:19<120:33:25, 14.30s/it]
 20%|██        | 7621/37963 [32:39:33<120:42:05, 14.32s/it]
 20%|██        | 7622/37963 [32:39:47<120:26:34, 14.29s/it]
 20%|██        | 7623/37963 [32:40:02<120:37:01, 14.31s/it]
 20%|██        | 7624/37963 [32:40:16<121:10:58, 14.38s/it]
 20%|██        | 7625/37963 [32:40:30<121:10:14, 14.38s/it]
 20%|██        | 7626/37963 [32:40:51<137:49:51, 16.36s/it]
 20%|██        | 7627/37963 [32:41:06<133:00:41, 15.78s/it]
 20%|██        | 7628/37963 [32:41:20<128:39:55, 15.27s/it]
 20%|██        | 7629/37963 [32:41:41<142:50:12, 16.95s/it]
 20%|██        | 7630/37963 [32:41:55<136:21:03, 16.18s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '6.756', 'learning_rate': '1.851e-05', 'epoch': '0.201'}

 20%|██        | 7630/37963 [32:41:55<136:21:03, 16.18s/it]
 20%|██        | 7631/37963 [32:42:16<148:47:38, 17.66s/it]
 20%|██        | 7632/37963 [32:42:31<140:08:28, 16.63s/it]
 20%|██        | 7633/37963 [32:42:51<150:13:08, 17.83s/it]
 20%|██        | 7634/37963 [32:43:06<141:23:10, 16.78s/it]
 20%|██        | 7635/37963 [32:43:20<134:55:08, 16.02s/it]
 20%|██        | 7636/37963 [32:43:34<130:21:57, 15.48s/it]
 20%|██        | 7637/37963 [32:43:48<127:08:50, 15.09s/it]
 20%|██        | 7638/37963 [32:44:03<125:13:48, 14.87s/it]
 20%|██        | 7639/37963 [32:44:24<141:05:08, 16.75s/it]
 20%|██        | 7640/37963 [32:44:45<151:51:46, 18.03s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '2.948', 'learning_rate': '1.85e-05', 'epoch': '0.2012'}

 20%|██        | 7640/37963 [32:44:45<151:51:46, 18.03s/it]
 20%|██        | 7641/37963 [32:45:06<160:33:03, 19.06s/it]
 20%|██        | 7642/37963 [32:45:21<148:42:07, 17.66s/it]
 20%|██        | 7643/37963 [32:45:35<140:19:35, 16.66s/it]
 20%|██        | 7644/37963 [32:45:49<135:03:29, 16.04s/it]
 20%|██        | 7645/37963 [32:46:04<130:47:58, 15.53s/it]
 20%|██        | 7646/37963 [32:46:18<127:31:20, 15.14s/it]
 20%|██        | 7647/37963 [32:46:32<125:41:34, 14.93s/it]
 20%|██        | 7648/37963 [32:46:47<124:20:36, 14.77s/it]
 20%|██        | 7649/37963 [32:47:01<121:56:18, 14.48s/it]
 20%|██        | 7650/37963 [32:47:15<121:38:34, 14.45s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '2.012', 'learning_rate': '1.85e-05', 'epoch': '0.2015'}

 20%|██        | 7650/37963 [32:47:15<121:38:34, 14.45s/it]
 20%|██        | 7651/37963 [32:47:29<121:32:49, 14.44s/it]
 20%|██        | 7652/37963 [32:47:44<121:19:49, 14.41s/it]
 20%|██        | 7653/37963 [32:47:57<119:30:46, 14.19s/it]
 20%|██        | 7654/37963 [32:48:19<137:54:51, 16.38s/it]
 20%|██        | 7655/37963 [32:48:33<132:44:40, 15.77s/it]
 20%|██        | 7656/37963 [32:48:47<128:23:20, 15.25s/it]
 20%|██        | 7657/37963 [32:49:02<126:23:49, 15.01s/it]
 20%|██        | 7658/37963 [32:49:16<124:44:16, 14.82s/it]
 20%|██        | 7659/37963 [32:49:30<122:27:30, 14.55s/it]
 20%|██        | 7660/37963 [32:49:44<121:30:16, 14.43s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '2.585', 'learning_rate': '1.849e-05', 'epoch': '0.2018'}

 20%|██        | 7660/37963 [32:49:44<121:30:16, 14.43s/it]
 20%|██        | 7661/37963 [32:49:58<119:55:14, 14.25s/it]
 20%|██        | 7662/37963 [32:50:12<120:08:32, 14.27s/it]
 20%|██        | 7663/37963 [32:50:26<118:14:27, 14.05s/it]
 20%|██        | 7664/37963 [32:50:40<119:08:29, 14.16s/it]
 20%|██        | 7665/37963 [32:50:55<119:15:31, 14.17s/it]
 20%|██        | 7666/37963 [32:51:09<120:21:48, 14.30s/it]
 20%|██        | 7667/37963 [32:51:24<120:38:26, 14.34s/it]
 20%|██        | 7668/37963 [32:51:38<120:43:54, 14.35s/it]
 20%|██        | 7669/37963 [32:51:52<121:00:09, 14.38s/it]
 20%|██        | 7670/37963 [32:52:06<119:58:32, 14.26s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '1.861', 'learning_rate': '1.849e-05', 'epoch': '0.202'}

 20%|██        | 7670/37963 [32:52:06<119:58:32, 14.26s/it]
 20%|██        | 7671/37963 [32:52:21<120:15:15, 14.29s/it]
 20%|██        | 7672/37963 [32:52:35<120:33:51, 14.33s/it]
 20%|██        | 7673/37963 [32:52:55<135:41:12, 16.13s/it]
 20%|██        | 7674/37963 [32:53:10<130:34:21, 15.52s/it]
 20%|██        | 7675/37963 [32:53:29<141:07:00, 16.77s/it]
 20%|██        | 7676/37963 [32:53:50<151:38:23, 18.02s/it]
 20%|██        | 7677/37963 [32:54:04<141:42:44, 16.84s/it]
 20%|██        | 7678/37963 [32:54:19<135:45:19, 16.14s/it]
 20%|██        | 7679/37963 [32:54:33<131:21:17, 15.61s/it]
 20%|██        | 7680/37963 [32:54:47<127:21:07, 15.14s/it]
                                                           
{'loss': '0.1493', 'grad_norm': '0.8207', 'learning_rate': '1.848e-05', 'epoch': '0.2023'}

 20%|██        | 7680/37963 [32:54:47<127:21:07, 15.14s/it]
 20%|██        | 7681/37963 [32:55:02<125:17:03, 14.89s/it]
 20%|██        | 7682/37963 [32:55:22<140:31:12, 16.71s/it]
 20%|██        | 7683/37963 [32:55:37<134:30:22, 15.99s/it]
 20%|██        | 7684/37963 [32:55:51<130:38:59, 15.53s/it]
 20%|██        | 7685/37963 [32:56:06<127:32:53, 15.17s/it]
 20%|██        | 7686/37963 [32:56:20<124:39:19, 14.82s/it]
 20%|██        | 7687/37963 [32:56:40<138:50:39, 16.51s/it]
 20%|██        | 7688/37963 [32:56:54<133:28:38, 15.87s/it]
 20%|██        | 7689/37963 [32:57:23<164:30:57, 19.56s/it]
 20%|██        | 7690/37963 [32:57:37<151:27:43, 18.01s/it]
                                                           
{'loss': '0.1671', 'grad_norm': '0.8808', 'learning_rate': '1.848e-05', 'epoch': '0.2026'}

 20%|██        | 7690/37963 [32:57:37<151:27:43, 18.01s/it]
 20%|██        | 7691/37963 [32:57:51<142:10:20, 16.91s/it]
 20%|██        | 7692/37963 [32:58:06<135:43:37, 16.14s/it]
 20%|██        | 7693/37963 [32:58:20<131:12:43, 15.61s/it]
 20%|██        | 7694/37963 [32:58:34<128:06:14, 15.24s/it]
 20%|██        | 7695/37963 [32:58:49<125:54:07, 14.97s/it]
 20%|██        | 7696/37963 [32:59:03<124:23:46, 14.80s/it]
 20%|██        | 7697/37963 [32:59:18<123:18:05, 14.67s/it]
 20%|██        | 7698/37963 [32:59:32<122:28:09, 14.57s/it]
 20%|██        | 7699/37963 [32:59:46<122:09:15, 14.53s/it]
 20%|██        | 7700/37963 [33:00:01<121:52:38, 14.50s/it]
                                                           
{'loss': '0.1702', 'grad_norm': '1.419', 'learning_rate': '1.847e-05', 'epoch': '0.2028'}

 20%|██        | 7700/37963 [33:00:01<121:52:38, 14.50s/it]
 20%|██        | 7701/37963 [33:00:15<120:37:00, 14.35s/it]
 20%|██        | 7702/37963 [33:00:36<137:26:13, 16.35s/it]
 20%|██        | 7703/37963 [33:00:50<132:40:13, 15.78s/it]
 20%|██        | 7704/37963 [33:01:05<129:04:04, 15.36s/it]
 20%|██        | 7705/37963 [33:01:18<125:19:27, 14.91s/it]
 20%|██        | 7706/37963 [33:01:33<123:54:23, 14.74s/it]
 20%|██        | 7707/37963 [33:01:47<122:56:22, 14.63s/it]
 20%|██        | 7708/37963 [33:02:01<122:11:21, 14.54s/it]
 20%|██        | 7709/37963 [33:02:15<120:48:27, 14.38s/it]
 20%|██        | 7710/37963 [33:02:30<120:40:46, 14.36s/it]
                                                           
{'loss': '0.1723', 'grad_norm': '3.388', 'learning_rate': '1.847e-05', 'epoch': '0.2031'}

 20%|██        | 7710/37963 [33:02:30<120:40:46, 14.36s/it]
 20%|██        | 7711/37963 [33:02:44<119:35:52, 14.23s/it]
 20%|██        | 7712/37963 [33:02:58<120:08:10, 14.30s/it]
 20%|██        | 7713/37963 [33:03:13<120:26:01, 14.33s/it]
 20%|██        | 7714/37963 [33:03:27<120:36:35, 14.35s/it]
 20%|██        | 7715/37963 [33:03:41<120:32:02, 14.35s/it]
 20%|██        | 7716/37963 [33:03:56<121:14:36, 14.43s/it]
 20%|██        | 7717/37963 [33:04:10<119:31:31, 14.23s/it]
 20%|██        | 7718/37963 [33:04:24<119:43:09, 14.25s/it]
 20%|██        | 7719/37963 [33:04:38<120:00:26, 14.28s/it]
 20%|██        | 7720/37963 [33:04:53<120:09:48, 14.30s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '3.113', 'learning_rate': '1.847e-05', 'epoch': '0.2034'}

 20%|██        | 7720/37963 [33:04:53<120:09:48, 14.30s/it]
 20%|██        | 7721/37963 [33:05:07<119:21:46, 14.21s/it]
 20%|██        | 7722/37963 [33:05:21<119:43:16, 14.25s/it]
 20%|██        | 7723/37963 [33:05:42<136:20:18, 16.23s/it]
 20%|██        | 7724/37963 [33:06:02<146:04:33, 17.39s/it]
 20%|██        | 7725/37963 [33:06:23<154:57:53, 18.45s/it]
 20%|██        | 7726/37963 [33:06:37<143:53:04, 17.13s/it]
 20%|██        | 7727/37963 [33:06:52<137:33:12, 16.38s/it]
 20%|██        | 7728/37963 [33:07:06<132:21:34, 15.76s/it]
 20%|██        | 7729/37963 [33:07:20<128:45:56, 15.33s/it]
 20%|██        | 7730/37963 [33:07:35<126:28:59, 15.06s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '3.035', 'learning_rate': '1.846e-05', 'epoch': '0.2036'}

 20%|██        | 7730/37963 [33:07:35<126:28:59, 15.06s/it]
 20%|██        | 7731/37963 [33:07:55<140:31:44, 16.73s/it]
 20%|██        | 7732/37963 [33:08:10<134:21:33, 16.00s/it]
 20%|██        | 7733/37963 [33:08:24<130:05:59, 15.49s/it]
 20%|██        | 7734/37963 [33:08:38<127:19:57, 15.16s/it]
 20%|██        | 7735/37963 [33:08:59<141:42:57, 16.88s/it]
 20%|██        | 7736/37963 [33:09:14<135:24:42, 16.13s/it]
 20%|██        | 7737/37963 [33:09:28<131:03:14, 15.61s/it]
 20%|██        | 7738/37963 [33:09:49<145:10:19, 17.29s/it]
 20%|██        | 7739/37963 [33:10:11<156:05:06, 18.59s/it]
 20%|██        | 7740/37963 [33:10:25<145:22:04, 17.32s/it]
                                                           
{'loss': '0.1671', 'grad_norm': '1.856', 'learning_rate': '1.846e-05', 'epoch': '0.2039'}

 20%|██        | 7740/37963 [33:10:25<145:22:04, 17.32s/it]
 20%|██        | 7741/37963 [33:10:39<136:55:19, 16.31s/it]
 20%|██        | 7742/37963 [33:10:54<132:06:55, 15.74s/it]
 20%|██        | 7743/37963 [33:11:08<127:52:03, 15.23s/it]
 20%|██        | 7744/37963 [33:11:22<124:36:58, 14.85s/it]
 20%|██        | 7745/37963 [33:11:35<121:57:46, 14.53s/it]
 20%|██        | 7746/37963 [33:11:50<121:41:52, 14.50s/it]
 20%|██        | 7747/37963 [33:12:04<120:28:09, 14.35s/it]
 20%|██        | 7748/37963 [33:12:18<120:27:30, 14.35s/it]
 20%|██        | 7749/37963 [33:12:32<120:13:05, 14.32s/it]
 20%|██        | 7750/37963 [33:12:47<120:26:18, 14.35s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '3.18', 'learning_rate': '1.845e-05', 'epoch': '0.2041'}

 20%|██        | 7750/37963 [33:12:47<120:26:18, 14.35s/it]
 20%|██        | 7751/37963 [33:13:09<139:03:25, 16.57s/it]
 20%|██        | 7752/37963 [33:13:22<132:04:45, 15.74s/it]
 20%|██        | 7753/37963 [33:13:37<128:54:15, 15.36s/it]
 20%|██        | 7754/37963 [33:13:51<125:58:35, 15.01s/it]
 20%|██        | 7755/37963 [33:14:05<123:24:32, 14.71s/it]
 20%|██        | 7756/37963 [33:14:19<121:43:55, 14.51s/it]
 20%|██        | 7757/37963 [33:14:33<121:25:42, 14.47s/it]
 20%|██        | 7758/37963 [33:14:48<121:14:16, 14.45s/it]
 20%|██        | 7759/37963 [33:15:02<120:50:34, 14.40s/it]
 20%|██        | 7760/37963 [33:15:16<120:38:03, 14.38s/it]
                                                           
{'loss': '0.1705', 'grad_norm': '2.193', 'learning_rate': '1.845e-05', 'epoch': '0.2044'}

 20%|██        | 7760/37963 [33:15:16<120:38:03, 14.38s/it]
 20%|██        | 7761/37963 [33:15:31<120:24:35, 14.35s/it]
 20%|██        | 7762/37963 [33:15:45<120:27:18, 14.36s/it]
 20%|██        | 7763/37963 [33:15:59<120:33:29, 14.37s/it]
 20%|██        | 7764/37963 [33:16:13<119:34:40, 14.25s/it]
 20%|██        | 7765/37963 [33:16:28<119:56:47, 14.30s/it]
 20%|██        | 7766/37963 [33:16:42<120:06:04, 14.32s/it]
 20%|██        | 7767/37963 [33:16:57<120:00:42, 14.31s/it]
 20%|██        | 7768/37963 [33:17:10<118:45:12, 14.16s/it]
 20%|██        | 7769/37963 [33:17:25<119:14:20, 14.22s/it]
 20%|██        | 7770/37963 [33:17:39<119:08:30, 14.21s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '2.495', 'learning_rate': '1.844e-05', 'epoch': '0.2047'}

 20%|██        | 7770/37963 [33:17:39<119:08:30, 14.21s/it]
 20%|██        | 7771/37963 [33:18:00<135:49:27, 16.20s/it]
 20%|██        | 7772/37963 [33:18:14<130:15:05, 15.53s/it]
 20%|██        | 7773/37963 [33:18:34<143:20:18, 17.09s/it]
 20%|██        | 7774/37963 [33:18:49<136:31:40, 16.28s/it]
 20%|██        | 7775/37963 [33:19:03<131:47:18, 15.72s/it]
 20%|██        | 7776/37963 [33:19:24<143:53:08, 17.16s/it]
 20%|██        | 7777/37963 [33:19:38<136:55:57, 16.33s/it]
 20%|██        | 7778/37963 [33:19:52<131:49:01, 15.72s/it]
 20%|██        | 7779/37963 [33:20:13<144:07:18, 17.19s/it]
 20%|██        | 7780/37963 [33:20:27<137:13:43, 16.37s/it]
                                                           
{'loss': '0.1658', 'grad_norm': '1.478', 'learning_rate': '1.844e-05', 'epoch': '0.2049'}

 20%|██        | 7780/37963 [33:20:28<137:13:43, 16.37s/it]
 20%|██        | 7781/37963 [33:20:42<132:08:53, 15.76s/it]
 20%|██        | 7782/37963 [33:20:56<128:29:54, 15.33s/it]
 21%|██        | 7783/37963 [33:21:11<126:03:12, 15.04s/it]
 21%|██        | 7784/37963 [33:21:31<140:27:14, 16.75s/it]
 21%|██        | 7785/37963 [33:21:45<133:42:39, 15.95s/it]
 21%|██        | 7786/37963 [33:22:00<130:01:30, 15.51s/it]
 21%|██        | 7787/37963 [33:22:21<144:34:17, 17.25s/it]
 21%|██        | 7788/37963 [33:22:35<135:46:08, 16.20s/it]
 21%|██        | 7789/37963 [33:22:49<130:56:25, 15.62s/it]
 21%|██        | 7790/37963 [33:23:03<126:46:18, 15.13s/it]
                                                           
{'loss': '0.1651', 'grad_norm': '1.889', 'learning_rate': '1.843e-05', 'epoch': '0.2052'}

 21%|██        | 7790/37963 [33:23:03<126:46:18, 15.13s/it]
 21%|██        | 7791/37963 [33:23:17<124:31:10, 14.86s/it]
 21%|██        | 7792/37963 [33:23:32<122:43:05, 14.64s/it]
 21%|██        | 7793/37963 [33:23:46<121:59:28, 14.56s/it]
 21%|██        | 7794/37963 [33:24:00<121:22:07, 14.48s/it]
 21%|██        | 7795/37963 [33:24:14<120:57:56, 14.44s/it]
 21%|██        | 7796/37963 [33:24:29<119:55:02, 14.31s/it]
 21%|██        | 7797/37963 [33:24:43<120:17:39, 14.36s/it]
 21%|██        | 7798/37963 [33:24:57<120:21:04, 14.36s/it]
 21%|██        | 7799/37963 [33:25:18<137:04:58, 16.36s/it]
 21%|██        | 7800/37963 [33:25:33<131:56:50, 15.75s/it]
                                                           
{'loss': '0.1657', 'grad_norm': '4.895', 'learning_rate': '1.843e-05', 'epoch': '0.2055'}

 21%|██        | 7800/37963 [33:25:33<131:56:50, 15.75s/it]
 21%|██        | 7801/37963 [33:25:47<128:16:26, 15.31s/it]
 21%|██        | 7802/37963 [33:26:01<126:04:58, 15.05s/it]
 21%|██        | 7803/37963 [33:26:16<124:26:49, 14.85s/it]
 21%|██        | 7804/37963 [33:26:30<123:12:24, 14.71s/it]
 21%|██        | 7805/37963 [33:26:45<122:25:19, 14.61s/it]
 21%|██        | 7806/37963 [33:26:58<120:14:10, 14.35s/it]
 21%|██        | 7807/37963 [33:27:13<120:04:07, 14.33s/it]
 21%|██        | 7808/37963 [33:27:27<119:58:16, 14.32s/it]
 21%|██        | 7809/37963 [33:27:41<118:39:04, 14.17s/it]
 21%|██        | 7810/37963 [33:27:55<118:27:27, 14.14s/it]
                                                           
{'loss': '0.1639', 'grad_norm': '5.919', 'learning_rate': '1.842e-05', 'epoch': '0.2057'}

 21%|██        | 7810/37963 [33:27:55<118:27:27, 14.14s/it]
 21%|██        | 7811/37963 [33:28:09<119:09:56, 14.23s/it]
 21%|██        | 7812/37963 [33:28:24<119:47:18, 14.30s/it]
 21%|██        | 7813/37963 [33:28:38<120:12:46, 14.35s/it]
 21%|██        | 7814/37963 [33:28:53<120:21:49, 14.37s/it]
 21%|██        | 7815/37963 [33:29:06<118:57:12, 14.20s/it]
 21%|██        | 7816/37963 [33:29:21<119:10:49, 14.23s/it]
 21%|██        | 7817/37963 [33:29:35<118:16:22, 14.12s/it]
 21%|██        | 7818/37963 [33:29:49<118:52:32, 14.20s/it]
 21%|██        | 7819/37963 [33:30:03<119:15:45, 14.24s/it]
 21%|██        | 7820/37963 [33:30:24<134:14:02, 16.03s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '4.011', 'learning_rate': '1.842e-05', 'epoch': '0.206'}

 21%|██        | 7820/37963 [33:30:24<134:14:02, 16.03s/it]
 21%|██        | 7821/37963 [33:30:38<130:11:25, 15.55s/it]
 21%|██        | 7822/37963 [33:30:59<143:39:06, 17.16s/it]
 21%|██        | 7823/37963 [33:31:13<136:48:06, 16.34s/it]
 21%|██        | 7824/37963 [33:31:28<132:02:17, 15.77s/it]
 21%|██        | 7825/37963 [33:31:49<144:48:11, 17.30s/it]
 21%|██        | 7826/37963 [33:32:03<137:28:15, 16.42s/it]
 21%|██        | 7827/37963 [33:32:17<131:45:24, 15.74s/it]
 21%|██        | 7828/37963 [33:32:31<127:30:18, 15.23s/it]
 21%|██        | 7829/37963 [33:32:45<125:15:15, 14.96s/it]
 21%|██        | 7830/37963 [33:33:00<123:34:48, 14.76s/it]
                                                           
{'loss': '0.1684', 'grad_norm': '1.471', 'learning_rate': '1.841e-05', 'epoch': '0.2063'}

 21%|██        | 7830/37963 [33:33:00<123:34:48, 14.76s/it]
 21%|██        | 7831/37963 [33:33:20<137:20:05, 16.41s/it]
 21%|██        | 7832/37963 [33:33:35<132:30:05, 15.83s/it]
 21%|██        | 7833/37963 [33:33:55<144:47:16, 17.30s/it]
 21%|██        | 7834/37963 [33:34:09<136:52:42, 16.36s/it]
 21%|██        | 7835/37963 [33:34:24<131:48:15, 15.75s/it]
 21%|██        | 7836/37963 [33:34:38<128:06:56, 15.31s/it]
 21%|██        | 7837/37963 [33:34:52<125:34:49, 15.01s/it]
 21%|██        | 7838/37963 [33:35:20<158:22:00, 18.93s/it]
 21%|██        | 7839/37963 [33:35:35<146:55:50, 17.56s/it]
 21%|██        | 7840/37963 [33:35:49<138:51:31, 16.60s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '5.159', 'learning_rate': '1.841e-05', 'epoch': '0.2065'}

 21%|██        | 7840/37963 [33:35:49<138:51:31, 16.60s/it]
 21%|██        | 7841/37963 [33:36:03<133:07:41, 15.91s/it]
 21%|██        | 7842/37963 [33:36:18<129:15:17, 15.45s/it]
 21%|██        | 7843/37963 [33:36:32<126:38:37, 15.14s/it]
 21%|██        | 7844/37963 [33:36:47<124:49:23, 14.92s/it]
 21%|██        | 7845/37963 [33:37:01<123:23:07, 14.75s/it]
 21%|██        | 7846/37963 [33:37:15<122:30:16, 14.64s/it]
 21%|██        | 7847/37963 [33:37:30<122:13:27, 14.61s/it]
 21%|██        | 7848/37963 [33:37:51<138:46:30, 16.59s/it]
 21%|██        | 7849/37963 [33:38:05<131:54:00, 15.77s/it]
 21%|██        | 7850/37963 [33:38:19<127:25:13, 15.23s/it]
                                                           
{'loss': '0.162', 'grad_norm': '1.372', 'learning_rate': '1.841e-05', 'epoch': '0.2068'}

 21%|██        | 7850/37963 [33:38:19<127:25:13, 15.23s/it]
 21%|██        | 7851/37963 [33:38:33<125:13:06, 14.97s/it]
 21%|██        | 7852/37963 [33:38:48<123:22:52, 14.75s/it]
 21%|██        | 7853/37963 [33:39:02<122:33:38, 14.65s/it]
 21%|██        | 7854/37963 [33:39:16<121:49:11, 14.57s/it]
 21%|██        | 7855/37963 [33:39:30<120:29:59, 14.41s/it]
 21%|██        | 7856/37963 [33:39:45<120:41:01, 14.43s/it]
 21%|██        | 7857/37963 [33:39:59<120:16:32, 14.38s/it]
 21%|██        | 7858/37963 [33:40:13<120:13:52, 14.38s/it]
 21%|██        | 7859/37963 [33:40:28<120:34:41, 14.42s/it]
 21%|██        | 7860/37963 [33:40:43<121:15:50, 14.50s/it]
                                                           
{'loss': '0.1721', 'grad_norm': '1.59', 'learning_rate': '1.84e-05', 'epoch': '0.207'}

 21%|██        | 7860/37963 [33:40:43<121:15:50, 14.50s/it]
 21%|██        | 7861/37963 [33:40:57<121:05:17, 14.48s/it]
 21%|██        | 7862/37963 [33:41:11<120:07:36, 14.37s/it]
 21%|██        | 7863/37963 [33:41:26<120:18:16, 14.39s/it]
 21%|██        | 7864/37963 [33:41:40<120:10:02, 14.37s/it]
 21%|██        | 7865/37963 [33:41:54<120:05:02, 14.36s/it]
 21%|██        | 7866/37963 [33:42:08<118:53:22, 14.22s/it]
 21%|██        | 7867/37963 [33:42:22<117:59:31, 14.11s/it]
 21%|██        | 7868/37963 [33:42:36<118:34:57, 14.19s/it]
 21%|██        | 7869/37963 [33:42:57<135:29:09, 16.21s/it]
 21%|██        | 7870/37963 [33:43:17<145:01:40, 17.35s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '3.744', 'learning_rate': '1.84e-05', 'epoch': '0.2073'}

 21%|██        | 7870/37963 [33:43:17<145:01:40, 17.35s/it]
 21%|██        | 7871/37963 [33:43:32<137:31:44, 16.45s/it]
 21%|██        | 7872/37963 [33:43:46<132:38:50, 15.87s/it]
 21%|██        | 7873/37963 [33:44:01<129:03:47, 15.44s/it]
 21%|██        | 7874/37963 [33:44:15<126:04:02, 15.08s/it]
 21%|██        | 7875/37963 [33:44:36<140:32:24, 16.82s/it]
 21%|██        | 7876/37963 [33:44:50<134:27:13, 16.09s/it]
 21%|██        | 7877/37963 [33:45:04<129:14:18, 15.46s/it]
 21%|██        | 7878/37963 [33:45:19<126:28:10, 15.13s/it]
 21%|██        | 7879/37963 [33:45:33<124:35:41, 14.91s/it]
 21%|██        | 7880/37963 [33:45:47<123:19:17, 14.76s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '3.052', 'learning_rate': '1.839e-05', 'epoch': '0.2076'}

 21%|██        | 7880/37963 [33:45:47<123:19:17, 14.76s/it]
 21%|██        | 7881/37963 [33:46:14<153:41:07, 18.39s/it]
 21%|██        | 7882/37963 [33:46:29<143:32:30, 17.18s/it]
 21%|██        | 7883/37963 [33:46:43<136:45:17, 16.37s/it]
 21%|██        | 7884/37963 [33:46:57<131:05:36, 15.69s/it]
 21%|██        | 7885/37963 [33:47:12<127:58:14, 15.32s/it]
 21%|██        | 7886/37963 [33:47:33<142:49:18, 17.09s/it]
 21%|██        | 7887/37963 [33:47:54<152:02:25, 18.20s/it]
 21%|██        | 7888/37963 [33:48:08<142:27:36, 17.05s/it]
 21%|██        | 7889/37963 [33:48:22<133:41:01, 16.00s/it]
 21%|██        | 7890/37963 [33:48:36<129:30:42, 15.50s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '1.998', 'learning_rate': '1.839e-05', 'epoch': '0.2078'}

 21%|██        | 7890/37963 [33:48:36<129:30:42, 15.50s/it]
 21%|██        | 7891/37963 [33:48:50<126:30:27, 15.14s/it]
 21%|██        | 7892/37963 [33:49:04<122:59:27, 14.72s/it]
 21%|██        | 7893/37963 [33:49:17<119:56:27, 14.36s/it]
 21%|██        | 7894/37963 [33:49:32<120:14:57, 14.40s/it]
 21%|██        | 7895/37963 [33:49:46<120:20:00, 14.41s/it]
 21%|██        | 7896/37963 [33:50:07<136:54:15, 16.39s/it]
 21%|██        | 7897/37963 [33:50:22<131:23:17, 15.73s/it]
 21%|██        | 7898/37963 [33:50:35<126:28:19, 15.14s/it]
 21%|██        | 7899/37963 [33:50:50<125:14:09, 15.00s/it]
 21%|██        | 7900/37963 [33:51:04<124:00:27, 14.85s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '5.796', 'learning_rate': '1.838e-05', 'epoch': '0.2081'}

 21%|██        | 7900/37963 [33:51:04<124:00:27, 14.85s/it]
 21%|██        | 7901/37963 [33:51:18<121:28:19, 14.55s/it]
 21%|██        | 7902/37963 [33:51:33<120:32:45, 14.44s/it]
 21%|██        | 7903/37963 [33:51:47<120:25:38, 14.42s/it]
 21%|██        | 7904/37963 [33:52:01<120:11:47, 14.40s/it]
 21%|██        | 7905/37963 [33:52:16<120:21:36, 14.42s/it]
 21%|██        | 7906/37963 [33:52:30<120:18:58, 14.41s/it]
 21%|██        | 7907/37963 [33:52:44<118:49:48, 14.23s/it]
 21%|██        | 7908/37963 [33:52:58<119:01:19, 14.26s/it]
 21%|██        | 7909/37963 [33:53:13<119:09:13, 14.27s/it]
 21%|██        | 7910/37963 [33:53:26<117:38:09, 14.09s/it]
                                                           
{'loss': '0.16', 'grad_norm': '2.327', 'learning_rate': '1.838e-05', 'epoch': '0.2084'}

 21%|██        | 7910/37963 [33:53:26<117:38:09, 14.09s/it]
 21%|██        | 7911/37963 [33:53:41<118:11:02, 14.16s/it]
 21%|██        | 7912/37963 [33:53:55<118:40:45, 14.22s/it]
 21%|██        | 7913/37963 [33:54:09<118:53:01, 14.24s/it]
 21%|██        | 7914/37963 [33:54:23<118:54:03, 14.24s/it]
 21%|██        | 7915/37963 [33:54:44<135:26:44, 16.23s/it]
 21%|██        | 7916/37963 [33:55:05<147:00:29, 17.61s/it]
 21%|██        | 7917/37963 [33:55:19<138:15:39, 16.57s/it]
 21%|██        | 7918/37963 [33:55:33<131:04:34, 15.71s/it]
 21%|██        | 7919/37963 [33:55:47<127:46:28, 15.31s/it]
 21%|██        | 7920/37963 [33:56:02<125:20:09, 15.02s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '6.149', 'learning_rate': '1.837e-05', 'epoch': '0.2086'}

 21%|██        | 7920/37963 [33:56:02<125:20:09, 15.02s/it]
 21%|██        | 7921/37963 [33:56:16<124:12:31, 14.88s/it]
 21%|██        | 7922/37963 [33:56:30<122:02:28, 14.62s/it]
 21%|██        | 7923/37963 [33:56:44<120:42:49, 14.47s/it]
 21%|██        | 7924/37963 [33:57:05<137:17:33, 16.45s/it]
 21%|██        | 7925/37963 [33:57:20<132:11:25, 15.84s/it]
 21%|██        | 7926/37963 [33:57:34<128:36:54, 15.41s/it]
 21%|██        | 7927/37963 [33:57:49<125:45:57, 15.07s/it]
 21%|██        | 7928/37963 [33:58:02<122:39:36, 14.70s/it]
 21%|██        | 7929/37963 [33:58:17<121:49:06, 14.60s/it]
 21%|██        | 7930/37963 [33:58:38<137:19:36, 16.46s/it]
                                                           
{'loss': '0.1582', 'grad_norm': '4.489', 'learning_rate': '1.837e-05', 'epoch': '0.2089'}

 21%|██        | 7930/37963 [33:58:38<137:19:36, 16.46s/it]
 21%|██        | 7931/37963 [33:58:52<132:09:05, 15.84s/it]
 21%|██        | 7932/37963 [33:59:12<143:47:24, 17.24s/it]
 21%|██        | 7933/37963 [33:59:27<135:55:33, 16.29s/it]
 21%|██        | 7934/37963 [33:59:41<131:11:21, 15.73s/it]
 21%|██        | 7935/37963 [34:00:09<161:46:16, 19.39s/it]
 21%|██        | 7936/37963 [34:00:23<149:21:08, 17.91s/it]
 21%|██        | 7937/37963 [34:00:38<140:21:12, 16.83s/it]
 21%|██        | 7938/37963 [34:00:52<133:26:10, 16.00s/it]
 21%|██        | 7939/37963 [34:01:06<128:07:04, 15.36s/it]
 21%|██        | 7940/37963 [34:01:20<125:48:41, 15.09s/it]
                                                           
{'loss': '0.1672', 'grad_norm': '1.725', 'learning_rate': '1.836e-05', 'epoch': '0.2092'}

 21%|██        | 7940/37963 [34:01:20<125:48:41, 15.09s/it]
 21%|██        | 7941/37963 [34:01:34<124:05:16, 14.88s/it]
 21%|██        | 7942/37963 [34:01:48<121:52:08, 14.61s/it]
 21%|██        | 7943/37963 [34:02:03<121:24:41, 14.56s/it]
 21%|██        | 7944/37963 [34:02:17<120:52:46, 14.50s/it]
 21%|██        | 7945/37963 [34:02:31<119:41:34, 14.35s/it]
 21%|██        | 7946/37963 [34:02:46<119:38:50, 14.35s/it]
 21%|██        | 7947/37963 [34:03:07<136:10:24, 16.33s/it]
 21%|██        | 7948/37963 [34:03:21<131:16:00, 15.74s/it]
 21%|██        | 7949/37963 [34:03:35<127:52:29, 15.34s/it]
 21%|██        | 7950/37963 [34:03:50<125:13:46, 15.02s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '6.693', 'learning_rate': '1.836e-05', 'epoch': '0.2094'}

 21%|██        | 7950/37963 [34:03:50<125:13:46, 15.02s/it]
 21%|██        | 7951/37963 [34:04:04<123:34:48, 14.82s/it]
 21%|██        | 7952/37963 [34:04:18<122:23:05, 14.68s/it]
 21%|██        | 7953/37963 [34:04:32<121:07:05, 14.53s/it]
 21%|██        | 7954/37963 [34:04:46<119:27:14, 14.33s/it]
 21%|██        | 7955/37963 [34:05:01<119:38:11, 14.35s/it]
 21%|██        | 7956/37963 [34:05:15<119:45:56, 14.37s/it]
 21%|██        | 7957/37963 [34:05:29<118:26:21, 14.21s/it]
 21%|██        | 7958/37963 [34:05:43<117:49:06, 14.14s/it]
 21%|██        | 7959/37963 [34:05:57<118:18:24, 14.19s/it]
 21%|██        | 7960/37963 [34:06:12<118:42:53, 14.24s/it]
                                                           
{'loss': '0.1633', 'grad_norm': '0.9763', 'learning_rate': '1.835e-05', 'epoch': '0.2097'}

 21%|██        | 7960/37963 [34:06:12<118:42:53, 14.24s/it]
 21%|██        | 7961/37963 [34:06:26<119:19:06, 14.32s/it]
 21%|██        | 7962/37963 [34:06:41<119:41:24, 14.36s/it]
 21%|██        | 7963/37963 [34:06:54<117:37:11, 14.11s/it]
 21%|██        | 7964/37963 [34:07:08<117:49:44, 14.14s/it]
 21%|██        | 7965/37963 [34:07:22<117:45:18, 14.13s/it]
 21%|██        | 7966/37963 [34:07:50<150:37:46, 18.08s/it]
 21%|██        | 7967/37963 [34:08:04<140:53:40, 16.91s/it]
 21%|██        | 7968/37963 [34:08:18<134:53:36, 16.19s/it]
 21%|██        | 7969/37963 [34:08:32<129:11:25, 15.51s/it]
 21%|██        | 7970/37963 [34:08:47<126:42:29, 15.21s/it]
                                                           
{'loss': '0.154', 'grad_norm': '3.516', 'learning_rate': '1.835e-05', 'epoch': '0.2099'}

 21%|██        | 7970/37963 [34:08:47<126:42:29, 15.21s/it]
 21%|██        | 7971/37963 [34:09:01<122:59:14, 14.76s/it]
 21%|██        | 7972/37963 [34:09:15<121:36:59, 14.60s/it]
 21%|██        | 7973/37963 [34:09:29<120:36:35, 14.48s/it]
 21%|██        | 7974/37963 [34:09:50<137:08:06, 16.46s/it]
 21%|██        | 7975/37963 [34:10:04<131:56:47, 15.84s/it]
 21%|██        | 7976/37963 [34:10:19<128:43:01, 15.45s/it]
 21%|██        | 7977/37963 [34:10:33<125:56:44, 15.12s/it]
 21%|██        | 7978/37963 [34:10:48<123:51:06, 14.87s/it]
 21%|██        | 7979/37963 [34:11:08<138:36:58, 16.64s/it]
 21%|██        | 7980/37963 [34:11:22<131:24:45, 15.78s/it]
                                                           
{'loss': '0.1624', 'grad_norm': '2.536', 'learning_rate': '1.835e-05', 'epoch': '0.2102'}

 21%|██        | 7980/37963 [34:11:22<131:24:45, 15.78s/it]
 21%|██        | 7981/37963 [34:11:37<128:26:37, 15.42s/it]
 21%|██        | 7982/37963 [34:11:58<141:53:21, 17.04s/it]
 21%|██        | 7983/37963 [34:12:12<135:17:23, 16.25s/it]
 21%|██        | 7984/37963 [34:12:33<148:27:01, 17.83s/it]
 21%|██        | 7985/37963 [34:12:55<158:48:44, 19.07s/it]
 21%|██        | 7986/37963 [34:13:10<146:46:03, 17.63s/it]
 21%|██        | 7987/37963 [34:13:24<138:59:21, 16.69s/it]
 21%|██        | 7988/37963 [34:13:38<132:16:29, 15.89s/it]
 21%|██        | 7989/37963 [34:13:53<128:40:35, 15.45s/it]
 21%|██        | 7990/37963 [34:14:07<126:02:47, 15.14s/it]
                                                           
{'loss': '0.1631', 'grad_norm': '3.996', 'learning_rate': '1.834e-05', 'epoch': '0.2105'}

 21%|██        | 7990/37963 [34:14:07<126:02:47, 15.14s/it]
 21%|██        | 7991/37963 [34:14:21<124:14:05, 14.92s/it]
 21%|██        | 7992/37963 [34:14:35<121:48:53, 14.63s/it]
 21%|██        | 7993/37963 [34:14:50<121:12:46, 14.56s/it]
 21%|██        | 7994/37963 [34:15:04<120:39:26, 14.49s/it]
 21%|██        | 7995/37963 [34:15:18<119:50:14, 14.40s/it]
 21%|██        | 7996/37963 [34:15:38<134:02:27, 16.10s/it]
 21%|██        | 7997/37963 [34:15:52<128:32:28, 15.44s/it]
 21%|██        | 7998/37963 [34:16:07<125:52:26, 15.12s/it]
 21%|██        | 7999/37963 [34:16:21<123:56:01, 14.89s/it]
 21%|██        | 8000/37963 [34:16:35<122:20:37, 14.70s/it]
                                                           
{'loss': '0.1705', 'grad_norm': '4.428', 'learning_rate': '1.834e-05', 'epoch': '0.2107'}

 21%|██        | 8000/37963 [34:16:35<122:20:37, 14.70s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.09s/it]
Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.09s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 21%|██        | 8001/37963 [34:18:22<351:10:45, 42.19s/it]
 21%|██        | 8002/37963 [34:18:35<280:06:50, 33.66s/it]
 21%|██        | 8003/37963 [34:18:49<230:32:28, 27.70s/it]
 21%|██        | 8004/37963 [34:19:03<195:29:52, 23.49s/it]
 21%|██        | 8005/37963 [34:19:17<172:42:19, 20.75s/it]
 21%|██        | 8006/37963 [34:19:32<156:46:27, 18.84s/it]
 21%|██        | 8007/37963 [34:19:46<145:50:46, 17.53s/it]
 21%|██        | 8008/37963 [34:20:00<137:05:34, 16.48s/it]
 21%|██        | 8009/37963 [34:20:14<131:46:40, 15.84s/it]
 21%|██        | 8010/37963 [34:20:29<127:33:11, 15.33s/it]
                                                           
{'loss': '0.1645', 'grad_norm': '1.071', 'learning_rate': '1.833e-05', 'epoch': '0.211'}

 21%|██        | 8010/37963 [34:20:29<127:33:11, 15.33s/it]
 21%|██        | 8011/37963 [34:20:43<125:07:48, 15.04s/it]
 21%|██        | 8012/37963 [34:20:57<122:34:45, 14.73s/it]
 21%|██        | 8013/37963 [34:21:17<135:54:06, 16.34s/it]
 21%|██        | 8014/37963 [34:21:31<130:35:35, 15.70s/it]
 21%|██        | 8015/37963 [34:21:52<143:08:44, 17.21s/it]
 21%|██        | 8016/37963 [34:22:06<136:11:52, 16.37s/it]
 21%|██        | 8017/37963 [34:22:21<131:21:13, 15.79s/it]
 21%|██        | 8018/37963 [34:22:35<127:27:40, 15.32s/it]
 21%|██        | 8019/37963 [34:22:49<123:51:32, 14.89s/it]
 21%|██        | 8020/37963 [34:23:03<122:29:03, 14.73s/it]
                                                           
{'loss': '0.1665', 'grad_norm': '3.854', 'learning_rate': '1.833e-05', 'epoch': '0.2113'}

 21%|██        | 8020/37963 [34:23:03<122:29:03, 14.73s/it]
 21%|██        | 8021/37963 [34:23:18<121:41:25, 14.63s/it]
 21%|██        | 8022/37963 [34:23:32<121:02:10, 14.55s/it]
 21%|██        | 8023/37963 [34:23:53<136:34:30, 16.42s/it]
 21%|██        | 8024/37963 [34:24:07<131:36:31, 15.83s/it]
 21%|██        | 8025/37963 [34:24:22<128:29:36, 15.45s/it]
 21%|██        | 8026/37963 [34:24:36<125:36:09, 15.10s/it]
 21%|██        | 8027/37963 [34:24:51<123:45:09, 14.88s/it]
 21%|██        | 8028/37963 [34:25:05<122:32:21, 14.74s/it]
 21%|██        | 8029/37963 [34:25:25<136:30:48, 16.42s/it]
 21%|██        | 8030/37963 [34:25:46<148:24:44, 17.85s/it]
                                                           
{'loss': '0.1777', 'grad_norm': '2.498', 'learning_rate': '1.832e-05', 'epoch': '0.2115'}

 21%|██        | 8030/37963 [34:25:46<148:24:44, 17.85s/it]
 21%|██        | 8031/37963 [34:26:01<139:49:15, 16.82s/it]
 21%|██        | 8032/37963 [34:26:29<168:29:14, 20.27s/it]
 21%|██        | 8033/37963 [34:26:43<152:55:30, 18.39s/it]
 21%|██        | 8034/37963 [34:26:58<142:48:34, 17.18s/it]
 21%|██        | 8035/37963 [34:27:12<136:01:10, 16.36s/it]
 21%|██        | 8036/37963 [34:27:27<131:28:07, 15.81s/it]
 21%|██        | 8037/37963 [34:27:41<127:35:42, 15.35s/it]
 21%|██        | 8038/37963 [34:27:55<124:54:52, 15.03s/it]
 21%|██        | 8039/37963 [34:28:09<121:23:21, 14.60s/it]
 21%|██        | 8040/37963 [34:28:23<120:49:54, 14.54s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '3.833', 'learning_rate': '1.832e-05', 'epoch': '0.2118'}

 21%|██        | 8040/37963 [34:28:23<120:49:54, 14.54s/it]
 21%|██        | 8041/37963 [34:28:37<120:22:02, 14.48s/it]
 21%|██        | 8042/37963 [34:28:52<120:12:02, 14.46s/it]
 21%|██        | 8043/37963 [34:29:06<119:09:03, 14.34s/it]
 21%|██        | 8044/37963 [34:29:27<135:40:28, 16.33s/it]
 21%|██        | 8045/37963 [34:29:41<130:03:13, 15.65s/it]
 21%|██        | 8046/37963 [34:29:55<126:44:41, 15.25s/it]
 21%|██        | 8047/37963 [34:30:09<123:55:32, 14.91s/it]
 21%|██        | 8048/37963 [34:30:24<122:30:54, 14.74s/it]
 21%|██        | 8049/37963 [34:30:38<121:30:41, 14.62s/it]
 21%|██        | 8050/37963 [34:30:53<122:01:55, 14.69s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '2.207', 'learning_rate': '1.831e-05', 'epoch': '0.212'}

 21%|██        | 8050/37963 [34:30:53<122:01:55, 14.69s/it]
 21%|██        | 8051/37963 [34:31:07<121:18:06, 14.60s/it]
 21%|██        | 8052/37963 [34:31:21<119:55:01, 14.43s/it]
 21%|██        | 8053/37963 [34:31:36<119:32:07, 14.39s/it]
 21%|██        | 8054/37963 [34:31:49<118:02:29, 14.21s/it]
 21%|██        | 8055/37963 [34:32:03<116:57:12, 14.08s/it]
 21%|██        | 8056/37963 [34:32:17<116:47:33, 14.06s/it]
 21%|██        | 8057/37963 [34:32:32<117:53:17, 14.19s/it]
 21%|██        | 8058/37963 [34:32:46<118:23:41, 14.25s/it]
 21%|██        | 8059/37963 [34:33:00<118:45:30, 14.30s/it]
 21%|██        | 8060/37963 [34:33:15<118:08:27, 14.22s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '2.026', 'learning_rate': '1.831e-05', 'epoch': '0.2123'}

 21%|██        | 8060/37963 [34:33:15<118:08:27, 14.22s/it]
 21%|██        | 8061/37963 [34:33:35<132:36:42, 15.97s/it]
 21%|██        | 8062/37963 [34:33:49<127:33:20, 15.36s/it]
 21%|██        | 8063/37963 [34:34:02<123:30:28, 14.87s/it]
 21%|██        | 8064/37963 [34:34:23<137:40:29, 16.58s/it]
 21%|██        | 8065/37963 [34:34:37<132:01:53, 15.90s/it]
 21%|██        | 8066/37963 [34:34:51<128:12:34, 15.44s/it]
 21%|██        | 8067/37963 [34:35:06<125:33:35, 15.12s/it]
 21%|██▏       | 8068/37963 [34:35:20<123:36:11, 14.88s/it]
 21%|██▏       | 8069/37963 [34:35:34<121:31:08, 14.63s/it]
 21%|██▏       | 8070/37963 [34:35:48<119:06:16, 14.34s/it]
                                                           
{'loss': '0.1414', 'grad_norm': '1.379', 'learning_rate': '1.83e-05', 'epoch': '0.2126'}

 21%|██▏       | 8070/37963 [34:35:48<119:06:16, 14.34s/it]
 21%|██▏       | 8071/37963 [34:36:08<134:07:18, 16.15s/it]
 21%|██▏       | 8072/37963 [34:36:23<129:49:50, 15.64s/it]
 21%|██▏       | 8073/37963 [34:36:37<126:50:12, 15.28s/it]
 21%|██▏       | 8074/37963 [34:36:52<124:36:25, 15.01s/it]
 21%|██▏       | 8075/37963 [34:37:06<123:13:47, 14.84s/it]
 21%|██▏       | 8076/37963 [34:37:33<152:23:03, 18.36s/it]
 21%|██▏       | 8077/37963 [34:37:47<142:31:09, 17.17s/it]
 21%|██▏       | 8078/37963 [34:38:01<134:34:34, 16.21s/it]
 21%|██▏       | 8079/37963 [34:38:15<129:42:28, 15.63s/it]
 21%|██▏       | 8080/37963 [34:38:44<161:35:38, 19.47s/it]
                                                           
{'loss': '0.1699', 'grad_norm': '1.918', 'learning_rate': '1.83e-05', 'epoch': '0.2128'}

 21%|██▏       | 8080/37963 [34:38:44<161:35:38, 19.47s/it]
 21%|██▏       | 8081/37963 [34:38:58<148:57:34, 17.95s/it]
 21%|██▏       | 8082/37963 [34:39:12<140:07:57, 16.88s/it]
 21%|██▏       | 8083/37963 [34:39:27<133:35:15, 16.09s/it]
 21%|██▏       | 8084/37963 [34:39:41<129:10:42, 15.56s/it]
 21%|██▏       | 8085/37963 [34:39:55<125:44:15, 15.15s/it]
 21%|██▏       | 8086/37963 [34:40:09<122:44:20, 14.79s/it]
 21%|██▏       | 8087/37963 [34:40:24<121:43:02, 14.67s/it]
 21%|██▏       | 8088/37963 [34:40:38<121:07:47, 14.60s/it]
 21%|██▏       | 8089/37963 [34:40:52<120:25:33, 14.51s/it]
 21%|██▏       | 8090/37963 [34:41:07<120:04:28, 14.47s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '1.574', 'learning_rate': '1.829e-05', 'epoch': '0.2131'}

 21%|██▏       | 8090/37963 [34:41:07<120:04:28, 14.47s/it]
 21%|██▏       | 8091/37963 [34:41:21<119:58:30, 14.46s/it]
 21%|██▏       | 8092/37963 [34:41:35<119:26:39, 14.40s/it]
 21%|██▏       | 8093/37963 [34:41:50<119:18:27, 14.38s/it]
 21%|██▏       | 8094/37963 [34:42:04<119:03:19, 14.35s/it]
 21%|██▏       | 8095/37963 [34:42:18<118:02:31, 14.23s/it]
 21%|██▏       | 8096/37963 [34:42:39<135:57:05, 16.39s/it]
 21%|██▏       | 8097/37963 [34:42:53<130:21:35, 15.71s/it]
 21%|██▏       | 8098/37963 [34:43:08<126:38:22, 15.27s/it]
 21%|██▏       | 8099/37963 [34:43:22<124:23:55, 15.00s/it]
 21%|██▏       | 8100/37963 [34:43:36<121:41:00, 14.67s/it]
                                                           
{'loss': '0.1808', 'grad_norm': '1.815', 'learning_rate': '1.829e-05', 'epoch': '0.2134'}

 21%|██▏       | 8100/37963 [34:43:36<121:41:00, 14.67s/it]
 21%|██▏       | 8101/37963 [34:43:50<120:46:52, 14.56s/it]
 21%|██▏       | 8102/37963 [34:44:04<118:57:30, 14.34s/it]
 21%|██▏       | 8103/37963 [34:44:18<117:48:44, 14.20s/it]
 21%|██▏       | 8104/37963 [34:44:32<118:01:53, 14.23s/it]
 21%|██▏       | 8105/37963 [34:44:46<117:56:55, 14.22s/it]
 21%|██▏       | 8106/37963 [34:45:01<118:31:43, 14.29s/it]
 21%|██▏       | 8107/37963 [34:45:15<118:38:58, 14.31s/it]
 21%|██▏       | 8108/37963 [34:45:30<118:46:52, 14.32s/it]
 21%|██▏       | 8109/37963 [34:45:44<118:45:46, 14.32s/it]
 21%|██▏       | 8110/37963 [34:46:04<132:33:34, 15.99s/it]
                                                           
{'loss': '0.168', 'grad_norm': '3.149', 'learning_rate': '1.828e-05', 'epoch': '0.2136'}

 21%|██▏       | 8110/37963 [34:46:04<132:33:34, 15.99s/it]
 21%|██▏       | 8111/37963 [34:46:18<128:40:58, 15.52s/it]
 21%|██▏       | 8112/37963 [34:46:39<141:45:36, 17.10s/it]
 21%|██▏       | 8113/37963 [34:46:53<135:04:01, 16.29s/it]
 21%|██▏       | 8114/37963 [34:47:08<130:15:15, 15.71s/it]
 21%|██▏       | 8115/37963 [34:47:22<126:53:22, 15.30s/it]
 21%|██▏       | 8116/37963 [34:47:36<124:31:30, 15.02s/it]
 21%|██▏       | 8117/37963 [34:47:50<121:30:53, 14.66s/it]
 21%|██▏       | 8118/37963 [34:48:04<120:12:40, 14.50s/it]
 21%|██▏       | 8119/37963 [34:48:19<119:41:28, 14.44s/it]
 21%|██▏       | 8120/37963 [34:48:39<134:47:23, 16.26s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '0.9631', 'learning_rate': '1.828e-05', 'epoch': '0.2139'}

 21%|██▏       | 8120/37963 [34:48:39<134:47:23, 16.26s/it]
 21%|██▏       | 8121/37963 [34:48:54<129:54:09, 15.67s/it]
 21%|██▏       | 8122/37963 [34:49:07<125:22:20, 15.12s/it]
 21%|██▏       | 8123/37963 [34:49:21<121:13:06, 14.62s/it]
 21%|██▏       | 8124/37963 [34:49:35<120:25:56, 14.53s/it]
 21%|██▏       | 8125/37963 [34:49:56<135:16:09, 16.32s/it]
 21%|██▏       | 8126/37963 [34:50:10<130:30:10, 15.75s/it]
 21%|██▏       | 8127/37963 [34:50:31<143:20:42, 17.30s/it]
 21%|██▏       | 8128/37963 [34:50:59<170:48:45, 20.61s/it]
 21%|██▏       | 8129/37963 [34:51:14<155:19:02, 18.74s/it]
 21%|██▏       | 8130/37963 [34:51:28<144:10:43, 17.40s/it]
                                                           
{'loss': '0.1635', 'grad_norm': '0.7822', 'learning_rate': '1.827e-05', 'epoch': '0.2142'}

 21%|██▏       | 8130/37963 [34:51:28<144:10:43, 17.40s/it]
 21%|██▏       | 8131/37963 [34:51:42<136:36:21, 16.49s/it]
 21%|██▏       | 8132/37963 [34:51:57<131:00:25, 15.81s/it]
 21%|██▏       | 8133/37963 [34:52:11<127:10:36, 15.35s/it]
 21%|██▏       | 8134/37963 [34:52:24<122:39:55, 14.80s/it]
 21%|██▏       | 8135/37963 [34:52:38<119:54:26, 14.47s/it]
 21%|██▏       | 8136/37963 [34:52:52<119:34:56, 14.43s/it]
 21%|██▏       | 8137/37963 [34:53:07<119:20:21, 14.40s/it]
 21%|██▏       | 8138/37963 [34:53:21<119:22:31, 14.41s/it]
 21%|██▏       | 8139/37963 [34:53:36<119:17:11, 14.40s/it]
 21%|██▏       | 8140/37963 [34:53:50<119:13:17, 14.39s/it]
                                                           
{'loss': '0.1666', 'grad_norm': '3.424', 'learning_rate': '1.827e-05', 'epoch': '0.2144'}

 21%|██▏       | 8140/37963 [34:53:50<119:13:17, 14.39s/it]
 21%|██▏       | 8141/37963 [34:54:04<119:10:23, 14.39s/it]
 21%|██▏       | 8142/37963 [34:54:19<119:18:39, 14.40s/it]
 21%|██▏       | 8143/37963 [34:54:33<119:27:19, 14.42s/it]
 21%|██▏       | 8144/37963 [34:54:48<119:39:51, 14.45s/it]
 21%|██▏       | 8145/37963 [34:55:02<118:33:14, 14.31s/it]
 21%|██▏       | 8146/37963 [34:55:23<135:25:39, 16.35s/it]
 21%|██▏       | 8147/37963 [34:55:37<130:37:51, 15.77s/it]
 21%|██▏       | 8148/37963 [34:55:51<126:51:14, 15.32s/it]
 21%|██▏       | 8149/37963 [34:56:06<124:22:16, 15.02s/it]
 21%|██▏       | 8150/37963 [34:56:20<122:46:54, 14.83s/it]
                                                           
{'loss': '0.1639', 'grad_norm': '3.611', 'learning_rate': '1.826e-05', 'epoch': '0.2147'}

 21%|██▏       | 8150/37963 [34:56:20<122:46:54, 14.83s/it]
 21%|██▏       | 8151/37963 [34:56:34<121:27:32, 14.67s/it]
 21%|██▏       | 8152/37963 [34:56:49<120:38:30, 14.57s/it]
 21%|██▏       | 8153/37963 [34:57:03<119:22:00, 14.42s/it]
 21%|██▏       | 8154/37963 [34:57:17<117:40:25, 14.21s/it]
 21%|██▏       | 8155/37963 [34:57:30<116:26:56, 14.06s/it]
 21%|██▏       | 8156/37963 [34:57:45<117:08:59, 14.15s/it]
 21%|██▏       | 8157/37963 [34:57:59<117:44:13, 14.22s/it]
 21%|██▏       | 8158/37963 [34:58:20<133:58:02, 16.18s/it]
 21%|██▏       | 8159/37963 [34:58:34<129:36:11, 15.65s/it]
 21%|██▏       | 8160/37963 [34:58:49<126:27:46, 15.28s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '1.611', 'learning_rate': '1.826e-05', 'epoch': '0.2149'}

 21%|██▏       | 8160/37963 [34:58:49<126:27:46, 15.28s/it]
 21%|██▏       | 8161/37963 [34:59:02<122:11:28, 14.76s/it]
 21%|██▏       | 8162/37963 [34:59:23<136:47:20, 16.52s/it]
 22%|██▏       | 8163/37963 [34:59:37<131:32:02, 15.89s/it]
 22%|██▏       | 8164/37963 [34:59:52<127:33:12, 15.41s/it]
 22%|██▏       | 8165/37963 [35:00:06<124:51:14, 15.08s/it]
 22%|██▏       | 8166/37963 [35:00:20<123:00:24, 14.86s/it]
 22%|██▏       | 8167/37963 [35:00:34<121:34:39, 14.69s/it]
 22%|██▏       | 8168/37963 [35:00:49<120:41:10, 14.58s/it]
 22%|██▏       | 8169/37963 [35:01:10<136:31:08, 16.50s/it]
 22%|██▏       | 8170/37963 [35:01:24<131:21:46, 15.87s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '2.013', 'learning_rate': '1.825e-05', 'epoch': '0.2152'}

 22%|██▏       | 8170/37963 [35:01:24<131:21:46, 15.87s/it]
 22%|██▏       | 8171/37963 [35:01:38<127:08:32, 15.36s/it]
 22%|██▏       | 8172/37963 [35:01:53<124:10:10, 15.00s/it]
 22%|██▏       | 8173/37963 [35:02:07<122:29:06, 14.80s/it]
 22%|██▏       | 8174/37963 [35:02:21<121:20:11, 14.66s/it]
 22%|██▏       | 8175/37963 [35:02:48<150:44:12, 18.22s/it]
 22%|██▏       | 8176/37963 [35:03:02<141:08:07, 17.06s/it]
 22%|██▏       | 8177/37963 [35:03:30<167:07:26, 20.20s/it]
 22%|██▏       | 8178/37963 [35:03:43<151:30:33, 18.31s/it]
 22%|██▏       | 8179/37963 [35:03:58<141:34:57, 17.11s/it]
 22%|██▏       | 8180/37963 [35:04:12<134:49:15, 16.30s/it]
                                                           
{'loss': '0.1562', 'grad_norm': '2.365', 'learning_rate': '1.825e-05', 'epoch': '0.2155'}

 22%|██▏       | 8180/37963 [35:04:12<134:49:15, 16.30s/it]
 22%|██▏       | 8181/37963 [35:04:27<130:15:11, 15.74s/it]
 22%|██▏       | 8182/37963 [35:04:41<127:07:29, 15.37s/it]
 22%|██▏       | 8183/37963 [35:04:55<124:23:18, 15.04s/it]
 22%|██▏       | 8184/37963 [35:05:10<122:11:21, 14.77s/it]
 22%|██▏       | 8185/37963 [35:05:24<121:17:02, 14.66s/it]
 22%|██▏       | 8186/37963 [35:05:38<119:16:44, 14.42s/it]
 22%|██▏       | 8187/37963 [35:05:52<119:19:17, 14.43s/it]
 22%|██▏       | 8188/37963 [35:06:07<119:34:37, 14.46s/it]
 22%|██▏       | 8189/37963 [35:06:21<119:16:45, 14.42s/it]
 22%|██▏       | 8190/37963 [35:06:35<119:04:27, 14.40s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '5.446', 'learning_rate': '1.825e-05', 'epoch': '0.2157'}

 22%|██▏       | 8190/37963 [35:06:35<119:04:27, 14.40s/it]
 22%|██▏       | 8191/37963 [35:06:50<118:11:42, 14.29s/it]
 22%|██▏       | 8192/37963 [35:07:03<116:17:07, 14.06s/it]
 22%|██▏       | 8193/37963 [35:07:17<117:03:16, 14.16s/it]
 22%|██▏       | 8194/37963 [35:07:39<134:17:35, 16.24s/it]
 22%|██▏       | 8195/37963 [35:07:53<129:52:47, 15.71s/it]
 22%|██▏       | 8196/37963 [35:08:07<126:35:11, 15.31s/it]
 22%|██▏       | 8197/37963 [35:08:21<123:19:39, 14.92s/it]
 22%|██▏       | 8198/37963 [35:08:36<122:04:12, 14.76s/it]
 22%|██▏       | 8199/37963 [35:08:50<121:07:36, 14.65s/it]
 22%|██▏       | 8200/37963 [35:09:05<120:25:44, 14.57s/it]
                                                           
{'loss': '0.1746', 'grad_norm': '5.459', 'learning_rate': '1.824e-05', 'epoch': '0.216'}

 22%|██▏       | 8200/37963 [35:09:05<120:25:44, 14.57s/it]
 22%|██▏       | 8201/37963 [35:09:19<120:03:00, 14.52s/it]
 22%|██▏       | 8202/37963 [35:09:33<117:51:32, 14.26s/it]
 22%|██▏       | 8203/37963 [35:09:47<118:08:58, 14.29s/it]
 22%|██▏       | 8204/37963 [35:10:01<116:48:31, 14.13s/it]
 22%|██▏       | 8205/37963 [35:10:15<117:34:06, 14.22s/it]
 22%|██▏       | 8206/37963 [35:10:30<118:22:55, 14.32s/it]
 22%|██▏       | 8207/37963 [35:10:44<118:34:57, 14.35s/it]
 22%|██▏       | 8208/37963 [35:10:58<118:30:45, 14.34s/it]
 22%|██▏       | 8209/37963 [35:11:19<134:17:13, 16.25s/it]
 22%|██▏       | 8210/37963 [35:11:39<143:40:17, 17.38s/it]
                                                           
{'loss': '0.174', 'grad_norm': '4.089', 'learning_rate': '1.824e-05', 'epoch': '0.2163'}

 22%|██▏       | 8210/37963 [35:11:39<143:40:17, 17.38s/it]
 22%|██▏       | 8211/37963 [35:11:53<135:37:36, 16.41s/it]
 22%|██▏       | 8212/37963 [35:12:08<130:23:16, 15.78s/it]
 22%|██▏       | 8213/37963 [35:12:22<126:56:22, 15.36s/it]
 22%|██▏       | 8214/37963 [35:12:36<123:28:19, 14.94s/it]
 22%|██▏       | 8215/37963 [35:12:50<120:30:30, 14.58s/it]
 22%|██▏       | 8216/37963 [35:13:04<119:57:49, 14.52s/it]
 22%|██▏       | 8217/37963 [35:13:18<119:33:36, 14.47s/it]
 22%|██▏       | 8218/37963 [35:13:33<118:52:29, 14.39s/it]
 22%|██▏       | 8219/37963 [35:13:47<119:27:50, 14.46s/it]
 22%|██▏       | 8220/37963 [35:14:08<135:50:48, 16.44s/it]
                                                           
{'loss': '0.1724', 'grad_norm': '1.385', 'learning_rate': '1.823e-05', 'epoch': '0.2165'}

 22%|██▏       | 8220/37963 [35:14:08<135:50:48, 16.44s/it]
 22%|██▏       | 8221/37963 [35:14:23<130:54:31, 15.85s/it]
 22%|██▏       | 8222/37963 [35:14:37<127:22:09, 15.42s/it]
 22%|██▏       | 8223/37963 [35:14:58<140:36:23, 17.02s/it]
 22%|██▏       | 8224/37963 [35:15:12<132:38:57, 16.06s/it]
 22%|██▏       | 8225/37963 [35:15:26<128:23:57, 15.54s/it]
 22%|██▏       | 8226/37963 [35:15:54<160:05:35, 19.38s/it]
 22%|██▏       | 8227/37963 [35:16:09<147:09:36, 17.82s/it]
 22%|██▏       | 8228/37963 [35:16:23<138:27:30, 16.76s/it]
 22%|██▏       | 8229/37963 [35:16:37<132:18:41, 16.02s/it]
 22%|██▏       | 8230/37963 [35:16:52<128:07:48, 15.51s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '2.01', 'learning_rate': '1.823e-05', 'epoch': '0.2168'}

 22%|██▏       | 8230/37963 [35:16:52<128:07:48, 15.51s/it]
 22%|██▏       | 8231/37963 [35:17:06<125:05:43, 15.15s/it]
 22%|██▏       | 8232/37963 [35:17:20<123:02:41, 14.90s/it]
 22%|██▏       | 8233/37963 [35:17:34<121:32:45, 14.72s/it]
 22%|██▏       | 8234/37963 [35:17:49<120:32:16, 14.60s/it]
 22%|██▏       | 8235/37963 [35:18:03<120:06:12, 14.54s/it]
 22%|██▏       | 8236/37963 [35:18:18<119:46:43, 14.51s/it]
 22%|██▏       | 8237/37963 [35:18:32<119:36:04, 14.48s/it]
 22%|██▏       | 8238/37963 [35:18:46<119:30:48, 14.47s/it]
 22%|██▏       | 8239/37963 [35:19:01<119:13:43, 14.44s/it]
 22%|██▏       | 8240/37963 [35:19:15<118:40:39, 14.37s/it]
                                                           
{'loss': '0.153', 'grad_norm': '1.021', 'learning_rate': '1.822e-05', 'epoch': '0.2171'}

 22%|██▏       | 8240/37963 [35:19:15<118:40:39, 14.37s/it]
 22%|██▏       | 8241/37963 [35:19:29<118:29:19, 14.35s/it]
 22%|██▏       | 8242/37963 [35:19:51<135:24:19, 16.40s/it]
 22%|██▏       | 8243/37963 [35:20:05<130:13:29, 15.77s/it]
 22%|██▏       | 8244/37963 [35:20:19<126:37:36, 15.34s/it]
 22%|██▏       | 8245/37963 [35:20:33<124:08:12, 15.04s/it]
 22%|██▏       | 8246/37963 [35:20:48<122:34:28, 14.85s/it]
 22%|██▏       | 8247/37963 [35:21:02<120:45:03, 14.63s/it]
 22%|██▏       | 8248/37963 [35:21:16<119:50:41, 14.52s/it]
 22%|██▏       | 8249/37963 [35:21:31<119:29:50, 14.48s/it]
 22%|██▏       | 8250/37963 [35:21:44<117:24:56, 14.23s/it]
                                                           
{'loss': '0.1582', 'grad_norm': '1.689', 'learning_rate': '1.822e-05', 'epoch': '0.2173'}

 22%|██▏       | 8250/37963 [35:21:44<117:24:56, 14.23s/it]
 22%|██▏       | 8251/37963 [35:21:58<116:53:04, 14.16s/it]
 22%|██▏       | 8252/37963 [35:22:12<116:50:31, 14.16s/it]
 22%|██▏       | 8253/37963 [35:22:27<117:10:04, 14.20s/it]
 22%|██▏       | 8254/37963 [35:22:41<117:29:37, 14.24s/it]
 22%|██▏       | 8255/37963 [35:22:55<116:54:16, 14.17s/it]
 22%|██▏       | 8256/37963 [35:23:09<117:23:08, 14.23s/it]
 22%|██▏       | 8257/37963 [35:23:24<117:34:53, 14.25s/it]
 22%|██▏       | 8258/37963 [35:23:38<117:46:05, 14.27s/it]
 22%|██▏       | 8259/37963 [35:24:05<149:39:52, 18.14s/it]
 22%|██▏       | 8260/37963 [35:24:19<139:34:45, 16.92s/it]
                                                           
{'loss': '0.168', 'grad_norm': '1.594', 'learning_rate': '1.821e-05', 'epoch': '0.2176'}

 22%|██▏       | 8260/37963 [35:24:19<139:34:45, 16.92s/it]
 22%|██▏       | 8261/37963 [35:24:34<133:16:34, 16.15s/it]
 22%|██▏       | 8262/37963 [35:24:48<128:40:06, 15.60s/it]
 22%|██▏       | 8263/37963 [35:25:02<124:37:45, 15.11s/it]
 22%|██▏       | 8264/37963 [35:25:16<122:40:59, 14.87s/it]
 22%|██▏       | 8265/37963 [35:25:30<120:53:09, 14.65s/it]
 22%|██▏       | 8266/37963 [35:25:45<120:11:46, 14.57s/it]
 22%|██▏       | 8267/37963 [35:25:59<119:50:25, 14.53s/it]
 22%|██▏       | 8268/37963 [35:26:19<133:42:46, 16.21s/it]
 22%|██▏       | 8269/37963 [35:26:33<127:46:29, 15.49s/it]
 22%|██▏       | 8270/37963 [35:26:47<123:57:22, 15.03s/it]
                                                           
{'loss': '0.1486', 'grad_norm': '1.111', 'learning_rate': '1.821e-05', 'epoch': '0.2178'}

 22%|██▏       | 8270/37963 [35:26:47<123:57:22, 15.03s/it]
 22%|██▏       | 8271/37963 [35:27:01<120:49:42, 14.65s/it]
 22%|██▏       | 8272/37963 [35:27:28<151:07:03, 18.32s/it]
 22%|██▏       | 8273/37963 [35:27:42<141:44:49, 17.19s/it]
 22%|██▏       | 8274/37963 [35:28:11<169:03:28, 20.50s/it]
 22%|██▏       | 8275/37963 [35:28:25<153:41:25, 18.64s/it]
 22%|██▏       | 8276/37963 [35:28:39<142:42:27, 17.31s/it]
 22%|██▏       | 8277/37963 [35:28:53<135:32:53, 16.44s/it]
 22%|██▏       | 8278/37963 [35:29:08<130:25:45, 15.82s/it]
 22%|██▏       | 8279/37963 [35:29:22<127:08:57, 15.42s/it]
 22%|██▏       | 8280/37963 [35:29:37<124:34:29, 15.11s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '2.313', 'learning_rate': '1.82e-05', 'epoch': '0.2181'}

 22%|██▏       | 8280/37963 [35:29:37<124:34:29, 15.11s/it]
 22%|██▏       | 8281/37963 [35:29:51<121:50:44, 14.78s/it]
 22%|██▏       | 8282/37963 [35:30:05<120:48:09, 14.65s/it]
 22%|██▏       | 8283/37963 [35:30:19<119:25:31, 14.49s/it]
 22%|██▏       | 8284/37963 [35:30:33<119:03:47, 14.44s/it]
 22%|██▏       | 8285/37963 [35:30:48<118:57:15, 14.43s/it]
 22%|██▏       | 8286/37963 [35:31:02<118:40:09, 14.40s/it]
 22%|██▏       | 8287/37963 [35:31:17<118:40:51, 14.40s/it]
 22%|██▏       | 8288/37963 [35:31:31<118:31:12, 14.38s/it]
 22%|██▏       | 8289/37963 [35:31:45<117:38:29, 14.27s/it]
 22%|██▏       | 8290/37963 [35:31:59<117:44:25, 14.28s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '1.265', 'learning_rate': '1.82e-05', 'epoch': '0.2184'}

 22%|██▏       | 8290/37963 [35:31:59<117:44:25, 14.28s/it]
 22%|██▏       | 8291/37963 [35:32:14<117:49:34, 14.30s/it]
 22%|██▏       | 8292/37963 [35:32:27<116:21:13, 14.12s/it]
 22%|██▏       | 8293/37963 [35:32:48<133:31:47, 16.20s/it]
 22%|██▏       | 8294/37963 [35:33:03<129:07:21, 15.67s/it]
 22%|██▏       | 8295/37963 [35:33:17<124:48:23, 15.14s/it]
 22%|██▏       | 8296/37963 [35:33:31<122:20:54, 14.85s/it]
 22%|██▏       | 8297/37963 [35:33:45<121:28:47, 14.74s/it]
 22%|██▏       | 8298/37963 [35:34:00<120:29:16, 14.62s/it]
 22%|██▏       | 8299/37963 [35:34:14<119:46:15, 14.54s/it]
 22%|██▏       | 8300/37963 [35:34:28<119:09:24, 14.46s/it]
                                                           
{'loss': '0.157', 'grad_norm': '2.324', 'learning_rate': '1.819e-05', 'epoch': '0.2186'}

 22%|██▏       | 8300/37963 [35:34:28<119:09:24, 14.46s/it]
 22%|██▏       | 8301/37963 [35:34:43<119:01:14, 14.45s/it]
 22%|██▏       | 8302/37963 [35:34:57<118:41:52, 14.41s/it]
 22%|██▏       | 8303/37963 [35:35:11<118:08:13, 14.34s/it]
 22%|██▏       | 8304/37963 [35:35:25<117:44:27, 14.29s/it]
 22%|██▏       | 8305/37963 [35:35:40<118:07:40, 14.34s/it]
 22%|██▏       | 8306/37963 [35:35:54<118:18:20, 14.36s/it]
 22%|██▏       | 8307/37963 [35:36:15<133:08:58, 16.16s/it]
 22%|██▏       | 8308/37963 [35:36:35<144:17:19, 17.52s/it]
 22%|██▏       | 8309/37963 [35:36:49<135:42:33, 16.48s/it]
 22%|██▏       | 8310/37963 [35:37:04<130:02:36, 15.79s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '1.283', 'learning_rate': '1.819e-05', 'epoch': '0.2189'}

 22%|██▏       | 8310/37963 [35:37:04<130:02:36, 15.79s/it]
 22%|██▏       | 8311/37963 [35:37:18<126:25:53, 15.35s/it]
 22%|██▏       | 8312/37963 [35:37:32<124:15:06, 15.09s/it]
 22%|██▏       | 8313/37963 [35:37:47<122:52:56, 14.92s/it]
 22%|██▏       | 8314/37963 [35:38:01<121:29:50, 14.75s/it]
 22%|██▏       | 8315/37963 [35:38:15<119:47:04, 14.54s/it]
 22%|██▏       | 8316/37963 [35:38:30<119:24:03, 14.50s/it]
 22%|██▏       | 8317/37963 [35:38:44<118:58:13, 14.45s/it]
 22%|██▏       | 8318/37963 [35:39:05<133:54:55, 16.26s/it]
 22%|██▏       | 8319/37963 [35:39:25<145:34:32, 17.68s/it]
 22%|██▏       | 8320/37963 [35:39:40<137:17:42, 16.67s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '1.675', 'learning_rate': '1.818e-05', 'epoch': '0.2192'}

 22%|██▏       | 8320/37963 [35:39:40<137:17:42, 16.67s/it]
 22%|██▏       | 8321/37963 [35:40:00<147:10:31, 17.87s/it]
 22%|██▏       | 8322/37963 [35:40:28<171:24:27, 20.82s/it]
 22%|██▏       | 8323/37963 [35:40:43<155:22:47, 18.87s/it]
 22%|██▏       | 8324/37963 [35:40:57<144:15:10, 17.52s/it]
 22%|██▏       | 8325/37963 [35:41:11<136:22:51, 16.57s/it]
 22%|██▏       | 8326/37963 [35:41:26<131:20:03, 15.95s/it]
 22%|██▏       | 8327/37963 [35:41:39<125:16:58, 15.22s/it]
 22%|██▏       | 8328/37963 [35:41:53<122:44:12, 14.91s/it]
 22%|██▏       | 8329/37963 [35:42:08<121:15:21, 14.73s/it]
 22%|██▏       | 8330/37963 [35:42:21<118:16:20, 14.37s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '2.545', 'learning_rate': '1.818e-05', 'epoch': '0.2194'}

 22%|██▏       | 8330/37963 [35:42:21<118:16:20, 14.37s/it]
 22%|██▏       | 8331/37963 [35:42:36<118:33:40, 14.40s/it]
 22%|██▏       | 8332/37963 [35:42:50<117:04:08, 14.22s/it]
 22%|██▏       | 8333/37963 [35:43:04<117:22:35, 14.26s/it]
 22%|██▏       | 8334/37963 [35:43:18<117:37:56, 14.29s/it]
 22%|██▏       | 8335/37963 [35:43:33<117:45:33, 14.31s/it]
 22%|██▏       | 8336/37963 [35:43:47<117:55:58, 14.33s/it]
 22%|██▏       | 8337/37963 [35:44:01<117:55:48, 14.33s/it]
 22%|██▏       | 8338/37963 [35:44:16<117:34:13, 14.29s/it]
 22%|██▏       | 8339/37963 [35:44:30<117:50:44, 14.32s/it]
 22%|██▏       | 8340/37963 [35:44:44<118:02:35, 14.35s/it]
                                                           
{'loss': '0.1822', 'grad_norm': '4.333', 'learning_rate': '1.817e-05', 'epoch': '0.2197'}

 22%|██▏       | 8340/37963 [35:44:44<118:02:35, 14.35s/it]
 22%|██▏       | 8341/37963 [35:44:59<117:58:52, 14.34s/it]
 22%|██▏       | 8342/37963 [35:45:19<133:26:51, 16.22s/it]
 22%|██▏       | 8343/37963 [35:45:34<128:50:55, 15.66s/it]
 22%|██▏       | 8344/37963 [35:45:47<124:12:18, 15.10s/it]
 22%|██▏       | 8345/37963 [35:46:02<122:28:29, 14.89s/it]
 22%|██▏       | 8346/37963 [35:46:16<120:20:17, 14.63s/it]
 22%|██▏       | 8347/37963 [35:46:30<119:49:14, 14.56s/it]
 22%|██▏       | 8348/37963 [35:46:44<118:32:09, 14.41s/it]
 22%|██▏       | 8349/37963 [35:46:58<118:03:43, 14.35s/it]
 22%|██▏       | 8350/37963 [35:47:13<117:55:29, 14.34s/it]
                                                           
{'loss': '0.1756', 'grad_norm': '1.774', 'learning_rate': '1.817e-05', 'epoch': '0.22'}

 22%|██▏       | 8350/37963 [35:47:13<117:55:29, 14.34s/it]
 22%|██▏       | 8351/37963 [35:47:27<117:56:28, 14.34s/it]
 22%|██▏       | 8352/37963 [35:47:41<117:55:24, 14.34s/it]
 22%|██▏       | 8353/37963 [35:47:56<118:16:02, 14.38s/it]
 22%|██▏       | 8354/37963 [35:48:10<118:27:25, 14.40s/it]
 22%|██▏       | 8355/37963 [35:48:25<117:56:30, 14.34s/it]
 22%|██▏       | 8356/37963 [35:48:45<133:06:01, 16.18s/it]
 22%|██▏       | 8357/37963 [35:49:06<143:56:53, 17.50s/it]
 22%|██▏       | 8358/37963 [35:49:20<136:14:06, 16.57s/it]
 22%|██▏       | 8359/37963 [35:49:34<130:53:48, 15.92s/it]
 22%|██▏       | 8360/37963 [35:49:48<125:59:44, 15.32s/it]
                                                           
{'loss': '0.1639', 'grad_norm': '2.182', 'learning_rate': '1.816e-05', 'epoch': '0.2202'}

 22%|██▏       | 8360/37963 [35:49:48<125:59:44, 15.32s/it]
 22%|██▏       | 8361/37963 [35:50:03<123:47:34, 15.05s/it]
 22%|██▏       | 8362/37963 [35:50:17<121:46:04, 14.81s/it]
 22%|██▏       | 8363/37963 [35:50:31<120:37:30, 14.67s/it]
 22%|██▏       | 8364/37963 [35:50:46<119:52:00, 14.58s/it]
 22%|██▏       | 8365/37963 [35:51:00<119:31:01, 14.54s/it]
 22%|██▏       | 8366/37963 [35:51:14<117:30:30, 14.29s/it]
 22%|██▏       | 8367/37963 [35:51:35<133:25:32, 16.23s/it]
 22%|██▏       | 8368/37963 [35:51:49<129:09:46, 15.71s/it]
 22%|██▏       | 8369/37963 [35:52:09<140:12:22, 17.06s/it]
 22%|██▏       | 8370/37963 [35:52:31<150:34:22, 18.32s/it]
                                                           
{'loss': '0.1511', 'grad_norm': '1.165', 'learning_rate': '1.816e-05', 'epoch': '0.2205'}

 22%|██▏       | 8370/37963 [35:52:31<150:34:22, 18.32s/it]
 22%|██▏       | 8371/37963 [35:52:45<140:50:32, 17.13s/it]
 22%|██▏       | 8372/37963 [35:53:06<149:47:32, 18.22s/it]
 22%|██▏       | 8373/37963 [35:53:27<158:09:58, 19.24s/it]
 22%|██▏       | 8374/37963 [35:53:42<146:14:07, 17.79s/it]
 22%|██▏       | 8375/37963 [35:53:56<137:06:03, 16.68s/it]
 22%|██▏       | 8376/37963 [35:54:10<130:55:34, 15.93s/it]
 22%|██▏       | 8377/37963 [35:54:24<127:13:17, 15.48s/it]
 22%|██▏       | 8378/37963 [35:54:38<123:29:35, 15.03s/it]
 22%|██▏       | 8379/37963 [35:54:53<121:44:47, 14.82s/it]
 22%|██▏       | 8380/37963 [35:55:07<119:07:21, 14.50s/it]
                                                           
{'loss': '0.1653', 'grad_norm': '1.799', 'learning_rate': '1.815e-05', 'epoch': '0.2207'}

 22%|██▏       | 8380/37963 [35:55:07<119:07:21, 14.50s/it]
 22%|██▏       | 8381/37963 [35:55:21<118:54:05, 14.47s/it]
 22%|██▏       | 8382/37963 [35:55:35<118:27:21, 14.42s/it]
 22%|██▏       | 8383/37963 [35:55:50<118:21:10, 14.40s/it]
 22%|██▏       | 8384/37963 [35:56:04<117:48:46, 14.34s/it]
 22%|██▏       | 8385/37963 [35:56:18<117:52:43, 14.35s/it]
 22%|██▏       | 8386/37963 [35:56:33<118:26:39, 14.42s/it]
 22%|██▏       | 8387/37963 [35:56:47<118:09:56, 14.38s/it]
 22%|██▏       | 8388/37963 [35:57:01<118:06:09, 14.38s/it]
 22%|██▏       | 8389/37963 [35:57:16<118:07:08, 14.38s/it]
 22%|██▏       | 8390/37963 [35:57:30<118:11:45, 14.39s/it]
                                                           
{'loss': '0.1741', 'grad_norm': '0.9336', 'learning_rate': '1.815e-05', 'epoch': '0.221'}

 22%|██▏       | 8390/37963 [35:57:30<118:11:45, 14.39s/it]
 22%|██▏       | 8391/37963 [35:57:51<134:55:22, 16.43s/it]
 22%|██▏       | 8392/37963 [35:58:05<128:58:41, 15.70s/it]
 22%|██▏       | 8393/37963 [35:58:20<125:03:03, 15.22s/it]
 22%|██▏       | 8394/37963 [35:58:34<122:46:04, 14.95s/it]
 22%|██▏       | 8395/37963 [35:58:48<121:42:28, 14.82s/it]
 22%|██▏       | 8396/37963 [35:59:03<120:21:38, 14.65s/it]
 22%|██▏       | 8397/37963 [35:59:17<119:03:48, 14.50s/it]
 22%|██▏       | 8398/37963 [35:59:31<118:06:55, 14.38s/it]
 22%|██▏       | 8399/37963 [35:59:45<118:05:58, 14.38s/it]
 22%|██▏       | 8400/37963 [36:00:00<117:59:32, 14.37s/it]
                                                           
{'loss': '0.1546', 'grad_norm': '0.6829', 'learning_rate': '1.814e-05', 'epoch': '0.2213'}

 22%|██▏       | 8400/37963 [36:00:00<117:59:32, 14.37s/it]
 22%|██▏       | 8401/37963 [36:00:14<117:53:36, 14.36s/it]
 22%|██▏       | 8402/37963 [36:00:28<117:55:45, 14.36s/it]
 22%|██▏       | 8403/37963 [36:00:43<117:59:09, 14.37s/it]
 22%|██▏       | 8404/37963 [36:00:57<118:00:00, 14.37s/it]
 22%|██▏       | 8405/37963 [36:01:18<134:00:12, 16.32s/it]
 22%|██▏       | 8406/37963 [36:01:32<129:45:33, 15.80s/it]
 22%|██▏       | 8407/37963 [36:01:46<124:51:57, 15.21s/it]
 22%|██▏       | 8408/37963 [36:02:07<139:14:25, 16.96s/it]
 22%|██▏       | 8409/37963 [36:02:22<132:45:45, 16.17s/it]
 22%|██▏       | 8410/37963 [36:02:36<128:16:35, 15.63s/it]
                                                           
{'loss': '0.1737', 'grad_norm': '2.614', 'learning_rate': '1.814e-05', 'epoch': '0.2215'}

 22%|██▏       | 8410/37963 [36:02:36<128:16:35, 15.63s/it]
 22%|██▏       | 8411/37963 [36:02:50<125:09:44, 15.25s/it]
 22%|██▏       | 8412/37963 [36:03:05<122:54:15, 14.97s/it]
 22%|██▏       | 8413/37963 [36:03:19<121:31:19, 14.80s/it]
 22%|██▏       | 8414/37963 [36:03:40<135:20:42, 16.49s/it]
 22%|██▏       | 8415/37963 [36:03:54<130:03:41, 15.85s/it]
 22%|██▏       | 8416/37963 [36:04:08<126:33:35, 15.42s/it]
 22%|██▏       | 8417/37963 [36:04:23<124:17:58, 15.15s/it]
 22%|██▏       | 8418/37963 [36:04:43<137:20:12, 16.73s/it]
 22%|██▏       | 8419/37963 [36:05:04<147:12:49, 17.94s/it]
 22%|██▏       | 8420/37963 [36:05:25<155:17:42, 18.92s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '1.301', 'learning_rate': '1.813e-05', 'epoch': '0.2218'}

 22%|██▏       | 8420/37963 [36:05:25<155:17:42, 18.92s/it]
 22%|██▏       | 8421/37963 [36:05:47<161:20:53, 19.66s/it]
 22%|██▏       | 8422/37963 [36:06:01<148:12:34, 18.06s/it]
 22%|██▏       | 8423/37963 [36:06:15<139:00:30, 16.94s/it]
 22%|██▏       | 8424/37963 [36:06:30<133:02:37, 16.21s/it]
 22%|██▏       | 8425/37963 [36:06:44<128:18:00, 15.64s/it]
 22%|██▏       | 8426/37963 [36:06:58<125:00:10, 15.24s/it]
 22%|██▏       | 8427/37963 [36:07:13<122:42:24, 14.96s/it]
 22%|██▏       | 8428/37963 [36:07:27<120:27:11, 14.68s/it]
 22%|██▏       | 8429/37963 [36:07:41<119:47:16, 14.60s/it]
 22%|██▏       | 8430/37963 [36:07:56<119:17:14, 14.54s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '1.649', 'learning_rate': '1.813e-05', 'epoch': '0.2221'}

 22%|██▏       | 8430/37963 [36:07:56<119:17:14, 14.54s/it]
 22%|██▏       | 8431/37963 [36:08:10<118:57:44, 14.50s/it]
 22%|██▏       | 8432/37963 [36:08:24<118:44:24, 14.48s/it]
 22%|██▏       | 8433/37963 [36:08:39<117:56:35, 14.38s/it]
 22%|██▏       | 8434/37963 [36:08:53<117:44:59, 14.36s/it]
 22%|██▏       | 8435/37963 [36:09:07<117:30:46, 14.33s/it]
 22%|██▏       | 8436/37963 [36:09:21<115:47:45, 14.12s/it]
 22%|██▏       | 8437/37963 [36:09:35<115:50:00, 14.12s/it]
 22%|██▏       | 8438/37963 [36:09:49<116:40:53, 14.23s/it]
 22%|██▏       | 8439/37963 [36:10:03<116:02:24, 14.15s/it]
 22%|██▏       | 8440/37963 [36:10:25<133:33:11, 16.29s/it]
                                                           
{'loss': '0.1702', 'grad_norm': '2.737', 'learning_rate': '1.812e-05', 'epoch': '0.2223'}

 22%|██▏       | 8440/37963 [36:10:25<133:33:11, 16.29s/it]
 22%|██▏       | 8441/37963 [36:10:39<128:21:54, 15.65s/it]
 22%|██▏       | 8442/37963 [36:10:53<125:29:53, 15.30s/it]
 22%|██▏       | 8443/37963 [36:11:08<123:10:37, 15.02s/it]
 22%|██▏       | 8444/37963 [36:11:22<121:51:10, 14.86s/it]
 22%|██▏       | 8445/37963 [36:11:36<120:29:06, 14.69s/it]
 22%|██▏       | 8446/37963 [36:11:51<119:43:26, 14.60s/it]
 22%|██▏       | 8447/37963 [36:12:05<119:21:11, 14.56s/it]
 22%|██▏       | 8448/37963 [36:12:19<118:20:42, 14.43s/it]
 22%|██▏       | 8449/37963 [36:12:33<117:31:58, 14.34s/it]
 22%|██▏       | 8450/37963 [36:12:48<118:08:21, 14.41s/it]
                                                           
{'loss': '0.1632', 'grad_norm': '3.462', 'learning_rate': '1.812e-05', 'epoch': '0.2226'}

 22%|██▏       | 8450/37963 [36:12:48<118:08:21, 14.41s/it]
 22%|██▏       | 8451/37963 [36:13:02<117:59:59, 14.39s/it]
 22%|██▏       | 8452/37963 [36:13:16<116:29:28, 14.21s/it]
 22%|██▏       | 8453/37963 [36:13:31<116:54:46, 14.26s/it]
 22%|██▏       | 8454/37963 [36:13:51<131:34:46, 16.05s/it]
 22%|██▏       | 8455/37963 [36:14:11<142:46:14, 17.42s/it]
 22%|██▏       | 8456/37963 [36:14:26<135:12:06, 16.50s/it]
 22%|██▏       | 8457/37963 [36:14:40<130:01:13, 15.86s/it]
 22%|██▏       | 8458/37963 [36:14:54<126:13:37, 15.40s/it]
 22%|██▏       | 8459/37963 [36:15:09<123:46:15, 15.10s/it]
 22%|██▏       | 8460/37963 [36:15:23<122:09:22, 14.91s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '2.677', 'learning_rate': '1.811e-05', 'epoch': '0.2228'}

 22%|██▏       | 8460/37963 [36:15:23<122:09:22, 14.91s/it]
 22%|██▏       | 8461/37963 [36:15:38<120:41:02, 14.73s/it]
 22%|██▏       | 8462/37963 [36:15:52<120:22:57, 14.69s/it]
 22%|██▏       | 8463/37963 [36:16:07<119:40:16, 14.60s/it]
 22%|██▏       | 8464/37963 [36:16:20<117:23:22, 14.33s/it]
 22%|██▏       | 8465/37963 [36:16:42<134:23:31, 16.40s/it]
 22%|██▏       | 8466/37963 [36:16:56<129:28:37, 15.80s/it]
 22%|██▏       | 8467/37963 [36:17:10<125:55:41, 15.37s/it]
 22%|██▏       | 8468/37963 [36:17:25<123:28:06, 15.07s/it]
 22%|██▏       | 8469/37963 [36:17:59<171:35:06, 20.94s/it]
 22%|██▏       | 8470/37963 [36:18:14<155:21:43, 18.96s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '1.019', 'learning_rate': '1.811e-05', 'epoch': '0.2231'}

 22%|██▏       | 8470/37963 [36:18:14<155:21:43, 18.96s/it]
 22%|██▏       | 8471/37963 [36:18:35<160:15:52, 19.56s/it]
 22%|██▏       | 8472/37963 [36:18:49<147:34:55, 18.02s/it]
 22%|██▏       | 8473/37963 [36:19:03<138:30:57, 16.91s/it]
 22%|██▏       | 8474/37963 [36:19:17<130:37:16, 15.95s/it]
 22%|██▏       | 8475/37963 [36:19:31<126:31:20, 15.45s/it]
 22%|██▏       | 8476/37963 [36:19:45<123:06:44, 15.03s/it]
 22%|██▏       | 8477/37963 [36:20:00<121:04:59, 14.78s/it]
 22%|██▏       | 8478/37963 [36:20:14<120:07:32, 14.67s/it]
 22%|██▏       | 8479/37963 [36:20:28<119:18:51, 14.57s/it]
 22%|██▏       | 8480/37963 [36:20:43<118:48:30, 14.51s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '5.076', 'learning_rate': '1.81e-05', 'epoch': '0.2234'}

 22%|██▏       | 8480/37963 [36:20:43<118:48:30, 14.51s/it]
 22%|██▏       | 8481/37963 [36:20:57<117:27:27, 14.34s/it]
 22%|██▏       | 8482/37963 [36:21:11<117:30:58, 14.35s/it]
 22%|██▏       | 8483/37963 [36:21:25<117:04:25, 14.30s/it]
 22%|██▏       | 8484/37963 [36:21:39<116:55:57, 14.28s/it]
 22%|██▏       | 8485/37963 [36:21:53<115:27:04, 14.10s/it]
 22%|██▏       | 8486/37963 [36:22:07<114:53:53, 14.03s/it]
 22%|██▏       | 8487/37963 [36:22:21<115:45:52, 14.14s/it]
 22%|██▏       | 8488/37963 [36:22:35<115:17:54, 14.08s/it]
 22%|██▏       | 8489/37963 [36:22:50<115:53:36, 14.16s/it]
 22%|██▏       | 8490/37963 [36:23:11<133:20:01, 16.29s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '3.676', 'learning_rate': '1.81e-05', 'epoch': '0.2236'}

 22%|██▏       | 8490/37963 [36:23:11<133:20:01, 16.29s/it]
 22%|██▏       | 8491/37963 [36:23:25<128:36:32, 15.71s/it]
 22%|██▏       | 8492/37963 [36:23:40<124:51:02, 15.25s/it]
 22%|██▏       | 8493/37963 [36:23:54<122:31:10, 14.97s/it]
 22%|██▏       | 8494/37963 [36:24:08<120:56:39, 14.77s/it]
 22%|██▏       | 8495/37963 [36:24:22<119:55:10, 14.65s/it]
 22%|██▏       | 8496/37963 [36:24:37<119:00:38, 14.54s/it]
 22%|██▏       | 8497/37963 [36:24:51<117:04:35, 14.30s/it]
 22%|██▏       | 8498/37963 [36:25:05<117:09:46, 14.31s/it]
 22%|██▏       | 8499/37963 [36:25:18<114:58:51, 14.05s/it]
 22%|██▏       | 8500/37963 [36:25:33<115:37:23, 14.13s/it]
                                                           
{'loss': '0.157', 'grad_norm': '4.205', 'learning_rate': '1.809e-05', 'epoch': '0.2239'}

 22%|██▏       | 8500/37963 [36:25:33<115:37:23, 14.13s/it]
 22%|██▏       | 8501/37963 [36:25:53<130:42:22, 15.97s/it]
 22%|██▏       | 8502/37963 [36:26:07<127:19:14, 15.56s/it]
 22%|██▏       | 8503/37963 [36:26:28<140:42:04, 17.19s/it]
 22%|██▏       | 8504/37963 [36:26:43<133:51:43, 16.36s/it]
 22%|██▏       | 8505/37963 [36:26:57<129:01:53, 15.77s/it]
 22%|██▏       | 8506/37963 [36:27:12<125:51:54, 15.38s/it]
 22%|██▏       | 8507/37963 [36:27:26<123:03:06, 15.04s/it]
 22%|██▏       | 8508/37963 [36:27:40<121:28:03, 14.85s/it]
 22%|██▏       | 8509/37963 [36:27:55<120:15:29, 14.70s/it]
 22%|██▏       | 8510/37963 [36:28:09<119:16:46, 14.58s/it]
                                                           
{'loss': '0.161', 'grad_norm': '1.78', 'learning_rate': '1.809e-05', 'epoch': '0.2242'}

 22%|██▏       | 8510/37963 [36:28:09<119:16:46, 14.58s/it]
 22%|██▏       | 8511/37963 [36:28:23<118:51:22, 14.53s/it]
 22%|██▏       | 8512/37963 [36:28:45<134:51:23, 16.48s/it]
 22%|██▏       | 8513/37963 [36:28:59<129:41:49, 15.85s/it]
 22%|██▏       | 8514/37963 [36:29:13<125:38:11, 15.36s/it]
 22%|██▏       | 8515/37963 [36:29:27<123:16:16, 15.07s/it]
 22%|██▏       | 8516/37963 [36:29:42<120:43:27, 14.76s/it]
 22%|██▏       | 8517/37963 [36:30:09<151:45:31, 18.55s/it]
 22%|██▏       | 8518/37963 [36:30:37<174:19:55, 21.31s/it]
 22%|██▏       | 8519/37963 [36:30:51<157:20:33, 19.24s/it]
 22%|██▏       | 8520/37963 [36:31:05<143:39:00, 17.56s/it]
                                                           
{'loss': '0.1705', 'grad_norm': '3.644', 'learning_rate': '1.808e-05', 'epoch': '0.2244'}

 22%|██▏       | 8520/37963 [36:31:05<143:39:00, 17.56s/it]
 22%|██▏       | 8521/37963 [36:31:18<134:14:47, 16.41s/it]
 22%|██▏       | 8522/37963 [36:31:33<128:59:12, 15.77s/it]
 22%|██▏       | 8523/37963 [36:31:47<125:39:41, 15.37s/it]
 22%|██▏       | 8524/37963 [36:32:01<122:42:29, 15.01s/it]
 22%|██▏       | 8525/37963 [36:32:16<121:04:51, 14.81s/it]
 22%|██▏       | 8526/37963 [36:32:30<120:03:25, 14.68s/it]
 22%|██▏       | 8527/37963 [36:32:44<118:14:03, 14.46s/it]
 22%|██▏       | 8528/37963 [36:32:58<117:59:12, 14.43s/it]
 22%|██▏       | 8529/37963 [36:33:12<115:51:08, 14.17s/it]
 22%|██▏       | 8530/37963 [36:33:26<116:17:59, 14.22s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '1.141', 'learning_rate': '1.808e-05', 'epoch': '0.2247'}

 22%|██▏       | 8530/37963 [36:33:26<116:17:59, 14.22s/it]
 22%|██▏       | 8531/37963 [36:33:41<116:44:34, 14.28s/it]
 22%|██▏       | 8532/37963 [36:33:55<117:01:09, 14.31s/it]
 22%|██▏       | 8533/37963 [36:34:09<116:51:38, 14.29s/it]
 22%|██▏       | 8534/37963 [36:34:23<116:19:47, 14.23s/it]
 22%|██▏       | 8535/37963 [36:34:38<116:33:17, 14.26s/it]
 22%|██▏       | 8536/37963 [36:34:52<116:45:12, 14.28s/it]
 22%|██▏       | 8537/37963 [36:35:06<116:11:02, 14.21s/it]
 22%|██▏       | 8538/37963 [36:35:21<116:34:57, 14.26s/it]
 22%|██▏       | 8539/37963 [36:35:41<131:49:50, 16.13s/it]
 22%|██▏       | 8540/37963 [36:35:55<127:17:49, 15.58s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '3.075', 'learning_rate': '1.807e-05', 'epoch': '0.225'}

 22%|██▏       | 8540/37963 [36:35:55<127:17:49, 15.58s/it]
 22%|██▏       | 8541/37963 [36:36:10<124:16:02, 15.21s/it]
 23%|██▎       | 8542/37963 [36:36:24<121:25:05, 14.86s/it]
 23%|██▎       | 8543/37963 [36:36:38<119:17:55, 14.60s/it]
 23%|██▎       | 8544/37963 [36:36:52<118:32:13, 14.51s/it]
 23%|██▎       | 8545/37963 [36:37:06<118:25:34, 14.49s/it]
 23%|██▎       | 8546/37963 [36:37:21<118:12:11, 14.47s/it]
 23%|██▎       | 8547/37963 [36:37:35<118:14:45, 14.47s/it]
 23%|██▎       | 8548/37963 [36:37:49<116:51:58, 14.30s/it]
 23%|██▎       | 8549/37963 [36:38:10<132:52:26, 16.26s/it]
 23%|██▎       | 8550/37963 [36:38:24<128:19:35, 15.71s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '2.782', 'learning_rate': '1.807e-05', 'epoch': '0.2252'}

 23%|██▎       | 8550/37963 [36:38:24<128:19:35, 15.71s/it]
 23%|██▎       | 8551/37963 [36:38:39<125:07:27, 15.32s/it]
 23%|██▎       | 8552/37963 [36:38:53<122:48:21, 15.03s/it]
 23%|██▎       | 8553/37963 [36:39:14<137:09:51, 16.79s/it]
 23%|██▎       | 8554/37963 [36:39:29<131:17:27, 16.07s/it]
 23%|██▎       | 8555/37963 [36:39:43<126:28:31, 15.48s/it]
 23%|██▎       | 8556/37963 [36:39:57<123:43:23, 15.15s/it]
 23%|██▎       | 8557/37963 [36:40:11<121:48:44, 14.91s/it]
 23%|██▎       | 8558/37963 [36:40:26<120:20:13, 14.73s/it]
 23%|██▎       | 8559/37963 [36:40:40<119:40:19, 14.65s/it]
 23%|██▎       | 8560/37963 [36:41:00<133:15:59, 16.32s/it]
                                                           
{'loss': '0.1624', 'grad_norm': '2.02', 'learning_rate': '1.806e-05', 'epoch': '0.2255'}

 23%|██▎       | 8560/37963 [36:41:00<133:15:59, 16.32s/it]
 23%|██▎       | 8561/37963 [36:41:15<128:41:35, 15.76s/it]
 23%|██▎       | 8562/37963 [36:41:29<125:16:46, 15.34s/it]
 23%|██▎       | 8563/37963 [36:41:43<122:30:06, 15.00s/it]
 23%|██▎       | 8564/37963 [36:41:58<120:50:52, 14.80s/it]
 23%|██▎       | 8565/37963 [36:42:19<136:34:52, 16.73s/it]
 23%|██▎       | 8566/37963 [36:42:40<146:25:25, 17.93s/it]
 23%|██▎       | 8567/37963 [36:43:00<153:20:53, 18.78s/it]
 23%|██▎       | 8568/37963 [36:43:22<159:35:06, 19.54s/it]
 23%|██▎       | 8569/37963 [36:43:36<146:46:12, 17.98s/it]
 23%|██▎       | 8570/37963 [36:43:50<138:01:46, 16.91s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '0.7987', 'learning_rate': '1.806e-05', 'epoch': '0.2257'}

 23%|██▎       | 8570/37963 [36:43:50<138:01:46, 16.91s/it]
 23%|██▎       | 8571/37963 [36:44:05<131:40:51, 16.13s/it]
 23%|██▎       | 8572/37963 [36:44:19<127:13:39, 15.58s/it]
 23%|██▎       | 8573/37963 [36:44:33<123:59:13, 15.19s/it]
 23%|██▎       | 8574/37963 [36:44:48<121:56:46, 14.94s/it]
 23%|██▎       | 8575/37963 [36:45:02<120:40:26, 14.78s/it]
 23%|██▎       | 8576/37963 [36:45:16<119:39:00, 14.66s/it]
 23%|██▎       | 8577/37963 [36:45:31<118:19:50, 14.50s/it]
 23%|██▎       | 8578/37963 [36:45:45<118:19:54, 14.50s/it]
 23%|██▎       | 8579/37963 [36:45:59<115:56:14, 14.20s/it]
 23%|██▎       | 8580/37963 [36:46:13<116:23:04, 14.26s/it]
                                                           
{'loss': '0.1624', 'grad_norm': '2.354', 'learning_rate': '1.805e-05', 'epoch': '0.226'}

 23%|██▎       | 8580/37963 [36:46:13<116:23:04, 14.26s/it]
 23%|██▎       | 8581/37963 [36:46:27<116:41:46, 14.30s/it]
 23%|██▎       | 8582/37963 [36:46:42<116:31:06, 14.28s/it]
 23%|██▎       | 8583/37963 [36:46:56<116:43:40, 14.30s/it]
 23%|██▎       | 8584/37963 [36:47:10<116:24:32, 14.26s/it]
 23%|██▎       | 8585/37963 [36:47:24<116:18:15, 14.25s/it]
 23%|██▎       | 8586/37963 [36:47:39<116:32:32, 14.28s/it]
 23%|██▎       | 8587/37963 [36:47:53<116:49:25, 14.32s/it]
 23%|██▎       | 8588/37963 [36:48:07<116:02:51, 14.22s/it]
 23%|██▎       | 8589/37963 [36:48:21<116:10:10, 14.24s/it]
 23%|██▎       | 8590/37963 [36:48:36<115:53:09, 14.20s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '3.281', 'learning_rate': '1.805e-05', 'epoch': '0.2263'}

 23%|██▎       | 8590/37963 [36:48:36<115:53:09, 14.20s/it]
 23%|██▎       | 8591/37963 [36:48:57<134:02:48, 16.43s/it]
 23%|██▎       | 8592/37963 [36:49:12<128:55:05, 15.80s/it]
 23%|██▎       | 8593/37963 [36:49:26<125:32:45, 15.39s/it]
 23%|██▎       | 8594/37963 [36:49:40<123:15:34, 15.11s/it]
 23%|██▎       | 8595/37963 [36:49:55<121:08:20, 14.85s/it]
 23%|██▎       | 8596/37963 [36:50:15<135:50:34, 16.65s/it]
 23%|██▎       | 8597/37963 [36:50:29<128:37:57, 15.77s/it]
 23%|██▎       | 8598/37963 [36:50:44<125:19:59, 15.37s/it]
 23%|██▎       | 8599/37963 [36:50:58<122:41:13, 15.04s/it]
 23%|██▎       | 8600/37963 [36:51:12<120:51:14, 14.82s/it]
                                                           
{'loss': '0.1678', 'grad_norm': '1.866', 'learning_rate': '1.804e-05', 'epoch': '0.2265'}

 23%|██▎       | 8600/37963 [36:51:12<120:51:14, 14.82s/it]
 23%|██▎       | 8601/37963 [36:51:27<119:39:17, 14.67s/it]
 23%|██▎       | 8602/37963 [36:51:41<117:59:58, 14.47s/it]
 23%|██▎       | 8603/37963 [36:52:01<133:22:27, 16.35s/it]
 23%|██▎       | 8604/37963 [36:52:16<128:22:05, 15.74s/it]
 23%|██▎       | 8605/37963 [36:52:30<125:02:32, 15.33s/it]
 23%|██▎       | 8606/37963 [36:52:44<122:47:38, 15.06s/it]
 23%|██▎       | 8607/37963 [36:53:05<136:47:00, 16.77s/it]
 23%|██▎       | 8608/37963 [36:53:20<130:59:21, 16.06s/it]
 23%|██▎       | 8609/37963 [36:53:34<126:38:58, 15.53s/it]
 23%|██▎       | 8610/37963 [36:53:48<123:46:53, 15.18s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '0.8071', 'learning_rate': '1.804e-05', 'epoch': '0.2268'}

 23%|██▎       | 8610/37963 [36:53:48<123:46:53, 15.18s/it]
 23%|██▎       | 8611/37963 [36:54:03<121:53:08, 14.95s/it]
 23%|██▎       | 8612/37963 [36:54:17<120:39:15, 14.80s/it]
 23%|██▎       | 8613/37963 [36:54:31<119:02:03, 14.60s/it]
 23%|██▎       | 8614/37963 [36:54:52<133:00:26, 16.31s/it]
 23%|██▎       | 8615/37963 [36:55:12<144:07:48, 17.68s/it]
 23%|██▎       | 8616/37963 [36:55:27<136:33:26, 16.75s/it]
 23%|██▎       | 8617/37963 [36:55:48<147:33:32, 18.10s/it]
 23%|██▎       | 8618/37963 [36:56:09<153:57:06, 18.89s/it]
 23%|██▎       | 8619/37963 [36:56:23<141:14:21, 17.33s/it]
 23%|██▎       | 8620/37963 [36:56:37<133:52:53, 16.43s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '2.163', 'learning_rate': '1.803e-05', 'epoch': '0.2271'}

 23%|██▎       | 8620/37963 [36:56:37<133:52:53, 16.43s/it]
 23%|██▎       | 8621/37963 [36:56:51<128:47:11, 15.80s/it]
 23%|██▎       | 8622/37963 [36:57:06<125:12:47, 15.36s/it]
 23%|██▎       | 8623/37963 [36:57:20<121:33:04, 14.91s/it]
 23%|██▎       | 8624/37963 [36:57:34<120:17:46, 14.76s/it]
 23%|██▎       | 8625/37963 [36:57:48<118:50:44, 14.58s/it]
 23%|██▎       | 8626/37963 [36:58:02<117:50:19, 14.46s/it]
 23%|██▎       | 8627/37963 [36:58:16<116:06:46, 14.25s/it]
 23%|██▎       | 8628/37963 [36:58:30<114:25:15, 14.04s/it]
 23%|██▎       | 8629/37963 [36:58:44<115:08:36, 14.13s/it]
 23%|██▎       | 8630/37963 [36:58:58<115:43:31, 14.20s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '3.296', 'learning_rate': '1.803e-05', 'epoch': '0.2273'}

 23%|██▎       | 8630/37963 [36:58:58<115:43:31, 14.20s/it]
 23%|██▎       | 8631/37963 [36:59:13<116:19:35, 14.28s/it]
 23%|██▎       | 8632/37963 [36:59:27<115:24:58, 14.17s/it]
 23%|██▎       | 8633/37963 [36:59:40<114:31:55, 14.06s/it]
 23%|██▎       | 8634/37963 [36:59:55<114:54:14, 14.10s/it]
 23%|██▎       | 8635/37963 [37:00:09<114:41:18, 14.08s/it]
 23%|██▎       | 8636/37963 [37:00:23<115:29:16, 14.18s/it]
 23%|██▎       | 8637/37963 [37:00:37<115:29:45, 14.18s/it]
 23%|██▎       | 8638/37963 [37:00:52<116:04:06, 14.25s/it]
 23%|██▎       | 8639/37963 [37:01:06<116:10:02, 14.26s/it]
 23%|██▎       | 8640/37963 [37:01:27<133:04:36, 16.34s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '2.025', 'learning_rate': '1.802e-05', 'epoch': '0.2276'}

 23%|██▎       | 8640/37963 [37:01:27<133:04:36, 16.34s/it]
 23%|██▎       | 8641/37963 [37:01:42<128:16:49, 15.75s/it]
 23%|██▎       | 8642/37963 [37:01:56<124:43:37, 15.31s/it]
 23%|██▎       | 8643/37963 [37:02:10<122:40:52, 15.06s/it]
 23%|██▎       | 8644/37963 [37:02:25<121:10:04, 14.88s/it]
 23%|██▎       | 8645/37963 [37:02:39<119:53:48, 14.72s/it]
 23%|██▎       | 8646/37963 [37:02:59<133:01:53, 16.34s/it]
 23%|██▎       | 8647/37963 [37:03:13<127:17:54, 15.63s/it]
 23%|██▎       | 8648/37963 [37:03:27<122:50:47, 15.09s/it]
 23%|██▎       | 8649/37963 [37:03:41<121:01:26, 14.86s/it]
 23%|██▎       | 8650/37963 [37:03:55<117:44:04, 14.46s/it]
                                                           
{'loss': '0.1665', 'grad_norm': '2.42', 'learning_rate': '1.802e-05', 'epoch': '0.2279'}

 23%|██▎       | 8650/37963 [37:03:55<117:44:04, 14.46s/it]
 23%|██▎       | 8651/37963 [37:04:09<117:33:17, 14.44s/it]
 23%|██▎       | 8652/37963 [37:04:23<116:17:16, 14.28s/it]
 23%|██▎       | 8653/37963 [37:04:44<132:30:44, 16.28s/it]
 23%|██▎       | 8654/37963 [37:04:58<127:54:11, 15.71s/it]
 23%|██▎       | 8655/37963 [37:05:13<124:25:00, 15.28s/it]
 23%|██▎       | 8656/37963 [37:05:27<122:12:51, 15.01s/it]
 23%|██▎       | 8657/37963 [37:05:42<120:44:32, 14.83s/it]
 23%|██▎       | 8658/37963 [37:06:02<134:54:35, 16.57s/it]
 23%|██▎       | 8659/37963 [37:06:17<129:35:59, 15.92s/it]
 23%|██▎       | 8660/37963 [37:06:31<125:57:51, 15.48s/it]
                                                           
{'loss': '0.1667', 'grad_norm': '1.504', 'learning_rate': '1.801e-05', 'epoch': '0.2281'}

 23%|██▎       | 8660/37963 [37:06:31<125:57:51, 15.48s/it]
 23%|██▎       | 8661/37963 [37:06:45<123:15:01, 15.14s/it]
 23%|██▎       | 8662/37963 [37:07:00<121:10:01, 14.89s/it]
 23%|██▎       | 8663/37963 [37:07:13<118:26:01, 14.55s/it]
 23%|██▎       | 8664/37963 [37:07:34<133:14:09, 16.37s/it]
 23%|██▎       | 8665/37963 [37:08:02<162:15:39, 19.94s/it]
 23%|██▎       | 8666/37963 [37:08:16<147:17:01, 18.10s/it]
 23%|██▎       | 8667/37963 [37:08:37<153:47:47, 18.90s/it]
 23%|██▎       | 8668/37963 [37:08:51<142:39:26, 17.53s/it]
 23%|██▎       | 8669/37963 [37:09:06<135:11:25, 16.61s/it]
 23%|██▎       | 8670/37963 [37:09:19<127:16:13, 15.64s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '1.283', 'learning_rate': '1.801e-05', 'epoch': '0.2284'}

 23%|██▎       | 8670/37963 [37:09:19<127:16:13, 15.64s/it]
 23%|██▎       | 8671/37963 [37:09:33<124:11:11, 15.26s/it]
 23%|██▎       | 8672/37963 [37:09:48<122:02:05, 15.00s/it]
 23%|██▎       | 8673/37963 [37:10:02<120:35:06, 14.82s/it]
 23%|██▎       | 8674/37963 [37:10:17<119:25:46, 14.68s/it]
 23%|██▎       | 8675/37963 [37:10:31<118:05:01, 14.51s/it]
 23%|██▎       | 8676/37963 [37:10:45<117:45:54, 14.48s/it]
 23%|██▎       | 8677/37963 [37:10:59<116:36:14, 14.33s/it]
 23%|██▎       | 8678/37963 [37:11:14<116:50:02, 14.36s/it]
 23%|██▎       | 8679/37963 [37:11:28<116:42:21, 14.35s/it]
 23%|██▎       | 8680/37963 [37:11:42<116:32:49, 14.33s/it]
                                                           
{'loss': '0.1635', 'grad_norm': '2.419', 'learning_rate': '1.8e-05', 'epoch': '0.2286'}

 23%|██▎       | 8680/37963 [37:11:42<116:32:49, 14.33s/it]
 23%|██▎       | 8681/37963 [37:11:56<116:26:25, 14.32s/it]
 23%|██▎       | 8682/37963 [37:12:11<116:17:26, 14.30s/it]
 23%|██▎       | 8683/37963 [37:12:25<115:54:13, 14.25s/it]
 23%|██▎       | 8684/37963 [37:12:39<116:25:39, 14.32s/it]
 23%|██▎       | 8685/37963 [37:12:54<116:44:31, 14.35s/it]
 23%|██▎       | 8686/37963 [37:13:08<116:46:40, 14.36s/it]
 23%|██▎       | 8687/37963 [37:13:22<116:39:49, 14.35s/it]
 23%|██▎       | 8688/37963 [37:13:37<116:54:55, 14.38s/it]
 23%|██▎       | 8689/37963 [37:13:58<133:33:11, 16.42s/it]
 23%|██▎       | 8690/37963 [37:14:12<128:27:10, 15.80s/it]
                                                           
{'loss': '0.161', 'grad_norm': '2.475', 'learning_rate': '1.8e-05', 'epoch': '0.2289'}

 23%|██▎       | 8690/37963 [37:14:12<128:27:10, 15.80s/it]
 23%|██▎       | 8691/37963 [37:14:27<124:52:28, 15.36s/it]
 23%|██▎       | 8692/37963 [37:14:41<121:01:40, 14.89s/it]
 23%|██▎       | 8693/37963 [37:14:55<120:08:39, 14.78s/it]
 23%|██▎       | 8694/37963 [37:15:09<119:04:44, 14.65s/it]
 23%|██▎       | 8695/37963 [37:15:23<117:00:06, 14.39s/it]
 23%|██▎       | 8696/37963 [37:15:44<132:42:00, 16.32s/it]
 23%|██▎       | 8697/37963 [37:15:58<127:59:18, 15.74s/it]
 23%|██▎       | 8698/37963 [37:16:12<123:14:49, 15.16s/it]
 23%|██▎       | 8699/37963 [37:16:26<120:59:01, 14.88s/it]
 23%|██▎       | 8700/37963 [37:16:41<119:33:23, 14.71s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '1.367', 'learning_rate': '1.799e-05', 'epoch': '0.2292'}

 23%|██▎       | 8700/37963 [37:16:41<119:33:23, 14.71s/it]
 23%|██▎       | 8701/37963 [37:16:55<118:24:10, 14.57s/it]
 23%|██▎       | 8702/37963 [37:17:09<118:04:43, 14.53s/it]
 23%|██▎       | 8703/37963 [37:17:30<133:09:11, 16.38s/it]
 23%|██▎       | 8704/37963 [37:17:44<127:59:30, 15.75s/it]
 23%|██▎       | 8705/37963 [37:17:59<124:41:11, 15.34s/it]
 23%|██▎       | 8706/37963 [37:18:13<122:29:10, 15.07s/it]
 23%|██▎       | 8707/37963 [37:18:28<120:56:20, 14.88s/it]
 23%|██▎       | 8708/37963 [37:18:42<118:51:20, 14.63s/it]
 23%|██▎       | 8709/37963 [37:18:56<118:09:43, 14.54s/it]
 23%|██▎       | 8710/37963 [37:19:10<117:52:24, 14.51s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '2.158', 'learning_rate': '1.799e-05', 'epoch': '0.2294'}

 23%|██▎       | 8710/37963 [37:19:10<117:52:24, 14.51s/it]
 23%|██▎       | 8711/37963 [37:19:31<132:28:31, 16.30s/it]
 23%|██▎       | 8712/37963 [37:19:52<144:16:32, 17.76s/it]
 23%|██▎       | 8713/37963 [37:20:13<151:35:05, 18.66s/it]
 23%|██▎       | 8714/37963 [37:20:27<139:49:47, 17.21s/it]
 23%|██▎       | 8715/37963 [37:20:48<150:43:12, 18.55s/it]
 23%|██▎       | 8716/37963 [37:21:03<140:19:23, 17.27s/it]
 23%|██▎       | 8717/37963 [37:21:23<148:41:49, 18.30s/it]
 23%|██▎       | 8718/37963 [37:21:38<139:02:56, 17.12s/it]
 23%|██▎       | 8719/37963 [37:21:52<131:27:21, 16.18s/it]
 23%|██▎       | 8720/37963 [37:22:06<127:05:01, 15.64s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '1.374', 'learning_rate': '1.798e-05', 'epoch': '0.2297'}

 23%|██▎       | 8720/37963 [37:22:06<127:05:01, 15.64s/it]
 23%|██▎       | 8721/37963 [37:22:20<123:23:21, 15.19s/it]
 23%|██▎       | 8722/37963 [37:22:34<119:56:37, 14.77s/it]
 23%|██▎       | 8723/37963 [37:22:48<118:17:46, 14.56s/it]
 23%|██▎       | 8724/37963 [37:23:02<117:24:19, 14.46s/it]
 23%|██▎       | 8725/37963 [37:23:17<117:06:12, 14.42s/it]
 23%|██▎       | 8726/37963 [37:23:31<116:13:54, 14.31s/it]
 23%|██▎       | 8727/37963 [37:23:45<116:36:30, 14.36s/it]
 23%|██▎       | 8728/37963 [37:24:00<116:40:44, 14.37s/it]
 23%|██▎       | 8729/37963 [37:24:14<116:43:03, 14.37s/it]
 23%|██▎       | 8730/37963 [37:24:28<116:41:03, 14.37s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '1.01', 'learning_rate': '1.798e-05', 'epoch': '0.23'}

 23%|██▎       | 8730/37963 [37:24:28<116:41:03, 14.37s/it]
 23%|██▎       | 8731/37963 [37:24:43<116:32:46, 14.35s/it]
 23%|██▎       | 8732/37963 [37:24:57<116:38:18, 14.36s/it]
 23%|██▎       | 8733/37963 [37:25:11<116:04:10, 14.30s/it]
 23%|██▎       | 8734/37963 [37:25:25<115:13:32, 14.19s/it]
 23%|██▎       | 8735/37963 [37:25:39<114:36:48, 14.12s/it]
 23%|██▎       | 8736/37963 [37:26:00<131:31:06, 16.20s/it]
 23%|██▎       | 8737/37963 [37:26:15<127:10:36, 15.67s/it]
 23%|██▎       | 8738/37963 [37:26:29<123:56:30, 15.27s/it]
 23%|██▎       | 8739/37963 [37:26:43<121:32:13, 14.97s/it]
 23%|██▎       | 8740/37963 [37:26:57<119:50:37, 14.76s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '2.345', 'learning_rate': '1.797e-05', 'epoch': '0.2302'}

 23%|██▎       | 8740/37963 [37:26:57<119:50:37, 14.76s/it]
 23%|██▎       | 8741/37963 [37:27:12<118:35:49, 14.61s/it]
 23%|██▎       | 8742/37963 [37:27:26<117:57:14, 14.53s/it]
 23%|██▎       | 8743/37963 [37:27:40<117:32:27, 14.48s/it]
 23%|██▎       | 8744/37963 [37:27:55<116:58:23, 14.41s/it]
 23%|██▎       | 8745/37963 [37:28:16<133:30:02, 16.45s/it]
 23%|██▎       | 8746/37963 [37:28:30<128:22:11, 15.82s/it]
 23%|██▎       | 8747/37963 [37:28:45<124:41:55, 15.37s/it]
 23%|██▎       | 8748/37963 [37:28:59<121:24:28, 14.96s/it]
 23%|██▎       | 8749/37963 [37:29:12<118:11:41, 14.56s/it]
 23%|██▎       | 8750/37963 [37:29:33<132:58:00, 16.39s/it]
                                                           
{'loss': '0.161', 'grad_norm': '1.785', 'learning_rate': '1.797e-05', 'epoch': '0.2305'}

 23%|██▎       | 8750/37963 [37:29:33<132:58:00, 16.39s/it]
 23%|██▎       | 8751/37963 [37:29:47<127:26:35, 15.71s/it]
 23%|██▎       | 8752/37963 [37:30:01<124:02:28, 15.29s/it]
 23%|██▎       | 8753/37963 [37:30:16<121:45:58, 15.01s/it]
 23%|██▎       | 8754/37963 [37:30:30<120:08:47, 14.81s/it]
 23%|██▎       | 8755/37963 [37:30:44<118:29:24, 14.60s/it]
 23%|██▎       | 8756/37963 [37:30:58<117:47:54, 14.52s/it]
 23%|██▎       | 8757/37963 [37:31:13<117:19:19, 14.46s/it]
 23%|██▎       | 8758/37963 [37:31:33<132:34:53, 16.34s/it]
 23%|██▎       | 8759/37963 [37:31:48<127:41:37, 15.74s/it]
 23%|██▎       | 8760/37963 [37:32:09<141:51:10, 17.49s/it]
                                                           
{'loss': '0.1618', 'grad_norm': '1.966', 'learning_rate': '1.796e-05', 'epoch': '0.2308'}

 23%|██▎       | 8760/37963 [37:32:09<141:51:10, 17.49s/it]
 23%|██▎       | 8761/37963 [37:32:23<133:33:06, 16.46s/it]
 23%|██▎       | 8762/37963 [37:32:38<128:28:48, 15.84s/it]
 23%|██▎       | 8763/37963 [37:33:05<156:08:13, 19.25s/it]
 23%|██▎       | 8764/37963 [37:33:26<159:51:41, 19.71s/it]
 23%|██▎       | 8765/37963 [37:33:40<146:13:45, 18.03s/it]
 23%|██▎       | 8766/37963 [37:33:54<137:20:12, 16.93s/it]
 23%|██▎       | 8767/37963 [37:34:08<130:40:38, 16.11s/it]
 23%|██▎       | 8768/37963 [37:34:23<125:38:36, 15.49s/it]
 23%|██▎       | 8769/37963 [37:34:36<121:42:30, 15.01s/it]
 23%|██▎       | 8770/37963 [37:34:51<119:58:46, 14.80s/it]
                                                           
{'loss': '0.164', 'grad_norm': '1.721', 'learning_rate': '1.796e-05', 'epoch': '0.231'}

 23%|██▎       | 8770/37963 [37:34:51<119:58:46, 14.80s/it]
 23%|██▎       | 8771/37963 [37:35:05<118:53:58, 14.66s/it]
 23%|██▎       | 8772/37963 [37:35:19<118:16:56, 14.59s/it]
 23%|██▎       | 8773/37963 [37:35:34<117:10:20, 14.45s/it]
 23%|██▎       | 8774/37963 [37:35:48<116:52:30, 14.41s/it]
 23%|██▎       | 8775/37963 [37:36:02<116:21:21, 14.35s/it]
 23%|██▎       | 8776/37963 [37:36:16<116:13:22, 14.34s/it]
 23%|██▎       | 8777/37963 [37:36:31<116:04:09, 14.32s/it]
 23%|██▎       | 8778/37963 [37:36:45<116:06:14, 14.32s/it]
 23%|██▎       | 8779/37963 [37:36:59<116:05:01, 14.32s/it]
 23%|██▎       | 8780/37963 [37:37:14<116:13:54, 14.34s/it]
                                                           
{'loss': '0.1495', 'grad_norm': '1.206', 'learning_rate': '1.795e-05', 'epoch': '0.2313'}

 23%|██▎       | 8780/37963 [37:37:14<116:13:54, 14.34s/it]
 23%|██▎       | 8781/37963 [37:37:28<116:11:58, 14.33s/it]
 23%|██▎       | 8782/37963 [37:37:43<116:49:08, 14.41s/it]
 23%|██▎       | 8783/37963 [37:37:57<115:47:56, 14.29s/it]
 23%|██▎       | 8784/37963 [37:38:11<115:45:41, 14.28s/it]
 23%|██▎       | 8785/37963 [37:38:32<132:14:05, 16.32s/it]
 23%|██▎       | 8786/37963 [37:38:46<126:00:49, 15.55s/it]
 23%|██▎       | 8787/37963 [37:38:59<121:39:32, 15.01s/it]
 23%|██▎       | 8788/37963 [37:39:14<120:00:35, 14.81s/it]
 23%|██▎       | 8789/37963 [37:39:28<118:51:04, 14.67s/it]
 23%|██▎       | 8790/37963 [37:39:42<116:43:26, 14.40s/it]
                                                           
{'loss': '0.1661', 'grad_norm': '0.8654', 'learning_rate': '1.794e-05', 'epoch': '0.2315'}

 23%|██▎       | 8790/37963 [37:39:42<116:43:26, 14.40s/it]
 23%|██▎       | 8791/37963 [37:39:56<116:35:49, 14.39s/it]
 23%|██▎       | 8792/37963 [37:40:11<116:24:53, 14.37s/it]
 23%|██▎       | 8793/37963 [37:40:25<116:20:17, 14.36s/it]
 23%|██▎       | 8794/37963 [37:40:39<116:27:44, 14.37s/it]
 23%|██▎       | 8795/37963 [37:41:01<133:57:16, 16.53s/it]
 23%|██▎       | 8796/37963 [37:41:15<128:32:49, 15.87s/it]
 23%|██▎       | 8797/37963 [37:41:29<124:31:50, 15.37s/it]
 23%|██▎       | 8798/37963 [37:41:50<136:38:10, 16.87s/it]
 23%|██▎       | 8799/37963 [37:42:04<130:41:03, 16.13s/it]
 23%|██▎       | 8800/37963 [37:42:19<126:34:51, 15.63s/it]
                                                           
{'loss': '0.156', 'grad_norm': '2.235', 'learning_rate': '1.794e-05', 'epoch': '0.2318'}

 23%|██▎       | 8800/37963 [37:42:19<126:34:51, 15.63s/it]
 23%|██▎       | 8801/37963 [37:42:33<123:39:11, 15.26s/it]
 23%|██▎       | 8802/37963 [37:42:47<121:30:47, 15.00s/it]
 23%|██▎       | 8803/37963 [37:43:02<119:58:27, 14.81s/it]
 23%|██▎       | 8804/37963 [37:43:16<119:02:20, 14.70s/it]
 23%|██▎       | 8805/37963 [37:43:31<118:01:44, 14.57s/it]
 23%|██▎       | 8806/37963 [37:43:50<130:56:19, 16.17s/it]
 23%|██▎       | 8807/37963 [37:44:05<126:51:54, 15.66s/it]
 23%|██▎       | 8808/37963 [37:44:19<123:27:21, 15.24s/it]
 23%|██▎       | 8809/37963 [37:44:34<121:18:16, 14.98s/it]
 23%|██▎       | 8810/37963 [37:44:55<136:13:10, 16.82s/it]
                                                           
{'loss': '0.1891', 'grad_norm': '3.105', 'learning_rate': '1.793e-05', 'epoch': '0.2321'}

 23%|██▎       | 8810/37963 [37:44:55<136:13:10, 16.82s/it]
 23%|██▎       | 8811/37963 [37:45:09<130:22:48, 16.10s/it]
 23%|██▎       | 8812/37963 [37:45:30<142:48:19, 17.64s/it]
 23%|██▎       | 8813/37963 [37:45:51<149:59:25, 18.52s/it]
 23%|██▎       | 8814/37963 [37:46:12<155:21:17, 19.19s/it]
 23%|██▎       | 8815/37963 [37:46:26<143:40:58, 17.75s/it]
 23%|██▎       | 8816/37963 [37:46:40<135:24:20, 16.72s/it]
 23%|██▎       | 8817/37963 [37:46:54<128:45:21, 15.90s/it]
 23%|██▎       | 8818/37963 [37:47:09<124:44:30, 15.41s/it]
 23%|██▎       | 8819/37963 [37:47:22<120:46:57, 14.92s/it]
 23%|██▎       | 8820/37963 [37:47:37<119:15:57, 14.73s/it]
                                                           
{'loss': '0.1588', 'grad_norm': '1.591', 'learning_rate': '1.793e-05', 'epoch': '0.2323'}

 23%|██▎       | 8820/37963 [37:47:37<119:15:57, 14.73s/it]
 23%|██▎       | 8821/37963 [37:47:51<118:20:06, 14.62s/it]
 23%|██▎       | 8822/37963 [37:48:05<117:28:43, 14.51s/it]
 23%|██▎       | 8823/37963 [37:48:20<117:57:07, 14.57s/it]
 23%|██▎       | 8824/37963 [37:48:34<117:28:07, 14.51s/it]
 23%|██▎       | 8825/37963 [37:48:49<117:01:33, 14.46s/it]
 23%|██▎       | 8826/37963 [37:49:03<116:42:44, 14.42s/it]
 23%|██▎       | 8827/37963 [37:49:17<116:17:40, 14.37s/it]
 23%|██▎       | 8828/37963 [37:49:31<115:47:24, 14.31s/it]
 23%|██▎       | 8829/37963 [37:49:45<114:35:05, 14.16s/it]
 23%|██▎       | 8830/37963 [37:50:00<115:33:20, 14.28s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '1.233', 'learning_rate': '1.792e-05', 'epoch': '0.2326'}

 23%|██▎       | 8830/37963 [37:50:00<115:33:20, 14.28s/it]
 23%|██▎       | 8831/37963 [37:50:14<114:21:49, 14.13s/it]
 23%|██▎       | 8832/37963 [37:50:28<115:04:30, 14.22s/it]
 23%|██▎       | 8833/37963 [37:50:43<115:34:57, 14.28s/it]
 23%|██▎       | 8834/37963 [37:51:03<131:47:34, 16.29s/it]
 23%|██▎       | 8835/37963 [37:51:18<127:07:14, 15.71s/it]
 23%|██▎       | 8836/37963 [37:51:32<123:08:31, 15.22s/it]
 23%|██▎       | 8837/37963 [37:51:46<121:06:26, 14.97s/it]
 23%|██▎       | 8838/37963 [37:52:00<118:47:50, 14.68s/it]
 23%|██▎       | 8839/37963 [37:52:15<118:09:41, 14.61s/it]
 23%|██▎       | 8840/37963 [37:52:29<116:15:53, 14.37s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '7.446', 'learning_rate': '1.792e-05', 'epoch': '0.2329'}

 23%|██▎       | 8840/37963 [37:52:29<116:15:53, 14.37s/it]
 23%|██▎       | 8841/37963 [37:52:43<116:17:51, 14.38s/it]
 23%|██▎       | 8842/37963 [37:52:57<114:53:02, 14.20s/it]
 23%|██▎       | 8843/37963 [37:53:11<115:11:16, 14.24s/it]
 23%|██▎       | 8844/37963 [37:53:25<115:26:20, 14.27s/it]
 23%|██▎       | 8845/37963 [37:53:46<131:04:01, 16.20s/it]
 23%|██▎       | 8846/37963 [37:54:01<126:39:10, 15.66s/it]
 23%|██▎       | 8847/37963 [37:54:21<138:19:46, 17.10s/it]
 23%|██▎       | 8848/37963 [37:54:35<131:50:06, 16.30s/it]
 23%|██▎       | 8849/37963 [37:54:50<127:24:04, 15.75s/it]
 23%|██▎       | 8850/37963 [37:55:04<123:47:33, 15.31s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '0.9547', 'learning_rate': '1.791e-05', 'epoch': '0.2331'}

 23%|██▎       | 8850/37963 [37:55:04<123:47:33, 15.31s/it]
 23%|██▎       | 8851/37963 [37:55:19<121:50:57, 15.07s/it]
 23%|██▎       | 8852/37963 [37:55:33<119:59:50, 14.84s/it]
 23%|██▎       | 8853/37963 [37:55:47<118:46:47, 14.69s/it]
 23%|██▎       | 8854/37963 [37:56:02<118:03:07, 14.60s/it]
 23%|██▎       | 8855/37963 [37:56:23<134:08:53, 16.59s/it]
 23%|██▎       | 8856/37963 [37:56:37<128:05:52, 15.84s/it]
 23%|██▎       | 8857/37963 [37:56:51<124:12:55, 15.36s/it]
 23%|██▎       | 8858/37963 [37:57:05<121:16:30, 15.00s/it]
 23%|██▎       | 8859/37963 [37:57:27<136:05:32, 16.83s/it]
 23%|██▎       | 8860/37963 [37:57:41<130:07:45, 16.10s/it]
                                                           
{'loss': '0.1661', 'grad_norm': '4.772', 'learning_rate': '1.791e-05', 'epoch': '0.2334'}

 23%|██▎       | 8860/37963 [37:57:41<130:07:45, 16.10s/it]
 23%|██▎       | 8861/37963 [37:58:02<141:28:51, 17.50s/it]
 23%|██▎       | 8862/37963 [37:58:29<164:27:30, 20.34s/it]
 23%|██▎       | 8863/37963 [37:58:43<149:51:33, 18.54s/it]
 23%|██▎       | 8864/37963 [37:58:57<139:30:04, 17.26s/it]
 23%|██▎       | 8865/37963 [37:59:12<132:30:38, 16.39s/it]
 23%|██▎       | 8866/37963 [37:59:26<127:27:05, 15.77s/it]
 23%|██▎       | 8867/37963 [37:59:40<124:24:41, 15.39s/it]
 23%|██▎       | 8868/37963 [37:59:55<121:49:01, 15.07s/it]
 23%|██▎       | 8869/37963 [38:00:09<120:07:10, 14.86s/it]
 23%|██▎       | 8870/37963 [38:00:23<118:40:37, 14.69s/it]
                                                           
{'loss': '0.1635', 'grad_norm': '2.096', 'learning_rate': '1.79e-05', 'epoch': '0.2336'}

 23%|██▎       | 8870/37963 [38:00:23<118:40:37, 14.69s/it]
 23%|██▎       | 8871/37963 [38:00:38<117:51:14, 14.58s/it]
 23%|██▎       | 8872/37963 [38:00:52<115:45:15, 14.32s/it]
 23%|██▎       | 8873/37963 [38:01:06<116:00:11, 14.36s/it]
 23%|██▎       | 8874/37963 [38:01:20<115:24:36, 14.28s/it]
 23%|██▎       | 8875/37963 [38:01:34<115:45:01, 14.33s/it]
 23%|██▎       | 8876/37963 [38:01:49<115:52:14, 14.34s/it]
 23%|██▎       | 8877/37963 [38:02:03<115:58:30, 14.35s/it]
 23%|██▎       | 8878/37963 [38:02:18<115:52:49, 14.34s/it]
 23%|██▎       | 8879/37963 [38:02:32<115:56:45, 14.35s/it]
 23%|██▎       | 8880/37963 [38:02:46<115:04:40, 14.24s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '4.868', 'learning_rate': '1.79e-05', 'epoch': '0.2339'}

 23%|██▎       | 8880/37963 [38:02:46<115:04:40, 14.24s/it]
 23%|██▎       | 8881/37963 [38:03:00<115:36:50, 14.31s/it]
 23%|██▎       | 8882/37963 [38:03:21<131:57:30, 16.34s/it]
 23%|██▎       | 8883/37963 [38:03:36<127:12:23, 15.75s/it]
 23%|██▎       | 8884/37963 [38:03:50<122:57:25, 15.22s/it]
 23%|██▎       | 8885/37963 [38:04:05<121:47:41, 15.08s/it]
 23%|██▎       | 8886/37963 [38:04:18<118:31:03, 14.67s/it]
 23%|██▎       | 8887/37963 [38:04:33<117:41:37, 14.57s/it]
 23%|██▎       | 8888/37963 [38:04:47<117:17:39, 14.52s/it]
 23%|██▎       | 8889/37963 [38:05:01<117:01:12, 14.49s/it]
 23%|██▎       | 8890/37963 [38:05:16<116:26:46, 14.42s/it]
                                                           
{'loss': '0.1498', 'grad_norm': '6.35', 'learning_rate': '1.789e-05', 'epoch': '0.2342'}

 23%|██▎       | 8890/37963 [38:05:16<116:26:46, 14.42s/it]
 23%|██▎       | 8891/37963 [38:05:36<130:02:47, 16.10s/it]
 23%|██▎       | 8892/37963 [38:05:50<125:45:25, 15.57s/it]
 23%|██▎       | 8893/37963 [38:06:03<120:06:16, 14.87s/it]
 23%|██▎       | 8894/37963 [38:06:17<118:04:03, 14.62s/it]
 23%|██▎       | 8895/37963 [38:06:32<117:29:08, 14.55s/it]
 23%|██▎       | 8896/37963 [38:06:46<117:22:56, 14.54s/it]
 23%|██▎       | 8897/37963 [38:07:01<116:55:51, 14.48s/it]
 23%|██▎       | 8898/37963 [38:07:15<116:19:34, 14.41s/it]
 23%|██▎       | 8899/37963 [38:07:29<116:11:31, 14.39s/it]
 23%|██▎       | 8900/37963 [38:07:50<131:50:52, 16.33s/it]
                                                           
{'loss': '0.1727', 'grad_norm': '1.898', 'learning_rate': '1.789e-05', 'epoch': '0.2344'}

 23%|██▎       | 8900/37963 [38:07:50<131:50:52, 16.33s/it]
 23%|██▎       | 8901/37963 [38:08:11<143:06:47, 17.73s/it]
 23%|██▎       | 8902/37963 [38:08:25<134:57:25, 16.72s/it]
 23%|██▎       | 8903/37963 [38:08:40<129:03:57, 15.99s/it]
 23%|██▎       | 8904/37963 [38:08:54<125:01:10, 15.49s/it]
 23%|██▎       | 8905/37963 [38:09:08<122:15:34, 15.15s/it]
 23%|██▎       | 8906/37963 [38:09:23<120:20:46, 14.91s/it]
 23%|██▎       | 8907/37963 [38:09:37<118:55:46, 14.74s/it]
 23%|██▎       | 8908/37963 [38:09:51<117:58:54, 14.62s/it]
 23%|██▎       | 8909/37963 [38:10:06<117:18:18, 14.53s/it]
 23%|██▎       | 8910/37963 [38:10:28<135:24:01, 16.78s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '5.353', 'learning_rate': '1.788e-05', 'epoch': '0.2347'}

 23%|██▎       | 8910/37963 [38:10:28<135:24:01, 16.78s/it]
 23%|██▎       | 8911/37963 [38:10:56<162:05:10, 20.09s/it]
 23%|██▎       | 8912/37963 [38:11:10<148:20:45, 18.38s/it]
 23%|██▎       | 8913/37963 [38:11:31<154:11:35, 19.11s/it]
 23%|██▎       | 8914/37963 [38:11:45<142:58:41, 17.72s/it]
 23%|██▎       | 8915/37963 [38:12:00<134:49:58, 16.71s/it]
 23%|██▎       | 8916/37963 [38:12:14<129:00:25, 15.99s/it]
 23%|██▎       | 8917/37963 [38:12:28<124:11:56, 15.39s/it]
 23%|██▎       | 8918/37963 [38:12:42<121:43:42, 15.09s/it]
 23%|██▎       | 8919/37963 [38:12:57<119:49:53, 14.85s/it]
 23%|██▎       | 8920/37963 [38:13:11<118:51:14, 14.73s/it]
                                                           
{'loss': '0.1611', 'grad_norm': '2.954', 'learning_rate': '1.788e-05', 'epoch': '0.235'}

 23%|██▎       | 8920/37963 [38:13:11<118:51:14, 14.73s/it]
 23%|██▎       | 8921/37963 [38:13:25<117:47:33, 14.60s/it]
 24%|██▎       | 8922/37963 [38:13:40<117:13:07, 14.53s/it]
 24%|██▎       | 8923/37963 [38:13:54<117:07:39, 14.52s/it]
 24%|██▎       | 8924/37963 [38:14:08<115:25:52, 14.31s/it]
 24%|██▎       | 8925/37963 [38:14:22<114:21:55, 14.18s/it]
 24%|██▎       | 8926/37963 [38:14:36<115:10:55, 14.28s/it]
 24%|██▎       | 8927/37963 [38:14:50<114:27:10, 14.19s/it]
 24%|██▎       | 8928/37963 [38:15:05<114:52:37, 14.24s/it]
 24%|██▎       | 8929/37963 [38:15:26<131:32:41, 16.31s/it]
 24%|██▎       | 8930/37963 [38:15:40<126:54:13, 15.74s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '1.986', 'learning_rate': '1.787e-05', 'epoch': '0.2352'}

 24%|██▎       | 8930/37963 [38:15:40<126:54:13, 15.74s/it]
 24%|██▎       | 8931/37963 [38:15:55<123:37:03, 15.33s/it]
 24%|██▎       | 8932/37963 [38:16:09<120:54:24, 14.99s/it]
 24%|██▎       | 8933/37963 [38:16:23<119:19:26, 14.80s/it]
 24%|██▎       | 8934/37963 [38:16:37<116:40:11, 14.47s/it]
 24%|██▎       | 8935/37963 [38:16:51<116:21:56, 14.43s/it]
 24%|██▎       | 8936/37963 [38:17:05<115:36:13, 14.34s/it]
 24%|██▎       | 8937/37963 [38:17:20<115:42:23, 14.35s/it]
 24%|██▎       | 8938/37963 [38:17:33<114:08:45, 14.16s/it]
 24%|██▎       | 8939/37963 [38:17:48<114:08:40, 14.16s/it]
 24%|██▎       | 8940/37963 [38:18:08<130:05:07, 16.14s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '6.846', 'learning_rate': '1.787e-05', 'epoch': '0.2355'}

 24%|██▎       | 8940/37963 [38:18:08<130:05:07, 16.14s/it]
 24%|██▎       | 8941/37963 [38:18:23<125:50:56, 15.61s/it]
 24%|██▎       | 8942/37963 [38:18:37<121:52:46, 15.12s/it]
 24%|██▎       | 8943/37963 [38:18:51<119:58:50, 14.88s/it]
 24%|██▎       | 8944/37963 [38:19:05<118:06:19, 14.65s/it]
 24%|██▎       | 8945/37963 [38:19:19<117:07:58, 14.53s/it]
 24%|██▎       | 8946/37963 [38:19:33<115:28:41, 14.33s/it]
 24%|██▎       | 8947/37963 [38:19:48<115:31:13, 14.33s/it]
 24%|██▎       | 8948/37963 [38:20:02<115:35:52, 14.34s/it]
 24%|██▎       | 8949/37963 [38:20:16<115:32:49, 14.34s/it]
 24%|██▎       | 8950/37963 [38:20:36<128:40:29, 15.97s/it]
                                                           
{'loss': '0.1708', 'grad_norm': '2.135', 'learning_rate': '1.786e-05', 'epoch': '0.2358'}

 24%|██▎       | 8950/37963 [38:20:36<128:40:29, 15.97s/it]
 24%|██▎       | 8951/37963 [38:20:50<124:41:27, 15.47s/it]
 24%|██▎       | 8952/37963 [38:21:10<135:42:35, 16.84s/it]
 24%|██▎       | 8953/37963 [38:21:25<129:44:45, 16.10s/it]
 24%|██▎       | 8954/37963 [38:21:39<124:41:51, 15.47s/it]
 24%|██▎       | 8955/37963 [38:21:53<121:49:38, 15.12s/it]
 24%|██▎       | 8956/37963 [38:22:08<120:05:23, 14.90s/it]
 24%|██▎       | 8957/37963 [38:22:22<118:27:08, 14.70s/it]
 24%|██▎       | 8958/37963 [38:22:43<134:24:29, 16.68s/it]
 24%|██▎       | 8959/37963 [38:22:57<128:39:29, 15.97s/it]
 24%|██▎       | 8960/37963 [38:23:18<140:59:32, 17.50s/it]
                                                           
{'loss': '0.1548', 'grad_norm': '4.304', 'learning_rate': '1.786e-05', 'epoch': '0.236'}

 24%|██▎       | 8960/37963 [38:23:18<140:59:32, 17.50s/it]
 24%|██▎       | 8961/37963 [38:23:39<147:21:03, 18.29s/it]
 24%|██▎       | 8962/37963 [38:23:59<153:22:24, 19.04s/it]
 24%|██▎       | 8963/37963 [38:24:13<141:26:06, 17.56s/it]
 24%|██▎       | 8964/37963 [38:24:27<132:31:34, 16.45s/it]
 24%|██▎       | 8965/37963 [38:24:42<127:29:55, 15.83s/it]
 24%|██▎       | 8966/37963 [38:24:56<123:50:55, 15.38s/it]
 24%|██▎       | 8967/37963 [38:25:10<121:04:54, 15.03s/it]
 24%|██▎       | 8968/37963 [38:25:24<117:34:42, 14.60s/it]
 24%|██▎       | 8969/37963 [38:25:38<117:11:13, 14.55s/it]
 24%|██▎       | 8970/37963 [38:25:52<116:06:45, 14.42s/it]
                                                           
{'loss': '0.1652', 'grad_norm': '2.977', 'learning_rate': '1.785e-05', 'epoch': '0.2363'}

 24%|██▎       | 8970/37963 [38:25:52<116:06:45, 14.42s/it]
 24%|██▎       | 8971/37963 [38:26:07<115:35:23, 14.35s/it]
 24%|██▎       | 8972/37963 [38:26:21<115:34:32, 14.35s/it]
 24%|██▎       | 8973/37963 [38:26:35<115:24:23, 14.33s/it]
 24%|██▎       | 8974/37963 [38:26:50<115:20:32, 14.32s/it]
 24%|██▎       | 8975/37963 [38:27:04<115:32:53, 14.35s/it]
 24%|██▎       | 8976/37963 [38:27:18<115:14:57, 14.31s/it]
 24%|██▎       | 8977/37963 [38:27:32<114:35:21, 14.23s/it]
 24%|██▎       | 8978/37963 [38:27:46<113:17:55, 14.07s/it]
 24%|██▎       | 8979/37963 [38:28:07<130:41:51, 16.23s/it]
 24%|██▎       | 8980/37963 [38:28:22<126:15:03, 15.68s/it]
                                                           
{'loss': '0.1778', 'grad_norm': '3.214', 'learning_rate': '1.785e-05', 'epoch': '0.2365'}

 24%|██▎       | 8980/37963 [38:28:22<126:15:03, 15.68s/it]
 24%|██▎       | 8981/37963 [38:28:36<122:57:52, 15.27s/it]
 24%|██▎       | 8982/37963 [38:28:50<120:42:56, 15.00s/it]
 24%|██▎       | 8983/37963 [38:29:05<119:15:26, 14.81s/it]
 24%|██▎       | 8984/37963 [38:29:19<118:18:12, 14.70s/it]
 24%|██▎       | 8985/37963 [38:29:33<117:11:32, 14.56s/it]
 24%|██▎       | 8986/37963 [38:29:48<116:42:35, 14.50s/it]
 24%|██▎       | 8987/37963 [38:30:07<129:31:54, 16.09s/it]
 24%|██▎       | 8988/37963 [38:30:22<124:54:26, 15.52s/it]
 24%|██▎       | 8989/37963 [38:30:36<121:59:11, 15.16s/it]
 24%|██▎       | 8990/37963 [38:30:50<119:30:21, 14.85s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '1.547', 'learning_rate': '1.784e-05', 'epoch': '0.2368'}

 24%|██▎       | 8990/37963 [38:30:50<119:30:21, 14.85s/it]
 24%|██▎       | 8991/37963 [38:31:04<116:59:50, 14.54s/it]
 24%|██▎       | 8992/37963 [38:31:18<115:34:39, 14.36s/it]
 24%|██▎       | 8993/37963 [38:31:32<115:12:47, 14.32s/it]
 24%|██▎       | 8994/37963 [38:31:46<114:33:07, 14.24s/it]
 24%|██▎       | 8995/37963 [38:32:00<114:48:55, 14.27s/it]
 24%|██▎       | 8996/37963 [38:32:14<114:10:10, 14.19s/it]
 24%|██▎       | 8997/37963 [38:32:35<129:47:04, 16.13s/it]
 24%|██▎       | 8998/37963 [38:32:49<124:05:13, 15.42s/it]
 24%|██▎       | 8999/37963 [38:33:10<138:06:53, 17.17s/it]
 24%|██▎       | 9000/37963 [38:33:24<131:18:46, 16.32s/it]
                                                           
{'loss': '0.1635', 'grad_norm': '6.239', 'learning_rate': '1.783e-05', 'epoch': '0.2371'}

 24%|██▎       | 9000/37963 [38:33:24<131:18:46, 16.32s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.51s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.51s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 24%|██▎       | 9001/37963 [38:35:12<351:29:31, 43.69s/it]
 24%|██▎       | 9002/37963 [38:35:26<280:49:26, 34.91s/it]
 24%|██▎       | 9003/37963 [38:35:41<231:19:39, 28.76s/it]
 24%|██▎       | 9004/37963 [38:35:55<196:32:55, 24.43s/it]
 24%|██▎       | 9005/37963 [38:36:17<190:31:32, 23.69s/it]
 24%|██▎       | 9006/37963 [38:36:31<168:00:17, 20.89s/it]
 24%|██▎       | 9007/37963 [38:36:46<152:10:04, 18.92s/it]
 24%|██▎       | 9008/37963 [38:37:06<155:00:12, 19.27s/it]
 24%|██▎       | 9009/37963 [38:37:27<159:12:53, 19.80s/it]
 24%|██▎       | 9010/37963 [38:37:48<161:39:16, 20.10s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '1.823', 'learning_rate': '1.783e-05', 'epoch': '0.2373'}

 24%|██▎       | 9010/37963 [38:37:48<161:39:16, 20.10s/it]
 24%|██▎       | 9011/37963 [38:38:02<148:06:07, 18.42s/it]
 24%|██▎       | 9012/37963 [38:38:16<137:21:37, 17.08s/it]
 24%|██▎       | 9013/37963 [38:38:31<130:48:58, 16.27s/it]
 24%|██▎       | 9014/37963 [38:38:45<125:16:21, 15.58s/it]
 24%|██▎       | 9015/37963 [38:38:59<122:25:42, 15.23s/it]
 24%|██▎       | 9016/37963 [38:39:13<120:15:25, 14.96s/it]
 24%|██▍       | 9017/37963 [38:39:28<118:42:41, 14.76s/it]
 24%|██▍       | 9018/37963 [38:39:42<117:50:55, 14.66s/it]
 24%|██▍       | 9019/37963 [38:39:56<116:21:26, 14.47s/it]
 24%|██▍       | 9020/37963 [38:40:10<116:08:06, 14.45s/it]
                                                           
{'loss': '0.1595', 'grad_norm': '2.788', 'learning_rate': '1.782e-05', 'epoch': '0.2376'}

 24%|██▍       | 9020/37963 [38:40:10<116:08:06, 14.45s/it]
 24%|██▍       | 9021/37963 [38:40:25<115:55:42, 14.42s/it]
 24%|██▍       | 9022/37963 [38:40:39<114:30:45, 14.24s/it]
 24%|██▍       | 9023/37963 [38:40:53<114:46:51, 14.28s/it]
 24%|██▍       | 9024/37963 [38:41:07<114:59:00, 14.30s/it]
 24%|██▍       | 9025/37963 [38:41:22<115:03:13, 14.31s/it]
 24%|██▍       | 9026/37963 [38:41:43<131:06:53, 16.31s/it]
 24%|██▍       | 9027/37963 [38:41:57<126:31:20, 15.74s/it]
 24%|██▍       | 9028/37963 [38:42:11<122:50:36, 15.28s/it]
 24%|██▍       | 9029/37963 [38:42:26<121:04:15, 15.06s/it]
 24%|██▍       | 9030/37963 [38:42:40<119:04:47, 14.82s/it]
                                                           
{'loss': '0.1636', 'grad_norm': '5.311', 'learning_rate': '1.782e-05', 'epoch': '0.2379'}

 24%|██▍       | 9030/37963 [38:42:40<119:04:47, 14.82s/it]
 24%|██▍       | 9031/37963 [38:42:54<118:03:42, 14.69s/it]
 24%|██▍       | 9032/37963 [38:43:09<117:18:41, 14.60s/it]
 24%|██▍       | 9033/37963 [38:43:23<116:49:47, 14.54s/it]
 24%|██▍       | 9034/37963 [38:43:43<130:32:06, 16.24s/it]
 24%|██▍       | 9035/37963 [38:43:58<126:07:14, 15.70s/it]
 24%|██▍       | 9036/37963 [38:44:12<121:57:30, 15.18s/it]
 24%|██▍       | 9037/37963 [38:44:26<119:51:32, 14.92s/it]
 24%|██▍       | 9038/37963 [38:44:41<118:36:02, 14.76s/it]
 24%|██▍       | 9039/37963 [38:44:55<117:33:53, 14.63s/it]
 24%|██▍       | 9040/37963 [38:45:09<116:55:54, 14.55s/it]
                                                           
{'loss': '0.1383', 'grad_norm': '1.158', 'learning_rate': '1.781e-05', 'epoch': '0.2381'}

 24%|██▍       | 9040/37963 [38:45:09<116:55:54, 14.55s/it]
 24%|██▍       | 9041/37963 [38:45:23<115:03:21, 14.32s/it]
 24%|██▍       | 9042/37963 [38:45:37<113:54:53, 14.18s/it]
 24%|██▍       | 9043/37963 [38:45:51<114:34:22, 14.26s/it]
 24%|██▍       | 9044/37963 [38:46:06<114:25:50, 14.24s/it]
 24%|██▍       | 9045/37963 [38:46:20<114:32:58, 14.26s/it]
 24%|██▍       | 9046/37963 [38:46:41<130:15:37, 16.22s/it]
 24%|██▍       | 9047/37963 [38:46:55<125:21:18, 15.61s/it]
 24%|██▍       | 9048/37963 [38:47:09<122:34:06, 15.26s/it]
 24%|██▍       | 9049/37963 [38:47:30<134:52:44, 16.79s/it]
 24%|██▍       | 9050/37963 [38:47:44<128:52:42, 16.05s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '2.553', 'learning_rate': '1.781e-05', 'epoch': '0.2384'}

 24%|██▍       | 9050/37963 [38:47:44<128:52:42, 16.05s/it]
 24%|██▍       | 9051/37963 [38:47:58<124:42:13, 15.53s/it]
 24%|██▍       | 9052/37963 [38:48:12<120:49:09, 15.04s/it]
 24%|██▍       | 9053/37963 [38:48:26<117:34:22, 14.64s/it]
 24%|██▍       | 9054/37963 [38:48:47<133:07:09, 16.58s/it]
 24%|██▍       | 9055/37963 [38:49:01<127:45:36, 15.91s/it]
 24%|██▍       | 9056/37963 [38:49:22<139:17:00, 17.35s/it]
 24%|██▍       | 9057/37963 [38:49:36<131:50:19, 16.42s/it]
 24%|██▍       | 9058/37963 [38:50:04<158:43:13, 19.77s/it]
 24%|██▍       | 9059/37963 [38:50:18<144:51:53, 18.04s/it]
 24%|██▍       | 9060/37963 [38:50:32<135:53:43, 16.93s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '1.531', 'learning_rate': '1.78e-05', 'epoch': '0.2387'}

 24%|██▍       | 9060/37963 [38:50:32<135:53:43, 16.93s/it]
 24%|██▍       | 9061/37963 [38:50:46<128:35:15, 16.02s/it]
 24%|██▍       | 9062/37963 [38:51:00<124:33:55, 15.52s/it]
 24%|██▍       | 9063/37963 [38:51:14<120:51:44, 15.06s/it]
 24%|██▍       | 9064/37963 [38:51:29<119:09:25, 14.84s/it]
 24%|██▍       | 9065/37963 [38:51:43<118:04:06, 14.71s/it]
 24%|██▍       | 9066/37963 [38:51:57<117:09:19, 14.60s/it]
 24%|██▍       | 9067/37963 [38:52:12<116:29:46, 14.51s/it]
 24%|██▍       | 9068/37963 [38:52:26<115:56:59, 14.45s/it]
 24%|██▍       | 9069/37963 [38:52:40<114:54:29, 14.32s/it]
 24%|██▍       | 9070/37963 [38:52:54<114:50:18, 14.31s/it]
                                                           
{'loss': '0.1588', 'grad_norm': '2.145', 'learning_rate': '1.78e-05', 'epoch': '0.2389'}

 24%|██▍       | 9070/37963 [38:52:54<114:50:18, 14.31s/it]
 24%|██▍       | 9071/37963 [38:53:09<114:59:01, 14.33s/it]
 24%|██▍       | 9072/37963 [38:53:23<115:07:21, 14.35s/it]
 24%|██▍       | 9073/37963 [38:53:38<115:12:12, 14.36s/it]
 24%|██▍       | 9074/37963 [38:53:58<129:59:58, 16.20s/it]
 24%|██▍       | 9075/37963 [38:54:12<124:49:31, 15.56s/it]
 24%|██▍       | 9076/37963 [38:54:26<122:01:53, 15.21s/it]
 24%|██▍       | 9077/37963 [38:54:40<118:40:36, 14.79s/it]
 24%|██▍       | 9078/37963 [38:54:55<117:42:06, 14.67s/it]
 24%|██▍       | 9079/37963 [38:55:09<116:58:00, 14.58s/it]
 24%|██▍       | 9080/37963 [38:55:23<116:14:00, 14.49s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '3.819', 'learning_rate': '1.779e-05', 'epoch': '0.2392'}

 24%|██▍       | 9080/37963 [38:55:23<116:14:00, 14.49s/it]
 24%|██▍       | 9081/37963 [38:55:37<115:01:05, 14.34s/it]
 24%|██▍       | 9082/37963 [38:55:52<115:04:04, 14.34s/it]
 24%|██▍       | 9083/37963 [38:56:12<129:23:08, 16.13s/it]
 24%|██▍       | 9084/37963 [38:56:26<125:03:45, 15.59s/it]
 24%|██▍       | 9085/37963 [38:56:41<122:14:49, 15.24s/it]
 24%|██▍       | 9086/37963 [38:56:55<120:04:36, 14.97s/it]
 24%|██▍       | 9087/37963 [38:57:09<118:33:08, 14.78s/it]
 24%|██▍       | 9088/37963 [38:57:24<117:29:05, 14.65s/it]
 24%|██▍       | 9089/37963 [38:57:38<116:36:48, 14.54s/it]
 24%|██▍       | 9090/37963 [38:57:52<115:21:27, 14.38s/it]
                                                           
{'loss': '0.1684', 'grad_norm': '1.935', 'learning_rate': '1.779e-05', 'epoch': '0.2394'}

 24%|██▍       | 9090/37963 [38:57:52<115:21:27, 14.38s/it]
 24%|██▍       | 9091/37963 [38:58:06<113:41:20, 14.18s/it]
 24%|██▍       | 9092/37963 [38:58:20<114:06:49, 14.23s/it]
 24%|██▍       | 9093/37963 [38:58:35<114:37:27, 14.29s/it]
 24%|██▍       | 9094/37963 [38:58:49<114:54:35, 14.33s/it]
 24%|██▍       | 9095/37963 [38:59:09<128:18:42, 16.00s/it]
 24%|██▍       | 9096/37963 [38:59:23<122:54:58, 15.33s/it]
 24%|██▍       | 9097/37963 [38:59:43<134:10:37, 16.73s/it]
 24%|██▍       | 9098/37963 [38:59:57<128:33:02, 16.03s/it]
 24%|██▍       | 9099/37963 [39:00:11<124:33:08, 15.53s/it]
 24%|██▍       | 9100/37963 [39:00:26<121:56:48, 15.21s/it]
                                                           
{'loss': '0.1643', 'grad_norm': '1.684', 'learning_rate': '1.778e-05', 'epoch': '0.2397'}

 24%|██▍       | 9100/37963 [39:00:26<121:56:48, 15.21s/it]
 24%|██▍       | 9101/37963 [39:00:47<135:33:10, 16.91s/it]
 24%|██▍       | 9102/37963 [39:01:01<130:01:41, 16.22s/it]
 24%|██▍       | 9103/37963 [39:01:22<141:52:51, 17.70s/it]
 24%|██▍       | 9104/37963 [39:01:37<133:57:49, 16.71s/it]
 24%|██▍       | 9105/37963 [39:01:51<127:22:46, 15.89s/it]
 24%|██▍       | 9106/37963 [39:02:05<123:35:23, 15.42s/it]
 24%|██▍       | 9107/37963 [39:02:32<152:11:24, 18.99s/it]
 24%|██▍       | 9108/37963 [39:02:47<141:10:16, 17.61s/it]
 24%|██▍       | 9109/37963 [39:03:01<132:23:29, 16.52s/it]
 24%|██▍       | 9110/37963 [39:03:15<127:08:30, 15.86s/it]
                                                           
{'loss': '0.151', 'grad_norm': '1.173', 'learning_rate': '1.778e-05', 'epoch': '0.24'}

 24%|██▍       | 9110/37963 [39:03:15<127:08:30, 15.86s/it]
 24%|██▍       | 9111/37963 [39:03:30<123:43:25, 15.44s/it]
 24%|██▍       | 9112/37963 [39:03:44<121:03:59, 15.11s/it]
 24%|██▍       | 9113/37963 [39:03:58<119:04:55, 14.86s/it]
 24%|██▍       | 9114/37963 [39:04:13<118:05:06, 14.74s/it]
 24%|██▍       | 9115/37963 [39:04:27<117:06:32, 14.61s/it]
 24%|██▍       | 9116/37963 [39:04:41<116:24:14, 14.53s/it]
 24%|██▍       | 9117/37963 [39:04:56<115:57:28, 14.47s/it]
 24%|██▍       | 9118/37963 [39:05:09<114:17:56, 14.27s/it]
 24%|██▍       | 9119/37963 [39:05:24<114:00:43, 14.23s/it]
 24%|██▍       | 9120/37963 [39:05:38<114:18:08, 14.27s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '1.959', 'learning_rate': '1.777e-05', 'epoch': '0.2402'}

 24%|██▍       | 9120/37963 [39:05:38<114:18:08, 14.27s/it]
 24%|██▍       | 9121/37963 [39:05:52<114:44:09, 14.32s/it]
 24%|██▍       | 9122/37963 [39:06:07<115:02:35, 14.36s/it]
 24%|██▍       | 9123/37963 [39:06:28<131:07:06, 16.37s/it]
 24%|██▍       | 9124/37963 [39:06:42<125:31:35, 15.67s/it]
 24%|██▍       | 9125/37963 [39:06:55<119:55:04, 14.97s/it]
 24%|██▍       | 9126/37963 [39:07:10<118:51:51, 14.84s/it]
 24%|██▍       | 9127/37963 [39:07:24<116:33:24, 14.55s/it]
 24%|██▍       | 9128/37963 [39:07:38<115:57:14, 14.48s/it]
 24%|██▍       | 9129/37963 [39:07:59<131:15:19, 16.39s/it]
 24%|██▍       | 9130/37963 [39:08:13<126:03:00, 15.74s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '3.274', 'learning_rate': '1.777e-05', 'epoch': '0.2405'}

 24%|██▍       | 9130/37963 [39:08:13<126:03:00, 15.74s/it]
 24%|██▍       | 9131/37963 [39:08:28<122:55:36, 15.35s/it]
 24%|██▍       | 9132/37963 [39:08:42<120:50:18, 15.09s/it]
 24%|██▍       | 9133/37963 [39:08:56<119:03:08, 14.87s/it]
 24%|██▍       | 9134/37963 [39:09:11<117:50:25, 14.72s/it]
 24%|██▍       | 9135/37963 [39:09:25<116:04:16, 14.49s/it]
 24%|██▍       | 9136/37963 [39:09:39<115:37:31, 14.44s/it]
 24%|██▍       | 9137/37963 [39:09:53<114:54:35, 14.35s/it]
 24%|██▍       | 9138/37963 [39:10:08<115:00:01, 14.36s/it]
 24%|██▍       | 9139/37963 [39:10:22<114:48:22, 14.34s/it]
 24%|██▍       | 9140/37963 [39:10:36<114:46:44, 14.34s/it]
                                                           
{'loss': '0.1683', 'grad_norm': '3.016', 'learning_rate': '1.776e-05', 'epoch': '0.2408'}

 24%|██▍       | 9140/37963 [39:10:36<114:46:44, 14.34s/it]
 24%|██▍       | 9141/37963 [39:10:50<114:44:38, 14.33s/it]
 24%|██▍       | 9142/37963 [39:11:05<114:43:18, 14.33s/it]
 24%|██▍       | 9143/37963 [39:11:26<130:08:31, 16.26s/it]
 24%|██▍       | 9144/37963 [39:11:40<125:41:40, 15.70s/it]
 24%|██▍       | 9145/37963 [39:11:54<121:34:26, 15.19s/it]
 24%|██▍       | 9146/37963 [39:12:08<118:09:48, 14.76s/it]
 24%|██▍       | 9147/37963 [39:12:28<132:35:50, 16.57s/it]
 24%|██▍       | 9148/37963 [39:12:42<126:06:54, 15.76s/it]
 24%|██▍       | 9149/37963 [39:12:57<122:36:35, 15.32s/it]
 24%|██▍       | 9150/37963 [39:13:11<120:22:25, 15.04s/it]
                                                           
{'loss': '0.1625', 'grad_norm': '1.819', 'learning_rate': '1.775e-05', 'epoch': '0.241'}

 24%|██▍       | 9150/37963 [39:13:11<120:22:25, 15.04s/it]
 24%|██▍       | 9151/37963 [39:13:33<136:00:16, 16.99s/it]
 24%|██▍       | 9152/37963 [39:13:47<129:35:50, 16.19s/it]
 24%|██▍       | 9153/37963 [39:14:08<140:55:25, 17.61s/it]
 24%|██▍       | 9154/37963 [39:14:22<133:22:34, 16.67s/it]
 24%|██▍       | 9155/37963 [39:14:43<142:11:18, 17.77s/it]
 24%|██▍       | 9156/37963 [39:15:04<149:38:12, 18.70s/it]
 24%|██▍       | 9157/37963 [39:15:18<139:29:52, 17.43s/it]
 24%|██▍       | 9158/37963 [39:15:32<131:08:31, 16.39s/it]
 24%|██▍       | 9159/37963 [39:15:46<125:44:36, 15.72s/it]
 24%|██▍       | 9160/37963 [39:16:00<122:30:12, 15.31s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '4.26', 'learning_rate': '1.775e-05', 'epoch': '0.2413'}

 24%|██▍       | 9160/37963 [39:16:00<122:30:12, 15.31s/it]
 24%|██▍       | 9161/37963 [39:16:15<120:08:43, 15.02s/it]
 24%|██▍       | 9162/37963 [39:16:29<118:05:15, 14.76s/it]
 24%|██▍       | 9163/37963 [39:16:43<116:12:28, 14.53s/it]
 24%|██▍       | 9164/37963 [39:16:57<115:26:56, 14.43s/it]
 24%|██▍       | 9165/37963 [39:17:12<115:20:39, 14.42s/it]
 24%|██▍       | 9166/37963 [39:17:25<113:54:23, 14.24s/it]
 24%|██▍       | 9167/37963 [39:17:40<113:44:24, 14.22s/it]
 24%|██▍       | 9168/37963 [39:17:54<113:37:31, 14.21s/it]
 24%|██▍       | 9169/37963 [39:18:08<113:55:54, 14.24s/it]
 24%|██▍       | 9170/37963 [39:18:29<130:36:00, 16.33s/it]
                                                           
{'loss': '0.1699', 'grad_norm': '0.8768', 'learning_rate': '1.774e-05', 'epoch': '0.2416'}

 24%|██▍       | 9170/37963 [39:18:29<130:36:00, 16.33s/it]
 24%|██▍       | 9171/37963 [39:18:44<125:51:02, 15.74s/it]
 24%|██▍       | 9172/37963 [39:18:58<122:28:32, 15.31s/it]
 24%|██▍       | 9173/37963 [39:19:12<119:38:21, 14.96s/it]
 24%|██▍       | 9174/37963 [39:19:26<118:17:46, 14.79s/it]
 24%|██▍       | 9175/37963 [39:19:41<116:47:02, 14.60s/it]
 24%|██▍       | 9176/37963 [39:20:01<130:23:05, 16.31s/it]
 24%|██▍       | 9177/37963 [39:20:15<125:43:58, 15.72s/it]
 24%|██▍       | 9178/37963 [39:20:30<122:24:24, 15.31s/it]
 24%|██▍       | 9179/37963 [39:20:44<119:59:35, 15.01s/it]
 24%|██▍       | 9180/37963 [39:20:58<118:30:05, 14.82s/it]
                                                           
{'loss': '0.1681', 'grad_norm': '3.881', 'learning_rate': '1.774e-05', 'epoch': '0.2418'}

 24%|██▍       | 9180/37963 [39:20:58<118:30:05, 14.82s/it]
 24%|██▍       | 9181/37963 [39:21:13<117:17:45, 14.67s/it]
 24%|██▍       | 9182/37963 [39:21:27<116:36:37, 14.59s/it]
 24%|██▍       | 9183/37963 [39:21:41<115:31:03, 14.45s/it]
 24%|██▍       | 9184/37963 [39:21:55<115:15:26, 14.42s/it]
 24%|██▍       | 9185/37963 [39:22:10<115:04:48, 14.40s/it]
 24%|██▍       | 9186/37963 [39:22:24<115:00:04, 14.39s/it]
 24%|██▍       | 9187/37963 [39:22:39<114:52:30, 14.37s/it]
 24%|██▍       | 9188/37963 [39:22:53<114:20:45, 14.31s/it]
 24%|██▍       | 9189/37963 [39:23:07<114:27:38, 14.32s/it]
 24%|██▍       | 9190/37963 [39:23:21<114:27:47, 14.32s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '1.799', 'learning_rate': '1.773e-05', 'epoch': '0.2421'}

 24%|██▍       | 9190/37963 [39:23:21<114:27:47, 14.32s/it]
 24%|██▍       | 9191/37963 [39:23:36<114:07:25, 14.28s/it]
 24%|██▍       | 9192/37963 [39:23:56<129:53:54, 16.25s/it]
 24%|██▍       | 9193/37963 [39:24:11<125:32:58, 15.71s/it]
 24%|██▍       | 9194/37963 [39:24:25<122:28:00, 15.32s/it]
 24%|██▍       | 9195/37963 [39:24:46<136:13:43, 17.05s/it]
 24%|██▍       | 9196/37963 [39:25:00<128:36:01, 16.09s/it]
 24%|██▍       | 9197/37963 [39:25:15<124:32:45, 15.59s/it]
 24%|██▍       | 9198/37963 [39:25:29<121:11:30, 15.17s/it]
 24%|██▍       | 9199/37963 [39:25:43<118:42:33, 14.86s/it]
 24%|██▍       | 9200/37963 [39:26:04<133:34:28, 16.72s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '2.003', 'learning_rate': '1.773e-05', 'epoch': '0.2423'}

 24%|██▍       | 9200/37963 [39:26:04<133:34:28, 16.72s/it]
 24%|██▍       | 9201/37963 [39:26:18<126:57:57, 15.89s/it]
 24%|██▍       | 9202/37963 [39:26:32<123:17:51, 15.43s/it]
 24%|██▍       | 9203/37963 [39:26:53<134:52:35, 16.88s/it]
 24%|██▍       | 9204/37963 [39:27:14<144:43:29, 18.12s/it]
 24%|██▍       | 9205/37963 [39:27:34<150:46:49, 18.88s/it]
 24%|██▍       | 9206/37963 [39:27:49<139:53:37, 17.51s/it]
 24%|██▍       | 9207/37963 [39:28:03<132:41:52, 16.61s/it]
 24%|██▍       | 9208/37963 [39:28:17<127:15:28, 15.93s/it]
 24%|██▍       | 9209/37963 [39:28:32<123:36:01, 15.47s/it]
 24%|██▍       | 9210/37963 [39:28:46<120:53:39, 15.14s/it]
                                                           
{'loss': '0.1772', 'grad_norm': '0.9884', 'learning_rate': '1.772e-05', 'epoch': '0.2426'}

 24%|██▍       | 9210/37963 [39:28:46<120:53:39, 15.14s/it]
 24%|██▍       | 9211/37963 [39:29:00<118:58:38, 14.90s/it]
 24%|██▍       | 9212/37963 [39:29:14<116:20:29, 14.57s/it]
 24%|██▍       | 9213/37963 [39:29:29<115:43:54, 14.49s/it]
 24%|██▍       | 9214/37963 [39:29:43<115:27:42, 14.46s/it]
 24%|██▍       | 9215/37963 [39:29:57<115:12:00, 14.43s/it]
 24%|██▍       | 9216/37963 [39:30:12<114:54:31, 14.39s/it]
 24%|██▍       | 9217/37963 [39:30:26<114:44:05, 14.37s/it]
 24%|██▍       | 9218/37963 [39:30:47<130:12:14, 16.31s/it]
 24%|██▍       | 9219/37963 [39:31:01<125:50:08, 15.76s/it]
 24%|██▍       | 9220/37963 [39:31:15<120:51:02, 15.14s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '2.499', 'learning_rate': '1.772e-05', 'epoch': '0.2429'}

 24%|██▍       | 9220/37963 [39:31:15<120:51:02, 15.14s/it]
 24%|██▍       | 9221/37963 [39:31:29<118:51:50, 14.89s/it]
 24%|██▍       | 9222/37963 [39:31:44<117:34:22, 14.73s/it]
 24%|██▍       | 9223/37963 [39:31:58<116:46:16, 14.63s/it]
 24%|██▍       | 9224/37963 [39:32:12<116:07:24, 14.55s/it]
 24%|██▍       | 9225/37963 [39:32:33<130:32:55, 16.35s/it]
 24%|██▍       | 9226/37963 [39:32:47<126:11:51, 15.81s/it]
 24%|██▍       | 9227/37963 [39:33:02<122:36:25, 15.36s/it]
 24%|██▍       | 9228/37963 [39:33:16<120:09:06, 15.05s/it]
 24%|██▍       | 9229/37963 [39:33:31<118:39:29, 14.87s/it]
 24%|██▍       | 9230/37963 [39:33:45<117:49:27, 14.76s/it]
                                                           
{'loss': '0.1741', 'grad_norm': '2.54', 'learning_rate': '1.771e-05', 'epoch': '0.2431'}

 24%|██▍       | 9230/37963 [39:33:45<117:49:27, 14.76s/it]
 24%|██▍       | 9231/37963 [39:33:59<116:23:20, 14.58s/it]
 24%|██▍       | 9232/37963 [39:34:14<116:00:51, 14.54s/it]
 24%|██▍       | 9233/37963 [39:34:28<115:31:33, 14.48s/it]
 24%|██▍       | 9234/37963 [39:34:42<114:09:07, 14.30s/it]
 24%|██▍       | 9235/37963 [39:34:56<114:37:18, 14.36s/it]
 24%|██▍       | 9236/37963 [39:35:11<114:29:08, 14.35s/it]
 24%|██▍       | 9237/37963 [39:35:25<113:57:39, 14.28s/it]
 24%|██▍       | 9238/37963 [39:35:39<113:58:16, 14.28s/it]
 24%|██▍       | 9239/37963 [39:35:53<113:26:42, 14.22s/it]
 24%|██▍       | 9240/37963 [39:36:07<112:57:53, 14.16s/it]
                                                           
{'loss': '0.1631', 'grad_norm': '3.571', 'learning_rate': '1.771e-05', 'epoch': '0.2434'}

 24%|██▍       | 9240/37963 [39:36:07<112:57:53, 14.16s/it]
 24%|██▍       | 9241/37963 [39:36:22<113:27:12, 14.22s/it]
 24%|██▍       | 9242/37963 [39:36:43<130:21:04, 16.34s/it]
 24%|██▍       | 9243/37963 [39:37:03<139:43:46, 17.51s/it]
 24%|██▍       | 9244/37963 [39:37:17<132:03:56, 16.55s/it]
 24%|██▍       | 9245/37963 [39:37:32<127:08:05, 15.94s/it]
 24%|██▍       | 9246/37963 [39:37:46<123:20:13, 15.46s/it]
 24%|██▍       | 9247/37963 [39:38:00<120:20:53, 15.09s/it]
 24%|██▍       | 9248/37963 [39:38:21<134:29:04, 16.86s/it]
 24%|██▍       | 9249/37963 [39:38:36<128:26:05, 16.10s/it]
 24%|██▍       | 9250/37963 [39:38:50<124:11:54, 15.57s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '1.327', 'learning_rate': '1.77e-05', 'epoch': '0.2437'}

 24%|██▍       | 9250/37963 [39:38:50<124:11:54, 15.57s/it]
 24%|██▍       | 9251/37963 [39:39:05<121:24:53, 15.22s/it]
 24%|██▍       | 9252/37963 [39:39:25<134:46:23, 16.90s/it]
 24%|██▍       | 9253/37963 [39:39:46<144:16:04, 18.09s/it]
 24%|██▍       | 9254/37963 [39:40:07<151:41:47, 19.02s/it]
 24%|██▍       | 9255/37963 [39:40:21<139:32:56, 17.50s/it]
 24%|██▍       | 9256/37963 [39:40:36<131:59:06, 16.55s/it]
 24%|██▍       | 9257/37963 [39:40:50<126:19:18, 15.84s/it]
 24%|██▍       | 9258/37963 [39:41:04<122:58:01, 15.42s/it]
 24%|██▍       | 9259/37963 [39:41:19<120:19:55, 15.09s/it]
 24%|██▍       | 9260/37963 [39:41:33<118:27:18, 14.86s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '1.058', 'learning_rate': '1.769e-05', 'epoch': '0.2439'}

 24%|██▍       | 9260/37963 [39:41:33<118:27:18, 14.86s/it]
 24%|██▍       | 9261/37963 [39:41:47<115:43:10, 14.51s/it]
 24%|██▍       | 9262/37963 [39:42:01<115:40:15, 14.51s/it]
 24%|██▍       | 9263/37963 [39:42:16<115:40:08, 14.51s/it]
 24%|██▍       | 9264/37963 [39:42:30<114:29:00, 14.36s/it]
 24%|██▍       | 9265/37963 [39:42:51<130:53:34, 16.42s/it]
 24%|██▍       | 9266/37963 [39:43:05<126:02:16, 15.81s/it]
 24%|██▍       | 9267/37963 [39:43:19<121:38:02, 15.26s/it]
 24%|██▍       | 9268/37963 [39:43:34<119:35:40, 15.00s/it]
 24%|██▍       | 9269/37963 [39:43:48<117:15:09, 14.71s/it]
 24%|██▍       | 9270/37963 [39:44:02<115:10:05, 14.45s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '1.541', 'learning_rate': '1.769e-05', 'epoch': '0.2442'}

 24%|██▍       | 9270/37963 [39:44:02<115:10:05, 14.45s/it]
 24%|██▍       | 9271/37963 [39:44:16<114:57:23, 14.42s/it]
 24%|██▍       | 9272/37963 [39:44:30<114:38:59, 14.39s/it]
 24%|██▍       | 9273/37963 [39:44:45<114:41:14, 14.39s/it]
 24%|██▍       | 9274/37963 [39:45:06<131:19:31, 16.48s/it]
 24%|██▍       | 9275/37963 [39:45:20<126:11:44, 15.84s/it]
 24%|██▍       | 9276/37963 [39:45:34<120:55:49, 15.18s/it]
 24%|██▍       | 9277/37963 [39:45:48<119:03:09, 14.94s/it]
 24%|██▍       | 9278/37963 [39:46:03<117:28:59, 14.74s/it]
 24%|██▍       | 9279/37963 [39:46:17<116:32:19, 14.63s/it]
 24%|██▍       | 9280/37963 [39:46:31<115:19:21, 14.47s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '1.254', 'learning_rate': '1.768e-05', 'epoch': '0.2444'}

 24%|██▍       | 9280/37963 [39:46:31<115:19:21, 14.47s/it]
 24%|██▍       | 9281/37963 [39:46:45<114:14:35, 14.34s/it]
 24%|██▍       | 9282/37963 [39:46:59<114:01:43, 14.31s/it]
 24%|██▍       | 9283/37963 [39:47:14<114:07:11, 14.32s/it]
 24%|██▍       | 9284/37963 [39:47:28<113:02:35, 14.19s/it]
 24%|██▍       | 9285/37963 [39:47:42<113:39:04, 14.27s/it]
 24%|██▍       | 9286/37963 [39:47:56<113:49:02, 14.29s/it]
 24%|██▍       | 9287/37963 [39:48:11<113:38:12, 14.27s/it]
 24%|██▍       | 9288/37963 [39:48:31<128:02:02, 16.07s/it]
 24%|██▍       | 9289/37963 [39:48:45<123:07:38, 15.46s/it]
 24%|██▍       | 9290/37963 [39:48:59<120:34:12, 15.14s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '5.068', 'learning_rate': '1.768e-05', 'epoch': '0.2447'}

 24%|██▍       | 9290/37963 [39:48:59<120:34:12, 15.14s/it]
 24%|██▍       | 9291/37963 [39:49:14<118:43:49, 14.91s/it]
 24%|██▍       | 9292/37963 [39:49:28<116:08:38, 14.58s/it]
 24%|██▍       | 9293/37963 [39:49:42<115:37:35, 14.52s/it]
 24%|██▍       | 9294/37963 [39:49:55<113:09:16, 14.21s/it]
 24%|██▍       | 9295/37963 [39:50:17<129:46:31, 16.30s/it]
 24%|██▍       | 9296/37963 [39:50:30<123:27:40, 15.50s/it]
 24%|██▍       | 9297/37963 [39:50:52<137:42:05, 17.29s/it]
 24%|██▍       | 9298/37963 [39:51:06<130:34:18, 16.40s/it]
 24%|██▍       | 9299/37963 [39:51:20<125:41:33, 15.79s/it]
 24%|██▍       | 9300/37963 [39:51:47<151:48:49, 19.07s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '3.988', 'learning_rate': '1.767e-05', 'epoch': '0.245'}

 24%|██▍       | 9300/37963 [39:51:47<151:48:49, 19.07s/it]
 25%|██▍       | 9301/37963 [39:52:01<140:25:30, 17.64s/it]
 25%|██▍       | 9302/37963 [39:52:16<132:35:47, 16.65s/it]
 25%|██▍       | 9303/37963 [39:52:30<127:23:39, 16.00s/it]
 25%|██▍       | 9304/37963 [39:52:51<139:53:54, 17.57s/it]
 25%|██▍       | 9305/37963 [39:53:06<132:03:25, 16.59s/it]
 25%|██▍       | 9306/37963 [39:53:20<126:49:31, 15.93s/it]
 25%|██▍       | 9307/37963 [39:53:34<123:00:26, 15.45s/it]
 25%|██▍       | 9308/37963 [39:53:49<120:40:24, 15.16s/it]
 25%|██▍       | 9309/37963 [39:54:03<118:44:41, 14.92s/it]
 25%|██▍       | 9310/37963 [39:54:18<117:27:06, 14.76s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '2.648', 'learning_rate': '1.767e-05', 'epoch': '0.2452'}

 25%|██▍       | 9310/37963 [39:54:18<117:27:06, 14.76s/it]
 25%|██▍       | 9311/37963 [39:54:38<131:27:34, 16.52s/it]
 25%|██▍       | 9312/37963 [39:54:52<125:02:50, 15.71s/it]
 25%|██▍       | 9313/37963 [39:55:06<121:47:28, 15.30s/it]
 25%|██▍       | 9314/37963 [39:55:21<119:31:36, 15.02s/it]
 25%|██▍       | 9315/37963 [39:55:35<117:47:38, 14.80s/it]
 25%|██▍       | 9316/37963 [39:55:49<116:43:11, 14.67s/it]
 25%|██▍       | 9317/37963 [39:56:04<116:04:56, 14.59s/it]
 25%|██▍       | 9318/37963 [39:56:18<115:39:13, 14.53s/it]
 25%|██▍       | 9319/37963 [39:56:33<115:20:50, 14.50s/it]
 25%|██▍       | 9320/37963 [39:56:47<114:19:45, 14.37s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '1.662', 'learning_rate': '1.766e-05', 'epoch': '0.2455'}

 25%|██▍       | 9320/37963 [39:56:47<114:19:45, 14.37s/it]
 25%|██▍       | 9321/37963 [39:57:01<114:44:39, 14.42s/it]
 25%|██▍       | 9322/37963 [39:57:16<114:42:14, 14.42s/it]
 25%|██▍       | 9323/37963 [39:57:36<129:30:46, 16.28s/it]
 25%|██▍       | 9324/37963 [39:57:51<124:49:56, 15.69s/it]
 25%|██▍       | 9325/37963 [39:58:05<121:37:33, 15.29s/it]
 25%|██▍       | 9326/37963 [39:58:19<119:30:19, 15.02s/it]
 25%|██▍       | 9327/37963 [39:58:34<118:03:34, 14.84s/it]
 25%|██▍       | 9328/37963 [39:58:48<116:58:43, 14.71s/it]
 25%|██▍       | 9329/37963 [39:59:02<115:45:35, 14.55s/it]
 25%|██▍       | 9330/37963 [39:59:17<115:12:10, 14.48s/it]
                                                           
{'loss': '0.1552', 'grad_norm': '0.9852', 'learning_rate': '1.766e-05', 'epoch': '0.2458'}

 25%|██▍       | 9330/37963 [39:59:17<115:12:10, 14.48s/it]
 25%|██▍       | 9331/37963 [39:59:31<114:49:09, 14.44s/it]
 25%|██▍       | 9332/37963 [39:59:45<114:28:41, 14.39s/it]
 25%|██▍       | 9333/37963 [40:00:00<114:43:27, 14.43s/it]
 25%|██▍       | 9334/37963 [40:00:14<114:04:10, 14.34s/it]
 25%|██▍       | 9335/37963 [40:00:35<129:51:30, 16.33s/it]
 25%|██▍       | 9336/37963 [40:00:49<124:56:20, 15.71s/it]
 25%|██▍       | 9337/37963 [40:01:04<121:40:13, 15.30s/it]
 25%|██▍       | 9338/37963 [40:01:18<119:29:17, 15.03s/it]
 25%|██▍       | 9339/37963 [40:01:33<118:14:14, 14.87s/it]
 25%|██▍       | 9340/37963 [40:01:47<117:01:31, 14.72s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '1.426', 'learning_rate': '1.765e-05', 'epoch': '0.246'}

 25%|██▍       | 9340/37963 [40:01:47<117:01:31, 14.72s/it]
 25%|██▍       | 9341/37963 [40:02:01<116:04:16, 14.60s/it]
 25%|██▍       | 9342/37963 [40:02:16<115:31:43, 14.53s/it]
 25%|██▍       | 9343/37963 [40:02:37<131:55:43, 16.59s/it]
 25%|██▍       | 9344/37963 [40:02:58<142:28:39, 17.92s/it]
 25%|██▍       | 9345/37963 [40:03:12<134:01:11, 16.86s/it]
 25%|██▍       | 9346/37963 [40:03:27<127:57:43, 16.10s/it]
 25%|██▍       | 9347/37963 [40:03:47<137:50:48, 17.34s/it]
 25%|██▍       | 9348/37963 [40:04:01<130:41:33, 16.44s/it]
 25%|██▍       | 9349/37963 [40:04:16<125:35:30, 15.80s/it]
 25%|██▍       | 9350/37963 [40:04:30<122:23:10, 15.40s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '7.313', 'learning_rate': '1.765e-05', 'epoch': '0.2463'}

 25%|██▍       | 9350/37963 [40:04:30<122:23:10, 15.40s/it]
 25%|██▍       | 9351/37963 [40:04:51<136:41:37, 17.20s/it]
 25%|██▍       | 9352/37963 [40:05:12<145:30:19, 18.31s/it]
 25%|██▍       | 9353/37963 [40:05:27<135:47:07, 17.09s/it]
 25%|██▍       | 9354/37963 [40:05:41<129:19:57, 16.27s/it]
 25%|██▍       | 9355/37963 [40:05:55<124:35:38, 15.68s/it]
 25%|██▍       | 9356/37963 [40:06:10<121:32:06, 15.29s/it]
 25%|██▍       | 9357/37963 [40:06:24<119:09:41, 15.00s/it]
 25%|██▍       | 9358/37963 [40:06:38<117:28:02, 14.78s/it]
 25%|██▍       | 9359/37963 [40:06:53<116:16:55, 14.63s/it]
 25%|██▍       | 9360/37963 [40:07:07<115:09:33, 14.49s/it]
                                                           
{'loss': '0.155', 'grad_norm': '3.989', 'learning_rate': '1.764e-05', 'epoch': '0.2466'}

 25%|██▍       | 9360/37963 [40:07:07<115:09:33, 14.49s/it]
 25%|██▍       | 9361/37963 [40:07:28<130:48:09, 16.46s/it]
 25%|██▍       | 9362/37963 [40:07:42<124:27:09, 15.66s/it]
 25%|██▍       | 9363/37963 [40:07:56<120:45:05, 15.20s/it]
 25%|██▍       | 9364/37963 [40:08:10<119:10:46, 15.00s/it]
 25%|██▍       | 9365/37963 [40:08:25<117:31:58, 14.80s/it]
 25%|██▍       | 9366/37963 [40:08:39<116:19:43, 14.64s/it]
 25%|██▍       | 9367/37963 [40:08:53<115:57:39, 14.60s/it]
 25%|██▍       | 9368/37963 [40:09:08<115:13:48, 14.51s/it]
 25%|██▍       | 9369/37963 [40:09:22<115:01:56, 14.48s/it]
 25%|██▍       | 9370/37963 [40:09:36<113:07:28, 14.24s/it]
                                                           
{'loss': '0.1716', 'grad_norm': '0.8756', 'learning_rate': '1.763e-05', 'epoch': '0.2468'}

 25%|██▍       | 9370/37963 [40:09:36<113:07:28, 14.24s/it]
 25%|██▍       | 9371/37963 [40:09:56<127:20:25, 16.03s/it]
 25%|██▍       | 9372/37963 [40:10:10<121:57:42, 15.36s/it]
 25%|██▍       | 9373/37963 [40:10:24<118:32:01, 14.93s/it]
 25%|██▍       | 9374/37963 [40:10:37<115:56:31, 14.60s/it]
 25%|██▍       | 9375/37963 [40:10:52<115:25:48, 14.54s/it]
 25%|██▍       | 9376/37963 [40:11:06<113:46:41, 14.33s/it]
 25%|██▍       | 9377/37963 [40:11:20<113:51:34, 14.34s/it]
 25%|██▍       | 9378/37963 [40:11:34<113:20:36, 14.27s/it]
 25%|██▍       | 9379/37963 [40:11:48<113:25:00, 14.28s/it]
 25%|██▍       | 9380/37963 [40:12:03<113:37:45, 14.31s/it]
                                                           
{'loss': '0.1525', 'grad_norm': '2.017', 'learning_rate': '1.763e-05', 'epoch': '0.2471'}

 25%|██▍       | 9380/37963 [40:12:03<113:37:45, 14.31s/it]
 25%|██▍       | 9381/37963 [40:12:17<113:44:40, 14.33s/it]
 25%|██▍       | 9382/37963 [40:12:32<114:00:25, 14.36s/it]
 25%|██▍       | 9383/37963 [40:12:46<114:08:40, 14.38s/it]
 25%|██▍       | 9384/37963 [40:13:07<129:19:33, 16.29s/it]
 25%|██▍       | 9385/37963 [40:13:21<124:27:35, 15.68s/it]
 25%|██▍       | 9386/37963 [40:13:35<121:03:51, 15.25s/it]
 25%|██▍       | 9387/37963 [40:13:50<118:53:24, 14.98s/it]
 25%|██▍       | 9388/37963 [40:14:04<117:25:46, 14.79s/it]
 25%|██▍       | 9389/37963 [40:14:18<115:34:25, 14.56s/it]
 25%|██▍       | 9390/37963 [40:14:32<115:11:09, 14.51s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '1.155', 'learning_rate': '1.762e-05', 'epoch': '0.2473'}

 25%|██▍       | 9390/37963 [40:14:32<115:11:09, 14.51s/it]
 25%|██▍       | 9391/37963 [40:14:47<114:29:08, 14.42s/it]
 25%|██▍       | 9392/37963 [40:15:14<145:48:32, 18.37s/it]
 25%|██▍       | 9393/37963 [40:15:29<136:24:26, 17.19s/it]
 25%|██▍       | 9394/37963 [40:15:50<145:04:39, 18.28s/it]
 25%|██▍       | 9395/37963 [40:16:04<136:02:58, 17.14s/it]
 25%|██▍       | 9396/37963 [40:16:19<129:50:08, 16.36s/it]
 25%|██▍       | 9397/37963 [40:16:33<124:57:10, 15.75s/it]
 25%|██▍       | 9398/37963 [40:16:47<121:45:58, 15.35s/it]
 25%|██▍       | 9399/37963 [40:17:08<135:47:14, 17.11s/it]
 25%|██▍       | 9400/37963 [40:17:29<143:03:08, 18.03s/it]
                                                           
{'loss': '0.159', 'grad_norm': '4.494', 'learning_rate': '1.762e-05', 'epoch': '0.2476'}

 25%|██▍       | 9400/37963 [40:17:29<143:03:08, 18.03s/it]
 25%|██▍       | 9401/37963 [40:17:43<134:14:13, 16.92s/it]
 25%|██▍       | 9402/37963 [40:17:57<128:13:11, 16.16s/it]
 25%|██▍       | 9403/37963 [40:18:12<123:59:45, 15.63s/it]
 25%|██▍       | 9404/37963 [40:18:26<120:59:49, 15.25s/it]
 25%|██▍       | 9405/37963 [40:18:40<118:16:01, 14.91s/it]
 25%|██▍       | 9406/37963 [40:18:54<115:53:51, 14.61s/it]
 25%|██▍       | 9407/37963 [40:19:08<115:09:41, 14.52s/it]
 25%|██▍       | 9408/37963 [40:19:23<114:09:34, 14.39s/it]
 25%|██▍       | 9409/37963 [40:19:36<113:00:43, 14.25s/it]
 25%|██▍       | 9410/37963 [40:19:57<129:03:43, 16.27s/it]
                                                           
{'loss': '0.1384', 'grad_norm': '1.328', 'learning_rate': '1.761e-05', 'epoch': '0.2479'}

 25%|██▍       | 9410/37963 [40:19:57<129:03:43, 16.27s/it]
 25%|██▍       | 9411/37963 [40:20:12<124:31:50, 15.70s/it]
 25%|██▍       | 9412/37963 [40:20:26<121:33:00, 15.33s/it]
 25%|██▍       | 9413/37963 [40:20:41<119:08:23, 15.02s/it]
 25%|██▍       | 9414/37963 [40:20:55<117:43:07, 14.84s/it]
 25%|██▍       | 9415/37963 [40:21:09<115:46:14, 14.60s/it]
 25%|██▍       | 9416/37963 [40:21:24<115:33:03, 14.57s/it]
 25%|██▍       | 9417/37963 [40:21:38<115:13:38, 14.53s/it]
 25%|██▍       | 9418/37963 [40:21:52<114:53:04, 14.49s/it]
 25%|██▍       | 9419/37963 [40:22:07<114:40:09, 14.46s/it]
 25%|██▍       | 9420/37963 [40:22:21<114:31:28, 14.44s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '1.911', 'learning_rate': '1.761e-05', 'epoch': '0.2481'}

 25%|██▍       | 9420/37963 [40:22:21<114:31:28, 14.44s/it]
 25%|██▍       | 9421/37963 [40:22:41<127:55:58, 16.14s/it]
 25%|██▍       | 9422/37963 [40:22:56<123:45:50, 15.61s/it]
 25%|██▍       | 9423/37963 [40:23:10<120:59:37, 15.26s/it]
 25%|██▍       | 9424/37963 [40:23:24<118:51:50, 14.99s/it]
 25%|██▍       | 9425/37963 [40:23:39<117:30:30, 14.82s/it]
 25%|██▍       | 9426/37963 [40:23:53<115:34:00, 14.58s/it]
 25%|██▍       | 9427/37963 [40:24:07<114:29:40, 14.44s/it]
 25%|██▍       | 9428/37963 [40:24:22<114:38:31, 14.46s/it]
 25%|██▍       | 9429/37963 [40:24:42<129:25:07, 16.33s/it]
 25%|██▍       | 9430/37963 [40:24:57<124:43:41, 15.74s/it]
                                                           
{'loss': '0.1724', 'grad_norm': '4.875', 'learning_rate': '1.76e-05', 'epoch': '0.2484'}

 25%|██▍       | 9430/37963 [40:24:57<124:43:41, 15.74s/it]
 25%|██▍       | 9431/37963 [40:25:11<120:37:56, 15.22s/it]
 25%|██▍       | 9432/37963 [40:25:25<118:30:50, 14.95s/it]
 25%|██▍       | 9433/37963 [40:25:39<116:11:21, 14.66s/it]
 25%|██▍       | 9434/37963 [40:25:53<115:43:31, 14.60s/it]
 25%|██▍       | 9435/37963 [40:26:08<114:44:48, 14.48s/it]
 25%|██▍       | 9436/37963 [40:26:22<114:26:57, 14.44s/it]
 25%|██▍       | 9437/37963 [40:26:36<114:14:59, 14.42s/it]
 25%|██▍       | 9438/37963 [40:26:50<113:31:18, 14.33s/it]
 25%|██▍       | 9439/37963 [40:27:11<128:30:15, 16.22s/it]
 25%|██▍       | 9440/37963 [40:27:32<139:40:55, 17.63s/it]
                                                           
{'loss': '0.1506', 'grad_norm': '0.9105', 'learning_rate': '1.76e-05', 'epoch': '0.2487'}

 25%|██▍       | 9440/37963 [40:27:32<139:40:55, 17.63s/it]
 25%|██▍       | 9441/37963 [40:27:46<131:48:05, 16.64s/it]
 25%|██▍       | 9442/37963 [40:28:00<125:41:33, 15.87s/it]
 25%|██▍       | 9443/37963 [40:28:21<136:54:03, 17.28s/it]
 25%|██▍       | 9444/37963 [40:28:35<129:59:40, 16.41s/it]
 25%|██▍       | 9445/37963 [40:28:50<125:45:05, 15.87s/it]
 25%|██▍       | 9446/37963 [40:29:04<121:44:41, 15.37s/it]
 25%|██▍       | 9447/37963 [40:29:19<119:25:35, 15.08s/it]
 25%|██▍       | 9448/37963 [40:29:40<133:39:57, 16.88s/it]
 25%|██▍       | 9449/37963 [40:29:54<127:34:23, 16.11s/it]
 25%|██▍       | 9450/37963 [40:30:15<138:31:14, 17.49s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '4.455', 'learning_rate': '1.759e-05', 'epoch': '0.2489'}

 25%|██▍       | 9450/37963 [40:30:15<138:31:14, 17.49s/it]
 25%|██▍       | 9451/37963 [40:30:29<131:00:14, 16.54s/it]
 25%|██▍       | 9452/37963 [40:30:43<125:42:35, 15.87s/it]
 25%|██▍       | 9453/37963 [40:30:57<121:46:59, 15.38s/it]
 25%|██▍       | 9454/37963 [40:31:11<118:09:47, 14.92s/it]
 25%|██▍       | 9455/37963 [40:31:26<116:28:12, 14.71s/it]
 25%|██▍       | 9456/37963 [40:31:40<115:39:51, 14.61s/it]
 25%|██▍       | 9457/37963 [40:31:54<115:11:20, 14.55s/it]
 25%|██▍       | 9458/37963 [40:32:09<115:08:08, 14.54s/it]
 25%|██▍       | 9459/37963 [40:32:23<114:43:47, 14.49s/it]
 25%|██▍       | 9460/37963 [40:32:38<114:19:57, 14.44s/it]
                                                           
{'loss': '0.1603', 'grad_norm': '1.075', 'learning_rate': '1.758e-05', 'epoch': '0.2492'}

 25%|██▍       | 9460/37963 [40:32:38<114:19:57, 14.44s/it]
 25%|██▍       | 9461/37963 [40:32:58<129:16:27, 16.33s/it]
 25%|██▍       | 9462/37963 [40:33:12<123:10:48, 15.56s/it]
 25%|██▍       | 9463/37963 [40:33:27<120:46:22, 15.26s/it]
 25%|██▍       | 9464/37963 [40:33:41<118:53:50, 15.02s/it]
 25%|██▍       | 9465/37963 [40:33:55<117:14:37, 14.81s/it]
 25%|██▍       | 9466/37963 [40:34:10<115:40:11, 14.61s/it]
 25%|██▍       | 9467/37963 [40:34:24<114:59:04, 14.53s/it]
 25%|██▍       | 9468/37963 [40:34:38<114:33:39, 14.47s/it]
 25%|██▍       | 9469/37963 [40:34:53<114:17:13, 14.44s/it]
 25%|██▍       | 9470/37963 [40:35:13<129:16:56, 16.33s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '1.519', 'learning_rate': '1.758e-05', 'epoch': '0.2495'}

 25%|██▍       | 9470/37963 [40:35:13<129:16:56, 16.33s/it]
 25%|██▍       | 9471/37963 [40:35:28<124:44:15, 15.76s/it]
 25%|██▍       | 9472/37963 [40:35:42<120:59:59, 15.29s/it]
 25%|██▍       | 9473/37963 [40:35:56<118:09:22, 14.93s/it]
 25%|██▍       | 9474/37963 [40:36:10<116:16:55, 14.69s/it]
 25%|██▍       | 9475/37963 [40:36:25<115:32:00, 14.60s/it]
 25%|██▍       | 9476/37963 [40:36:39<114:07:56, 14.42s/it]
 25%|██▍       | 9477/37963 [40:36:59<129:10:29, 16.32s/it]
 25%|██▍       | 9478/37963 [40:37:13<122:30:50, 15.48s/it]
 25%|██▍       | 9479/37963 [40:37:27<119:41:53, 15.13s/it]
 25%|██▍       | 9480/37963 [40:37:41<117:13:25, 14.82s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '0.853', 'learning_rate': '1.757e-05', 'epoch': '0.2497'}

 25%|██▍       | 9480/37963 [40:37:41<117:13:25, 14.82s/it]
 25%|██▍       | 9481/37963 [40:37:55<115:46:28, 14.63s/it]
 25%|██▍       | 9482/37963 [40:38:10<115:14:48, 14.57s/it]
 25%|██▍       | 9483/37963 [40:38:24<114:42:43, 14.50s/it]
 25%|██▍       | 9484/37963 [40:38:38<113:01:45, 14.29s/it]
 25%|██▍       | 9485/37963 [40:38:53<113:40:00, 14.37s/it]
 25%|██▍       | 9486/37963 [40:39:07<113:29:24, 14.35s/it]
 25%|██▍       | 9487/37963 [40:39:21<112:12:49, 14.19s/it]
 25%|██▍       | 9488/37963 [40:39:49<145:37:24, 18.41s/it]
 25%|██▍       | 9489/37963 [40:40:03<135:05:54, 17.08s/it]
 25%|██▍       | 9490/37963 [40:40:17<127:19:09, 16.10s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '2.7', 'learning_rate': '1.757e-05', 'epoch': '0.25'}

 25%|██▍       | 9490/37963 [40:40:17<127:19:09, 16.10s/it]
 25%|██▌       | 9491/37963 [40:40:37<138:17:15, 17.49s/it]
 25%|██▌       | 9492/37963 [40:40:52<131:16:31, 16.60s/it]
 25%|██▌       | 9493/37963 [40:41:06<125:54:23, 15.92s/it]
 25%|██▌       | 9494/37963 [40:41:20<120:58:53, 15.30s/it]
 25%|██▌       | 9495/37963 [40:41:35<118:56:01, 15.04s/it]
 25%|██▌       | 9496/37963 [40:41:48<116:06:01, 14.68s/it]
 25%|██▌       | 9497/37963 [40:42:09<131:06:10, 16.58s/it]
 25%|██▌       | 9498/37963 [40:42:24<125:27:55, 15.87s/it]
 25%|██▌       | 9499/37963 [40:42:38<122:08:19, 15.45s/it]
 25%|██▌       | 9500/37963 [40:42:52<119:23:55, 15.10s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '0.6999', 'learning_rate': '1.756e-05', 'epoch': '0.2502'}

 25%|██▌       | 9500/37963 [40:42:52<119:23:55, 15.10s/it]
 25%|██▌       | 9501/37963 [40:43:07<117:36:59, 14.88s/it]
 25%|██▌       | 9502/37963 [40:43:28<131:38:02, 16.65s/it]
 25%|██▌       | 9503/37963 [40:43:42<125:26:11, 15.87s/it]
 25%|██▌       | 9504/37963 [40:43:56<121:36:54, 15.38s/it]
 25%|██▌       | 9505/37963 [40:44:10<118:58:30, 15.05s/it]
 25%|██▌       | 9506/37963 [40:44:24<116:36:28, 14.75s/it]
 25%|██▌       | 9507/37963 [40:44:39<115:48:27, 14.65s/it]
 25%|██▌       | 9508/37963 [40:44:53<115:07:18, 14.56s/it]
 25%|██▌       | 9509/37963 [40:45:14<130:31:27, 16.51s/it]
 25%|██▌       | 9510/37963 [40:45:28<125:04:29, 15.83s/it]
                                                           
{'loss': '0.1536', 'grad_norm': '0.7812', 'learning_rate': '1.756e-05', 'epoch': '0.2505'}

 25%|██▌       | 9510/37963 [40:45:28<125:04:29, 15.83s/it]
 25%|██▌       | 9511/37963 [40:45:43<121:30:41, 15.37s/it]
 25%|██▌       | 9512/37963 [40:45:57<118:15:37, 14.96s/it]
 25%|██▌       | 9513/37963 [40:46:11<116:47:49, 14.78s/it]
 25%|██▌       | 9514/37963 [40:46:25<115:59:33, 14.68s/it]
 25%|██▌       | 9515/37963 [40:46:40<114:48:07, 14.53s/it]
 25%|██▌       | 9516/37963 [40:46:54<114:34:41, 14.50s/it]
 25%|██▌       | 9517/37963 [40:47:08<113:01:31, 14.30s/it]
 25%|██▌       | 9518/37963 [40:47:22<113:02:45, 14.31s/it]
 25%|██▌       | 9519/37963 [40:47:36<113:07:49, 14.32s/it]
 25%|██▌       | 9520/37963 [40:47:57<126:42:24, 16.04s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '2.482', 'learning_rate': '1.755e-05', 'epoch': '0.2508'}

 25%|██▌       | 9520/37963 [40:47:57<126:42:24, 16.04s/it]
 25%|██▌       | 9521/37963 [40:48:11<121:51:37, 15.42s/it]
 25%|██▌       | 9522/37963 [40:48:25<119:18:35, 15.10s/it]
 25%|██▌       | 9523/37963 [40:48:39<117:04:47, 14.82s/it]
 25%|██▌       | 9524/37963 [40:48:53<115:16:05, 14.59s/it]
 25%|██▌       | 9525/37963 [40:49:08<115:15:19, 14.59s/it]
 25%|██▌       | 9526/37963 [40:49:22<113:42:20, 14.39s/it]
 25%|██▌       | 9527/37963 [40:49:36<113:38:10, 14.39s/it]
 25%|██▌       | 9528/37963 [40:49:57<128:29:37, 16.27s/it]
 25%|██▌       | 9529/37963 [40:50:11<123:36:34, 15.65s/it]
 25%|██▌       | 9530/37963 [40:50:25<119:22:34, 15.11s/it]
                                                           
{'loss': '0.1685', 'grad_norm': '5.742', 'learning_rate': '1.755e-05', 'epoch': '0.251'}

 25%|██▌       | 9530/37963 [40:50:25<119:22:34, 15.11s/it]
 25%|██▌       | 9531/37963 [40:50:39<117:28:47, 14.88s/it]
 25%|██▌       | 9532/37963 [40:50:53<116:24:14, 14.74s/it]
 25%|██▌       | 9533/37963 [40:51:08<115:28:02, 14.62s/it]
 25%|██▌       | 9534/37963 [40:51:22<113:55:44, 14.43s/it]
 25%|██▌       | 9535/37963 [40:51:36<113:33:33, 14.38s/it]
 25%|██▌       | 9536/37963 [40:51:50<112:35:57, 14.26s/it]
 25%|██▌       | 9537/37963 [40:52:11<128:32:59, 16.28s/it]
 25%|██▌       | 9538/37963 [40:52:32<138:51:45, 17.59s/it]
 25%|██▌       | 9539/37963 [40:52:53<146:56:32, 18.61s/it]
 25%|██▌       | 9540/37963 [40:53:07<136:54:49, 17.34s/it]
                                                           
{'loss': '0.166', 'grad_norm': '2.815', 'learning_rate': '1.754e-05', 'epoch': '0.2513'}

 25%|██▌       | 9540/37963 [40:53:07<136:54:49, 17.34s/it]
 25%|██▌       | 9541/37963 [40:53:21<129:25:58, 16.39s/it]
 25%|██▌       | 9542/37963 [40:53:35<123:47:52, 15.68s/it]
 25%|██▌       | 9543/37963 [40:53:49<120:14:02, 15.23s/it]
 25%|██▌       | 9544/37963 [40:54:04<118:23:53, 15.00s/it]
 25%|██▌       | 9545/37963 [40:54:18<116:58:59, 14.82s/it]
 25%|██▌       | 9546/37963 [40:54:39<130:27:38, 16.53s/it]
 25%|██▌       | 9547/37963 [40:54:53<125:21:38, 15.88s/it]
 25%|██▌       | 9548/37963 [40:55:08<121:52:17, 15.44s/it]
 25%|██▌       | 9549/37963 [40:55:21<118:08:45, 14.97s/it]
 25%|██▌       | 9550/37963 [40:55:36<116:43:27, 14.79s/it]
                                                           
{'loss': '0.1702', 'grad_norm': '2.042', 'learning_rate': '1.753e-05', 'epoch': '0.2516'}

 25%|██▌       | 9550/37963 [40:55:36<116:43:27, 14.79s/it]
 25%|██▌       | 9551/37963 [40:55:56<130:00:43, 16.47s/it]
 25%|██▌       | 9552/37963 [40:56:11<125:24:06, 15.89s/it]
 25%|██▌       | 9553/37963 [40:56:25<121:40:10, 15.42s/it]
 25%|██▌       | 9554/37963 [40:56:39<118:59:35, 15.08s/it]
 25%|██▌       | 9555/37963 [40:56:54<117:02:24, 14.83s/it]
 25%|██▌       | 9556/37963 [40:57:08<115:57:11, 14.69s/it]
 25%|██▌       | 9557/37963 [40:57:22<114:50:34, 14.55s/it]
 25%|██▌       | 9558/37963 [40:57:43<130:44:07, 16.57s/it]
 25%|██▌       | 9559/37963 [40:57:58<125:23:03, 15.89s/it]
 25%|██▌       | 9560/37963 [40:58:12<121:52:25, 15.45s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '5.304', 'learning_rate': '1.753e-05', 'epoch': '0.2518'}

 25%|██▌       | 9560/37963 [40:58:12<121:52:25, 15.45s/it]
 25%|██▌       | 9561/37963 [40:58:27<119:14:53, 15.11s/it]
 25%|██▌       | 9562/37963 [40:58:41<117:32:20, 14.90s/it]
 25%|██▌       | 9563/37963 [40:58:55<115:26:02, 14.63s/it]
 25%|██▌       | 9564/37963 [40:59:09<114:20:55, 14.50s/it]
 25%|██▌       | 9565/37963 [40:59:23<113:40:01, 14.41s/it]
 25%|██▌       | 9566/37963 [40:59:38<113:24:38, 14.38s/it]
 25%|██▌       | 9567/37963 [40:59:52<113:29:46, 14.39s/it]
 25%|██▌       | 9568/37963 [41:00:06<113:23:43, 14.38s/it]
 25%|██▌       | 9569/37963 [41:00:20<112:28:31, 14.26s/it]
 25%|██▌       | 9570/37963 [41:00:41<128:28:42, 16.29s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '2.88', 'learning_rate': '1.752e-05', 'epoch': '0.2521'}

 25%|██▌       | 9570/37963 [41:00:41<128:28:42, 16.29s/it]
 25%|██▌       | 9571/37963 [41:00:56<123:42:55, 15.69s/it]
 25%|██▌       | 9572/37963 [41:01:10<120:41:50, 15.30s/it]
 25%|██▌       | 9573/37963 [41:01:25<118:38:08, 15.04s/it]
 25%|██▌       | 9574/37963 [41:01:39<116:58:51, 14.83s/it]
 25%|██▌       | 9575/37963 [41:01:53<115:58:35, 14.71s/it]
 25%|██▌       | 9576/37963 [41:02:14<130:15:19, 16.52s/it]
 25%|██▌       | 9577/37963 [41:02:29<125:39:31, 15.94s/it]
 25%|██▌       | 9578/37963 [41:02:43<121:48:47, 15.45s/it]
 25%|██▌       | 9579/37963 [41:02:57<119:22:41, 15.14s/it]
 25%|██▌       | 9580/37963 [41:03:12<117:31:32, 14.91s/it]
                                                           
{'loss': '0.1632', 'grad_norm': '2.808', 'learning_rate': '1.752e-05', 'epoch': '0.2524'}

 25%|██▌       | 9580/37963 [41:03:12<117:31:32, 14.91s/it]
 25%|██▌       | 9581/37963 [41:03:26<115:29:48, 14.65s/it]
 25%|██▌       | 9582/37963 [41:03:40<114:10:06, 14.48s/it]
 25%|██▌       | 9583/37963 [41:03:54<113:49:55, 14.44s/it]
 25%|██▌       | 9584/37963 [41:04:09<113:48:04, 14.44s/it]
 25%|██▌       | 9585/37963 [41:04:23<113:26:05, 14.39s/it]
 25%|██▌       | 9586/37963 [41:04:37<113:18:23, 14.37s/it]
 25%|██▌       | 9587/37963 [41:05:05<144:02:08, 18.27s/it]
 25%|██▌       | 9588/37963 [41:05:19<135:02:16, 17.13s/it]
 25%|██▌       | 9589/37963 [41:05:40<144:11:30, 18.29s/it]
 25%|██▌       | 9590/37963 [41:05:54<134:45:25, 17.10s/it]
                                                           
{'loss': '0.1625', 'grad_norm': '0.9257', 'learning_rate': '1.751e-05', 'epoch': '0.2526'}

 25%|██▌       | 9590/37963 [41:05:54<134:45:25, 17.10s/it]
 25%|██▌       | 9591/37963 [41:06:09<128:12:12, 16.27s/it]
 25%|██▌       | 9592/37963 [41:06:23<124:05:26, 15.75s/it]
 25%|██▌       | 9593/37963 [41:06:38<120:44:34, 15.32s/it]
 25%|██▌       | 9594/37963 [41:06:52<118:05:44, 14.99s/it]
 25%|██▌       | 9595/37963 [41:07:13<132:11:08, 16.77s/it]
 25%|██▌       | 9596/37963 [41:07:27<126:41:48, 16.08s/it]
 25%|██▌       | 9597/37963 [41:07:42<122:35:22, 15.56s/it]
 25%|██▌       | 9598/37963 [41:07:56<119:40:34, 15.19s/it]
 25%|██▌       | 9599/37963 [41:08:10<117:42:15, 14.94s/it]
 25%|██▌       | 9600/37963 [41:08:31<131:32:57, 16.70s/it]
                                                           
{'loss': '0.1557', 'grad_norm': '4.98', 'learning_rate': '1.751e-05', 'epoch': '0.2529'}

 25%|██▌       | 9600/37963 [41:08:31<131:32:57, 16.70s/it]
 25%|██▌       | 9601/37963 [41:08:45<125:34:01, 15.94s/it]
 25%|██▌       | 9602/37963 [41:08:59<120:26:07, 15.29s/it]
 25%|██▌       | 9603/37963 [41:09:13<117:52:19, 14.96s/it]
 25%|██▌       | 9604/37963 [41:09:27<115:38:19, 14.68s/it]
 25%|██▌       | 9605/37963 [41:09:42<115:20:25, 14.64s/it]
 25%|██▌       | 9606/37963 [41:09:56<114:45:14, 14.57s/it]
 25%|██▌       | 9607/37963 [41:10:10<113:34:16, 14.42s/it]
 25%|██▌       | 9608/37963 [41:10:24<112:51:41, 14.33s/it]
 25%|██▌       | 9609/37963 [41:10:46<129:26:02, 16.43s/it]
 25%|██▌       | 9610/37963 [41:11:00<124:30:00, 15.81s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '4.768', 'learning_rate': '1.75e-05', 'epoch': '0.2531'}

 25%|██▌       | 9610/37963 [41:11:00<124:30:00, 15.81s/it]
 25%|██▌       | 9611/37963 [41:11:14<121:02:34, 15.37s/it]
 25%|██▌       | 9612/37963 [41:11:28<117:49:41, 14.96s/it]
 25%|██▌       | 9613/37963 [41:11:43<116:30:04, 14.79s/it]
 25%|██▌       | 9614/37963 [41:11:56<113:57:37, 14.47s/it]
 25%|██▌       | 9615/37963 [41:12:11<113:49:36, 14.46s/it]
 25%|██▌       | 9616/37963 [41:12:25<113:28:13, 14.41s/it]
 25%|██▌       | 9617/37963 [41:12:40<113:25:16, 14.40s/it]
 25%|██▌       | 9618/37963 [41:12:54<113:26:23, 14.41s/it]
 25%|██▌       | 9619/37963 [41:13:08<113:30:58, 14.42s/it]
 25%|██▌       | 9620/37963 [41:13:29<128:30:12, 16.32s/it]
                                                           
{'loss': '0.1722', 'grad_norm': '2.448', 'learning_rate': '1.75e-05', 'epoch': '0.2534'}

 25%|██▌       | 9620/37963 [41:13:29<128:30:12, 16.32s/it]
 25%|██▌       | 9621/37963 [41:13:44<124:35:38, 15.83s/it]
 25%|██▌       | 9622/37963 [41:13:58<120:48:22, 15.35s/it]
 25%|██▌       | 9623/37963 [41:14:12<118:07:55, 15.01s/it]
 25%|██▌       | 9624/37963 [41:14:26<116:04:57, 14.75s/it]
 25%|██▌       | 9625/37963 [41:14:41<115:00:08, 14.61s/it]
 25%|██▌       | 9626/37963 [41:15:01<129:17:32, 16.43s/it]
 25%|██▌       | 9627/37963 [41:15:15<123:21:36, 15.67s/it]
 25%|██▌       | 9628/37963 [41:15:30<120:11:19, 15.27s/it]
 25%|██▌       | 9629/37963 [41:15:44<117:28:47, 14.93s/it]
 25%|██▌       | 9630/37963 [41:15:58<115:52:00, 14.72s/it]
                                                           
{'loss': '0.1546', 'grad_norm': '3.977', 'learning_rate': '1.749e-05', 'epoch': '0.2537'}

 25%|██▌       | 9630/37963 [41:15:58<115:52:00, 14.72s/it]
 25%|██▌       | 9631/37963 [41:16:12<114:56:54, 14.61s/it]
 25%|██▌       | 9632/37963 [41:16:27<114:33:35, 14.56s/it]
 25%|██▌       | 9633/37963 [41:16:41<112:51:54, 14.34s/it]
 25%|██▌       | 9634/37963 [41:16:55<113:00:22, 14.36s/it]
 25%|██▌       | 9635/37963 [41:17:16<129:36:18, 16.47s/it]
 25%|██▌       | 9636/37963 [41:17:37<139:42:38, 17.76s/it]
 25%|██▌       | 9637/37963 [41:17:52<132:00:10, 16.78s/it]
 25%|██▌       | 9638/37963 [41:18:06<125:47:21, 15.99s/it]
 25%|██▌       | 9639/37963 [41:18:20<121:55:22, 15.50s/it]
 25%|██▌       | 9640/37963 [41:18:41<134:45:35, 17.13s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '1.24', 'learning_rate': '1.748e-05', 'epoch': '0.2539'}

 25%|██▌       | 9640/37963 [41:18:41<134:45:35, 17.13s/it]
 25%|██▌       | 9641/37963 [41:18:55<127:23:00, 16.19s/it]
 25%|██▌       | 9642/37963 [41:19:16<139:03:42, 17.68s/it]
 25%|██▌       | 9643/37963 [41:19:31<131:16:36, 16.69s/it]
 25%|██▌       | 9644/37963 [41:19:45<125:00:36, 15.89s/it]
 25%|██▌       | 9645/37963 [41:19:59<120:16:06, 15.29s/it]
 25%|██▌       | 9646/37963 [41:20:13<118:07:20, 15.02s/it]
 25%|██▌       | 9647/37963 [41:20:27<116:31:37, 14.81s/it]
 25%|██▌       | 9648/37963 [41:20:42<115:29:24, 14.68s/it]
 25%|██▌       | 9649/37963 [41:20:56<114:41:47, 14.58s/it]
 25%|██▌       | 9650/37963 [41:21:17<129:26:40, 16.46s/it]
                                                           
{'loss': '0.154', 'grad_norm': '3.002', 'learning_rate': '1.748e-05', 'epoch': '0.2542'}

 25%|██▌       | 9650/37963 [41:21:17<129:26:40, 16.46s/it]
 25%|██▌       | 9651/37963 [41:21:31<123:39:42, 15.72s/it]
 25%|██▌       | 9652/37963 [41:21:45<120:42:24, 15.35s/it]
 25%|██▌       | 9653/37963 [41:22:00<118:18:10, 15.04s/it]
 25%|██▌       | 9654/37963 [41:22:14<117:05:13, 14.89s/it]
 25%|██▌       | 9655/37963 [41:22:28<115:41:05, 14.71s/it]
 25%|██▌       | 9656/37963 [41:22:43<114:49:35, 14.60s/it]
 25%|██▌       | 9657/37963 [41:22:57<114:31:44, 14.57s/it]
 25%|██▌       | 9658/37963 [41:23:19<130:34:56, 16.61s/it]
 25%|██▌       | 9659/37963 [41:23:33<124:54:27, 15.89s/it]
 25%|██▌       | 9660/37963 [41:23:47<120:44:15, 15.36s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '2.001', 'learning_rate': '1.747e-05', 'epoch': '0.2545'}

 25%|██▌       | 9660/37963 [41:23:47<120:44:15, 15.36s/it]
 25%|██▌       | 9661/37963 [41:24:01<117:49:09, 14.99s/it]
 25%|██▌       | 9662/37963 [41:24:16<116:21:30, 14.80s/it]
 25%|██▌       | 9663/37963 [41:24:30<115:15:04, 14.66s/it]
 25%|██▌       | 9664/37963 [41:24:44<114:22:34, 14.55s/it]
 25%|██▌       | 9665/37963 [41:24:58<113:47:01, 14.48s/it]
 25%|██▌       | 9666/37963 [41:25:13<113:05:33, 14.39s/it]
 25%|██▌       | 9667/37963 [41:25:27<112:59:09, 14.37s/it]
 25%|██▌       | 9668/37963 [41:25:41<112:58:19, 14.37s/it]
 25%|██▌       | 9669/37963 [41:26:02<128:04:14, 16.30s/it]
 25%|██▌       | 9670/37963 [41:26:17<123:44:38, 15.75s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '5.921', 'learning_rate': '1.747e-05', 'epoch': '0.2547'}

 25%|██▌       | 9670/37963 [41:26:17<123:44:38, 15.75s/it]
 25%|██▌       | 9671/37963 [41:26:31<120:20:12, 15.31s/it]
 25%|██▌       | 9672/37963 [41:26:45<118:10:46, 15.04s/it]
 25%|██▌       | 9673/37963 [41:27:00<116:32:45, 14.83s/it]
 25%|██▌       | 9674/37963 [41:27:20<128:45:11, 16.38s/it]
 25%|██▌       | 9675/37963 [41:27:34<123:54:06, 15.77s/it]
 25%|██▌       | 9676/37963 [41:27:48<120:35:34, 15.35s/it]
 25%|██▌       | 9677/37963 [41:28:02<116:53:10, 14.88s/it]
 25%|██▌       | 9678/37963 [41:28:16<115:41:24, 14.72s/it]
 25%|██▌       | 9679/37963 [41:28:31<114:50:26, 14.62s/it]
 25%|██▌       | 9680/37963 [41:28:45<114:19:42, 14.55s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '0.9934', 'learning_rate': '1.746e-05', 'epoch': '0.255'}

 25%|██▌       | 9680/37963 [41:28:45<114:19:42, 14.55s/it]
 26%|██▌       | 9681/37963 [41:29:00<114:13:53, 14.54s/it]
 26%|██▌       | 9682/37963 [41:29:14<113:51:27, 14.49s/it]
 26%|██▌       | 9683/37963 [41:29:42<144:38:25, 18.41s/it]
 26%|██▌       | 9684/37963 [41:29:56<135:00:28, 17.19s/it]
 26%|██▌       | 9685/37963 [41:30:10<128:13:53, 16.32s/it]
 26%|██▌       | 9686/37963 [41:30:25<123:52:38, 15.77s/it]
 26%|██▌       | 9687/37963 [41:30:39<120:30:06, 15.34s/it]
 26%|██▌       | 9688/37963 [41:30:53<118:07:14, 15.04s/it]
 26%|██▌       | 9689/37963 [41:31:08<116:23:18, 14.82s/it]
 26%|██▌       | 9690/37963 [41:31:28<129:54:00, 16.54s/it]
                                                           
{'loss': '0.1725', 'grad_norm': '4.423', 'learning_rate': '1.746e-05', 'epoch': '0.2552'}

 26%|██▌       | 9690/37963 [41:31:28<129:54:00, 16.54s/it]
 26%|██▌       | 9691/37963 [41:31:42<124:11:45, 15.81s/it]
 26%|██▌       | 9692/37963 [41:32:03<135:26:47, 17.25s/it]
 26%|██▌       | 9693/37963 [41:32:17<128:40:44, 16.39s/it]
 26%|██▌       | 9694/37963 [41:32:32<123:59:39, 15.79s/it]
 26%|██▌       | 9695/37963 [41:32:46<120:31:07, 15.35s/it]
 26%|██▌       | 9696/37963 [41:33:01<118:18:23, 15.07s/it]
 26%|██▌       | 9697/37963 [41:33:15<116:44:44, 14.87s/it]
 26%|██▌       | 9698/37963 [41:33:30<115:56:00, 14.77s/it]
 26%|██▌       | 9699/37963 [41:33:44<114:11:46, 14.55s/it]
 26%|██▌       | 9700/37963 [41:33:58<113:45:04, 14.49s/it]
                                                           
{'loss': '0.1709', 'grad_norm': '1.017', 'learning_rate': '1.745e-05', 'epoch': '0.2555'}

 26%|██▌       | 9700/37963 [41:33:58<113:45:04, 14.49s/it]
 26%|██▌       | 9701/37963 [41:34:19<128:42:41, 16.40s/it]
 26%|██▌       | 9702/37963 [41:34:33<123:54:11, 15.78s/it]
 26%|██▌       | 9703/37963 [41:34:47<119:12:39, 15.19s/it]
 26%|██▌       | 9704/37963 [41:35:01<117:08:56, 14.92s/it]
 26%|██▌       | 9705/37963 [41:35:16<116:09:19, 14.80s/it]
 26%|██▌       | 9706/37963 [41:35:30<114:52:59, 14.64s/it]
 26%|██▌       | 9707/37963 [41:35:51<130:18:29, 16.60s/it]
 26%|██▌       | 9708/37963 [41:36:06<125:07:16, 15.94s/it]
 26%|██▌       | 9709/37963 [41:36:20<121:17:51, 15.46s/it]
 26%|██▌       | 9710/37963 [41:36:34<118:38:26, 15.12s/it]
                                                           
{'loss': '0.139', 'grad_norm': '2.346', 'learning_rate': '1.744e-05', 'epoch': '0.2558'}

 26%|██▌       | 9710/37963 [41:36:34<118:38:26, 15.12s/it]
 26%|██▌       | 9711/37963 [41:36:49<117:18:22, 14.95s/it]
 26%|██▌       | 9712/37963 [41:37:03<116:01:51, 14.79s/it]
 26%|██▌       | 9713/37963 [41:37:18<115:03:05, 14.66s/it]
 26%|██▌       | 9714/37963 [41:37:32<114:17:48, 14.57s/it]
 26%|██▌       | 9715/37963 [41:37:46<113:45:47, 14.50s/it]
 26%|██▌       | 9716/37963 [41:38:07<128:40:45, 16.40s/it]
 26%|██▌       | 9717/37963 [41:38:21<123:53:35, 15.79s/it]
 26%|██▌       | 9718/37963 [41:38:36<120:48:34, 15.40s/it]
 26%|██▌       | 9719/37963 [41:38:50<118:33:24, 15.11s/it]
 26%|██▌       | 9720/37963 [41:39:05<116:41:56, 14.88s/it]
                                                           
{'loss': '0.1739', 'grad_norm': '1.08', 'learning_rate': '1.744e-05', 'epoch': '0.256'}

 26%|██▌       | 9720/37963 [41:39:05<116:41:56, 14.88s/it]
 26%|██▌       | 9721/37963 [41:39:25<129:58:49, 16.57s/it]
 26%|██▌       | 9722/37963 [41:39:39<123:56:48, 15.80s/it]
 26%|██▌       | 9723/37963 [41:39:54<120:30:58, 15.36s/it]
 26%|██▌       | 9724/37963 [41:40:07<117:09:12, 14.94s/it]
 26%|██▌       | 9725/37963 [41:40:22<115:54:52, 14.78s/it]
 26%|██▌       | 9726/37963 [41:40:36<114:05:55, 14.55s/it]
 26%|██▌       | 9727/37963 [41:40:50<113:39:01, 14.49s/it]
 26%|██▌       | 9728/37963 [41:41:05<113:15:43, 14.44s/it]
 26%|██▌       | 9729/37963 [41:41:19<113:04:09, 14.42s/it]
 26%|██▌       | 9730/37963 [41:41:33<112:07:48, 14.30s/it]
                                                           
{'loss': '0.1633', 'grad_norm': '3.753', 'learning_rate': '1.743e-05', 'epoch': '0.2563'}

 26%|██▌       | 9730/37963 [41:41:33<112:07:48, 14.30s/it]
 26%|██▌       | 9731/37963 [41:42:00<142:26:07, 18.16s/it]
 26%|██▌       | 9732/37963 [41:42:15<133:37:43, 17.04s/it]
 26%|██▌       | 9733/37963 [41:42:29<127:35:42, 16.27s/it]
 26%|██▌       | 9734/37963 [41:42:43<122:36:38, 15.64s/it]
 26%|██▌       | 9735/37963 [41:42:58<119:41:47, 15.27s/it]
 26%|██▌       | 9736/37963 [41:43:12<117:32:55, 14.99s/it]
 26%|██▌       | 9737/37963 [41:43:26<116:06:03, 14.81s/it]
 26%|██▌       | 9738/37963 [41:43:41<115:06:25, 14.68s/it]
 26%|██▌       | 9739/37963 [41:44:02<129:47:49, 16.56s/it]
 26%|██▌       | 9740/37963 [41:44:23<140:54:33, 17.97s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '3.823', 'learning_rate': '1.743e-05', 'epoch': '0.2566'}

 26%|██▌       | 9740/37963 [41:44:23<140:54:33, 17.97s/it]
 26%|██▌       | 9741/37963 [41:44:37<131:08:02, 16.73s/it]
 26%|██▌       | 9742/37963 [41:44:51<125:31:17, 16.01s/it]
 26%|██▌       | 9743/37963 [41:45:05<121:33:52, 15.51s/it]
 26%|██▌       | 9744/37963 [41:45:20<118:34:06, 15.13s/it]
 26%|██▌       | 9745/37963 [41:45:34<116:41:29, 14.89s/it]
 26%|██▌       | 9746/37963 [41:45:48<115:40:43, 14.76s/it]
 26%|██▌       | 9747/37963 [41:46:03<114:40:31, 14.63s/it]
 26%|██▌       | 9748/37963 [41:46:17<113:58:25, 14.54s/it]
 26%|██▌       | 9749/37963 [41:46:37<127:22:46, 16.25s/it]
 26%|██▌       | 9750/37963 [41:46:52<122:52:46, 15.68s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '2.881', 'learning_rate': '1.742e-05', 'epoch': '0.2568'}

 26%|██▌       | 9750/37963 [41:46:52<122:52:46, 15.68s/it]
 26%|██▌       | 9751/37963 [41:47:06<119:59:16, 15.31s/it]
 26%|██▌       | 9752/37963 [41:47:20<116:50:48, 14.91s/it]
 26%|██▌       | 9753/37963 [41:47:34<115:29:13, 14.74s/it]
 26%|██▌       | 9754/37963 [41:47:49<114:45:48, 14.65s/it]
 26%|██▌       | 9755/37963 [41:48:03<114:06:51, 14.56s/it]
 26%|██▌       | 9756/37963 [41:48:17<113:01:08, 14.42s/it]
 26%|██▌       | 9757/37963 [41:48:38<126:43:45, 16.17s/it]
 26%|██▌       | 9758/37963 [41:48:51<121:14:15, 15.47s/it]
 26%|██▌       | 9759/37963 [41:49:06<118:35:11, 15.14s/it]
 26%|██▌       | 9760/37963 [41:49:20<116:13:29, 14.84s/it]
                                                           
{'loss': '0.1474', 'grad_norm': '3.551', 'learning_rate': '1.742e-05', 'epoch': '0.2571'}

 26%|██▌       | 9760/37963 [41:49:20<116:13:29, 14.84s/it]
 26%|██▌       | 9761/37963 [41:49:34<115:07:24, 14.70s/it]
 26%|██▌       | 9762/37963 [41:49:48<113:48:18, 14.53s/it]
 26%|██▌       | 9763/37963 [41:50:02<110:37:29, 14.12s/it]
 26%|██▌       | 9764/37963 [41:50:22<125:55:36, 16.08s/it]
 26%|██▌       | 9765/37963 [41:50:37<122:03:29, 15.58s/it]
 26%|██▌       | 9766/37963 [41:50:51<118:41:13, 15.15s/it]
 26%|██▌       | 9767/37963 [41:51:05<116:56:55, 14.93s/it]
 26%|██▌       | 9768/37963 [41:51:26<129:36:24, 16.55s/it]
 26%|██▌       | 9769/37963 [41:51:40<124:28:08, 15.89s/it]
 26%|██▌       | 9770/37963 [41:51:54<120:45:10, 15.42s/it]
                                                           
{'loss': '0.1393', 'grad_norm': '1.797', 'learning_rate': '1.741e-05', 'epoch': '0.2574'}

 26%|██▌       | 9770/37963 [41:51:54<120:45:10, 15.42s/it]
 26%|██▌       | 9771/37963 [41:52:09<118:11:38, 15.09s/it]
 26%|██▌       | 9772/37963 [41:52:23<116:21:09, 14.86s/it]
 26%|██▌       | 9773/37963 [41:52:37<115:02:34, 14.69s/it]
 26%|██▌       | 9774/37963 [41:52:52<114:18:59, 14.60s/it]
 26%|██▌       | 9775/37963 [41:53:06<113:47:57, 14.53s/it]
 26%|██▌       | 9776/37963 [41:53:20<113:25:57, 14.49s/it]
 26%|██▌       | 9777/37963 [41:53:35<113:26:43, 14.49s/it]
 26%|██▌       | 9778/37963 [41:53:49<113:10:20, 14.46s/it]
 26%|██▌       | 9779/37963 [41:54:04<112:49:00, 14.41s/it]
 26%|██▌       | 9780/37963 [41:54:24<127:52:57, 16.34s/it]
                                                           
{'loss': '0.163', 'grad_norm': '1.525', 'learning_rate': '1.74e-05', 'epoch': '0.2576'}

 26%|██▌       | 9780/37963 [41:54:24<127:52:57, 16.34s/it]
 26%|██▌       | 9781/37963 [41:54:46<139:54:35, 17.87s/it]
 26%|██▌       | 9782/37963 [41:55:00<131:40:13, 16.82s/it]
 26%|██▌       | 9783/37963 [41:55:14<125:32:29, 16.04s/it]
 26%|██▌       | 9784/37963 [41:55:29<121:31:28, 15.53s/it]
 26%|██▌       | 9785/37963 [41:55:49<133:11:52, 17.02s/it]
 26%|██▌       | 9786/37963 [41:56:03<125:55:30, 16.09s/it]
 26%|██▌       | 9787/37963 [41:56:17<121:48:15, 15.56s/it]
 26%|██▌       | 9788/37963 [41:56:32<119:00:57, 15.21s/it]
 26%|██▌       | 9789/37963 [41:56:53<133:20:41, 17.04s/it]
 26%|██▌       | 9790/37963 [41:57:08<127:09:30, 16.25s/it]
                                                           
{'loss': '0.1472', 'grad_norm': '2.217', 'learning_rate': '1.74e-05', 'epoch': '0.2579'}

 26%|██▌       | 9790/37963 [41:57:08<127:09:30, 16.25s/it]
 26%|██▌       | 9791/37963 [41:57:22<122:39:47, 15.67s/it]
 26%|██▌       | 9792/37963 [41:57:36<119:13:22, 15.24s/it]
 26%|██▌       | 9793/37963 [41:57:50<117:12:48, 14.98s/it]
 26%|██▌       | 9794/37963 [41:58:04<114:54:54, 14.69s/it]
 26%|██▌       | 9795/37963 [41:58:19<113:58:10, 14.57s/it]
 26%|██▌       | 9796/37963 [41:58:33<112:45:56, 14.41s/it]
 26%|██▌       | 9797/37963 [41:58:47<112:43:23, 14.41s/it]
 26%|██▌       | 9798/37963 [41:59:01<112:09:50, 14.34s/it]
 26%|██▌       | 9799/37963 [41:59:22<126:24:49, 16.16s/it]
 26%|██▌       | 9800/37963 [41:59:36<122:05:05, 15.61s/it]
                                                           
{'loss': '0.1654', 'grad_norm': '3.912', 'learning_rate': '1.739e-05', 'epoch': '0.2581'}

 26%|██▌       | 9800/37963 [41:59:36<122:05:05, 15.61s/it]
 26%|██▌       | 9801/37963 [41:59:50<118:39:11, 15.17s/it]
 26%|██▌       | 9802/37963 [42:00:04<115:02:50, 14.71s/it]
 26%|██▌       | 9803/37963 [42:00:18<114:08:32, 14.59s/it]
 26%|██▌       | 9804/37963 [42:00:33<113:43:02, 14.54s/it]
 26%|██▌       | 9805/37963 [42:00:47<112:51:13, 14.43s/it]
 26%|██▌       | 9806/37963 [42:01:07<126:27:50, 16.17s/it]
 26%|██▌       | 9807/37963 [42:01:21<122:19:07, 15.64s/it]
 26%|██▌       | 9808/37963 [42:01:36<118:49:18, 15.19s/it]
 26%|██▌       | 9809/37963 [42:01:50<116:31:17, 14.90s/it]
 26%|██▌       | 9810/37963 [42:02:04<115:10:19, 14.73s/it]
                                                           
{'loss': '0.1546', 'grad_norm': '3.897', 'learning_rate': '1.739e-05', 'epoch': '0.2584'}

 26%|██▌       | 9810/37963 [42:02:04<115:10:19, 14.73s/it]
 26%|██▌       | 9811/37963 [42:02:18<113:36:23, 14.53s/it]
 26%|██▌       | 9812/37963 [42:02:32<112:35:53, 14.40s/it]
 26%|██▌       | 9813/37963 [42:02:52<125:56:14, 16.11s/it]
 26%|██▌       | 9814/37963 [42:03:07<121:26:58, 15.53s/it]
 26%|██▌       | 9815/37963 [42:03:21<119:06:39, 15.23s/it]
 26%|██▌       | 9816/37963 [42:03:35<116:21:27, 14.88s/it]
 26%|██▌       | 9817/37963 [42:03:50<115:09:18, 14.73s/it]
 26%|██▌       | 9818/37963 [42:04:04<114:08:51, 14.60s/it]
 26%|██▌       | 9819/37963 [42:04:18<113:48:53, 14.56s/it]
 26%|██▌       | 9820/37963 [42:04:39<127:48:26, 16.35s/it]
                                                           
{'loss': '0.153', 'grad_norm': '2.928', 'learning_rate': '1.738e-05', 'epoch': '0.2587'}

 26%|██▌       | 9820/37963 [42:04:39<127:48:26, 16.35s/it]
 26%|██▌       | 9821/37963 [42:04:53<122:57:27, 15.73s/it]
 26%|██▌       | 9822/37963 [42:05:07<119:46:17, 15.32s/it]
 26%|██▌       | 9823/37963 [42:05:22<117:04:38, 14.98s/it]
 26%|██▌       | 9824/37963 [42:05:36<115:35:55, 14.79s/it]
 26%|██▌       | 9825/37963 [42:05:50<114:30:44, 14.65s/it]
 26%|██▌       | 9826/37963 [42:06:05<113:49:50, 14.56s/it]
 26%|██▌       | 9827/37963 [42:06:19<113:19:27, 14.50s/it]
 26%|██▌       | 9828/37963 [42:06:33<112:55:28, 14.45s/it]
 26%|██▌       | 9829/37963 [42:06:56<130:56:04, 16.75s/it]
 26%|██▌       | 9830/37963 [42:07:16<140:09:36, 17.94s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '2.065', 'learning_rate': '1.738e-05', 'epoch': '0.2589'}

 26%|██▌       | 9830/37963 [42:07:16<140:09:36, 17.94s/it]
 26%|██▌       | 9831/37963 [42:07:31<131:46:01, 16.86s/it]
 26%|██▌       | 9832/37963 [42:07:44<124:29:58, 15.93s/it]
 26%|██▌       | 9833/37963 [42:07:59<120:37:43, 15.44s/it]
 26%|██▌       | 9834/37963 [42:08:13<118:07:18, 15.12s/it]
 26%|██▌       | 9835/37963 [42:08:26<114:07:26, 14.61s/it]
 26%|██▌       | 9836/37963 [42:08:47<128:22:07, 16.43s/it]
 26%|██▌       | 9837/37963 [42:09:02<123:45:59, 15.84s/it]
 26%|██▌       | 9838/37963 [42:09:23<136:51:44, 17.52s/it]
 26%|██▌       | 9839/37963 [42:09:37<129:42:23, 16.60s/it]
 26%|██▌       | 9840/37963 [42:09:51<123:35:49, 15.82s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '2.508', 'learning_rate': '1.737e-05', 'epoch': '0.2592'}

 26%|██▌       | 9840/37963 [42:09:51<123:35:49, 15.82s/it]
 26%|██▌       | 9841/37963 [42:10:06<119:49:11, 15.34s/it]
 26%|██▌       | 9842/37963 [42:10:20<117:23:39, 15.03s/it]
 26%|██▌       | 9843/37963 [42:10:34<115:38:09, 14.80s/it]
 26%|██▌       | 9844/37963 [42:10:49<114:45:33, 14.69s/it]
 26%|██▌       | 9845/37963 [42:11:03<113:27:31, 14.53s/it]
 26%|██▌       | 9846/37963 [42:11:17<113:23:31, 14.52s/it]
 26%|██▌       | 9847/37963 [42:11:32<113:03:20, 14.48s/it]
 26%|██▌       | 9848/37963 [42:11:52<127:30:49, 16.33s/it]
 26%|██▌       | 9849/37963 [42:12:07<122:47:55, 15.72s/it]
 26%|██▌       | 9850/37963 [42:12:21<119:36:55, 15.32s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '1.463', 'learning_rate': '1.736e-05', 'epoch': '0.2595'}

 26%|██▌       | 9850/37963 [42:12:21<119:36:55, 15.32s/it]
 26%|██▌       | 9851/37963 [42:12:35<117:18:01, 15.02s/it]
 26%|██▌       | 9852/37963 [42:12:57<131:48:24, 16.88s/it]
 26%|██▌       | 9853/37963 [42:13:11<124:54:48, 16.00s/it]
 26%|██▌       | 9854/37963 [42:13:25<121:05:49, 15.51s/it]
 26%|██▌       | 9855/37963 [42:13:39<118:20:33, 15.16s/it]
 26%|██▌       | 9856/37963 [42:13:54<116:42:28, 14.95s/it]
 26%|██▌       | 9857/37963 [42:14:08<115:23:39, 14.78s/it]
 26%|██▌       | 9858/37963 [42:14:22<114:25:58, 14.66s/it]
 26%|██▌       | 9859/37963 [42:14:37<113:53:00, 14.59s/it]
 26%|██▌       | 9860/37963 [42:14:51<112:01:58, 14.35s/it]
                                                           
{'loss': '0.1529', 'grad_norm': '2.671', 'learning_rate': '1.736e-05', 'epoch': '0.2597'}

 26%|██▌       | 9860/37963 [42:14:51<112:01:58, 14.35s/it]
 26%|██▌       | 9861/37963 [42:15:11<127:00:09, 16.27s/it]
 26%|██▌       | 9862/37963 [42:15:26<122:32:54, 15.70s/it]
 26%|██▌       | 9863/37963 [42:15:40<119:23:31, 15.30s/it]
 26%|██▌       | 9864/37963 [42:15:54<116:42:38, 14.95s/it]
 26%|██▌       | 9865/37963 [42:16:09<115:11:28, 14.76s/it]
 26%|██▌       | 9866/37963 [42:16:22<112:31:25, 14.42s/it]
 26%|██▌       | 9867/37963 [42:16:36<112:05:15, 14.36s/it]
 26%|██▌       | 9868/37963 [42:16:57<126:47:28, 16.25s/it]
 26%|██▌       | 9869/37963 [42:17:12<122:31:18, 15.70s/it]
 26%|██▌       | 9870/37963 [42:17:26<119:21:22, 15.30s/it]
                                                           
{'loss': '0.1624', 'grad_norm': '1.829', 'learning_rate': '1.735e-05', 'epoch': '0.26'}

 26%|██▌       | 9870/37963 [42:17:26<119:21:22, 15.30s/it]
 26%|██▌       | 9871/37963 [42:17:40<117:16:47, 15.03s/it]
 26%|██▌       | 9872/37963 [42:17:54<115:13:08, 14.77s/it]
 26%|██▌       | 9873/37963 [42:18:09<114:19:50, 14.65s/it]
 26%|██▌       | 9874/37963 [42:18:23<112:32:18, 14.42s/it]
 26%|██▌       | 9875/37963 [42:18:37<112:19:32, 14.40s/it]
 26%|██▌       | 9876/37963 [42:18:51<112:00:30, 14.36s/it]
 26%|██▌       | 9877/37963 [42:19:13<128:08:57, 16.43s/it]
 26%|██▌       | 9878/37963 [42:19:27<123:20:44, 15.81s/it]
 26%|██▌       | 9879/37963 [42:19:41<119:54:56, 15.37s/it]
 26%|██▌       | 9880/37963 [42:20:02<132:34:50, 17.00s/it]
                                                           
{'loss': '0.1721', 'grad_norm': '0.9152', 'learning_rate': '1.735e-05', 'epoch': '0.2603'}

 26%|██▌       | 9880/37963 [42:20:02<132:34:50, 17.00s/it]
 26%|██▌       | 9881/37963 [42:20:16<126:15:48, 16.19s/it]
 26%|██▌       | 9882/37963 [42:20:37<137:02:19, 17.57s/it]
 26%|██▌       | 9883/37963 [42:20:51<129:27:12, 16.60s/it]
 26%|██▌       | 9884/37963 [42:21:06<123:41:31, 15.86s/it]
 26%|██▌       | 9885/37963 [42:21:20<120:11:28, 15.41s/it]
 26%|██▌       | 9886/37963 [42:21:40<131:32:37, 16.87s/it]
 26%|██▌       | 9887/37963 [42:21:55<125:53:22, 16.14s/it]
 26%|██▌       | 9888/37963 [42:22:09<121:38:46, 15.60s/it]
 26%|██▌       | 9889/37963 [42:22:23<117:58:22, 15.13s/it]
 26%|██▌       | 9890/37963 [42:22:37<115:17:28, 14.78s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '1.384', 'learning_rate': '1.734e-05', 'epoch': '0.2605'}

 26%|██▌       | 9890/37963 [42:22:37<115:17:28, 14.78s/it]
 26%|██▌       | 9891/37963 [42:22:51<114:25:33, 14.67s/it]
 26%|██▌       | 9892/37963 [42:23:06<113:01:27, 14.49s/it]
 26%|██▌       | 9893/37963 [42:23:20<112:51:39, 14.47s/it]
 26%|██▌       | 9894/37963 [42:23:34<112:08:57, 14.38s/it]
 26%|██▌       | 9895/37963 [42:23:49<112:17:38, 14.40s/it]
 26%|██▌       | 9896/37963 [42:24:09<127:27:05, 16.35s/it]
 26%|██▌       | 9897/37963 [42:24:24<122:47:46, 15.75s/it]
 26%|██▌       | 9898/37963 [42:24:38<119:47:54, 15.37s/it]
 26%|██▌       | 9899/37963 [42:24:53<117:14:42, 15.04s/it]
 26%|██▌       | 9900/37963 [42:25:14<131:24:25, 16.86s/it]
                                                           
{'loss': '0.1633', 'grad_norm': '2.035', 'learning_rate': '1.733e-05', 'epoch': '0.2608'}

 26%|██▌       | 9900/37963 [42:25:14<131:24:25, 16.86s/it]
 26%|██▌       | 9901/37963 [42:25:28<125:57:22, 16.16s/it]
 26%|██▌       | 9902/37963 [42:25:42<120:18:47, 15.44s/it]
 26%|██▌       | 9903/37963 [42:25:56<117:30:37, 15.08s/it]
 26%|██▌       | 9904/37963 [42:26:10<115:02:11, 14.76s/it]
 26%|██▌       | 9905/37963 [42:26:25<114:08:48, 14.65s/it]
 26%|██▌       | 9906/37963 [42:26:39<113:19:44, 14.54s/it]
 26%|██▌       | 9907/37963 [42:26:53<112:37:05, 14.45s/it]
 26%|██▌       | 9908/37963 [42:27:07<112:22:07, 14.42s/it]
 26%|██▌       | 9909/37963 [42:27:22<112:20:43, 14.42s/it]
 26%|██▌       | 9910/37963 [42:27:36<111:46:08, 14.34s/it]
                                                           
{'loss': '0.1636', 'grad_norm': '1.702', 'learning_rate': '1.733e-05', 'epoch': '0.261'}

 26%|██▌       | 9910/37963 [42:27:36<111:46:08, 14.34s/it]
 26%|██▌       | 9911/37963 [42:27:57<126:33:24, 16.24s/it]
 26%|██▌       | 9912/37963 [42:28:11<122:10:41, 15.68s/it]
 26%|██▌       | 9913/37963 [42:28:25<119:03:35, 15.28s/it]
 26%|██▌       | 9914/37963 [42:28:47<132:35:28, 17.02s/it]
 26%|██▌       | 9915/37963 [42:29:00<125:07:31, 16.06s/it]
 26%|██▌       | 9916/37963 [42:29:15<121:02:58, 15.54s/it]
 26%|██▌       | 9917/37963 [42:29:29<118:13:14, 15.17s/it]
 26%|██▌       | 9918/37963 [42:29:43<115:28:54, 14.82s/it]
 26%|██▌       | 9919/37963 [42:29:57<114:24:52, 14.69s/it]
 26%|██▌       | 9920/37963 [42:30:12<113:47:52, 14.61s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '1.545', 'learning_rate': '1.732e-05', 'epoch': '0.2613'}

 26%|██▌       | 9920/37963 [42:30:12<113:47:52, 14.61s/it]
 26%|██▌       | 9921/37963 [42:30:25<111:04:25, 14.26s/it]
 26%|██▌       | 9922/37963 [42:30:39<110:36:26, 14.20s/it]
 26%|██▌       | 9923/37963 [42:30:53<110:18:01, 14.16s/it]
 26%|██▌       | 9924/37963 [42:31:08<110:37:53, 14.20s/it]
 26%|██▌       | 9925/37963 [42:31:21<109:03:05, 14.00s/it]
 26%|██▌       | 9926/37963 [42:31:43<126:12:22, 16.21s/it]
 26%|██▌       | 9927/37963 [42:31:56<120:46:24, 15.51s/it]
 26%|██▌       | 9928/37963 [42:32:10<116:35:57, 14.97s/it]
 26%|██▌       | 9929/37963 [42:32:24<114:52:20, 14.75s/it]
 26%|██▌       | 9930/37963 [42:32:45<127:41:21, 16.40s/it]
                                                           
{'loss': '0.1763', 'grad_norm': '4.569', 'learning_rate': '1.732e-05', 'epoch': '0.2616'}

 26%|██▌       | 9930/37963 [42:32:45<127:41:21, 16.40s/it]
 26%|██▌       | 9931/37963 [42:32:59<123:05:48, 15.81s/it]
 26%|██▌       | 9932/37963 [42:33:13<119:54:37, 15.40s/it]
 26%|██▌       | 9933/37963 [42:33:28<117:18:27, 15.07s/it]
 26%|██▌       | 9934/37963 [42:33:42<115:29:38, 14.83s/it]
 26%|██▌       | 9935/37963 [42:33:56<113:08:21, 14.53s/it]
 26%|██▌       | 9936/37963 [42:34:16<127:06:54, 16.33s/it]
 26%|██▌       | 9937/37963 [42:34:31<122:21:32, 15.72s/it]
 26%|██▌       | 9938/37963 [42:34:45<119:14:50, 15.32s/it]
 26%|██▌       | 9939/37963 [42:35:00<117:10:23, 15.05s/it]
 26%|██▌       | 9940/37963 [42:35:14<115:44:03, 14.87s/it]
                                                           
{'loss': '0.151', 'grad_norm': '1.719', 'learning_rate': '1.731e-05', 'epoch': '0.2618'}

 26%|██▌       | 9940/37963 [42:35:14<115:44:03, 14.87s/it]
 26%|██▌       | 9941/37963 [42:35:28<114:09:38, 14.67s/it]
 26%|██▌       | 9942/37963 [42:35:42<112:57:35, 14.51s/it]
 26%|██▌       | 9943/37963 [42:35:56<111:49:08, 14.37s/it]
 26%|██▌       | 9944/37963 [42:36:11<111:49:37, 14.37s/it]
 26%|██▌       | 9945/37963 [42:36:32<127:16:49, 16.35s/it]
 26%|██▌       | 9946/37963 [42:36:46<122:29:31, 15.74s/it]
 26%|██▌       | 9947/37963 [42:37:07<135:03:29, 17.35s/it]
 26%|██▌       | 9948/37963 [42:37:21<127:55:53, 16.44s/it]
 26%|██▌       | 9949/37963 [42:37:36<122:49:39, 15.78s/it]
 26%|██▌       | 9950/37963 [42:37:49<118:00:27, 15.17s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '3.373', 'learning_rate': '1.731e-05', 'epoch': '0.2621'}

 26%|██▌       | 9950/37963 [42:37:49<118:00:27, 15.17s/it]
 26%|██▌       | 9951/37963 [42:38:04<115:48:49, 14.88s/it]
 26%|██▌       | 9952/37963 [42:38:18<114:53:00, 14.76s/it]
 26%|██▌       | 9953/37963 [42:38:32<112:21:39, 14.44s/it]
 26%|██▌       | 9954/37963 [42:38:46<112:11:05, 14.42s/it]
 26%|██▌       | 9955/37963 [42:39:01<112:03:02, 14.40s/it]
 26%|██▌       | 9956/37963 [42:39:15<111:21:16, 14.31s/it]
 26%|██▌       | 9957/37963 [42:39:29<111:31:10, 14.34s/it]
 26%|██▌       | 9958/37963 [42:39:50<126:01:53, 16.20s/it]
 26%|██▌       | 9959/37963 [42:40:04<121:47:29, 15.66s/it]
 26%|██▌       | 9960/37963 [42:40:18<118:33:04, 15.24s/it]
                                                           
{'loss': '0.155', 'grad_norm': '1.817', 'learning_rate': '1.73e-05', 'epoch': '0.2624'}

 26%|██▌       | 9960/37963 [42:40:18<118:33:04, 15.24s/it]
 26%|██▌       | 9961/37963 [42:40:33<116:25:22, 14.97s/it]
 26%|██▌       | 9962/37963 [42:40:47<115:00:02, 14.79s/it]
 26%|██▌       | 9963/37963 [42:41:08<129:32:02, 16.65s/it]
 26%|██▌       | 9964/37963 [42:41:22<124:15:52, 15.98s/it]
 26%|██▌       | 9965/37963 [42:41:37<120:06:45, 15.44s/it]
 26%|██▋       | 9966/37963 [42:41:51<116:58:32, 15.04s/it]
 26%|██▋       | 9967/37963 [42:42:05<115:37:34, 14.87s/it]
 26%|██▋       | 9968/37963 [42:42:19<114:12:41, 14.69s/it]
 26%|██▋       | 9969/37963 [42:42:34<113:32:22, 14.60s/it]
 26%|██▋       | 9970/37963 [42:42:48<113:01:19, 14.54s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '1.487', 'learning_rate': '1.729e-05', 'epoch': '0.2626'}

 26%|██▋       | 9970/37963 [42:42:48<113:01:19, 14.54s/it]
 26%|██▋       | 9971/37963 [42:43:02<112:00:56, 14.41s/it]
 26%|██▋       | 9972/37963 [42:43:16<111:26:15, 14.33s/it]
 26%|██▋       | 9973/37963 [42:43:31<111:03:08, 14.28s/it]
 26%|██▋       | 9974/37963 [42:43:45<111:22:18, 14.32s/it]
 26%|██▋       | 9975/37963 [42:43:59<111:38:26, 14.36s/it]
 26%|██▋       | 9976/37963 [42:44:21<127:18:20, 16.38s/it]
 26%|██▋       | 9977/37963 [42:44:34<121:14:38, 15.60s/it]
 26%|██▋       | 9978/37963 [42:44:49<118:20:45, 15.22s/it]
 26%|██▋       | 9979/37963 [42:45:10<131:33:40, 16.92s/it]
 26%|██▋       | 9980/37963 [42:45:31<141:19:40, 18.18s/it]
                                                           
{'loss': '0.1488', 'grad_norm': '2.074', 'learning_rate': '1.729e-05', 'epoch': '0.2629'}

 26%|██▋       | 9980/37963 [42:45:31<141:19:40, 18.18s/it]
 26%|██▋       | 9981/37963 [42:45:45<132:16:12, 17.02s/it]
 26%|██▋       | 9982/37963 [42:45:59<124:28:38, 16.02s/it]
 26%|██▋       | 9983/37963 [42:46:13<120:02:39, 15.45s/it]
 26%|██▋       | 9984/37963 [42:46:27<117:33:34, 15.13s/it]
 26%|██▋       | 9985/37963 [42:46:49<132:34:14, 17.06s/it]
 26%|██▋       | 9986/37963 [42:47:03<125:50:25, 16.19s/it]
 26%|██▋       | 9987/37963 [42:47:17<121:34:11, 15.64s/it]
 26%|██▋       | 9988/37963 [42:47:32<118:29:41, 15.25s/it]
 26%|██▋       | 9989/37963 [42:47:46<116:31:09, 14.99s/it]
 26%|██▋       | 9990/37963 [42:48:00<114:44:12, 14.77s/it]
                                                           
{'loss': '0.1673', 'grad_norm': '3.631', 'learning_rate': '1.728e-05', 'epoch': '0.2632'}

 26%|██▋       | 9990/37963 [42:48:00<114:44:12, 14.77s/it]
 26%|██▋       | 9991/37963 [42:48:15<113:44:38, 14.64s/it]
 26%|██▋       | 9992/37963 [42:48:35<127:15:37, 16.38s/it]
 26%|██▋       | 9993/37963 [42:48:49<122:36:32, 15.78s/it]
 26%|██▋       | 9994/37963 [42:49:04<118:58:25, 15.31s/it]
 26%|██▋       | 9995/37963 [42:49:18<116:41:43, 15.02s/it]
 26%|██▋       | 9996/37963 [42:49:32<115:02:03, 14.81s/it]
 26%|██▋       | 9997/37963 [42:49:53<129:52:19, 16.72s/it]
 26%|██▋       | 9998/37963 [42:50:08<124:11:40, 15.99s/it]
 26%|██▋       | 9999/37963 [42:50:22<119:14:19, 15.35s/it]
 26%|██▋       | 10000/37963 [42:50:35<115:13:22, 14.83s/it]
                                                            
{'loss': '0.1777', 'grad_norm': '11.08', 'learning_rate': '1.728e-05', 'epoch': '0.2634'}

 26%|██▋       | 10000/37963 [42:50:35<115:13:22, 14.83s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.59s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.59s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 26%|██▋       | 10001/37963 [42:52:20<324:34:14, 41.79s/it]
 26%|██▋       | 10002/37963 [42:52:34<258:55:13, 33.34s/it]
 26%|██▋       | 10003/37963 [42:52:48<214:38:16, 27.64s/it]
 26%|██▋       | 10004/37963 [42:53:02<183:40:02, 23.65s/it]
 26%|██▋       | 10005/37963 [42:53:17<162:03:13, 20.87s/it]
 26%|██▋       | 10006/37963 [42:53:37<162:12:16, 20.89s/it]
 26%|██▋       | 10007/37963 [42:53:52<147:10:11, 18.95s/it]
 26%|██▋       | 10008/37963 [42:54:06<136:33:26, 17.59s/it]
 26%|██▋       | 10009/37963 [42:54:21<129:12:54, 16.64s/it]
 26%|██▋       | 10010/37963 [42:54:41<137:05:22, 17.66s/it]
                                                            
{'loss': '0.1802', 'grad_norm': '2.082', 'learning_rate': '1.727e-05', 'epoch': '0.2637'}

 26%|██▋       | 10010/37963 [42:54:41<137:05:22, 17.66s/it]
 26%|██▋       | 10011/37963 [42:54:55<128:19:19, 16.53s/it]
 26%|██▋       | 10012/37963 [42:55:09<123:18:06, 15.88s/it]
 26%|██▋       | 10013/37963 [42:55:23<119:50:59, 15.44s/it]
 26%|██▋       | 10014/37963 [42:55:38<117:12:43, 15.10s/it]
 26%|██▋       | 10015/37963 [42:55:52<114:09:09, 14.70s/it]
 26%|██▋       | 10016/37963 [42:56:06<113:20:08, 14.60s/it]
 26%|██▋       | 10017/37963 [42:56:20<111:58:43, 14.43s/it]
 26%|██▋       | 10018/37963 [42:56:34<111:57:28, 14.42s/it]
 26%|██▋       | 10019/37963 [42:56:49<111:44:03, 14.39s/it]
 26%|██▋       | 10020/37963 [42:57:03<110:28:55, 14.23s/it]
                                                            
{'loss': '0.1635', 'grad_norm': '1.584', 'learning_rate': '1.726e-05', 'epoch': '0.2639'}

 26%|██▋       | 10020/37963 [42:57:03<110:28:55, 14.23s/it]
 26%|██▋       | 10021/37963 [42:57:17<110:41:45, 14.26s/it]
 26%|██▋       | 10022/37963 [42:57:38<126:41:37, 16.32s/it]
 26%|██▋       | 10023/37963 [42:57:52<121:40:51, 15.68s/it]
 26%|██▋       | 10024/37963 [42:58:06<117:46:07, 15.17s/it]
 26%|██▋       | 10025/37963 [42:58:20<115:42:24, 14.91s/it]
 26%|██▋       | 10026/37963 [42:58:35<114:19:22, 14.73s/it]
 26%|██▋       | 10027/37963 [42:58:49<112:33:53, 14.51s/it]
 26%|██▋       | 10028/37963 [42:59:16<141:57:57, 18.30s/it]
 26%|██▋       | 10029/37963 [42:59:30<132:50:50, 17.12s/it]
 26%|██▋       | 10030/37963 [42:59:45<126:57:15, 16.36s/it]
                                                            
{'loss': '0.1549', 'grad_norm': '0.7173', 'learning_rate': '1.726e-05', 'epoch': '0.2642'}

 26%|██▋       | 10030/37963 [42:59:45<126:57:15, 16.36s/it]
 26%|██▋       | 10031/37963 [42:59:59<121:53:00, 15.71s/it]
 26%|██▋       | 10032/37963 [43:00:13<118:39:04, 15.29s/it]
 26%|██▋       | 10033/37963 [43:00:28<116:03:01, 14.96s/it]
 26%|██▋       | 10034/37963 [43:00:42<114:51:42, 14.81s/it]
 26%|██▋       | 10035/37963 [43:01:04<131:07:22, 16.90s/it]
 26%|██▋       | 10036/37963 [43:01:18<125:05:43, 16.13s/it]
 26%|██▋       | 10037/37963 [43:01:32<119:56:58, 15.46s/it]
 26%|██▋       | 10038/37963 [43:01:47<118:05:26, 15.22s/it]
 26%|██▋       | 10039/37963 [43:02:01<116:06:43, 14.97s/it]
 26%|██▋       | 10040/37963 [43:02:15<114:38:46, 14.78s/it]
                                                            
{'loss': '0.1686', 'grad_norm': '2.598', 'learning_rate': '1.725e-05', 'epoch': '0.2645'}

 26%|██▋       | 10040/37963 [43:02:15<114:38:46, 14.78s/it]
 26%|██▋       | 10041/37963 [43:02:30<113:51:14, 14.68s/it]
 26%|██▋       | 10042/37963 [43:02:44<113:05:33, 14.58s/it]
 26%|██▋       | 10043/37963 [43:02:58<111:41:30, 14.40s/it]
 26%|██▋       | 10044/37963 [43:03:19<127:03:58, 16.38s/it]
 26%|██▋       | 10045/37963 [43:03:33<121:10:29, 15.63s/it]
 26%|██▋       | 10046/37963 [43:03:53<131:48:35, 17.00s/it]
 26%|██▋       | 10047/37963 [43:04:08<125:29:20, 16.18s/it]
 26%|██▋       | 10048/37963 [43:04:22<120:24:57, 15.53s/it]
 26%|██▋       | 10049/37963 [43:04:36<117:39:39, 15.17s/it]
 26%|██▋       | 10050/37963 [43:04:50<115:42:32, 14.92s/it]
                                                            
{'loss': '0.1652', 'grad_norm': '0.8488', 'learning_rate': '1.725e-05', 'epoch': '0.2647'}

 26%|██▋       | 10050/37963 [43:04:50<115:42:32, 14.92s/it]
 26%|██▋       | 10051/37963 [43:05:05<114:22:15, 14.75s/it]
 26%|██▋       | 10052/37963 [43:05:19<113:35:03, 14.65s/it]
 26%|██▋       | 10053/37963 [43:05:40<127:51:35, 16.49s/it]
 26%|██▋       | 10054/37963 [43:05:54<121:34:35, 15.68s/it]
 26%|██▋       | 10055/37963 [43:06:08<118:51:07, 15.33s/it]
 26%|██▋       | 10056/37963 [43:06:23<116:54:42, 15.08s/it]
 26%|██▋       | 10057/37963 [43:06:37<115:12:53, 14.86s/it]
 26%|██▋       | 10058/37963 [43:06:51<114:03:29, 14.71s/it]
 26%|██▋       | 10059/37963 [43:07:12<128:57:58, 16.64s/it]
 26%|██▋       | 10060/37963 [43:07:27<123:44:55, 15.97s/it]
                                                            
{'loss': '0.1632', 'grad_norm': '0.7671', 'learning_rate': '1.724e-05', 'epoch': '0.265'}

 26%|██▋       | 10060/37963 [43:07:27<123:44:55, 15.97s/it]
 27%|██▋       | 10061/37963 [43:07:41<119:57:00, 15.48s/it]
 27%|██▋       | 10062/37963 [43:07:55<117:07:15, 15.11s/it]
 27%|██▋       | 10063/37963 [43:08:10<115:22:23, 14.89s/it]
 27%|██▋       | 10064/37963 [43:08:24<113:44:56, 14.68s/it]
 27%|██▋       | 10065/37963 [43:08:38<113:09:21, 14.60s/it]
 27%|██▋       | 10066/37963 [43:08:53<112:24:57, 14.51s/it]
 27%|██▋       | 10067/37963 [43:09:07<111:58:30, 14.45s/it]
 27%|██▋       | 10068/37963 [43:09:21<111:37:25, 14.41s/it]
 27%|██▋       | 10069/37963 [43:09:36<111:36:05, 14.40s/it]
 27%|██▋       | 10070/37963 [43:09:57<127:25:35, 16.45s/it]
                                                            
{'loss': '0.1588', 'grad_norm': '1.217', 'learning_rate': '1.724e-05', 'epoch': '0.2653'}

 27%|██▋       | 10070/37963 [43:09:57<127:25:35, 16.45s/it]
 27%|██▋       | 10071/37963 [43:10:11<121:14:23, 15.65s/it]
 27%|██▋       | 10072/37963 [43:10:25<117:34:27, 15.18s/it]
 27%|██▋       | 10073/37963 [43:10:39<115:51:45, 14.96s/it]
 27%|██▋       | 10074/37963 [43:10:53<113:01:23, 14.59s/it]
 27%|██▋       | 10075/37963 [43:11:07<112:29:09, 14.52s/it]
 27%|██▋       | 10076/37963 [43:11:22<112:01:10, 14.46s/it]
 27%|██▋       | 10077/37963 [43:11:49<141:45:30, 18.30s/it]
 27%|██▋       | 10078/37963 [43:12:03<132:49:24, 17.15s/it]
 27%|██▋       | 10079/37963 [43:12:18<126:11:13, 16.29s/it]
 27%|██▋       | 10080/37963 [43:12:32<120:53:18, 15.61s/it]
                                                            
{'loss': '0.1687', 'grad_norm': '2.068', 'learning_rate': '1.723e-05', 'epoch': '0.2655'}

 27%|██▋       | 10080/37963 [43:12:32<120:53:18, 15.61s/it]
 27%|██▋       | 10081/37963 [43:12:46<117:57:14, 15.23s/it]
 27%|██▋       | 10082/37963 [43:13:07<131:41:51, 17.00s/it]
 27%|██▋       | 10083/37963 [43:13:22<125:45:29, 16.24s/it]
 27%|██▋       | 10084/37963 [43:13:36<120:31:46, 15.56s/it]
 27%|██▋       | 10085/37963 [43:13:50<118:05:18, 15.25s/it]
 27%|██▋       | 10086/37963 [43:14:04<115:56:12, 14.97s/it]
 27%|██▋       | 10087/37963 [43:14:19<114:30:33, 14.79s/it]
 27%|██▋       | 10088/37963 [43:14:33<112:58:34, 14.59s/it]
 27%|██▋       | 10089/37963 [43:14:47<112:20:50, 14.51s/it]
 27%|██▋       | 10090/37963 [43:15:01<110:50:10, 14.32s/it]
                                                            
{'loss': '0.1611', 'grad_norm': '3.699', 'learning_rate': '1.722e-05', 'epoch': '0.2658'}

 27%|██▋       | 10090/37963 [43:15:01<110:50:10, 14.32s/it]
 27%|██▋       | 10091/37963 [43:15:15<110:55:05, 14.33s/it]
 27%|██▋       | 10092/37963 [43:15:30<111:01:36, 14.34s/it]
 27%|██▋       | 10093/37963 [43:15:51<126:11:58, 16.30s/it]
 27%|██▋       | 10094/37963 [43:16:12<136:53:27, 17.68s/it]
 27%|██▋       | 10095/37963 [43:16:26<129:25:09, 16.72s/it]
 27%|██▋       | 10096/37963 [43:16:40<123:25:46, 15.95s/it]
 27%|██▋       | 10097/37963 [43:16:55<119:40:20, 15.46s/it]
 27%|██▋       | 10098/37963 [43:17:09<117:02:07, 15.12s/it]
 27%|██▋       | 10099/37963 [43:17:23<114:52:35, 14.84s/it]
 27%|██▋       | 10100/37963 [43:17:37<113:49:17, 14.71s/it]
                                                            
{'loss': '0.1457', 'grad_norm': '1.187', 'learning_rate': '1.722e-05', 'epoch': '0.266'}

 27%|██▋       | 10100/37963 [43:17:37<113:49:17, 14.71s/it]
 27%|██▋       | 10101/37963 [43:17:52<112:55:15, 14.59s/it]
 27%|██▋       | 10102/37963 [43:18:06<112:23:48, 14.52s/it]
 27%|██▋       | 10103/37963 [43:18:28<128:40:24, 16.63s/it]
 27%|██▋       | 10104/37963 [43:18:42<123:25:16, 15.95s/it]
 27%|██▋       | 10105/37963 [43:18:56<119:50:34, 15.49s/it]
 27%|██▋       | 10106/37963 [43:19:11<117:14:00, 15.15s/it]
 27%|██▋       | 10107/37963 [43:19:31<130:04:01, 16.81s/it]
 27%|██▋       | 10108/37963 [43:19:46<124:23:50, 16.08s/it]
 27%|██▋       | 10109/37963 [43:20:00<120:21:12, 15.56s/it]
 27%|██▋       | 10110/37963 [43:20:15<117:40:56, 15.21s/it]
                                                            
{'loss': '0.1635', 'grad_norm': '4.065', 'learning_rate': '1.721e-05', 'epoch': '0.2663'}

 27%|██▋       | 10110/37963 [43:20:15<117:40:56, 15.21s/it]
 27%|██▋       | 10111/37963 [43:20:29<115:36:32, 14.94s/it]
 27%|██▋       | 10112/37963 [43:20:43<114:26:39, 14.79s/it]
 27%|██▋       | 10113/37963 [43:20:58<113:15:24, 14.64s/it]
 27%|██▋       | 10114/37963 [43:21:12<112:41:51, 14.57s/it]
 27%|██▋       | 10115/37963 [43:21:26<112:09:01, 14.50s/it]
 27%|██▋       | 10116/37963 [43:21:41<111:47:01, 14.45s/it]
 27%|██▋       | 10117/37963 [43:21:55<111:01:02, 14.35s/it]
 27%|██▋       | 10118/37963 [43:22:09<111:00:48, 14.35s/it]
 27%|██▋       | 10119/37963 [43:22:31<127:50:29, 16.53s/it]
 27%|██▋       | 10120/37963 [43:22:45<122:51:43, 15.89s/it]
                                                            
{'loss': '0.1676', 'grad_norm': '1.383', 'learning_rate': '1.721e-05', 'epoch': '0.2666'}

 27%|██▋       | 10120/37963 [43:22:45<122:51:43, 15.89s/it]
 27%|██▋       | 10121/37963 [43:23:00<119:14:11, 15.42s/it]
 27%|██▋       | 10122/37963 [43:23:13<115:40:26, 14.96s/it]
 27%|██▋       | 10123/37963 [43:23:28<114:26:08, 14.80s/it]
 27%|██▋       | 10124/37963 [43:23:42<113:00:33, 14.61s/it]
 27%|██▋       | 10125/37963 [43:23:56<112:40:03, 14.57s/it]
 27%|██▋       | 10126/37963 [43:24:17<127:16:32, 16.46s/it]
 27%|██▋       | 10127/37963 [43:24:32<122:15:38, 15.81s/it]
 27%|██▋       | 10128/37963 [43:24:46<118:50:43, 15.37s/it]
 27%|██▋       | 10129/37963 [43:25:07<132:07:54, 17.09s/it]
 27%|██▋       | 10130/37963 [43:25:21<125:42:25, 16.26s/it]
                                                            
{'loss': '0.1641', 'grad_norm': '3.386', 'learning_rate': '1.72e-05', 'epoch': '0.2668'}

 27%|██▋       | 10130/37963 [43:25:21<125:42:25, 16.26s/it]
 27%|██▋       | 10131/37963 [43:25:43<137:22:23, 17.77s/it]
 27%|██▋       | 10132/37963 [43:25:57<129:27:55, 16.75s/it]
 27%|██▋       | 10133/37963 [43:26:11<123:52:36, 16.02s/it]
 27%|██▋       | 10134/37963 [43:26:26<120:02:14, 15.53s/it]
 27%|██▋       | 10135/37963 [43:26:40<117:21:45, 15.18s/it]
 27%|██▋       | 10136/37963 [43:26:54<114:04:09, 14.76s/it]
 27%|██▋       | 10137/37963 [43:27:08<113:13:34, 14.65s/it]
 27%|██▋       | 10138/37963 [43:27:23<112:30:36, 14.56s/it]
 27%|██▋       | 10139/37963 [43:27:37<112:08:35, 14.51s/it]
 27%|██▋       | 10140/37963 [43:27:51<111:53:09, 14.48s/it]
                                                            
{'loss': '0.1617', 'grad_norm': '3.27', 'learning_rate': '1.719e-05', 'epoch': '0.2671'}

 27%|██▋       | 10140/37963 [43:27:51<111:53:09, 14.48s/it]
 27%|██▋       | 10141/37963 [43:28:06<111:27:18, 14.42s/it]
 27%|██▋       | 10142/37963 [43:28:20<110:57:38, 14.36s/it]
 27%|██▋       | 10143/37963 [43:28:48<141:35:23, 18.32s/it]
 27%|██▋       | 10144/37963 [43:29:02<132:23:09, 17.13s/it]
 27%|██▋       | 10145/37963 [43:29:16<126:08:21, 16.32s/it]
 27%|██▋       | 10146/37963 [43:29:31<121:21:31, 15.71s/it]
 27%|██▋       | 10147/37963 [43:29:45<118:00:55, 15.27s/it]
 27%|██▋       | 10148/37963 [43:29:59<116:13:05, 15.04s/it]
 27%|██▋       | 10149/37963 [43:30:13<114:08:28, 14.77s/it]
 27%|██▋       | 10150/37963 [43:30:27<112:00:40, 14.50s/it]
                                                            
{'loss': '0.1608', 'grad_norm': '1.886', 'learning_rate': '1.719e-05', 'epoch': '0.2674'}

 27%|██▋       | 10150/37963 [43:30:27<112:00:40, 14.50s/it]
 27%|██▋       | 10151/37963 [43:30:49<127:42:43, 16.53s/it]
 27%|██▋       | 10152/37963 [43:31:02<121:19:29, 15.70s/it]
 27%|██▋       | 10153/37963 [43:31:17<118:16:44, 15.31s/it]
 27%|██▋       | 10154/37963 [43:31:37<130:42:34, 16.92s/it]
 27%|██▋       | 10155/37963 [43:31:52<124:28:37, 16.11s/it]
 27%|██▋       | 10156/37963 [43:32:06<120:02:10, 15.54s/it]
 27%|██▋       | 10157/37963 [43:32:20<117:27:19, 15.21s/it]
 27%|██▋       | 10158/37963 [43:32:35<115:27:11, 14.95s/it]
 27%|██▋       | 10159/37963 [43:32:49<113:55:04, 14.75s/it]
 27%|██▋       | 10160/37963 [43:33:03<113:23:23, 14.68s/it]
                                                            
{'loss': '0.1595', 'grad_norm': '3.399', 'learning_rate': '1.718e-05', 'epoch': '0.2676'}

 27%|██▋       | 10160/37963 [43:33:03<113:23:23, 14.68s/it]
 27%|██▋       | 10161/37963 [43:33:18<112:08:33, 14.52s/it]
 27%|██▋       | 10162/37963 [43:33:32<110:56:27, 14.37s/it]
 27%|██▋       | 10163/37963 [43:33:46<110:44:01, 14.34s/it]
 27%|██▋       | 10164/37963 [43:34:00<110:42:07, 14.34s/it]
 27%|██▋       | 10165/37963 [43:34:14<110:02:26, 14.25s/it]
 27%|██▋       | 10166/37963 [43:34:29<110:20:47, 14.29s/it]
 27%|██▋       | 10167/37963 [43:34:50<126:15:09, 16.35s/it]
 27%|██▋       | 10168/37963 [43:35:04<121:32:52, 15.74s/it]
 27%|██▋       | 10169/37963 [43:35:19<118:17:22, 15.32s/it]
 27%|██▋       | 10170/37963 [43:35:33<115:25:57, 14.95s/it]
                                                            
{'loss': '0.1602', 'grad_norm': '2.822', 'learning_rate': '1.718e-05', 'epoch': '0.2679'}

 27%|██▋       | 10170/37963 [43:35:33<115:25:57, 14.95s/it]
 27%|██▋       | 10171/37963 [43:35:47<113:56:13, 14.76s/it]
 27%|██▋       | 10172/37963 [43:36:01<113:06:55, 14.65s/it]
 27%|██▋       | 10173/37963 [43:36:15<110:59:46, 14.38s/it]
 27%|██▋       | 10174/37963 [43:36:29<110:10:48, 14.27s/it]
 27%|██▋       | 10175/37963 [43:36:50<125:12:00, 16.22s/it]
 27%|██▋       | 10176/37963 [43:37:04<120:54:18, 15.66s/it]
 27%|██▋       | 10177/37963 [43:37:18<117:06:52, 15.17s/it]
 27%|██▋       | 10178/37963 [43:37:32<113:24:56, 14.69s/it]
 27%|██▋       | 10179/37963 [43:37:53<128:29:15, 16.65s/it]
 27%|██▋       | 10180/37963 [43:38:14<138:57:13, 18.01s/it]
                                                            
{'loss': '0.1543', 'grad_norm': '4.409', 'learning_rate': '1.717e-05', 'epoch': '0.2682'}

 27%|██▋       | 10180/37963 [43:38:14<138:57:13, 18.01s/it]
 27%|██▋       | 10181/37963 [43:38:28<130:10:15, 16.87s/it]
 27%|██▋       | 10182/37963 [43:38:43<123:55:20, 16.06s/it]
 27%|██▋       | 10183/37963 [43:38:57<119:55:34, 15.54s/it]
 27%|██▋       | 10184/37963 [43:39:11<117:14:28, 15.19s/it]
 27%|██▋       | 10185/37963 [43:39:26<115:21:11, 14.95s/it]
 27%|██▋       | 10186/37963 [43:39:39<112:38:43, 14.60s/it]
 27%|██▋       | 10187/37963 [43:39:54<112:00:03, 14.52s/it]
 27%|██▋       | 10188/37963 [43:40:08<111:39:16, 14.47s/it]
 27%|██▋       | 10189/37963 [43:40:23<111:25:04, 14.44s/it]
 27%|██▋       | 10190/37963 [43:40:37<111:13:04, 14.42s/it]
                                                            
{'loss': '0.1558', 'grad_norm': '1.369', 'learning_rate': '1.716e-05', 'epoch': '0.2684'}

 27%|██▋       | 10190/37963 [43:40:37<111:13:04, 14.42s/it]
 27%|██▋       | 10191/37963 [43:40:51<111:05:19, 14.40s/it]
 27%|██▋       | 10192/37963 [43:41:18<140:41:08, 18.24s/it]
 27%|██▋       | 10193/37963 [43:41:33<132:01:21, 17.11s/it]
 27%|██▋       | 10194/37963 [43:41:47<125:39:25, 16.29s/it]
 27%|██▋       | 10195/37963 [43:42:01<120:32:01, 15.63s/it]
 27%|██▋       | 10196/37963 [43:42:16<117:53:50, 15.29s/it]
 27%|██▋       | 10197/37963 [43:42:30<115:44:29, 15.01s/it]
 27%|██▋       | 10198/37963 [43:42:45<114:07:39, 14.80s/it]
 27%|██▋       | 10199/37963 [43:43:05<127:57:07, 16.59s/it]
 27%|██▋       | 10200/37963 [43:43:20<123:14:21, 15.98s/it]
                                                            
{'loss': '0.1614', 'grad_norm': '1.625', 'learning_rate': '1.716e-05', 'epoch': '0.2687'}

 27%|██▋       | 10200/37963 [43:43:20<123:14:21, 15.98s/it]
 27%|██▋       | 10201/37963 [43:43:34<119:33:49, 15.50s/it]
 27%|██▋       | 10202/37963 [43:43:48<116:03:26, 15.05s/it]
 27%|██▋       | 10203/37963 [43:44:02<112:48:02, 14.63s/it]
 27%|██▋       | 10204/37963 [43:44:22<125:33:21, 16.28s/it]
 27%|██▋       | 10205/37963 [43:44:36<120:57:59, 15.69s/it]
 27%|██▋       | 10206/37963 [43:44:51<117:52:17, 15.29s/it]
 27%|██▋       | 10207/37963 [43:45:05<115:03:06, 14.92s/it]
 27%|██▋       | 10208/37963 [43:45:19<114:11:34, 14.81s/it]
 27%|██▋       | 10209/37963 [43:45:33<112:43:44, 14.62s/it]
 27%|██▋       | 10210/37963 [43:45:48<112:12:31, 14.56s/it]
                                                            
{'loss': '0.1565', 'grad_norm': '0.8493', 'learning_rate': '1.715e-05', 'epoch': '0.2689'}

 27%|██▋       | 10210/37963 [43:45:48<112:12:31, 14.56s/it]
 27%|██▋       | 10211/37963 [43:46:02<110:21:10, 14.32s/it]
 27%|██▋       | 10212/37963 [43:46:16<110:30:43, 14.34s/it]
 27%|██▋       | 10213/37963 [43:46:30<110:31:28, 14.34s/it]
 27%|██▋       | 10214/37963 [43:46:45<110:07:24, 14.29s/it]
 27%|██▋       | 10215/37963 [43:46:59<109:25:09, 14.20s/it]
 27%|██▋       | 10216/37963 [43:47:19<125:04:27, 16.23s/it]
 27%|██▋       | 10217/37963 [43:47:34<120:58:24, 15.70s/it]
 27%|██▋       | 10218/37963 [43:47:48<117:48:44, 15.29s/it]
 27%|██▋       | 10219/37963 [43:48:02<114:46:51, 14.89s/it]
 27%|██▋       | 10220/37963 [43:48:17<113:40:59, 14.75s/it]
                                                            
{'loss': '0.1565', 'grad_norm': '6.2', 'learning_rate': '1.715e-05', 'epoch': '0.2692'}

 27%|██▋       | 10220/37963 [43:48:17<113:40:59, 14.75s/it]
 27%|██▋       | 10221/37963 [43:48:31<112:38:55, 14.62s/it]
 27%|██▋       | 10222/37963 [43:48:44<110:05:55, 14.29s/it]
 27%|██▋       | 10223/37963 [43:48:59<110:22:53, 14.32s/it]
 27%|██▋       | 10224/37963 [43:49:20<125:45:51, 16.32s/it]
 27%|██▋       | 10225/37963 [43:49:41<135:52:46, 17.64s/it]
 27%|██▋       | 10226/37963 [43:49:55<128:25:54, 16.67s/it]
 27%|██▋       | 10227/37963 [43:50:16<138:57:36, 18.04s/it]
 27%|██▋       | 10228/37963 [43:50:31<130:25:31, 16.93s/it]
 27%|██▋       | 10229/37963 [43:50:44<123:10:04, 15.99s/it]
 27%|██▋       | 10230/37963 [43:50:59<119:20:02, 15.49s/it]
                                                            
{'loss': '0.1545', 'grad_norm': '2.381', 'learning_rate': '1.714e-05', 'epoch': '0.2695'}

 27%|██▋       | 10230/37963 [43:50:59<119:20:02, 15.49s/it]
 27%|██▋       | 10231/37963 [43:51:13<116:14:29, 15.09s/it]
 27%|██▋       | 10232/37963 [43:51:27<113:17:43, 14.71s/it]
 27%|██▋       | 10233/37963 [43:51:41<112:30:22, 14.61s/it]
 27%|██▋       | 10234/37963 [43:51:55<111:56:08, 14.53s/it]
 27%|██▋       | 10235/37963 [43:52:09<110:33:45, 14.35s/it]
 27%|██▋       | 10236/37963 [43:52:23<109:24:11, 14.20s/it]
 27%|██▋       | 10237/37963 [43:52:37<109:36:20, 14.23s/it]
 27%|██▋       | 10238/37963 [43:52:52<109:55:36, 14.27s/it]
 27%|██▋       | 10239/37963 [43:53:13<125:33:13, 16.30s/it]
 27%|██▋       | 10240/37963 [43:53:33<135:07:01, 17.55s/it]
                                                            
{'loss': '0.1541', 'grad_norm': '1.432', 'learning_rate': '1.713e-05', 'epoch': '0.2697'}

 27%|██▋       | 10240/37963 [43:53:33<135:07:01, 17.55s/it]
 27%|██▋       | 10241/37963 [43:53:48<128:26:21, 16.68s/it]
 27%|██▋       | 10242/37963 [43:54:02<122:57:24, 15.97s/it]
 27%|██▋       | 10243/37963 [43:54:16<118:15:45, 15.36s/it]
 27%|██▋       | 10244/37963 [43:54:31<115:52:14, 15.05s/it]
 27%|██▋       | 10245/37963 [43:54:45<114:10:40, 14.83s/it]
 27%|██▋       | 10246/37963 [43:54:59<113:06:02, 14.69s/it]
 27%|██▋       | 10247/37963 [43:55:20<126:45:47, 16.47s/it]
 27%|██▋       | 10248/37963 [43:55:34<121:43:50, 15.81s/it]
 27%|██▋       | 10249/37963 [43:55:49<118:23:23, 15.38s/it]
 27%|██▋       | 10250/37963 [43:56:03<115:55:26, 15.06s/it]
                                                            
{'loss': '0.1463', 'grad_norm': '2.808', 'learning_rate': '1.713e-05', 'epoch': '0.27'}

 27%|██▋       | 10250/37963 [43:56:03<115:55:26, 15.06s/it]
 27%|██▋       | 10251/37963 [43:56:17<114:12:24, 14.84s/it]
 27%|██▋       | 10252/37963 [43:56:32<113:07:32, 14.70s/it]
 27%|██▋       | 10253/37963 [43:56:45<110:36:53, 14.37s/it]
 27%|██▋       | 10254/37963 [43:56:59<109:54:06, 14.28s/it]
 27%|██▋       | 10255/37963 [43:57:20<124:35:35, 16.19s/it]
 27%|██▋       | 10256/37963 [43:57:34<120:11:37, 15.62s/it]
 27%|██▋       | 10257/37963 [43:57:48<117:07:32, 15.22s/it]
 27%|██▋       | 10258/37963 [43:58:03<115:12:59, 14.97s/it]
 27%|██▋       | 10259/37963 [43:58:17<112:34:49, 14.63s/it]
 27%|██▋       | 10260/37963 [43:58:31<111:52:23, 14.54s/it]
                                                            
{'loss': '0.1617', 'grad_norm': '2.581', 'learning_rate': '1.712e-05', 'epoch': '0.2703'}

 27%|██▋       | 10260/37963 [43:58:31<111:52:23, 14.54s/it]
 27%|██▋       | 10261/37963 [43:58:45<111:25:14, 14.48s/it]
 27%|██▋       | 10262/37963 [43:58:59<110:41:53, 14.39s/it]
 27%|██▋       | 10263/37963 [43:59:14<110:10:19, 14.32s/it]
 27%|██▋       | 10264/37963 [43:59:28<110:15:35, 14.33s/it]
 27%|██▋       | 10265/37963 [43:59:49<126:01:06, 16.38s/it]
 27%|██▋       | 10266/37963 [44:00:03<121:19:41, 15.77s/it]
 27%|██▋       | 10267/37963 [44:00:18<118:01:33, 15.34s/it]
 27%|██▋       | 10268/37963 [44:00:32<115:40:35, 15.04s/it]
 27%|██▋       | 10269/37963 [44:00:46<114:04:11, 14.83s/it]
 27%|██▋       | 10270/37963 [44:01:01<113:02:35, 14.70s/it]
                                                            
{'loss': '0.1614', 'grad_norm': '7.338', 'learning_rate': '1.712e-05', 'epoch': '0.2705'}

 27%|██▋       | 10270/37963 [44:01:01<113:02:35, 14.70s/it]
 27%|██▋       | 10271/37963 [44:01:15<112:11:56, 14.59s/it]
 27%|██▋       | 10272/37963 [44:01:36<125:40:23, 16.34s/it]
 27%|██▋       | 10273/37963 [44:01:50<121:03:09, 15.74s/it]
 27%|██▋       | 10274/37963 [44:02:04<116:42:27, 15.17s/it]
 27%|██▋       | 10275/37963 [44:02:18<115:10:01, 14.97s/it]
 27%|██▋       | 10276/37963 [44:02:46<144:00:02, 18.72s/it]
 27%|██▋       | 10277/37963 [44:03:00<133:56:08, 17.42s/it]
 27%|██▋       | 10278/37963 [44:03:14<126:47:34, 16.49s/it]
 27%|██▋       | 10279/37963 [44:03:28<119:58:16, 15.60s/it]
 27%|██▋       | 10280/37963 [44:03:42<117:15:55, 15.25s/it]
                                                            
{'loss': '0.16', 'grad_norm': '1.191', 'learning_rate': '1.711e-05', 'epoch': '0.2708'}

 27%|██▋       | 10280/37963 [44:03:42<117:15:55, 15.25s/it]
 27%|██▋       | 10281/37963 [44:03:57<115:12:11, 14.98s/it]
 27%|██▋       | 10282/37963 [44:04:11<113:56:25, 14.82s/it]
 27%|██▋       | 10283/37963 [44:04:26<112:46:25, 14.67s/it]
 27%|██▋       | 10284/37963 [44:04:40<112:01:16, 14.57s/it]
 27%|██▋       | 10285/37963 [44:04:54<111:32:31, 14.51s/it]
 27%|██▋       | 10286/37963 [44:05:09<111:12:42, 14.47s/it]
 27%|██▋       | 10287/37963 [44:05:23<110:58:27, 14.44s/it]
 27%|██▋       | 10288/37963 [44:05:44<125:45:12, 16.36s/it]
 27%|██▋       | 10289/37963 [44:06:05<136:39:03, 17.78s/it]
 27%|██▋       | 10290/37963 [44:06:20<129:40:04, 16.87s/it]
                                                            
{'loss': '0.1689', 'grad_norm': '4.616', 'learning_rate': '1.71e-05', 'epoch': '0.2711'}

 27%|██▋       | 10290/37963 [44:06:20<129:40:04, 16.87s/it]
 27%|██▋       | 10291/37963 [44:06:34<123:04:49, 16.01s/it]
 27%|██▋       | 10292/37963 [44:06:48<119:09:51, 15.50s/it]
 27%|██▋       | 10293/37963 [44:07:02<115:50:44, 15.07s/it]
 27%|██▋       | 10294/37963 [44:07:16<113:42:27, 14.79s/it]
 27%|██▋       | 10295/37963 [44:07:37<127:36:07, 16.60s/it]
 27%|██▋       | 10296/37963 [44:07:51<122:20:47, 15.92s/it]
 27%|██▋       | 10297/37963 [44:08:06<118:45:32, 15.45s/it]
 27%|██▋       | 10298/37963 [44:08:20<116:15:20, 15.13s/it]
 27%|██▋       | 10299/37963 [44:08:34<114:23:02, 14.89s/it]
 27%|██▋       | 10300/37963 [44:08:49<112:41:55, 14.67s/it]
                                                            
{'loss': '0.1582', 'grad_norm': '3.703', 'learning_rate': '1.71e-05', 'epoch': '0.2713'}

 27%|██▋       | 10300/37963 [44:08:49<112:41:55, 14.67s/it]
 27%|██▋       | 10301/37963 [44:09:03<112:02:35, 14.58s/it]
 27%|██▋       | 10302/37963 [44:09:17<111:43:41, 14.54s/it]
 27%|██▋       | 10303/37963 [44:09:32<111:20:08, 14.49s/it]
 27%|██▋       | 10304/37963 [44:09:46<111:08:02, 14.46s/it]
 27%|██▋       | 10305/37963 [44:10:01<111:00:20, 14.45s/it]
 27%|██▋       | 10306/37963 [44:10:22<126:05:32, 16.41s/it]
 27%|██▋       | 10307/37963 [44:10:36<121:23:57, 15.80s/it]
 27%|██▋       | 10308/37963 [44:10:50<117:48:59, 15.34s/it]
 27%|██▋       | 10309/37963 [44:11:05<115:32:47, 15.04s/it]
 27%|██▋       | 10310/37963 [44:11:19<114:12:15, 14.87s/it]
                                                            
{'loss': '0.1529', 'grad_norm': '1.839', 'learning_rate': '1.709e-05', 'epoch': '0.2716'}

 27%|██▋       | 10310/37963 [44:11:19<114:12:15, 14.87s/it]
 27%|██▋       | 10311/37963 [44:11:33<112:57:33, 14.71s/it]
 27%|██▋       | 10312/37963 [44:11:48<112:10:01, 14.60s/it]
 27%|██▋       | 10313/37963 [44:12:01<110:03:36, 14.33s/it]
 27%|██▋       | 10314/37963 [44:12:23<125:43:45, 16.37s/it]
 27%|██▋       | 10315/37963 [44:12:37<120:56:17, 15.75s/it]
 27%|██▋       | 10316/37963 [44:12:51<117:40:14, 15.32s/it]
 27%|██▋       | 10317/37963 [44:13:05<115:04:26, 14.98s/it]
 27%|██▋       | 10318/37963 [44:13:20<113:56:39, 14.84s/it]
 27%|██▋       | 10319/37963 [44:13:34<112:47:22, 14.69s/it]
 27%|██▋       | 10320/37963 [44:13:48<111:01:37, 14.46s/it]
                                                            
{'loss': '0.1646', 'grad_norm': '1.782', 'learning_rate': '1.709e-05', 'epoch': '0.2718'}

 27%|██▋       | 10320/37963 [44:13:48<111:01:37, 14.46s/it]
 27%|██▋       | 10321/37963 [44:14:09<125:12:44, 16.31s/it]
 27%|██▋       | 10322/37963 [44:14:23<119:57:27, 15.62s/it]
 27%|██▋       | 10323/37963 [44:14:37<116:46:01, 15.21s/it]
 27%|██▋       | 10324/37963 [44:14:51<113:12:03, 14.74s/it]
 27%|██▋       | 10325/37963 [44:15:11<126:36:35, 16.49s/it]
 27%|██▋       | 10326/37963 [44:15:26<121:39:54, 15.85s/it]
 27%|██▋       | 10327/37963 [44:15:40<118:10:43, 15.39s/it]
 27%|██▋       | 10328/37963 [44:15:54<115:11:51, 15.01s/it]
 27%|██▋       | 10329/37963 [44:16:08<113:50:12, 14.83s/it]
 27%|██▋       | 10330/37963 [44:16:23<112:53:42, 14.71s/it]
                                                            
{'loss': '0.1554', 'grad_norm': '4.135', 'learning_rate': '1.708e-05', 'epoch': '0.2721'}

 27%|██▋       | 10330/37963 [44:16:23<112:53:42, 14.71s/it]
 27%|██▋       | 10331/37963 [44:16:37<111:55:19, 14.58s/it]
 27%|██▋       | 10332/37963 [44:16:52<111:28:37, 14.52s/it]
 27%|██▋       | 10333/37963 [44:17:06<111:02:12, 14.47s/it]
 27%|██▋       | 10334/37963 [44:17:20<110:40:33, 14.42s/it]
 27%|██▋       | 10335/37963 [44:17:35<110:26:24, 14.39s/it]
 27%|██▋       | 10336/37963 [44:17:49<110:29:25, 14.40s/it]
 27%|██▋       | 10337/37963 [44:18:10<125:29:43, 16.35s/it]
 27%|██▋       | 10338/37963 [44:18:31<136:26:38, 17.78s/it]
 27%|██▋       | 10339/37963 [44:18:45<128:33:31, 16.75s/it]
 27%|██▋       | 10340/37963 [44:19:00<123:00:40, 16.03s/it]
                                                            
{'loss': '0.1639', 'grad_norm': '0.9101', 'learning_rate': '1.707e-05', 'epoch': '0.2724'}

 27%|██▋       | 10340/37963 [44:19:00<123:00:40, 16.03s/it]
 27%|██▋       | 10341/37963 [44:19:14<119:03:25, 15.52s/it]
 27%|██▋       | 10342/37963 [44:19:28<116:14:34, 15.15s/it]
 27%|██▋       | 10343/37963 [44:19:43<114:40:50, 14.95s/it]
 27%|██▋       | 10344/37963 [44:20:04<128:06:09, 16.70s/it]
 27%|██▋       | 10345/37963 [44:20:18<122:37:25, 15.98s/it]
 27%|██▋       | 10346/37963 [44:20:32<118:56:03, 15.50s/it]
 27%|██▋       | 10347/37963 [44:20:46<115:56:55, 15.11s/it]
 27%|██▋       | 10348/37963 [44:21:01<114:02:56, 14.87s/it]
 27%|██▋       | 10349/37963 [44:21:15<113:02:25, 14.74s/it]
 27%|██▋       | 10350/37963 [44:21:29<112:04:53, 14.61s/it]
                                                            
{'loss': '0.15', 'grad_norm': '2.389', 'learning_rate': '1.707e-05', 'epoch': '0.2726'}

 27%|██▋       | 10350/37963 [44:21:29<112:04:53, 14.61s/it]
 27%|██▋       | 10351/37963 [44:21:44<111:07:15, 14.49s/it]
 27%|██▋       | 10352/37963 [44:21:58<110:54:33, 14.46s/it]
 27%|██▋       | 10353/37963 [44:22:19<124:42:40, 16.26s/it]
 27%|██▋       | 10354/37963 [44:22:33<119:37:08, 15.60s/it]
 27%|██▋       | 10355/37963 [44:22:47<116:44:42, 15.22s/it]
 27%|██▋       | 10356/37963 [44:23:01<114:41:58, 14.96s/it]
 27%|██▋       | 10357/37963 [44:23:16<113:19:44, 14.78s/it]
 27%|██▋       | 10358/37963 [44:23:30<112:25:50, 14.66s/it]
 27%|██▋       | 10359/37963 [44:23:44<111:44:05, 14.57s/it]
 27%|██▋       | 10360/37963 [44:23:59<111:16:31, 14.51s/it]
                                                            
{'loss': '0.1751', 'grad_norm': '2.583', 'learning_rate': '1.706e-05', 'epoch': '0.2729'}

 27%|██▋       | 10360/37963 [44:23:59<111:16:31, 14.51s/it]
 27%|██▋       | 10361/37963 [44:24:12<109:16:10, 14.25s/it]
 27%|██▋       | 10362/37963 [44:24:27<109:21:22, 14.26s/it]
 27%|██▋       | 10363/37963 [44:24:41<109:39:27, 14.30s/it]
 27%|██▋       | 10364/37963 [44:25:02<125:35:06, 16.38s/it]
 27%|██▋       | 10365/37963 [44:25:16<120:05:53, 15.67s/it]
 27%|██▋       | 10366/37963 [44:25:31<116:54:03, 15.25s/it]
 27%|██▋       | 10367/37963 [44:25:45<114:40:17, 14.96s/it]
 27%|██▋       | 10368/37963 [44:25:59<113:16:13, 14.78s/it]
 27%|██▋       | 10369/37963 [44:26:20<126:53:57, 16.56s/it]
 27%|██▋       | 10370/37963 [44:26:34<121:34:18, 15.86s/it]
                                                            
{'loss': '0.1641', 'grad_norm': '4.387', 'learning_rate': '1.706e-05', 'epoch': '0.2732'}

 27%|██▋       | 10370/37963 [44:26:34<121:34:18, 15.86s/it]
 27%|██▋       | 10371/37963 [44:26:49<118:12:14, 15.42s/it]
 27%|██▋       | 10372/37963 [44:27:03<115:45:42, 15.10s/it]
 27%|██▋       | 10373/37963 [44:27:30<144:10:04, 18.81s/it]
 27%|██▋       | 10374/37963 [44:27:45<134:05:08, 17.50s/it]
 27%|██▋       | 10375/37963 [44:27:59<126:53:44, 16.56s/it]
 27%|██▋       | 10376/37963 [44:28:14<121:58:44, 15.92s/it]
 27%|██▋       | 10377/37963 [44:28:28<118:23:01, 15.45s/it]
 27%|██▋       | 10378/37963 [44:28:42<115:05:17, 15.02s/it]
 27%|██▋       | 10379/37963 [44:28:56<112:38:33, 14.70s/it]
 27%|██▋       | 10380/37963 [44:29:10<111:43:01, 14.58s/it]
                                                            
{'loss': '0.1516', 'grad_norm': '3.074', 'learning_rate': '1.705e-05', 'epoch': '0.2734'}

 27%|██▋       | 10380/37963 [44:29:10<111:43:01, 14.58s/it]
 27%|██▋       | 10381/37963 [44:29:25<111:04:42, 14.50s/it]
 27%|██▋       | 10382/37963 [44:29:39<110:48:33, 14.46s/it]
 27%|██▋       | 10383/37963 [44:29:53<110:31:08, 14.43s/it]
 27%|██▋       | 10384/37963 [44:30:08<110:24:34, 14.41s/it]
 27%|██▋       | 10385/37963 [44:30:21<108:38:55, 14.18s/it]
 27%|██▋       | 10386/37963 [44:30:49<138:42:08, 18.11s/it]
 27%|██▋       | 10387/37963 [44:31:03<130:00:29, 16.97s/it]
 27%|██▋       | 10388/37963 [44:31:17<124:06:24, 16.20s/it]
 27%|██▋       | 10389/37963 [44:31:31<119:24:18, 15.59s/it]
 27%|██▋       | 10390/37963 [44:31:46<116:35:51, 15.22s/it]
                                                            
{'loss': '0.1563', 'grad_norm': '1.776', 'learning_rate': '1.704e-05', 'epoch': '0.2737'}

 27%|██▋       | 10390/37963 [44:31:46<116:35:51, 15.22s/it]
 27%|██▋       | 10391/37963 [44:32:00<114:42:51, 14.98s/it]
 27%|██▋       | 10392/37963 [44:32:20<126:04:41, 16.46s/it]
 27%|██▋       | 10393/37963 [44:32:34<120:51:55, 15.78s/it]
 27%|██▋       | 10394/37963 [44:32:49<117:37:26, 15.36s/it]
 27%|██▋       | 10395/37963 [44:33:03<115:13:11, 15.05s/it]
 27%|██▋       | 10396/37963 [44:33:17<113:18:56, 14.80s/it]
 27%|██▋       | 10397/37963 [44:33:32<112:14:56, 14.66s/it]
 27%|██▋       | 10398/37963 [44:33:46<111:23:47, 14.55s/it]
 27%|██▋       | 10399/37963 [44:34:00<110:58:47, 14.49s/it]
 27%|██▋       | 10400/37963 [44:34:14<109:48:27, 14.34s/it]
                                                            
{'loss': '0.1599', 'grad_norm': '3.499', 'learning_rate': '1.704e-05', 'epoch': '0.274'}

 27%|██▋       | 10400/37963 [44:34:14<109:48:27, 14.34s/it]
 27%|██▋       | 10401/37963 [44:34:29<110:02:04, 14.37s/it]
 27%|██▋       | 10402/37963 [44:34:43<110:01:23, 14.37s/it]
 27%|██▋       | 10403/37963 [44:35:04<124:31:41, 16.27s/it]
 27%|██▋       | 10404/37963 [44:35:18<120:19:32, 15.72s/it]
 27%|██▋       | 10405/37963 [44:35:32<116:18:27, 15.19s/it]
 27%|██▋       | 10406/37963 [44:35:46<113:54:25, 14.88s/it]
 27%|██▋       | 10407/37963 [44:36:01<112:33:50, 14.71s/it]
 27%|██▋       | 10408/37963 [44:36:15<111:45:10, 14.60s/it]
 27%|██▋       | 10409/37963 [44:36:29<111:22:43, 14.55s/it]
 27%|██▋       | 10410/37963 [44:36:43<110:01:48, 14.38s/it]
                                                            
{'loss': '0.1656', 'grad_norm': '2.603', 'learning_rate': '1.703e-05', 'epoch': '0.2742'}

 27%|██▋       | 10410/37963 [44:36:43<110:01:48, 14.38s/it]
 27%|██▋       | 10411/37963 [44:36:57<109:27:25, 14.30s/it]
 27%|██▋       | 10412/37963 [44:37:12<109:34:26, 14.32s/it]
 27%|██▋       | 10413/37963 [44:37:33<125:28:41, 16.40s/it]
 27%|██▋       | 10414/37963 [44:37:47<119:05:57, 15.56s/it]
 27%|██▋       | 10415/37963 [44:38:01<116:08:09, 15.18s/it]
 27%|██▋       | 10416/37963 [44:38:15<114:15:19, 14.93s/it]
 27%|██▋       | 10417/37963 [44:38:29<112:26:17, 14.69s/it]
 27%|██▋       | 10418/37963 [44:38:43<110:10:08, 14.40s/it]
 27%|██▋       | 10419/37963 [44:38:58<110:01:06, 14.38s/it]
 27%|██▋       | 10420/37963 [44:39:18<125:03:34, 16.35s/it]
                                                            
{'loss': '0.1538', 'grad_norm': '5.801', 'learning_rate': '1.703e-05', 'epoch': '0.2745'}

 27%|██▋       | 10420/37963 [44:39:18<125:03:34, 16.35s/it]
 27%|██▋       | 10421/37963 [44:39:39<135:27:00, 17.70s/it]
 27%|██▋       | 10422/37963 [44:40:01<143:46:16, 18.79s/it]
 27%|██▋       | 10423/37963 [44:40:15<132:52:52, 17.37s/it]
 27%|██▋       | 10424/37963 [44:40:29<126:07:55, 16.49s/it]
 27%|██▋       | 10425/37963 [44:40:43<121:09:22, 15.84s/it]
 27%|██▋       | 10426/37963 [44:40:58<117:36:15, 15.37s/it]
 27%|██▋       | 10427/37963 [44:41:12<114:24:13, 14.96s/it]
 27%|██▋       | 10428/37963 [44:41:26<112:09:38, 14.66s/it]
 27%|██▋       | 10429/37963 [44:41:40<110:12:22, 14.41s/it]
 27%|██▋       | 10430/37963 [44:41:54<109:56:09, 14.37s/it]
                                                            
{'loss': '0.1633', 'grad_norm': '1.916', 'learning_rate': '1.702e-05', 'epoch': '0.2747'}

 27%|██▋       | 10430/37963 [44:41:54<109:56:09, 14.37s/it]
 27%|██▋       | 10431/37963 [44:42:07<107:51:10, 14.10s/it]
 27%|██▋       | 10432/37963 [44:42:22<108:05:51, 14.14s/it]
 27%|██▋       | 10433/37963 [44:42:36<108:39:31, 14.21s/it]
 27%|██▋       | 10434/37963 [44:43:04<139:25:00, 18.23s/it]
 27%|██▋       | 10435/37963 [44:43:18<129:39:19, 16.96s/it]
 27%|██▋       | 10436/37963 [44:43:32<123:35:17, 16.16s/it]
 27%|██▋       | 10437/37963 [44:43:46<118:49:37, 15.54s/it]
 27%|██▋       | 10438/37963 [44:43:59<113:47:30, 14.88s/it]
 27%|██▋       | 10439/37963 [44:44:14<112:34:57, 14.73s/it]
 28%|██▊       | 10440/37963 [44:44:28<112:00:41, 14.65s/it]
                                                            
{'loss': '0.1691', 'grad_norm': '1.525', 'learning_rate': '1.701e-05', 'epoch': '0.275'}

 28%|██▊       | 10440/37963 [44:44:28<112:00:41, 14.65s/it]
 28%|██▊       | 10441/37963 [44:44:42<111:15:22, 14.55s/it]
 28%|██▊       | 10442/37963 [44:45:03<124:52:47, 16.34s/it]
 28%|██▊       | 10443/37963 [44:45:17<120:27:42, 15.76s/it]
 28%|██▊       | 10444/37963 [44:45:31<115:50:52, 15.16s/it]
 28%|██▊       | 10445/37963 [44:45:45<113:53:27, 14.90s/it]
 28%|██▊       | 10446/37963 [44:46:00<112:37:58, 14.74s/it]
 28%|██▊       | 10447/37963 [44:46:14<111:44:49, 14.62s/it]
 28%|██▊       | 10448/37963 [44:46:28<111:11:58, 14.55s/it]
 28%|██▊       | 10449/37963 [44:46:43<110:44:40, 14.49s/it]
 28%|██▊       | 10450/37963 [44:47:04<125:05:33, 16.37s/it]
                                                            
{'loss': '0.1527', 'grad_norm': '1.764', 'learning_rate': '1.701e-05', 'epoch': '0.2753'}

 28%|██▊       | 10450/37963 [44:47:04<125:05:33, 16.37s/it]
 28%|██▊       | 10451/37963 [44:47:18<120:44:36, 15.80s/it]
 28%|██▊       | 10452/37963 [44:47:32<117:39:13, 15.40s/it]
 28%|██▊       | 10453/37963 [44:47:47<114:53:14, 15.03s/it]
 28%|██▊       | 10454/37963 [44:48:01<112:44:54, 14.75s/it]
 28%|██▊       | 10455/37963 [44:48:15<111:17:56, 14.57s/it]
 28%|██▊       | 10456/37963 [44:48:29<109:54:07, 14.38s/it]
 28%|██▊       | 10457/37963 [44:48:43<109:36:16, 14.35s/it]
 28%|██▊       | 10458/37963 [44:48:58<109:42:40, 14.36s/it]
 28%|██▊       | 10459/37963 [44:49:12<109:50:05, 14.38s/it]
 28%|██▊       | 10460/37963 [44:49:26<108:21:19, 14.18s/it]
                                                            
{'loss': '0.167', 'grad_norm': '1.921', 'learning_rate': '1.7e-05', 'epoch': '0.2755'}

 28%|██▊       | 10460/37963 [44:49:26<108:21:19, 14.18s/it]
 28%|██▊       | 10461/37963 [44:49:40<108:31:38, 14.21s/it]
 28%|██▊       | 10462/37963 [44:49:54<109:11:31, 14.29s/it]
 28%|██▊       | 10463/37963 [44:50:16<125:37:36, 16.45s/it]
 28%|██▊       | 10464/37963 [44:50:30<120:21:37, 15.76s/it]
 28%|██▊       | 10465/37963 [44:50:45<117:30:58, 15.39s/it]
 28%|██▊       | 10466/37963 [44:50:59<115:10:55, 15.08s/it]
 28%|██▊       | 10467/37963 [44:51:13<113:22:20, 14.84s/it]
 28%|██▊       | 10468/37963 [44:51:28<112:13:20, 14.69s/it]
 28%|██▊       | 10469/37963 [44:51:48<126:25:02, 16.55s/it]
 28%|██▊       | 10470/37963 [44:52:16<151:14:20, 19.80s/it]
                                                            
{'loss': '0.1752', 'grad_norm': '2.508', 'learning_rate': '1.7e-05', 'epoch': '0.2758'}

 28%|██▊       | 10470/37963 [44:52:16<151:14:20, 19.80s/it]
 28%|██▊       | 10471/37963 [44:52:30<138:39:03, 18.16s/it]
 28%|██▊       | 10472/37963 [44:52:44<129:54:42, 17.01s/it]
 28%|██▊       | 10473/37963 [44:52:59<123:21:12, 16.15s/it]
 28%|██▊       | 10474/37963 [44:53:13<118:21:49, 15.50s/it]
 28%|██▊       | 10475/37963 [44:53:27<115:30:17, 15.13s/it]
 28%|██▊       | 10476/37963 [44:53:41<113:19:17, 14.84s/it]
 28%|██▊       | 10477/37963 [44:53:55<111:57:18, 14.66s/it]
 28%|██▊       | 10478/37963 [44:54:10<111:06:03, 14.55s/it]
 28%|██▊       | 10479/37963 [44:54:24<110:59:39, 14.54s/it]
 28%|██▊       | 10480/37963 [44:54:38<110:02:48, 14.42s/it]
                                                            
{'loss': '0.1639', 'grad_norm': '1.401', 'learning_rate': '1.699e-05', 'epoch': '0.2761'}

 28%|██▊       | 10480/37963 [44:54:38<110:02:48, 14.42s/it]
 28%|██▊       | 10481/37963 [44:54:53<109:58:27, 14.41s/it]
 28%|██▊       | 10482/37963 [44:55:20<139:30:35, 18.28s/it]
 28%|██▊       | 10483/37963 [44:55:34<129:02:04, 16.90s/it]
 28%|██▊       | 10484/37963 [44:55:48<123:30:04, 16.18s/it]
 28%|██▊       | 10485/37963 [44:56:03<119:27:43, 15.65s/it]
 28%|██▊       | 10486/37963 [44:56:17<116:40:32, 15.29s/it]
 28%|██▊       | 10487/37963 [44:56:31<114:10:00, 14.96s/it]
 28%|██▊       | 10488/37963 [44:56:46<112:54:17, 14.79s/it]
 28%|██▊       | 10489/37963 [44:56:59<110:52:47, 14.53s/it]
 28%|██▊       | 10490/37963 [44:57:14<110:31:30, 14.48s/it]
                                                            
{'loss': '0.1626', 'grad_norm': '4.496', 'learning_rate': '1.698e-05', 'epoch': '0.2763'}

 28%|██▊       | 10490/37963 [44:57:14<110:31:30, 14.48s/it]
 28%|██▊       | 10491/37963 [44:57:35<124:54:45, 16.37s/it]
 28%|██▊       | 10492/37963 [44:57:49<120:27:56, 15.79s/it]
 28%|██▊       | 10493/37963 [44:58:04<117:34:36, 15.41s/it]
 28%|██▊       | 10494/37963 [44:58:18<115:07:38, 15.09s/it]
 28%|██▊       | 10495/37963 [44:58:32<113:26:49, 14.87s/it]
 28%|██▊       | 10496/37963 [44:58:46<111:29:26, 14.61s/it]
 28%|██▊       | 10497/37963 [44:59:01<110:47:51, 14.52s/it]
 28%|██▊       | 10498/37963 [44:59:21<124:58:23, 16.38s/it]
 28%|██▊       | 10499/37963 [44:59:35<119:48:50, 15.71s/it]
 28%|██▊       | 10500/37963 [44:59:49<115:17:59, 15.11s/it]
                                                            
{'loss': '0.1624', 'grad_norm': '3.803', 'learning_rate': '1.698e-05', 'epoch': '0.2766'}

 28%|██▊       | 10500/37963 [44:59:49<115:17:59, 15.11s/it]
 28%|██▊       | 10501/37963 [45:00:03<113:10:16, 14.84s/it]
 28%|██▊       | 10502/37963 [45:00:18<112:02:58, 14.69s/it]
 28%|██▊       | 10503/37963 [45:00:32<111:15:58, 14.59s/it]
 28%|██▊       | 10504/37963 [45:00:46<110:36:39, 14.50s/it]
 28%|██▊       | 10505/37963 [45:01:01<110:16:16, 14.46s/it]
 28%|██▊       | 10506/37963 [45:01:14<108:13:37, 14.19s/it]
 28%|██▊       | 10507/37963 [45:01:29<108:32:05, 14.23s/it]
 28%|██▊       | 10508/37963 [45:01:43<108:53:38, 14.28s/it]
 28%|██▊       | 10509/37963 [45:01:57<108:38:03, 14.25s/it]
 28%|██▊       | 10510/37963 [45:02:11<108:13:43, 14.19s/it]
                                                            
{'loss': '0.1476', 'grad_norm': '2.791', 'learning_rate': '1.697e-05', 'epoch': '0.2768'}

 28%|██▊       | 10510/37963 [45:02:11<108:13:43, 14.19s/it]
 28%|██▊       | 10511/37963 [45:02:33<124:41:10, 16.35s/it]
 28%|██▊       | 10512/37963 [45:02:46<118:09:46, 15.50s/it]
 28%|██▊       | 10513/37963 [45:03:00<114:52:22, 15.07s/it]
 28%|██▊       | 10514/37963 [45:03:14<112:32:17, 14.76s/it]
 28%|██▊       | 10515/37963 [45:03:28<111:04:42, 14.57s/it]
 28%|██▊       | 10516/37963 [45:03:43<111:11:04, 14.58s/it]
 28%|██▊       | 10517/37963 [45:03:57<111:01:46, 14.56s/it]
 28%|██▊       | 10518/37963 [45:04:25<141:30:00, 18.56s/it]
 28%|██▊       | 10519/37963 [45:04:47<147:31:00, 19.35s/it]
 28%|██▊       | 10520/37963 [45:05:01<135:30:15, 17.78s/it]
                                                            
{'loss': '0.1631', 'grad_norm': '1.77', 'learning_rate': '1.697e-05', 'epoch': '0.2771'}

 28%|██▊       | 10520/37963 [45:05:01<135:30:15, 17.78s/it]
 28%|██▊       | 10521/37963 [45:05:15<127:44:03, 16.76s/it]
 28%|██▊       | 10522/37963 [45:05:30<122:29:48, 16.07s/it]
 28%|██▊       | 10523/37963 [45:05:44<118:20:58, 15.53s/it]
 28%|██▊       | 10524/37963 [45:05:58<114:22:54, 15.01s/it]
 28%|██▊       | 10525/37963 [45:06:12<112:55:50, 14.82s/it]
 28%|██▊       | 10526/37963 [45:06:26<110:31:57, 14.50s/it]
 28%|██▊       | 10527/37963 [45:06:40<110:27:45, 14.49s/it]
 28%|██▊       | 10528/37963 [45:06:54<108:56:42, 14.30s/it]
 28%|██▊       | 10529/37963 [45:07:08<108:28:24, 14.23s/it]
 28%|██▊       | 10530/37963 [45:07:29<123:16:36, 16.18s/it]
                                                            
{'loss': '0.1581', 'grad_norm': '1.283', 'learning_rate': '1.696e-05', 'epoch': '0.2774'}

 28%|██▊       | 10530/37963 [45:07:29<123:16:36, 16.18s/it]
 28%|██▊       | 10531/37963 [45:07:50<134:08:32, 17.60s/it]
 28%|██▊       | 10532/37963 [45:08:04<126:42:41, 16.63s/it]
 28%|██▊       | 10533/37963 [45:08:18<121:23:41, 15.93s/it]
 28%|██▊       | 10534/37963 [45:08:32<115:40:10, 15.18s/it]
 28%|██▊       | 10535/37963 [45:08:46<113:07:26, 14.85s/it]
 28%|██▊       | 10536/37963 [45:09:00<111:51:57, 14.68s/it]
 28%|██▊       | 10537/37963 [45:09:15<110:57:05, 14.56s/it]
 28%|██▊       | 10538/37963 [45:09:29<110:28:26, 14.50s/it]
 28%|██▊       | 10539/37963 [45:09:43<110:05:49, 14.45s/it]
 28%|██▊       | 10540/37963 [45:09:58<109:45:45, 14.41s/it]
                                                            
{'loss': '0.1671', 'grad_norm': '2.072', 'learning_rate': '1.695e-05', 'epoch': '0.2776'}

 28%|██▊       | 10540/37963 [45:09:58<109:45:45, 14.41s/it]
 28%|██▊       | 10541/37963 [45:10:18<124:03:20, 16.29s/it]
 28%|██▊       | 10542/37963 [45:10:33<119:35:17, 15.70s/it]
 28%|██▊       | 10543/37963 [45:10:47<115:44:05, 15.19s/it]
 28%|██▊       | 10544/37963 [45:11:01<114:02:16, 14.97s/it]
 28%|██▊       | 10545/37963 [45:11:15<111:25:01, 14.63s/it]
 28%|██▊       | 10546/37963 [45:11:35<124:06:09, 16.30s/it]
 28%|██▊       | 10547/37963 [45:11:49<119:44:21, 15.72s/it]
 28%|██▊       | 10548/37963 [45:12:03<115:03:31, 15.11s/it]
 28%|██▊       | 10549/37963 [45:12:17<113:23:30, 14.89s/it]
 28%|██▊       | 10550/37963 [45:12:32<112:20:43, 14.75s/it]
                                                            
{'loss': '0.164', 'grad_norm': '4.808', 'learning_rate': '1.695e-05', 'epoch': '0.2779'}

 28%|██▊       | 10550/37963 [45:12:32<112:20:43, 14.75s/it]
 28%|██▊       | 10551/37963 [45:12:46<111:18:09, 14.62s/it]
 28%|██▊       | 10552/37963 [45:13:01<110:42:46, 14.54s/it]
 28%|██▊       | 10553/37963 [45:13:15<110:18:21, 14.49s/it]
 28%|██▊       | 10554/37963 [45:13:29<109:07:38, 14.33s/it]
 28%|██▊       | 10555/37963 [45:13:43<109:12:15, 14.34s/it]
 28%|██▊       | 10556/37963 [45:13:58<109:14:18, 14.35s/it]
 28%|██▊       | 10557/37963 [45:14:12<108:59:08, 14.32s/it]
 28%|██▊       | 10558/37963 [45:14:26<109:09:20, 14.34s/it]
 28%|██▊       | 10559/37963 [45:14:41<109:03:44, 14.33s/it]
 28%|██▊       | 10560/37963 [45:15:02<124:46:08, 16.39s/it]
                                                            
{'loss': '0.1551', 'grad_norm': '2.758', 'learning_rate': '1.694e-05', 'epoch': '0.2782'}

 28%|██▊       | 10560/37963 [45:15:02<124:46:08, 16.39s/it]
 28%|██▊       | 10561/37963 [45:15:16<119:34:59, 15.71s/it]
 28%|██▊       | 10562/37963 [45:15:30<116:33:42, 15.31s/it]
 28%|██▊       | 10563/37963 [45:15:44<114:05:19, 14.99s/it]
 28%|██▊       | 10564/37963 [45:15:59<112:34:30, 14.79s/it]
 28%|██▊       | 10565/37963 [45:16:13<111:33:33, 14.66s/it]
 28%|██▊       | 10566/37963 [45:16:27<109:42:02, 14.41s/it]
 28%|██▊       | 10567/37963 [45:16:48<124:39:44, 16.38s/it]
 28%|██▊       | 10568/37963 [45:17:09<136:16:54, 17.91s/it]
 28%|██▊       | 10569/37963 [45:17:24<128:26:41, 16.88s/it]
 28%|██▊       | 10570/37963 [45:17:38<122:41:23, 16.12s/it]
                                                            
{'loss': '0.1661', 'grad_norm': '2.101', 'learning_rate': '1.693e-05', 'epoch': '0.2784'}

 28%|██▊       | 10570/37963 [45:17:38<122:41:23, 16.12s/it]
 28%|██▊       | 10571/37963 [45:17:59<133:46:31, 17.58s/it]
 28%|██▊       | 10572/37963 [45:18:14<126:25:16, 16.62s/it]
 28%|██▊       | 10573/37963 [45:18:28<121:39:59, 15.99s/it]
 28%|██▊       | 10574/37963 [45:18:43<118:00:48, 15.51s/it]
 28%|██▊       | 10575/37963 [45:18:57<115:24:57, 15.17s/it]
 28%|██▊       | 10576/37963 [45:19:11<113:23:54, 14.91s/it]
 28%|██▊       | 10577/37963 [45:19:26<112:07:46, 14.74s/it]
 28%|██▊       | 10578/37963 [45:19:46<125:52:21, 16.55s/it]
 28%|██▊       | 10579/37963 [45:20:00<119:35:39, 15.72s/it]
 28%|██▊       | 10580/37963 [45:20:21<131:38:50, 17.31s/it]
                                                            
{'loss': '0.1682', 'grad_norm': '1.774', 'learning_rate': '1.693e-05', 'epoch': '0.2787'}

 28%|██▊       | 10580/37963 [45:20:21<131:38:50, 17.31s/it]
 28%|██▊       | 10581/37963 [45:20:36<125:00:51, 16.44s/it]
 28%|██▊       | 10582/37963 [45:20:50<120:43:15, 15.87s/it]
 28%|██▊       | 10583/37963 [45:21:04<115:52:15, 15.24s/it]
 28%|██▊       | 10584/37963 [45:21:18<114:00:11, 14.99s/it]
 28%|██▊       | 10585/37963 [45:21:32<111:36:24, 14.68s/it]
 28%|██▊       | 10586/37963 [45:21:46<110:00:36, 14.47s/it]
 28%|██▊       | 10587/37963 [45:22:01<109:58:15, 14.46s/it]
 28%|██▊       | 10588/37963 [45:22:21<124:21:34, 16.35s/it]
 28%|██▊       | 10589/37963 [45:22:36<119:30:35, 15.72s/it]
 28%|██▊       | 10590/37963 [45:22:50<116:12:19, 15.28s/it]
                                                            
{'loss': '0.1665', 'grad_norm': '4.156', 'learning_rate': '1.692e-05', 'epoch': '0.279'}

 28%|██▊       | 10590/37963 [45:22:50<116:12:19, 15.28s/it]
 28%|██▊       | 10591/37963 [45:23:04<114:05:51, 15.01s/it]
 28%|██▊       | 10592/37963 [45:23:19<112:37:32, 14.81s/it]
 28%|██▊       | 10593/37963 [45:23:33<111:41:52, 14.69s/it]
 28%|██▊       | 10594/37963 [45:23:47<111:03:13, 14.61s/it]
 28%|██▊       | 10595/37963 [45:24:02<110:17:49, 14.51s/it]
 28%|██▊       | 10596/37963 [45:24:23<125:00:50, 16.45s/it]
 28%|██▊       | 10597/37963 [45:24:36<118:57:21, 15.65s/it]
 28%|██▊       | 10598/37963 [45:24:51<116:00:15, 15.26s/it]
 28%|██▊       | 10599/37963 [45:25:05<113:55:20, 14.99s/it]
 28%|██▊       | 10600/37963 [45:25:20<112:46:25, 14.84s/it]
                                                            
{'loss': '0.1533', 'grad_norm': '3.482', 'learning_rate': '1.692e-05', 'epoch': '0.2792'}

 28%|██▊       | 10600/37963 [45:25:20<112:46:25, 14.84s/it]
 28%|██▊       | 10601/37963 [45:25:34<111:47:19, 14.71s/it]
 28%|██▊       | 10602/37963 [45:25:48<111:05:16, 14.62s/it]
 28%|██▊       | 10603/37963 [45:26:03<109:48:23, 14.45s/it]
 28%|██▊       | 10604/37963 [45:26:17<109:44:56, 14.44s/it]
 28%|██▊       | 10605/37963 [45:26:31<109:20:32, 14.39s/it]
 28%|██▊       | 10606/37963 [45:26:45<107:15:58, 14.12s/it]
 28%|██▊       | 10607/37963 [45:26:59<107:43:36, 14.18s/it]
 28%|██▊       | 10608/37963 [45:27:20<122:28:31, 16.12s/it]
 28%|██▊       | 10609/37963 [45:27:34<118:18:57, 15.57s/it]
 28%|██▊       | 10610/37963 [45:27:48<114:19:58, 15.05s/it]
                                                            
{'loss': '0.172', 'grad_norm': '5.009', 'learning_rate': '1.691e-05', 'epoch': '0.2795'}

 28%|██▊       | 10610/37963 [45:27:48<114:19:58, 15.05s/it]
 28%|██▊       | 10611/37963 [45:28:02<112:54:32, 14.86s/it]
 28%|██▊       | 10612/37963 [45:28:17<111:47:39, 14.71s/it]
 28%|██▊       | 10613/37963 [45:28:31<110:58:42, 14.61s/it]
 28%|██▊       | 10614/37963 [45:28:45<110:35:01, 14.56s/it]
 28%|██▊       | 10615/37963 [45:29:06<124:25:32, 16.38s/it]
 28%|██▊       | 10616/37963 [45:29:34<149:47:55, 19.72s/it]
 28%|██▊       | 10617/37963 [45:29:47<136:16:33, 17.94s/it]
 28%|██▊       | 10618/37963 [45:30:02<128:02:03, 16.86s/it]
 28%|██▊       | 10619/37963 [45:30:16<122:07:17, 16.08s/it]
 28%|██▊       | 10620/37963 [45:30:30<118:33:46, 15.61s/it]
                                                            
{'loss': '0.1763', 'grad_norm': '3.176', 'learning_rate': '1.69e-05', 'epoch': '0.2797'}

 28%|██▊       | 10620/37963 [45:30:30<118:33:46, 15.61s/it]
 28%|██▊       | 10621/37963 [45:30:44<113:20:24, 14.92s/it]
 28%|██▊       | 10622/37963 [45:30:58<111:59:21, 14.75s/it]
 28%|██▊       | 10623/37963 [45:31:12<109:35:29, 14.43s/it]
 28%|██▊       | 10624/37963 [45:31:26<109:29:18, 14.42s/it]
 28%|██▊       | 10625/37963 [45:31:41<109:29:54, 14.42s/it]
 28%|██▊       | 10626/37963 [45:32:01<124:14:30, 16.36s/it]
 28%|██▊       | 10627/37963 [45:32:15<117:37:02, 15.49s/it]
 28%|██▊       | 10628/37963 [45:32:29<113:47:55, 14.99s/it]
 28%|██▊       | 10629/37963 [45:32:50<128:07:25, 16.87s/it]
 28%|██▊       | 10630/37963 [45:33:04<122:10:12, 16.09s/it]
                                                            
{'loss': '0.1588', 'grad_norm': '2.389', 'learning_rate': '1.69e-05', 'epoch': '0.28'}

 28%|██▊       | 10630/37963 [45:33:04<122:10:12, 16.09s/it]
 28%|██▊       | 10631/37963 [45:33:19<118:11:06, 15.57s/it]
 28%|██▊       | 10632/37963 [45:33:33<114:25:44, 15.07s/it]
 28%|██▊       | 10633/37963 [45:33:47<112:56:45, 14.88s/it]
 28%|██▊       | 10634/37963 [45:34:01<110:09:09, 14.51s/it]
 28%|██▊       | 10635/37963 [45:34:15<109:49:38, 14.47s/it]
 28%|██▊       | 10636/37963 [45:34:29<108:00:07, 14.23s/it]
 28%|██▊       | 10637/37963 [45:34:43<108:25:38, 14.28s/it]
 28%|██▊       | 10638/37963 [45:35:04<122:54:48, 16.19s/it]
 28%|██▊       | 10639/37963 [45:35:18<118:45:09, 15.65s/it]
 28%|██▊       | 10640/37963 [45:35:32<115:48:08, 15.26s/it]
                                                            
{'loss': '0.1626', 'grad_norm': '4.093', 'learning_rate': '1.689e-05', 'epoch': '0.2803'}

 28%|██▊       | 10640/37963 [45:35:32<115:48:08, 15.26s/it]
 28%|██▊       | 10641/37963 [45:35:47<113:52:43, 15.00s/it]
 28%|██▊       | 10642/37963 [45:36:01<112:16:06, 14.79s/it]
 28%|██▊       | 10643/37963 [45:36:15<111:11:10, 14.65s/it]
 28%|██▊       | 10644/37963 [45:36:30<110:26:40, 14.55s/it]
 28%|██▊       | 10645/37963 [45:36:51<124:45:28, 16.44s/it]
 28%|██▊       | 10646/37963 [45:37:05<120:03:38, 15.82s/it]
 28%|██▊       | 10647/37963 [45:37:19<116:53:46, 15.41s/it]
 28%|██▊       | 10648/37963 [45:37:34<114:26:52, 15.08s/it]
 28%|██▊       | 10649/37963 [45:37:48<111:46:09, 14.73s/it]
 28%|██▊       | 10650/37963 [45:38:02<110:55:51, 14.62s/it]
                                                            
{'loss': '0.1611', 'grad_norm': '1.726', 'learning_rate': '1.689e-05', 'epoch': '0.2805'}

 28%|██▊       | 10650/37963 [45:38:02<110:55:51, 14.62s/it]
 28%|██▊       | 10651/37963 [45:38:16<110:29:24, 14.56s/it]
 28%|██▊       | 10652/37963 [45:38:31<109:49:22, 14.48s/it]
 28%|██▊       | 10653/37963 [45:38:45<109:12:43, 14.40s/it]
 28%|██▊       | 10654/37963 [45:38:59<109:08:30, 14.39s/it]
 28%|██▊       | 10655/37963 [45:39:13<107:45:05, 14.20s/it]
 28%|██▊       | 10656/37963 [45:39:34<122:25:06, 16.14s/it]
 28%|██▊       | 10657/37963 [45:39:48<118:17:44, 15.60s/it]
 28%|██▊       | 10658/37963 [45:40:03<115:54:55, 15.28s/it]
 28%|██▊       | 10659/37963 [45:40:16<112:30:53, 14.83s/it]
 28%|██▊       | 10660/37963 [45:40:31<111:21:26, 14.68s/it]
                                                            
{'loss': '0.1583', 'grad_norm': '4.35', 'learning_rate': '1.688e-05', 'epoch': '0.2808'}

 28%|██▊       | 10660/37963 [45:40:31<111:21:26, 14.68s/it]
 28%|██▊       | 10661/37963 [45:40:45<110:29:46, 14.57s/it]
 28%|██▊       | 10662/37963 [45:41:06<124:32:55, 16.42s/it]
 28%|██▊       | 10663/37963 [45:41:20<119:46:52, 15.80s/it]
 28%|██▊       | 10664/37963 [45:41:34<116:21:51, 15.35s/it]
 28%|██▊       | 10665/37963 [45:41:56<129:21:54, 17.06s/it]
 28%|██▊       | 10666/37963 [45:42:10<123:24:52, 16.28s/it]
 28%|██▊       | 10667/37963 [45:42:24<118:53:21, 15.68s/it]
 28%|██▊       | 10668/37963 [45:42:39<115:52:47, 15.28s/it]
 28%|██▊       | 10669/37963 [45:42:53<113:46:55, 15.01s/it]
 28%|██▊       | 10670/37963 [45:43:07<112:10:40, 14.80s/it]
                                                            
{'loss': '0.1657', 'grad_norm': '3.887', 'learning_rate': '1.687e-05', 'epoch': '0.2811'}

 28%|██▊       | 10670/37963 [45:43:07<112:10:40, 14.80s/it]
 28%|██▊       | 10671/37963 [45:43:22<111:20:08, 14.69s/it]
 28%|██▊       | 10672/37963 [45:43:36<109:59:24, 14.51s/it]
 28%|██▊       | 10673/37963 [45:43:50<108:13:40, 14.28s/it]
 28%|██▊       | 10674/37963 [45:44:10<122:56:51, 16.22s/it]
 28%|██▊       | 10675/37963 [45:44:25<118:48:42, 15.67s/it]
 28%|██▊       | 10676/37963 [45:44:38<114:31:25, 15.11s/it]
 28%|██▊       | 10677/37963 [45:44:53<112:04:28, 14.79s/it]
 28%|██▊       | 10678/37963 [45:45:07<111:11:20, 14.67s/it]
 28%|██▊       | 10679/37963 [45:45:21<110:38:43, 14.60s/it]
 28%|██▊       | 10680/37963 [45:45:36<110:16:31, 14.55s/it]
                                                            
{'loss': '0.1598', 'grad_norm': '4.116', 'learning_rate': '1.687e-05', 'epoch': '0.2813'}

 28%|██▊       | 10680/37963 [45:45:36<110:16:31, 14.55s/it]
 28%|██▊       | 10681/37963 [45:45:50<109:10:18, 14.41s/it]
 28%|██▊       | 10682/37963 [45:46:11<124:04:23, 16.37s/it]
 28%|██▊       | 10683/37963 [45:46:25<118:22:52, 15.62s/it]
 28%|██▊       | 10684/37963 [45:46:39<115:33:02, 15.25s/it]
 28%|██▊       | 10685/37963 [45:46:59<126:00:14, 16.63s/it]
 28%|██▊       | 10686/37963 [45:47:13<119:30:45, 15.77s/it]
 28%|██▊       | 10687/37963 [45:47:27<116:19:27, 15.35s/it]
 28%|██▊       | 10688/37963 [45:47:41<113:55:18, 15.04s/it]
 28%|██▊       | 10689/37963 [45:47:56<112:46:19, 14.89s/it]
 28%|██▊       | 10690/37963 [45:48:10<110:40:34, 14.61s/it]
                                                            
{'loss': '0.1648', 'grad_norm': '5.412', 'learning_rate': '1.686e-05', 'epoch': '0.2816'}

 28%|██▊       | 10690/37963 [45:48:10<110:40:34, 14.61s/it]
 28%|██▊       | 10691/37963 [45:48:25<111:20:10, 14.70s/it]
 28%|██▊       | 10692/37963 [45:48:39<109:46:48, 14.49s/it]
 28%|██▊       | 10693/37963 [45:49:00<124:32:09, 16.44s/it]
 28%|██▊       | 10694/37963 [45:49:14<119:38:27, 15.79s/it]
 28%|██▊       | 10695/37963 [45:49:29<116:38:06, 15.40s/it]
 28%|██▊       | 10696/37963 [45:49:43<114:06:53, 15.07s/it]
 28%|██▊       | 10697/37963 [45:49:57<111:11:55, 14.68s/it]
 28%|██▊       | 10698/37963 [45:50:11<110:19:16, 14.57s/it]
 28%|██▊       | 10699/37963 [45:50:25<108:08:39, 14.28s/it]
 28%|██▊       | 10700/37963 [45:50:39<108:15:31, 14.30s/it]
                                                            
{'loss': '0.1583', 'grad_norm': '2.922', 'learning_rate': '1.685e-05', 'epoch': '0.2819'}

 28%|██▊       | 10700/37963 [45:50:39<108:15:31, 14.30s/it]
 28%|██▊       | 10701/37963 [45:50:53<107:56:11, 14.25s/it]
 28%|██▊       | 10702/37963 [45:51:07<108:02:08, 14.27s/it]
 28%|██▊       | 10703/37963 [45:51:22<108:13:43, 14.29s/it]
 28%|██▊       | 10704/37963 [45:51:35<107:12:51, 14.16s/it]
 28%|██▊       | 10705/37963 [45:51:57<123:03:31, 16.25s/it]
 28%|██▊       | 10706/37963 [45:52:11<117:51:13, 15.57s/it]
 28%|██▊       | 10707/37963 [45:52:25<115:17:41, 15.23s/it]
 28%|██▊       | 10708/37963 [45:52:39<112:12:11, 14.82s/it]
 28%|██▊       | 10709/37963 [45:52:53<111:13:13, 14.69s/it]
 28%|██▊       | 10710/37963 [45:53:13<123:39:46, 16.34s/it]
                                                            
{'loss': '0.1606', 'grad_norm': '1.049', 'learning_rate': '1.685e-05', 'epoch': '0.2821'}

 28%|██▊       | 10710/37963 [45:53:13<123:39:46, 16.34s/it]
 28%|██▊       | 10711/37963 [45:53:28<119:13:01, 15.75s/it]
 28%|██▊       | 10712/37963 [45:53:55<145:54:14, 19.27s/it]
 28%|██▊       | 10713/37963 [45:54:10<134:36:17, 17.78s/it]
 28%|██▊       | 10714/37963 [45:54:24<126:40:18, 16.74s/it]
 28%|██▊       | 10715/37963 [45:54:38<120:26:12, 15.91s/it]
 28%|██▊       | 10716/37963 [45:54:52<116:56:21, 15.45s/it]
 28%|██▊       | 10717/37963 [45:55:06<113:05:04, 14.94s/it]
 28%|██▊       | 10718/37963 [45:55:20<111:01:12, 14.67s/it]
 28%|██▊       | 10719/37963 [45:55:34<110:09:06, 14.56s/it]
 28%|██▊       | 10720/37963 [45:55:48<108:07:10, 14.29s/it]
                                                            
{'loss': '0.1427', 'grad_norm': '2.355', 'learning_rate': '1.684e-05', 'epoch': '0.2824'}

 28%|██▊       | 10720/37963 [45:55:48<108:07:10, 14.29s/it]
 28%|██▊       | 10721/37963 [45:56:02<108:27:49, 14.33s/it]
 28%|██▊       | 10722/37963 [45:56:23<123:15:31, 16.29s/it]
 28%|██▊       | 10723/37963 [45:56:38<119:10:39, 15.75s/it]
 28%|██▊       | 10724/37963 [45:56:52<116:00:25, 15.33s/it]
 28%|██▊       | 10725/37963 [45:57:07<114:04:00, 15.08s/it]
 28%|██▊       | 10726/37963 [45:57:21<111:51:39, 14.79s/it]
 28%|██▊       | 10727/37963 [45:57:35<110:56:02, 14.66s/it]
 28%|██▊       | 10728/37963 [45:57:49<110:10:29, 14.56s/it]
 28%|██▊       | 10729/37963 [45:58:04<109:38:20, 14.49s/it]
 28%|██▊       | 10730/37963 [45:58:18<109:19:50, 14.45s/it]
                                                            
{'loss': '0.1465', 'grad_norm': '1.887', 'learning_rate': '1.684e-05', 'epoch': '0.2826'}

 28%|██▊       | 10730/37963 [45:58:18<109:19:50, 14.45s/it]
 28%|██▊       | 10731/37963 [45:58:38<122:28:38, 16.19s/it]
 28%|██▊       | 10732/37963 [45:58:52<117:22:15, 15.52s/it]
 28%|██▊       | 10733/37963 [45:59:06<113:29:47, 15.01s/it]
 28%|██▊       | 10734/37963 [45:59:26<125:02:11, 16.53s/it]
 28%|██▊       | 10735/37963 [45:59:41<119:54:41, 15.85s/it]
 28%|██▊       | 10736/37963 [45:59:55<116:01:20, 15.34s/it]
 28%|██▊       | 10737/37963 [46:00:09<113:43:49, 15.04s/it]
 28%|██▊       | 10738/37963 [46:00:23<111:09:08, 14.70s/it]
 28%|██▊       | 10739/37963 [46:00:37<110:13:47, 14.58s/it]
 28%|██▊       | 10740/37963 [46:00:52<109:39:13, 14.50s/it]
                                                            
{'loss': '0.1577', 'grad_norm': '2.88', 'learning_rate': '1.683e-05', 'epoch': '0.2829'}

 28%|██▊       | 10740/37963 [46:00:52<109:39:13, 14.50s/it]
 28%|██▊       | 10741/37963 [46:01:06<109:07:51, 14.43s/it]
 28%|██▊       | 10742/37963 [46:01:20<108:54:34, 14.40s/it]
 28%|██▊       | 10743/37963 [46:01:40<121:44:34, 16.10s/it]
 28%|██▊       | 10744/37963 [46:01:55<117:43:23, 15.57s/it]
 28%|██▊       | 10745/37963 [46:02:09<115:21:35, 15.26s/it]
 28%|██▊       | 10746/37963 [46:02:23<113:05:40, 14.96s/it]
 28%|██▊       | 10747/37963 [46:02:38<112:29:36, 14.88s/it]
 28%|██▊       | 10748/37963 [46:02:52<110:56:16, 14.67s/it]
 28%|██▊       | 10749/37963 [46:03:06<110:01:53, 14.56s/it]
 28%|██▊       | 10750/37963 [46:03:21<109:11:10, 14.44s/it]
                                                            
{'loss': '0.1666', 'grad_norm': '1.432', 'learning_rate': '1.682e-05', 'epoch': '0.2832'}

 28%|██▊       | 10750/37963 [46:03:21<109:11:10, 14.44s/it]
 28%|██▊       | 10751/37963 [46:03:35<108:55:21, 14.41s/it]
 28%|██▊       | 10752/37963 [46:03:49<108:44:23, 14.39s/it]
 28%|██▊       | 10753/37963 [46:04:10<123:00:33, 16.27s/it]
 28%|██▊       | 10754/37963 [46:04:24<118:14:53, 15.65s/it]
 28%|██▊       | 10755/37963 [46:04:38<114:10:25, 15.11s/it]
 28%|██▊       | 10756/37963 [46:04:52<112:02:29, 14.83s/it]
 28%|██▊       | 10757/37963 [46:05:07<110:56:35, 14.68s/it]
 28%|██▊       | 10758/37963 [46:05:21<110:24:46, 14.61s/it]
 28%|██▊       | 10759/37963 [46:05:42<124:28:20, 16.47s/it]
 28%|██▊       | 10760/37963 [46:05:56<119:42:05, 15.84s/it]
                                                            
{'loss': '0.1699', 'grad_norm': '2', 'learning_rate': '1.682e-05', 'epoch': '0.2834'}

 28%|██▊       | 10760/37963 [46:05:56<119:42:05, 15.84s/it]
 28%|██▊       | 10761/37963 [46:06:24<146:16:30, 19.36s/it]
 28%|██▊       | 10762/37963 [46:06:38<134:52:10, 17.85s/it]
 28%|██▊       | 10763/37963 [46:06:52<126:53:01, 16.79s/it]
 28%|██▊       | 10764/37963 [46:07:06<120:36:51, 15.96s/it]
 28%|██▊       | 10765/37963 [46:07:21<117:01:47, 15.49s/it]
 28%|██▊       | 10766/37963 [46:07:35<113:21:00, 15.00s/it]
 28%|██▊       | 10767/37963 [46:07:49<111:46:56, 14.80s/it]
 28%|██▊       | 10768/37963 [46:08:03<110:43:40, 14.66s/it]
 28%|██▊       | 10769/37963 [46:08:18<110:25:17, 14.62s/it]
 28%|██▊       | 10770/37963 [46:08:32<109:24:19, 14.48s/it]
                                                            
{'loss': '0.1687', 'grad_norm': '4.291', 'learning_rate': '1.681e-05', 'epoch': '0.2837'}

 28%|██▊       | 10770/37963 [46:08:32<109:24:19, 14.48s/it]
 28%|██▊       | 10771/37963 [46:08:46<109:06:11, 14.44s/it]
 28%|██▊       | 10772/37963 [46:09:07<122:45:59, 16.25s/it]
 28%|██▊       | 10773/37963 [46:09:21<117:21:50, 15.54s/it]
 28%|██▊       | 10774/37963 [46:09:35<114:23:46, 15.15s/it]
 28%|██▊       | 10775/37963 [46:09:49<112:36:21, 14.91s/it]
 28%|██▊       | 10776/37963 [46:10:03<110:49:15, 14.67s/it]
 28%|██▊       | 10777/37963 [46:10:18<110:13:37, 14.60s/it]
 28%|██▊       | 10778/37963 [46:10:32<109:45:44, 14.54s/it]
 28%|██▊       | 10779/37963 [46:10:47<109:19:01, 14.48s/it]
 28%|██▊       | 10780/37963 [46:11:08<124:23:26, 16.47s/it]
                                                            
{'loss': '0.166', 'grad_norm': '1.386', 'learning_rate': '1.68e-05', 'epoch': '0.284'}

 28%|██▊       | 10780/37963 [46:11:08<124:23:26, 16.47s/it]
 28%|██▊       | 10781/37963 [46:11:22<119:30:45, 15.83s/it]
 28%|██▊       | 10782/37963 [46:11:36<116:16:47, 15.40s/it]
 28%|██▊       | 10783/37963 [46:11:51<114:13:00, 15.13s/it]
 28%|██▊       | 10784/37963 [46:12:05<111:51:06, 14.82s/it]
 28%|██▊       | 10785/37963 [46:12:26<125:53:10, 16.67s/it]
 28%|██▊       | 10786/37963 [46:12:41<121:18:44, 16.07s/it]
 28%|██▊       | 10787/37963 [46:12:55<117:35:10, 15.58s/it]
 28%|██▊       | 10788/37963 [46:13:09<114:48:42, 15.21s/it]
 28%|██▊       | 10789/37963 [46:13:24<112:46:37, 14.94s/it]
 28%|██▊       | 10790/37963 [46:13:37<109:40:30, 14.53s/it]
                                                            
{'loss': '0.1638', 'grad_norm': '4.837', 'learning_rate': '1.68e-05', 'epoch': '0.2842'}

 28%|██▊       | 10790/37963 [46:13:37<109:40:30, 14.53s/it]
 28%|██▊       | 10791/37963 [46:13:51<108:00:26, 14.31s/it]
 28%|██▊       | 10792/37963 [46:14:12<122:15:41, 16.20s/it]
 28%|██▊       | 10793/37963 [46:14:26<117:50:17, 15.61s/it]
 28%|██▊       | 10794/37963 [46:14:40<114:42:35, 15.20s/it]
 28%|██▊       | 10795/37963 [46:14:55<113:17:44, 15.01s/it]
 28%|██▊       | 10796/37963 [46:15:09<111:36:43, 14.79s/it]
 28%|██▊       | 10797/37963 [46:15:23<110:28:49, 14.64s/it]
 28%|██▊       | 10798/37963 [46:15:38<109:40:22, 14.53s/it]
 28%|██▊       | 10799/37963 [46:15:52<108:48:14, 14.42s/it]
 28%|██▊       | 10800/37963 [46:16:06<108:35:55, 14.39s/it]
                                                            
{'loss': '0.1588', 'grad_norm': '4.095', 'learning_rate': '1.679e-05', 'epoch': '0.2845'}

 28%|██▊       | 10800/37963 [46:16:06<108:35:55, 14.39s/it]
 28%|██▊       | 10801/37963 [46:16:20<108:20:49, 14.36s/it]
 28%|██▊       | 10802/37963 [46:16:42<123:39:42, 16.39s/it]
 28%|██▊       | 10803/37963 [46:16:56<119:12:50, 15.80s/it]
 28%|██▊       | 10804/37963 [46:17:10<115:02:54, 15.25s/it]
 28%|██▊       | 10805/37963 [46:17:24<112:59:10, 14.98s/it]
 28%|██▊       | 10806/37963 [46:17:45<126:26:40, 16.76s/it]
 28%|██▊       | 10807/37963 [46:18:06<135:46:48, 18.00s/it]
 28%|██▊       | 10808/37963 [46:18:20<126:24:07, 16.76s/it]
 28%|██▊       | 10809/37963 [46:18:34<119:28:20, 15.84s/it]
 28%|██▊       | 10810/37963 [46:18:54<129:40:06, 17.19s/it]
                                                            
{'loss': '0.1637', 'grad_norm': '2.358', 'learning_rate': '1.679e-05', 'epoch': '0.2848'}

 28%|██▊       | 10810/37963 [46:18:54<129:40:06, 17.19s/it]
 28%|██▊       | 10811/37963 [46:19:08<123:15:26, 16.34s/it]
 28%|██▊       | 10812/37963 [46:19:23<118:21:02, 15.69s/it]
 28%|██▊       | 10813/37963 [46:19:37<115:22:57, 15.30s/it]
 28%|██▊       | 10814/37963 [46:19:51<113:26:14, 15.04s/it]
 28%|██▊       | 10815/37963 [46:20:05<110:43:52, 14.68s/it]
 28%|██▊       | 10816/37963 [46:20:20<109:54:15, 14.57s/it]
 28%|██▊       | 10817/37963 [46:20:33<108:18:45, 14.36s/it]
 28%|██▊       | 10818/37963 [46:20:48<108:16:17, 14.36s/it]
 28%|██▊       | 10819/37963 [46:21:02<108:15:31, 14.36s/it]
 29%|██▊       | 10820/37963 [46:21:16<107:26:22, 14.25s/it]
                                                            
{'loss': '0.1538', 'grad_norm': '5.772', 'learning_rate': '1.678e-05', 'epoch': '0.285'}

 29%|██▊       | 10820/37963 [46:21:16<107:26:22, 14.25s/it]
 29%|██▊       | 10821/37963 [46:21:30<107:31:03, 14.26s/it]
 29%|██▊       | 10822/37963 [46:21:45<107:34:01, 14.27s/it]
 29%|██▊       | 10823/37963 [46:21:59<107:49:10, 14.30s/it]
 29%|██▊       | 10824/37963 [46:22:20<123:05:20, 16.33s/it]
 29%|██▊       | 10825/37963 [46:22:34<118:29:15, 15.72s/it]
 29%|██▊       | 10826/37963 [46:22:48<114:34:24, 15.20s/it]
 29%|██▊       | 10827/37963 [46:23:03<112:56:46, 14.98s/it]
 29%|██▊       | 10828/37963 [46:23:17<111:42:50, 14.82s/it]
 29%|██▊       | 10829/37963 [46:23:38<125:24:07, 16.64s/it]
 29%|██▊       | 10830/37963 [46:23:53<120:09:18, 15.94s/it]
                                                            
{'loss': '0.1786', 'grad_norm': '6.648', 'learning_rate': '1.677e-05', 'epoch': '0.2853'}

 29%|██▊       | 10830/37963 [46:23:53<120:09:18, 15.94s/it]
 29%|██▊       | 10831/37963 [46:24:07<116:35:06, 15.47s/it]
 29%|██▊       | 10832/37963 [46:24:21<114:29:12, 15.19s/it]
 29%|██▊       | 10833/37963 [46:24:42<127:13:40, 16.88s/it]
 29%|██▊       | 10834/37963 [46:24:57<121:15:49, 16.09s/it]
 29%|██▊       | 10835/37963 [46:25:11<117:16:55, 15.56s/it]
 29%|██▊       | 10836/37963 [46:25:25<114:02:23, 15.13s/it]
 29%|██▊       | 10837/37963 [46:25:39<111:35:00, 14.81s/it]
 29%|██▊       | 10838/37963 [46:25:53<110:45:12, 14.70s/it]
 29%|██▊       | 10839/37963 [46:26:08<109:52:45, 14.58s/it]
 29%|██▊       | 10840/37963 [46:26:28<123:36:21, 16.41s/it]
                                                            
{'loss': '0.164', 'grad_norm': '6.924', 'learning_rate': '1.677e-05', 'epoch': '0.2855'}

 29%|██▊       | 10840/37963 [46:26:28<123:36:21, 16.41s/it]
 29%|██▊       | 10841/37963 [46:26:43<119:04:08, 15.80s/it]
 29%|██▊       | 10842/37963 [46:26:57<115:36:03, 15.34s/it]
 29%|██▊       | 10843/37963 [46:27:11<111:56:05, 14.86s/it]
 29%|██▊       | 10844/37963 [46:27:25<110:52:05, 14.72s/it]
 29%|██▊       | 10845/37963 [46:27:40<110:01:56, 14.61s/it]
 29%|██▊       | 10846/37963 [46:27:54<109:28:52, 14.53s/it]
 29%|██▊       | 10847/37963 [46:28:08<109:02:33, 14.48s/it]
 29%|██▊       | 10848/37963 [46:28:23<109:07:56, 14.49s/it]
 29%|██▊       | 10849/37963 [46:28:37<108:43:53, 14.44s/it]
 29%|██▊       | 10850/37963 [46:28:58<123:26:17, 16.39s/it]
                                                            
{'loss': '0.1615', 'grad_norm': '3.696', 'learning_rate': '1.676e-05', 'epoch': '0.2858'}

 29%|██▊       | 10850/37963 [46:28:58<123:26:17, 16.39s/it]
 29%|██▊       | 10851/37963 [46:29:12<118:26:18, 15.73s/it]
 29%|██▊       | 10852/37963 [46:29:32<128:01:49, 17.00s/it]
 29%|██▊       | 10853/37963 [46:29:46<121:12:04, 16.09s/it]
 29%|██▊       | 10854/37963 [46:30:07<132:15:51, 17.56s/it]
 29%|██▊       | 10855/37963 [46:30:22<124:58:42, 16.60s/it]
 29%|██▊       | 10856/37963 [46:30:36<119:21:11, 15.85s/it]
 29%|██▊       | 10857/37963 [46:30:50<116:02:48, 15.41s/it]
 29%|██▊       | 10858/37963 [46:31:04<113:37:07, 15.09s/it]
 29%|██▊       | 10859/37963 [46:31:18<111:03:57, 14.75s/it]
 29%|██▊       | 10860/37963 [46:31:40<127:03:38, 16.88s/it]
                                                            
{'loss': '0.1589', 'grad_norm': '1.577', 'learning_rate': '1.675e-05', 'epoch': '0.2861'}

 29%|██▊       | 10860/37963 [46:31:40<127:03:38, 16.88s/it]
 29%|██▊       | 10861/37963 [46:31:55<121:17:47, 16.11s/it]
 29%|██▊       | 10862/37963 [46:32:09<117:35:49, 15.62s/it]
 29%|██▊       | 10863/37963 [46:32:23<113:54:02, 15.13s/it]
 29%|██▊       | 10864/37963 [46:32:37<112:05:50, 14.89s/it]
 29%|██▊       | 10865/37963 [46:32:52<110:46:10, 14.72s/it]
 29%|██▊       | 10866/37963 [46:33:06<109:49:19, 14.59s/it]
 29%|██▊       | 10867/37963 [46:33:20<109:40:33, 14.57s/it]
 29%|██▊       | 10868/37963 [46:33:35<109:12:04, 14.51s/it]
 29%|██▊       | 10869/37963 [46:33:49<108:52:40, 14.47s/it]
 29%|██▊       | 10870/37963 [46:34:03<108:29:49, 14.42s/it]
                                                            
{'loss': '0.1655', 'grad_norm': '1.488', 'learning_rate': '1.675e-05', 'epoch': '0.2863'}

 29%|██▊       | 10870/37963 [46:34:03<108:29:49, 14.42s/it]
 29%|██▊       | 10871/37963 [46:34:25<123:44:06, 16.44s/it]
 29%|██▊       | 10872/37963 [46:34:39<119:18:47, 15.85s/it]
 29%|██▊       | 10873/37963 [46:34:53<115:59:26, 15.41s/it]
 29%|██▊       | 10874/37963 [46:35:08<113:26:12, 15.08s/it]
 29%|██▊       | 10875/37963 [46:35:21<109:55:06, 14.61s/it]
 29%|██▊       | 10876/37963 [46:35:36<109:24:17, 14.54s/it]
 29%|██▊       | 10877/37963 [46:35:50<108:17:06, 14.39s/it]
 29%|██▊       | 10878/37963 [46:36:04<108:03:25, 14.36s/it]
 29%|██▊       | 10879/37963 [46:36:24<121:27:22, 16.14s/it]
 29%|██▊       | 10880/37963 [46:36:39<117:09:21, 15.57s/it]
                                                            
{'loss': '0.1632', 'grad_norm': '2.831', 'learning_rate': '1.674e-05', 'epoch': '0.2866'}

 29%|██▊       | 10880/37963 [46:36:39<117:09:21, 15.57s/it]
 29%|██▊       | 10881/37963 [46:36:53<113:54:29, 15.14s/it]
 29%|██▊       | 10882/37963 [46:37:07<112:04:13, 14.90s/it]
 29%|██▊       | 10883/37963 [46:37:22<111:10:45, 14.78s/it]
 29%|██▊       | 10884/37963 [46:37:43<125:40:13, 16.71s/it]
 29%|██▊       | 10885/37963 [46:37:57<120:46:18, 16.06s/it]
 29%|██▊       | 10886/37963 [46:38:12<117:02:26, 15.56s/it]
 29%|██▊       | 10887/37963 [46:38:26<113:25:50, 15.08s/it]
 29%|██▊       | 10888/37963 [46:38:40<112:03:32, 14.90s/it]
 29%|██▊       | 10889/37963 [46:38:54<110:41:33, 14.72s/it]
 29%|██▊       | 10890/37963 [46:39:15<124:31:15, 16.56s/it]
                                                            
{'loss': '0.1643', 'grad_norm': '1.674', 'learning_rate': '1.674e-05', 'epoch': '0.2869'}

 29%|██▊       | 10890/37963 [46:39:15<124:31:15, 16.56s/it]
 29%|██▊       | 10891/37963 [46:39:30<119:39:11, 15.91s/it]
 29%|██▊       | 10892/37963 [46:39:44<115:15:03, 15.33s/it]
 29%|██▊       | 10893/37963 [46:39:58<113:07:00, 15.04s/it]
 29%|██▊       | 10894/37963 [46:40:12<111:36:53, 14.84s/it]
 29%|██▊       | 10895/37963 [46:40:27<110:20:02, 14.67s/it]
 29%|██▊       | 10896/37963 [46:40:41<109:32:55, 14.57s/it]
 29%|██▊       | 10897/37963 [46:40:55<108:00:05, 14.37s/it]
 29%|██▊       | 10898/37963 [46:41:09<107:36:06, 14.31s/it]
 29%|██▊       | 10899/37963 [46:41:30<121:51:23, 16.21s/it]
 29%|██▊       | 10900/37963 [46:41:44<117:48:46, 15.67s/it]
                                                            
{'loss': '0.1649', 'grad_norm': '1.606', 'learning_rate': '1.673e-05', 'epoch': '0.2871'}

 29%|██▊       | 10900/37963 [46:41:44<117:48:46, 15.67s/it]
 29%|██▊       | 10901/37963 [46:41:58<114:37:09, 15.25s/it]
 29%|██▊       | 10902/37963 [46:42:19<127:25:18, 16.95s/it]
 29%|██▊       | 10903/37963 [46:42:34<121:38:10, 16.18s/it]
 29%|██▊       | 10904/37963 [46:42:54<131:24:42, 17.48s/it]
 29%|██▊       | 10905/37963 [46:43:08<123:08:46, 16.38s/it]
 29%|██▊       | 10906/37963 [46:43:23<118:55:27, 15.82s/it]
 29%|██▊       | 10907/37963 [46:43:37<115:08:27, 15.32s/it]
 29%|██▊       | 10908/37963 [46:43:51<113:00:22, 15.04s/it]
 29%|██▊       | 10909/37963 [46:44:12<125:51:06, 16.75s/it]
 29%|██▊       | 10910/37963 [46:44:26<120:28:25, 16.03s/it]
                                                            
{'loss': '0.1561', 'grad_norm': '1.986', 'learning_rate': '1.672e-05', 'epoch': '0.2874'}

 29%|██▊       | 10910/37963 [46:44:26<120:28:25, 16.03s/it]
 29%|██▊       | 10911/37963 [46:44:41<116:46:58, 15.54s/it]
 29%|██▊       | 10912/37963 [46:44:55<114:06:37, 15.19s/it]
 29%|██▊       | 10913/37963 [46:45:09<110:34:09, 14.72s/it]
 29%|██▊       | 10914/37963 [46:45:23<109:47:59, 14.61s/it]
 29%|██▉       | 10915/37963 [46:45:37<109:06:06, 14.52s/it]
 29%|██▉       | 10916/37963 [46:45:52<108:46:03, 14.48s/it]
 29%|██▉       | 10917/37963 [46:46:06<108:31:03, 14.44s/it]
 29%|██▉       | 10918/37963 [46:46:20<108:19:24, 14.42s/it]
 29%|██▉       | 10919/37963 [46:46:41<122:35:05, 16.32s/it]
 29%|██▉       | 10920/37963 [46:46:55<118:12:02, 15.74s/it]
                                                            
{'loss': '0.1663', 'grad_norm': '7.02', 'learning_rate': '1.672e-05', 'epoch': '0.2876'}

 29%|██▉       | 10920/37963 [46:46:55<118:12:02, 15.74s/it]
 29%|██▉       | 10921/37963 [46:47:09<113:37:02, 15.13s/it]
 29%|██▉       | 10922/37963 [46:47:23<111:46:47, 14.88s/it]
 29%|██▉       | 10923/37963 [46:47:38<110:54:49, 14.77s/it]
 29%|██▉       | 10924/37963 [46:47:52<109:16:57, 14.55s/it]
 29%|██▉       | 10925/37963 [46:48:06<108:52:40, 14.50s/it]
 29%|██▉       | 10926/37963 [46:48:21<108:27:07, 14.44s/it]
 29%|██▉       | 10927/37963 [46:48:42<123:30:03, 16.44s/it]
 29%|██▉       | 10928/37963 [46:48:56<118:53:31, 15.83s/it]
 29%|██▉       | 10929/37963 [46:49:11<115:34:55, 15.39s/it]
 29%|██▉       | 10930/37963 [46:49:25<113:07:19, 15.06s/it]
                                                            
{'loss': '0.1559', 'grad_norm': '1.758', 'learning_rate': '1.671e-05', 'epoch': '0.2879'}

 29%|██▉       | 10930/37963 [46:49:25<113:07:19, 15.06s/it]
 29%|██▉       | 10931/37963 [46:49:39<110:47:33, 14.75s/it]
 29%|██▉       | 10932/37963 [46:50:00<124:30:27, 16.58s/it]
 29%|██▉       | 10933/37963 [46:50:14<118:17:58, 15.76s/it]
 29%|██▉       | 10934/37963 [46:50:28<114:42:45, 15.28s/it]
 29%|██▉       | 10935/37963 [46:50:42<112:37:29, 15.00s/it]
 29%|██▉       | 10936/37963 [46:50:56<110:40:50, 14.74s/it]
 29%|██▉       | 10937/37963 [46:51:10<109:01:43, 14.52s/it]
 29%|██▉       | 10938/37963 [46:51:25<108:33:32, 14.46s/it]
 29%|██▉       | 10939/37963 [46:51:45<122:29:05, 16.32s/it]
 29%|██▉       | 10940/37963 [46:51:59<116:49:39, 15.56s/it]
                                                            
{'loss': '0.1578', 'grad_norm': '7.401', 'learning_rate': '1.67e-05', 'epoch': '0.2882'}

 29%|██▉       | 10940/37963 [46:51:59<116:49:39, 15.56s/it]
 29%|██▉       | 10941/37963 [46:52:13<114:07:05, 15.20s/it]
 29%|██▉       | 10942/37963 [46:52:28<112:04:13, 14.93s/it]
 29%|██▉       | 10943/37963 [46:52:42<110:48:19, 14.76s/it]
 29%|██▉       | 10944/37963 [46:52:57<110:40:55, 14.75s/it]
 29%|██▉       | 10945/37963 [46:53:11<110:18:45, 14.70s/it]
 29%|██▉       | 10946/37963 [46:53:26<109:37:57, 14.61s/it]
 29%|██▉       | 10947/37963 [46:53:54<140:18:30, 18.70s/it]
 29%|██▉       | 10948/37963 [46:54:08<130:35:56, 17.40s/it]
 29%|██▉       | 10949/37963 [46:54:23<124:07:58, 16.54s/it]
 29%|██▉       | 10950/37963 [46:54:37<118:59:23, 15.86s/it]
                                                            
{'loss': '0.1509', 'grad_norm': '2.207', 'learning_rate': '1.67e-05', 'epoch': '0.2884'}

 29%|██▉       | 10950/37963 [46:54:37<118:59:23, 15.86s/it]
 29%|██▉       | 10951/37963 [46:54:51<115:31:22, 15.40s/it]
 29%|██▉       | 10952/37963 [46:55:06<112:39:26, 15.01s/it]
 29%|██▉       | 10953/37963 [46:55:26<124:57:20, 16.65s/it]
 29%|██▉       | 10954/37963 [46:55:40<119:06:58, 15.88s/it]
 29%|██▉       | 10955/37963 [46:55:54<114:59:05, 15.33s/it]
 29%|██▉       | 10956/37963 [46:56:09<112:48:04, 15.04s/it]
 29%|██▉       | 10957/37963 [46:56:22<109:57:01, 14.66s/it]
 29%|██▉       | 10958/37963 [46:56:37<109:40:13, 14.62s/it]
 29%|██▉       | 10959/37963 [46:56:58<124:52:07, 16.65s/it]
 29%|██▉       | 10960/37963 [46:57:13<119:42:49, 15.96s/it]
                                                            
{'loss': '0.1419', 'grad_norm': '3.781', 'learning_rate': '1.669e-05', 'epoch': '0.2887'}

 29%|██▉       | 10960/37963 [46:57:13<119:42:49, 15.96s/it]
 29%|██▉       | 10961/37963 [46:57:27<116:15:01, 15.50s/it]
 29%|██▉       | 10962/37963 [46:57:41<113:37:47, 15.15s/it]
 29%|██▉       | 10963/37963 [46:57:56<111:55:56, 14.92s/it]
 29%|██▉       | 10964/37963 [46:58:10<110:44:37, 14.77s/it]
 29%|██▉       | 10965/37963 [46:58:31<125:18:58, 16.71s/it]
 29%|██▉       | 10966/37963 [46:58:45<118:47:22, 15.84s/it]
 29%|██▉       | 10967/37963 [46:58:59<115:11:10, 15.36s/it]
 29%|██▉       | 10968/37963 [46:59:14<112:43:00, 15.03s/it]
 29%|██▉       | 10969/37963 [46:59:28<111:27:35, 14.86s/it]
 29%|██▉       | 10970/37963 [46:59:43<110:18:24, 14.71s/it]
                                                            
{'loss': '0.1564', 'grad_norm': '2.224', 'learning_rate': '1.668e-05', 'epoch': '0.289'}

 29%|██▉       | 10970/37963 [46:59:43<110:18:24, 14.71s/it]
 29%|██▉       | 10971/37963 [46:59:56<107:53:45, 14.39s/it]
 29%|██▉       | 10972/37963 [47:00:11<107:53:21, 14.39s/it]
 29%|██▉       | 10973/37963 [47:00:25<107:57:42, 14.40s/it]
 29%|██▉       | 10974/37963 [47:00:39<107:46:22, 14.38s/it]
 29%|██▉       | 10975/37963 [47:00:54<107:42:19, 14.37s/it]
 29%|██▉       | 10976/37963 [47:01:08<107:14:49, 14.31s/it]
 29%|██▉       | 10977/37963 [47:01:29<122:36:28, 16.36s/it]
 29%|██▉       | 10978/37963 [47:01:43<118:02:32, 15.75s/it]
 29%|██▉       | 10979/37963 [47:01:58<114:51:34, 15.32s/it]
 29%|██▉       | 10980/37963 [47:02:12<112:52:28, 15.06s/it]
                                                            
{'loss': '0.1642', 'grad_norm': '1.372', 'learning_rate': '1.668e-05', 'epoch': '0.2892'}

 29%|██▉       | 10980/37963 [47:02:12<112:52:28, 15.06s/it]
 29%|██▉       | 10981/37963 [47:02:27<111:29:58, 14.88s/it]
 29%|██▉       | 10982/37963 [47:02:47<123:24:35, 16.47s/it]
 29%|██▉       | 10983/37963 [47:03:01<118:57:26, 15.87s/it]
 29%|██▉       | 10984/37963 [47:03:15<114:01:27, 15.22s/it]
 29%|██▉       | 10985/37963 [47:03:29<112:26:51, 15.01s/it]
 29%|██▉       | 10986/37963 [47:03:50<124:29:01, 16.61s/it]
 29%|██▉       | 10987/37963 [47:04:04<119:25:01, 15.94s/it]
 29%|██▉       | 10988/37963 [47:04:18<115:54:45, 15.47s/it]
 29%|██▉       | 10989/37963 [47:04:32<112:38:11, 15.03s/it]
 29%|██▉       | 10990/37963 [47:04:47<111:16:46, 14.85s/it]
                                                            
{'loss': '0.1745', 'grad_norm': '2.715', 'learning_rate': '1.667e-05', 'epoch': '0.2895'}

 29%|██▉       | 10990/37963 [47:04:47<111:16:46, 14.85s/it]
 29%|██▉       | 10991/37963 [47:05:01<110:02:23, 14.69s/it]
 29%|██▉       | 10992/37963 [47:05:16<109:17:50, 14.59s/it]
 29%|██▉       | 10993/37963 [47:05:30<108:48:46, 14.52s/it]
 29%|██▉       | 10994/37963 [47:05:44<108:22:55, 14.47s/it]
 29%|██▉       | 10995/37963 [47:06:11<136:56:44, 18.28s/it]
 29%|██▉       | 10996/37963 [47:06:25<126:48:09, 16.93s/it]
 29%|██▉       | 10997/37963 [47:06:39<119:40:41, 15.98s/it]
 29%|██▉       | 10998/37963 [47:06:53<115:42:34, 15.45s/it]
 29%|██▉       | 10999/37963 [47:07:07<113:03:48, 15.10s/it]
 29%|██▉       | 11000/37963 [47:07:28<125:55:58, 16.81s/it]
                                                            
{'loss': '0.1661', 'grad_norm': '2.478', 'learning_rate': '1.667e-05', 'epoch': '0.2898'}

 29%|██▉       | 11000/37963 [47:07:28<125:55:58, 16.81s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.05s/it]
Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.05s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 29%|██▉       | 11001/37963 [47:09:12<320:23:01, 42.78s/it]
 29%|██▉       | 11002/37963 [47:09:26<256:09:31, 34.20s/it]
 29%|██▉       | 11003/37963 [47:09:40<211:45:57, 28.28s/it]
 29%|██▉       | 11004/37963 [47:09:55<180:54:20, 24.16s/it]
 29%|██▉       | 11005/37963 [47:10:09<158:27:04, 21.16s/it]
 29%|██▉       | 11006/37963 [47:10:30<156:59:32, 20.97s/it]
 29%|██▉       | 11007/37963 [47:10:44<142:31:43, 19.03s/it]
 29%|██▉       | 11008/37963 [47:10:58<132:04:32, 17.64s/it]
 29%|██▉       | 11009/37963 [47:11:13<124:05:35, 16.57s/it]
 29%|██▉       | 11010/37963 [47:11:27<118:58:23, 15.89s/it]
                                                            
{'loss': '0.1555', 'grad_norm': '1.309', 'learning_rate': '1.666e-05', 'epoch': '0.29'}

 29%|██▉       | 11010/37963 [47:11:27<118:58:23, 15.89s/it]
 29%|██▉       | 11011/37963 [47:11:41<115:13:28, 15.39s/it]
 29%|██▉       | 11012/37963 [47:12:01<125:54:05, 16.82s/it]
 29%|██▉       | 11013/37963 [47:12:16<120:38:01, 16.11s/it]
 29%|██▉       | 11014/37963 [47:12:30<116:40:41, 15.59s/it]
 29%|██▉       | 11015/37963 [47:12:44<113:51:28, 15.21s/it]
 29%|██▉       | 11016/37963 [47:12:59<112:09:37, 14.98s/it]
 29%|██▉       | 11017/37963 [47:13:13<109:19:51, 14.61s/it]
 29%|██▉       | 11018/37963 [47:13:27<108:48:02, 14.54s/it]
 29%|██▉       | 11019/37963 [47:13:41<108:11:54, 14.46s/it]
 29%|██▉       | 11020/37963 [47:13:56<108:26:24, 14.49s/it]
                                                            
{'loss': '0.1628', 'grad_norm': '2.195', 'learning_rate': '1.665e-05', 'epoch': '0.2903'}

 29%|██▉       | 11020/37963 [47:13:56<108:26:24, 14.49s/it]
 29%|██▉       | 11021/37963 [47:14:10<107:46:53, 14.40s/it]
 29%|██▉       | 11022/37963 [47:14:24<106:10:58, 14.19s/it]
 29%|██▉       | 11023/37963 [47:14:38<106:22:19, 14.21s/it]
 29%|██▉       | 11024/37963 [47:14:59<121:45:23, 16.27s/it]
 29%|██▉       | 11025/37963 [47:15:13<117:31:47, 15.71s/it]
 29%|██▉       | 11026/37963 [47:15:28<114:20:35, 15.28s/it]
 29%|██▉       | 11027/37963 [47:15:42<112:23:50, 15.02s/it]
 29%|██▉       | 11028/37963 [47:16:02<124:25:55, 16.63s/it]
 29%|██▉       | 11029/37963 [47:16:17<119:32:34, 15.98s/it]
 29%|██▉       | 11030/37963 [47:16:31<114:51:03, 15.35s/it]
                                                            
{'loss': '0.1484', 'grad_norm': '0.8884', 'learning_rate': '1.665e-05', 'epoch': '0.2905'}

 29%|██▉       | 11030/37963 [47:16:31<114:51:03, 15.35s/it]
 29%|██▉       | 11031/37963 [47:16:45<112:35:51, 15.05s/it]
 29%|██▉       | 11032/37963 [47:16:59<110:10:53, 14.73s/it]
 29%|██▉       | 11033/37963 [47:17:13<109:19:20, 14.61s/it]
 29%|██▉       | 11034/37963 [47:17:34<122:54:41, 16.43s/it]
 29%|██▉       | 11035/37963 [47:17:48<118:11:38, 15.80s/it]
 29%|██▉       | 11036/37963 [47:18:03<115:08:11, 15.39s/it]
 29%|██▉       | 11037/37963 [47:18:17<112:43:27, 15.07s/it]
 29%|██▉       | 11038/37963 [47:18:32<110:53:18, 14.83s/it]
 29%|██▉       | 11039/37963 [47:18:46<109:52:20, 14.69s/it]
 29%|██▉       | 11040/37963 [47:19:07<123:54:39, 16.57s/it]
                                                            
{'loss': '0.167', 'grad_norm': '3.15', 'learning_rate': '1.664e-05', 'epoch': '0.2908'}

 29%|██▉       | 11040/37963 [47:19:07<123:54:39, 16.57s/it]
 29%|██▉       | 11041/37963 [47:19:21<118:30:31, 15.85s/it]
 29%|██▉       | 11042/37963 [47:19:43<131:26:39, 17.58s/it]
 29%|██▉       | 11043/37963 [47:19:57<124:14:52, 16.62s/it]
 29%|██▉       | 11044/37963 [47:20:11<119:21:05, 15.96s/it]
 29%|██▉       | 11045/37963 [47:20:25<115:05:20, 15.39s/it]
 29%|██▉       | 11046/37963 [47:20:39<110:34:18, 14.79s/it]
 29%|██▉       | 11047/37963 [47:20:53<109:35:59, 14.66s/it]
 29%|██▉       | 11048/37963 [47:21:14<123:24:03, 16.51s/it]
 29%|██▉       | 11049/37963 [47:21:28<118:11:29, 15.81s/it]
 29%|██▉       | 11050/37963 [47:21:42<113:51:17, 15.23s/it]
                                                            
{'loss': '0.1568', 'grad_norm': '4.108', 'learning_rate': '1.663e-05', 'epoch': '0.2911'}

 29%|██▉       | 11050/37963 [47:21:42<113:51:17, 15.23s/it]
 29%|██▉       | 11051/37963 [47:21:56<110:33:07, 14.79s/it]
 29%|██▉       | 11052/37963 [47:22:10<109:46:46, 14.69s/it]
 29%|██▉       | 11053/37963 [47:22:25<108:53:46, 14.57s/it]
 29%|██▉       | 11054/37963 [47:22:39<108:29:57, 14.52s/it]
 29%|██▉       | 11055/37963 [47:23:00<123:18:24, 16.50s/it]
 29%|██▉       | 11056/37963 [47:23:15<118:39:59, 15.88s/it]
 29%|██▉       | 11057/37963 [47:23:29<115:21:39, 15.44s/it]
 29%|██▉       | 11058/37963 [47:23:43<113:06:36, 15.13s/it]
 29%|██▉       | 11059/37963 [47:24:04<125:48:41, 16.83s/it]
 29%|██▉       | 11060/37963 [47:24:19<120:26:03, 16.12s/it]
                                                            
{'loss': '0.1639', 'grad_norm': '3.473', 'learning_rate': '1.663e-05', 'epoch': '0.2913'}

 29%|██▉       | 11060/37963 [47:24:19<120:26:03, 16.12s/it]
 29%|██▉       | 11061/37963 [47:24:33<116:27:41, 15.58s/it]
 29%|██▉       | 11062/37963 [47:24:47<113:38:08, 15.21s/it]
 29%|██▉       | 11063/37963 [47:25:02<111:39:24, 14.94s/it]
 29%|██▉       | 11064/37963 [47:25:16<110:00:03, 14.72s/it]
 29%|██▉       | 11065/37963 [47:25:30<108:05:33, 14.47s/it]
 29%|██▉       | 11066/37963 [47:25:44<107:44:44, 14.42s/it]
 29%|██▉       | 11067/37963 [47:25:58<107:46:00, 14.42s/it]
 29%|██▉       | 11068/37963 [47:26:13<107:34:42, 14.40s/it]
 29%|██▉       | 11069/37963 [47:26:27<107:54:48, 14.45s/it]
 29%|██▉       | 11070/37963 [47:26:42<107:57:50, 14.45s/it]
                                                            
{'loss': '0.1686', 'grad_norm': '1.719', 'learning_rate': '1.662e-05', 'epoch': '0.2916'}

 29%|██▉       | 11070/37963 [47:26:42<107:57:50, 14.45s/it]
 29%|██▉       | 11071/37963 [47:26:56<106:48:16, 14.30s/it]
 29%|██▉       | 11072/37963 [47:27:10<107:14:31, 14.36s/it]
 29%|██▉       | 11073/37963 [47:27:25<107:09:39, 14.35s/it]
 29%|██▉       | 11074/37963 [47:27:39<107:06:24, 14.34s/it]
 29%|██▉       | 11075/37963 [47:28:00<122:05:09, 16.35s/it]
 29%|██▉       | 11076/37963 [47:28:20<129:50:29, 17.38s/it]
 29%|██▉       | 11077/37963 [47:28:34<123:09:43, 16.49s/it]
 29%|██▉       | 11078/37963 [47:28:49<118:33:49, 15.88s/it]
 29%|██▉       | 11079/37963 [47:29:03<114:18:35, 15.31s/it]
 29%|██▉       | 11080/37963 [47:29:17<111:52:03, 14.98s/it]
                                                            
{'loss': '0.1677', 'grad_norm': '2.933', 'learning_rate': '1.661e-05', 'epoch': '0.2919'}

 29%|██▉       | 11080/37963 [47:29:17<111:52:03, 14.98s/it]
 29%|██▉       | 11081/37963 [47:29:31<109:47:39, 14.70s/it]
 29%|██▉       | 11082/37963 [47:29:45<108:56:35, 14.59s/it]
 29%|██▉       | 11083/37963 [47:30:06<122:38:36, 16.43s/it]
 29%|██▉       | 11084/37963 [47:30:20<117:11:11, 15.70s/it]
 29%|██▉       | 11085/37963 [47:30:33<112:28:07, 15.06s/it]
 29%|██▉       | 11086/37963 [47:30:47<109:39:39, 14.69s/it]
 29%|██▉       | 11087/37963 [47:31:01<108:34:03, 14.54s/it]
 29%|██▉       | 11088/37963 [47:31:16<108:02:28, 14.47s/it]
 29%|██▉       | 11089/37963 [47:31:37<122:40:35, 16.43s/it]
 29%|██▉       | 11090/37963 [47:31:59<134:39:51, 18.04s/it]
                                                            
{'loss': '0.1562', 'grad_norm': '4.066', 'learning_rate': '1.661e-05', 'epoch': '0.2921'}

 29%|██▉       | 11090/37963 [47:31:59<134:39:51, 18.04s/it]
 29%|██▉       | 11091/37963 [47:32:13<126:18:10, 16.92s/it]
 29%|██▉       | 11092/37963 [47:32:27<120:42:14, 16.17s/it]
 29%|██▉       | 11093/37963 [47:32:42<116:55:21, 15.67s/it]
 29%|██▉       | 11094/37963 [47:32:56<113:53:15, 15.26s/it]
 29%|██▉       | 11095/37963 [47:33:10<111:44:56, 14.97s/it]
 29%|██▉       | 11096/37963 [47:33:25<110:02:47, 14.75s/it]
 29%|██▉       | 11097/37963 [47:33:45<123:17:11, 16.52s/it]
 29%|██▉       | 11098/37963 [47:33:59<118:07:03, 15.83s/it]
 29%|██▉       | 11099/37963 [47:34:14<115:23:20, 15.46s/it]
 29%|██▉       | 11100/37963 [47:34:28<112:51:00, 15.12s/it]
                                                            
{'loss': '0.1546', 'grad_norm': '2.209', 'learning_rate': '1.66e-05', 'epoch': '0.2924'}

 29%|██▉       | 11100/37963 [47:34:28<112:51:00, 15.12s/it]
 29%|██▉       | 11101/37963 [47:34:43<111:25:32, 14.93s/it]
 29%|██▉       | 11102/37963 [47:34:57<110:04:00, 14.75s/it]
 29%|██▉       | 11103/37963 [47:35:12<109:08:16, 14.63s/it]
 29%|██▉       | 11104/37963 [47:35:33<123:16:22, 16.52s/it]
 29%|██▉       | 11105/37963 [47:35:47<118:05:17, 15.83s/it]
 29%|██▉       | 11106/37963 [47:36:01<114:17:59, 15.32s/it]
 29%|██▉       | 11107/37963 [47:36:15<112:15:29, 15.05s/it]
 29%|██▉       | 11108/37963 [47:36:30<110:42:57, 14.84s/it]
 29%|██▉       | 11109/37963 [47:36:50<122:58:53, 16.49s/it]
 29%|██▉       | 11110/37963 [47:37:04<118:06:25, 15.83s/it]
                                                            
{'loss': '0.1617', 'grad_norm': '1.388', 'learning_rate': '1.66e-05', 'epoch': '0.2927'}

 29%|██▉       | 11110/37963 [47:37:04<118:06:25, 15.83s/it]
 29%|██▉       | 11111/37963 [47:37:19<114:43:41, 15.38s/it]
 29%|██▉       | 11112/37963 [47:37:33<111:52:56, 15.00s/it]
 29%|██▉       | 11113/37963 [47:37:46<109:03:52, 14.62s/it]
 29%|██▉       | 11114/37963 [47:38:01<108:33:41, 14.56s/it]
 29%|██▉       | 11115/37963 [47:38:14<106:18:19, 14.25s/it]
 29%|██▉       | 11116/37963 [47:38:29<106:29:16, 14.28s/it]
 29%|██▉       | 11117/37963 [47:38:43<106:32:23, 14.29s/it]
 29%|██▉       | 11118/37963 [47:38:57<106:43:49, 14.31s/it]
 29%|██▉       | 11119/37963 [47:39:12<106:36:30, 14.30s/it]
 29%|██▉       | 11120/37963 [47:39:26<106:48:49, 14.33s/it]
                                                            
{'loss': '0.1687', 'grad_norm': '1.614', 'learning_rate': '1.659e-05', 'epoch': '0.2929'}

 29%|██▉       | 11120/37963 [47:39:26<106:48:49, 14.33s/it]
 29%|██▉       | 11121/37963 [47:39:40<105:22:10, 14.13s/it]
 29%|██▉       | 11122/37963 [47:39:54<105:53:59, 14.20s/it]
 29%|██▉       | 11123/37963 [47:40:08<104:48:45, 14.06s/it]
 29%|██▉       | 11124/37963 [47:40:35<134:08:33, 17.99s/it]
 29%|██▉       | 11125/37963 [47:40:49<126:05:51, 16.91s/it]
 29%|██▉       | 11126/37963 [47:41:04<120:17:47, 16.14s/it]
 29%|██▉       | 11127/37963 [47:41:18<116:21:37, 15.61s/it]
 29%|██▉       | 11128/37963 [47:41:33<113:39:38, 15.25s/it]
 29%|██▉       | 11129/37963 [47:41:47<111:31:06, 14.96s/it]
 29%|██▉       | 11130/37963 [47:42:01<110:18:14, 14.80s/it]
                                                            
{'loss': '0.1569', 'grad_norm': '3.59', 'learning_rate': '1.658e-05', 'epoch': '0.2932'}

 29%|██▉       | 11130/37963 [47:42:01<110:18:14, 14.80s/it]
 29%|██▉       | 11131/37963 [47:42:15<108:26:14, 14.55s/it]
 29%|██▉       | 11132/37963 [47:42:36<122:58:09, 16.50s/it]
 29%|██▉       | 11133/37963 [47:42:51<118:10:36, 15.86s/it]
 29%|██▉       | 11134/37963 [47:43:04<112:36:27, 15.11s/it]
 29%|██▉       | 11135/37963 [47:43:18<110:56:42, 14.89s/it]
 29%|██▉       | 11136/37963 [47:43:33<109:40:22, 14.72s/it]
 29%|██▉       | 11137/37963 [47:43:47<108:46:46, 14.60s/it]
 29%|██▉       | 11138/37963 [47:44:07<121:51:35, 16.35s/it]
 29%|██▉       | 11139/37963 [47:44:22<117:23:28, 15.75s/it]
 29%|██▉       | 11140/37963 [47:44:43<129:09:15, 17.33s/it]
                                                            
{'loss': '0.1664', 'grad_norm': '1.769', 'learning_rate': '1.658e-05', 'epoch': '0.2934'}

 29%|██▉       | 11140/37963 [47:44:43<129:09:15, 17.33s/it]
 29%|██▉       | 11141/37963 [47:44:57<122:33:15, 16.45s/it]
 29%|██▉       | 11142/37963 [47:45:12<117:48:49, 15.81s/it]
 29%|██▉       | 11143/37963 [47:45:26<114:36:13, 15.38s/it]
 29%|██▉       | 11144/37963 [47:45:40<112:02:29, 15.04s/it]
 29%|██▉       | 11145/37963 [47:45:54<109:59:37, 14.77s/it]
 29%|██▉       | 11146/37963 [47:46:08<108:22:52, 14.55s/it]
 29%|██▉       | 11147/37963 [47:46:29<121:56:57, 16.37s/it]
 29%|██▉       | 11148/37963 [47:46:43<117:33:07, 15.78s/it]
 29%|██▉       | 11149/37963 [47:46:58<114:19:21, 15.35s/it]
 29%|██▉       | 11150/37963 [47:47:12<112:06:31, 15.05s/it]
                                                            
{'loss': '0.159', 'grad_norm': '2.976', 'learning_rate': '1.657e-05', 'epoch': '0.2937'}

 29%|██▉       | 11150/37963 [47:47:12<112:06:31, 15.05s/it]
 29%|██▉       | 11151/37963 [47:47:26<110:40:16, 14.86s/it]
 29%|██▉       | 11152/37963 [47:47:41<109:37:09, 14.72s/it]
 29%|██▉       | 11153/37963 [47:48:02<124:30:58, 16.72s/it]
 29%|██▉       | 11154/37963 [47:48:17<119:14:23, 16.01s/it]
 29%|██▉       | 11155/37963 [47:48:31<114:48:42, 15.42s/it]
 29%|██▉       | 11156/37963 [47:48:45<112:19:37, 15.08s/it]
 29%|██▉       | 11157/37963 [47:49:06<125:13:12, 16.82s/it]
 29%|██▉       | 11158/37963 [47:49:20<119:04:58, 15.99s/it]
 29%|██▉       | 11159/37963 [47:49:34<115:13:27, 15.48s/it]
 29%|██▉       | 11160/37963 [47:49:49<112:50:32, 15.16s/it]
                                                            
{'loss': '0.1609', 'grad_norm': '1.712', 'learning_rate': '1.656e-05', 'epoch': '0.294'}

 29%|██▉       | 11160/37963 [47:49:49<112:50:32, 15.16s/it]
 29%|██▉       | 11161/37963 [47:50:03<111:04:18, 14.92s/it]
 29%|██▉       | 11162/37963 [47:50:16<108:05:47, 14.52s/it]
 29%|██▉       | 11163/37963 [47:50:31<107:49:18, 14.48s/it]
 29%|██▉       | 11164/37963 [47:50:45<107:44:27, 14.47s/it]
 29%|██▉       | 11165/37963 [47:50:59<106:02:33, 14.25s/it]
 29%|██▉       | 11166/37963 [47:51:13<105:55:31, 14.23s/it]
 29%|██▉       | 11167/37963 [47:51:28<106:08:13, 14.26s/it]
 29%|██▉       | 11168/37963 [47:51:42<106:19:34, 14.29s/it]
 29%|██▉       | 11169/37963 [47:51:56<106:25:29, 14.30s/it]
 29%|██▉       | 11170/37963 [47:52:11<106:30:19, 14.31s/it]
                                                            
{'loss': '0.1531', 'grad_norm': '2.497', 'learning_rate': '1.656e-05', 'epoch': '0.2942'}

 29%|██▉       | 11170/37963 [47:52:11<106:30:19, 14.31s/it]
 29%|██▉       | 11171/37963 [47:52:31<120:00:54, 16.13s/it]
 29%|██▉       | 11172/37963 [47:52:45<115:40:12, 15.54s/it]
 29%|██▉       | 11173/37963 [47:52:59<113:00:39, 15.19s/it]
 29%|██▉       | 11174/37963 [47:53:14<111:09:56, 14.94s/it]
 29%|██▉       | 11175/37963 [47:53:35<124:34:16, 16.74s/it]
 29%|██▉       | 11176/37963 [47:53:49<119:24:44, 16.05s/it]
 29%|██▉       | 11177/37963 [47:54:03<114:20:26, 15.37s/it]
 29%|██▉       | 11178/37963 [47:54:17<112:00:28, 15.05s/it]
 29%|██▉       | 11179/37963 [47:54:32<110:37:14, 14.87s/it]
 29%|██▉       | 11180/37963 [47:54:46<109:23:37, 14.70s/it]
                                                            
{'loss': '0.165', 'grad_norm': '3.903', 'learning_rate': '1.655e-05', 'epoch': '0.2945'}

 29%|██▉       | 11180/37963 [47:54:46<109:23:37, 14.70s/it]
 29%|██▉       | 11181/37963 [47:55:00<108:43:32, 14.61s/it]
 29%|██▉       | 11182/37963 [47:55:21<121:23:39, 16.32s/it]
 29%|██▉       | 11183/37963 [47:55:35<117:19:31, 15.77s/it]
 29%|██▉       | 11184/37963 [47:55:50<114:11:25, 15.35s/it]
 29%|██▉       | 11185/37963 [47:56:04<112:05:29, 15.07s/it]
 29%|██▉       | 11186/37963 [47:56:18<110:03:57, 14.80s/it]
 29%|██▉       | 11187/37963 [47:56:38<121:35:44, 16.35s/it]
 29%|██▉       | 11188/37963 [47:56:59<131:49:43, 17.72s/it]
 29%|██▉       | 11189/37963 [47:57:14<124:24:54, 16.73s/it]
 29%|██▉       | 11190/37963 [47:57:28<119:16:53, 16.04s/it]
                                                            
{'loss': '0.1579', 'grad_norm': '3.199', 'learning_rate': '1.654e-05', 'epoch': '0.2948'}

 29%|██▉       | 11190/37963 [47:57:28<119:16:53, 16.04s/it]
 29%|██▉       | 11191/37963 [47:57:42<114:51:16, 15.44s/it]
 29%|██▉       | 11192/37963 [47:57:56<112:22:27, 15.11s/it]
 29%|██▉       | 11193/37963 [47:58:10<109:59:39, 14.79s/it]
 29%|██▉       | 11194/37963 [47:58:25<108:51:18, 14.64s/it]
 29%|██▉       | 11195/37963 [47:58:39<108:07:50, 14.54s/it]
 29%|██▉       | 11196/37963 [47:58:59<121:12:10, 16.30s/it]
 29%|██▉       | 11197/37963 [47:59:14<116:46:26, 15.71s/it]
 29%|██▉       | 11198/37963 [47:59:27<111:51:35, 15.05s/it]
 29%|██▉       | 11199/37963 [47:59:41<109:12:47, 14.69s/it]
 30%|██▉       | 11200/37963 [48:00:02<123:30:18, 16.61s/it]
                                                            
{'loss': '0.1555', 'grad_norm': '1.483', 'learning_rate': '1.654e-05', 'epoch': '0.295'}

 30%|██▉       | 11200/37963 [48:00:02<123:30:18, 16.61s/it]
 30%|██▉       | 11201/37963 [48:00:17<118:36:08, 15.95s/it]
 30%|██▉       | 11202/37963 [48:00:31<114:54:21, 15.46s/it]
 30%|██▉       | 11203/37963 [48:00:45<112:10:29, 15.09s/it]
 30%|██▉       | 11204/37963 [48:00:59<110:26:50, 14.86s/it]
 30%|██▉       | 11205/37963 [48:01:14<109:50:55, 14.78s/it]
 30%|██▉       | 11206/37963 [48:01:28<108:49:23, 14.64s/it]
 30%|██▉       | 11207/37963 [48:01:49<122:35:36, 16.49s/it]
 30%|██▉       | 11208/37963 [48:02:04<117:58:04, 15.87s/it]
 30%|██▉       | 11209/37963 [48:02:18<114:38:00, 15.42s/it]
 30%|██▉       | 11210/37963 [48:02:32<112:05:40, 15.08s/it]
                                                            
{'loss': '0.166', 'grad_norm': '1.478', 'learning_rate': '1.653e-05', 'epoch': '0.2953'}

 30%|██▉       | 11210/37963 [48:02:32<112:05:40, 15.08s/it]
 30%|██▉       | 11211/37963 [48:02:46<108:46:06, 14.64s/it]
 30%|██▉       | 11212/37963 [48:03:00<108:37:06, 14.62s/it]
 30%|██▉       | 11213/37963 [48:03:14<106:41:28, 14.36s/it]
 30%|██▉       | 11214/37963 [48:03:29<106:46:40, 14.37s/it]
 30%|██▉       | 11215/37963 [48:03:43<106:01:17, 14.27s/it]
 30%|██▉       | 11216/37963 [48:03:57<106:08:37, 14.29s/it]
 30%|██▉       | 11217/37963 [48:04:11<105:43:23, 14.23s/it]
 30%|██▉       | 11218/37963 [48:04:25<106:01:44, 14.27s/it]
 30%|██▉       | 11219/37963 [48:04:39<104:58:48, 14.13s/it]
 30%|██▉       | 11220/37963 [48:04:54<105:34:19, 14.21s/it]
                                                            
{'loss': '0.1675', 'grad_norm': '5.345', 'learning_rate': '1.652e-05', 'epoch': '0.2956'}

 30%|██▉       | 11220/37963 [48:04:54<105:34:19, 14.21s/it]
 30%|██▉       | 11221/37963 [48:05:14<120:19:36, 16.20s/it]
 30%|██▉       | 11222/37963 [48:05:29<116:21:49, 15.67s/it]
 30%|██▉       | 11223/37963 [48:05:43<113:31:01, 15.28s/it]
 30%|██▉       | 11224/37963 [48:06:04<125:37:00, 16.91s/it]
 30%|██▉       | 11225/37963 [48:06:18<119:58:50, 16.15s/it]
 30%|██▉       | 11226/37963 [48:06:33<116:02:05, 15.62s/it]
 30%|██▉       | 11227/37963 [48:06:47<113:16:28, 15.25s/it]
 30%|██▉       | 11228/37963 [48:07:02<111:19:47, 14.99s/it]
 30%|██▉       | 11229/37963 [48:07:16<109:50:29, 14.79s/it]
 30%|██▉       | 11230/37963 [48:07:37<123:32:43, 16.64s/it]
                                                            
{'loss': '0.1654', 'grad_norm': '6.206', 'learning_rate': '1.652e-05', 'epoch': '0.2958'}

 30%|██▉       | 11230/37963 [48:07:37<123:32:43, 16.64s/it]
 30%|██▉       | 11231/37963 [48:07:51<118:08:15, 15.91s/it]
 30%|██▉       | 11232/37963 [48:08:05<114:40:45, 15.44s/it]
 30%|██▉       | 11233/37963 [48:08:20<112:25:21, 15.14s/it]
 30%|██▉       | 11234/37963 [48:08:34<109:47:22, 14.79s/it]
 30%|██▉       | 11235/37963 [48:08:55<123:40:25, 16.66s/it]
 30%|██▉       | 11236/37963 [48:09:09<118:24:52, 15.95s/it]
 30%|██▉       | 11237/37963 [48:09:30<130:09:03, 17.53s/it]
 30%|██▉       | 11238/37963 [48:09:45<123:01:32, 16.57s/it]
 30%|██▉       | 11239/37963 [48:09:59<118:02:58, 15.90s/it]
 30%|██▉       | 11240/37963 [48:10:13<114:44:07, 15.46s/it]
                                                            
{'loss': '0.1716', 'grad_norm': '3.13', 'learning_rate': '1.651e-05', 'epoch': '0.2961'}

 30%|██▉       | 11240/37963 [48:10:13<114:44:07, 15.46s/it]
 30%|██▉       | 11241/37963 [48:10:28<112:18:02, 15.13s/it]
 30%|██▉       | 11242/37963 [48:10:42<110:39:29, 14.91s/it]
 30%|██▉       | 11243/37963 [48:10:56<109:24:12, 14.74s/it]
 30%|██▉       | 11244/37963 [48:11:11<108:41:54, 14.65s/it]
 30%|██▉       | 11245/37963 [48:11:25<108:03:41, 14.56s/it]
 30%|██▉       | 11246/37963 [48:11:46<120:55:31, 16.29s/it]
 30%|██▉       | 11247/37963 [48:12:00<116:31:44, 15.70s/it]
 30%|██▉       | 11248/37963 [48:12:21<128:43:30, 17.35s/it]
 30%|██▉       | 11249/37963 [48:12:35<120:27:11, 16.23s/it]
 30%|██▉       | 11250/37963 [48:12:49<116:20:22, 15.68s/it]
                                                            
{'loss': '0.1645', 'grad_norm': '4.135', 'learning_rate': '1.651e-05', 'epoch': '0.2963'}

 30%|██▉       | 11250/37963 [48:12:49<116:20:22, 15.68s/it]
 30%|██▉       | 11251/37963 [48:13:04<113:36:47, 15.31s/it]
 30%|██▉       | 11252/37963 [48:13:18<111:40:49, 15.05s/it]
 30%|██▉       | 11253/37963 [48:13:32<109:56:19, 14.82s/it]
 30%|██▉       | 11254/37963 [48:13:47<108:56:36, 14.68s/it]
 30%|██▉       | 11255/37963 [48:14:07<122:03:25, 16.45s/it]
 30%|██▉       | 11256/37963 [48:14:22<117:16:42, 15.81s/it]
 30%|██▉       | 11257/37963 [48:14:36<114:27:59, 15.43s/it]
 30%|██▉       | 11258/37963 [48:14:50<111:43:49, 15.06s/it]
 30%|██▉       | 11259/37963 [48:15:05<110:03:16, 14.84s/it]
 30%|██▉       | 11260/37963 [48:15:19<108:50:41, 14.67s/it]
                                                            
{'loss': '0.1626', 'grad_norm': '3.502', 'learning_rate': '1.65e-05', 'epoch': '0.2966'}

 30%|██▉       | 11260/37963 [48:15:19<108:50:41, 14.67s/it]
 30%|██▉       | 11261/37963 [48:15:33<108:06:30, 14.58s/it]
 30%|██▉       | 11262/37963 [48:15:48<107:34:33, 14.50s/it]
 30%|██▉       | 11263/37963 [48:16:02<107:15:17, 14.46s/it]
 30%|██▉       | 11264/37963 [48:16:16<107:15:50, 14.46s/it]
 30%|██▉       | 11265/37963 [48:16:31<107:02:51, 14.43s/it]
 30%|██▉       | 11266/37963 [48:16:45<107:00:57, 14.43s/it]
 30%|██▉       | 11267/37963 [48:16:59<105:43:25, 14.26s/it]
 30%|██▉       | 11268/37963 [48:17:13<105:52:06, 14.28s/it]
 30%|██▉       | 11269/37963 [48:17:28<105:59:25, 14.29s/it]
 30%|██▉       | 11270/37963 [48:17:42<105:32:00, 14.23s/it]
                                                            
{'loss': '0.1603', 'grad_norm': '4.424', 'learning_rate': '1.649e-05', 'epoch': '0.2969'}

 30%|██▉       | 11270/37963 [48:17:42<105:32:00, 14.23s/it]
 30%|██▉       | 11271/37963 [48:18:02<117:58:56, 15.91s/it]
 30%|██▉       | 11272/37963 [48:18:16<114:25:55, 15.43s/it]
 30%|██▉       | 11273/37963 [48:18:37<127:55:56, 17.26s/it]
 30%|██▉       | 11274/37963 [48:18:52<121:23:13, 16.37s/it]
 30%|██▉       | 11275/37963 [48:19:05<115:12:58, 15.54s/it]
 30%|██▉       | 11276/37963 [48:19:20<112:38:53, 15.20s/it]
 30%|██▉       | 11277/37963 [48:19:34<110:42:16, 14.93s/it]
 30%|██▉       | 11278/37963 [48:19:55<124:32:44, 16.80s/it]
 30%|██▉       | 11279/37963 [48:20:10<118:59:48, 16.05s/it]
 30%|██▉       | 11280/37963 [48:20:24<115:03:03, 15.52s/it]
                                                            
{'loss': '0.1624', 'grad_norm': '1.836', 'learning_rate': '1.649e-05', 'epoch': '0.2971'}

 30%|██▉       | 11280/37963 [48:20:24<115:03:03, 15.52s/it]
 30%|██▉       | 11281/37963 [48:20:38<112:23:59, 15.17s/it]
 30%|██▉       | 11282/37963 [48:20:52<110:10:23, 14.87s/it]
 30%|██▉       | 11283/37963 [48:21:07<109:26:21, 14.77s/it]
 30%|██▉       | 11284/37963 [48:21:28<124:11:19, 16.76s/it]
 30%|██▉       | 11285/37963 [48:21:49<132:41:08, 17.90s/it]
 30%|██▉       | 11286/37963 [48:22:03<124:42:17, 16.83s/it]
 30%|██▉       | 11287/37963 [48:22:18<119:26:12, 16.12s/it]
 30%|██▉       | 11288/37963 [48:22:32<115:24:43, 15.58s/it]
 30%|██▉       | 11289/37963 [48:22:46<112:45:56, 15.22s/it]
 30%|██▉       | 11290/37963 [48:23:01<110:50:26, 14.96s/it]
                                                            
{'loss': '0.1694', 'grad_norm': '0.7924', 'learning_rate': '1.648e-05', 'epoch': '0.2974'}

 30%|██▉       | 11290/37963 [48:23:01<110:50:26, 14.96s/it]
 30%|██▉       | 11291/37963 [48:23:15<109:22:52, 14.76s/it]
 30%|██▉       | 11292/37963 [48:23:29<107:31:40, 14.51s/it]
 30%|██▉       | 11293/37963 [48:23:43<105:42:14, 14.27s/it]
 30%|██▉       | 11294/37963 [48:23:57<105:21:34, 14.22s/it]
 30%|██▉       | 11295/37963 [48:24:17<119:43:28, 16.16s/it]
 30%|██▉       | 11296/37963 [48:24:32<115:56:22, 15.65s/it]
 30%|██▉       | 11297/37963 [48:24:46<112:42:19, 15.22s/it]
 30%|██▉       | 11298/37963 [48:25:08<127:30:48, 17.22s/it]
 30%|██▉       | 11299/37963 [48:25:23<121:30:21, 16.40s/it]
 30%|██▉       | 11300/37963 [48:25:37<116:43:35, 15.76s/it]
                                                            
{'loss': '0.1484', 'grad_norm': '2.009', 'learning_rate': '1.647e-05', 'epoch': '0.2977'}

 30%|██▉       | 11300/37963 [48:25:37<116:43:35, 15.76s/it]
 30%|██▉       | 11301/37963 [48:25:58<128:01:26, 17.29s/it]
 30%|██▉       | 11302/37963 [48:26:12<121:28:15, 16.40s/it]
 30%|██▉       | 11303/37963 [48:26:26<115:59:59, 15.66s/it]
 30%|██▉       | 11304/37963 [48:26:40<112:18:07, 15.17s/it]
 30%|██▉       | 11305/37963 [48:26:54<110:30:57, 14.92s/it]
 30%|██▉       | 11306/37963 [48:27:08<108:29:02, 14.65s/it]
 30%|██▉       | 11307/37963 [48:27:22<107:28:20, 14.51s/it]
 30%|██▉       | 11308/37963 [48:27:37<107:09:58, 14.47s/it]
 30%|██▉       | 11309/37963 [48:27:51<106:45:49, 14.42s/it]
 30%|██▉       | 11310/37963 [48:28:05<106:34:36, 14.40s/it]
                                                            
{'loss': '0.1663', 'grad_norm': '4.723', 'learning_rate': '1.647e-05', 'epoch': '0.2979'}

 30%|██▉       | 11310/37963 [48:28:05<106:34:36, 14.40s/it]
 30%|██▉       | 11311/37963 [48:28:19<105:14:13, 14.21s/it]
 30%|██▉       | 11312/37963 [48:28:34<105:37:30, 14.27s/it]
 30%|██▉       | 11313/37963 [48:28:48<105:59:18, 14.32s/it]
 30%|██▉       | 11314/37963 [48:29:03<106:13:14, 14.35s/it]
 30%|██▉       | 11315/37963 [48:29:17<106:12:12, 14.35s/it]
 30%|██▉       | 11316/37963 [48:29:31<106:04:02, 14.33s/it]
 30%|██▉       | 11317/37963 [48:29:45<106:02:23, 14.33s/it]
 30%|██▉       | 11318/37963 [48:30:06<119:53:30, 16.20s/it]
 30%|██▉       | 11319/37963 [48:30:20<115:05:38, 15.55s/it]
 30%|██▉       | 11320/37963 [48:30:34<111:51:03, 15.11s/it]
                                                            
{'loss': '0.1672', 'grad_norm': '2.408', 'learning_rate': '1.646e-05', 'epoch': '0.2982'}

 30%|██▉       | 11320/37963 [48:30:34<111:51:03, 15.11s/it]
 30%|██▉       | 11321/37963 [48:30:48<109:33:44, 14.80s/it]
 30%|██▉       | 11322/37963 [48:31:09<122:42:10, 16.58s/it]
 30%|██▉       | 11323/37963 [48:31:23<118:03:30, 15.95s/it]
 30%|██▉       | 11324/37963 [48:31:44<129:13:55, 17.46s/it]
 30%|██▉       | 11325/37963 [48:31:59<122:21:53, 16.54s/it]
 30%|██▉       | 11326/37963 [48:32:13<117:47:19, 15.92s/it]
 30%|██▉       | 11327/37963 [48:32:28<114:16:04, 15.44s/it]
 30%|██▉       | 11328/37963 [48:32:42<111:20:42, 15.05s/it]
 30%|██▉       | 11329/37963 [48:32:56<109:43:08, 14.83s/it]
 30%|██▉       | 11330/37963 [48:33:10<108:32:56, 14.67s/it]
                                                            
{'loss': '0.158', 'grad_norm': '3.188', 'learning_rate': '1.645e-05', 'epoch': '0.2984'}

 30%|██▉       | 11330/37963 [48:33:10<108:32:56, 14.67s/it]
 30%|██▉       | 11331/37963 [48:33:25<107:53:08, 14.58s/it]
 30%|██▉       | 11332/37963 [48:33:46<122:00:18, 16.49s/it]
 30%|██▉       | 11333/37963 [48:34:00<117:18:19, 15.86s/it]
 30%|██▉       | 11334/37963 [48:34:21<128:28:02, 17.37s/it]
 30%|██▉       | 11335/37963 [48:34:35<121:58:22, 16.49s/it]
 30%|██▉       | 11336/37963 [48:34:50<117:11:17, 15.84s/it]
 30%|██▉       | 11337/37963 [48:35:04<113:28:51, 15.34s/it]
 30%|██▉       | 11338/37963 [48:35:18<110:42:09, 14.97s/it]
 30%|██▉       | 11339/37963 [48:35:32<108:55:24, 14.73s/it]
 30%|██▉       | 11340/37963 [48:35:47<108:15:17, 14.64s/it]
                                                            
{'loss': '0.1631', 'grad_norm': '1.435', 'learning_rate': '1.645e-05', 'epoch': '0.2987'}

 30%|██▉       | 11340/37963 [48:35:47<108:15:17, 14.64s/it]
 30%|██▉       | 11341/37963 [48:36:01<107:40:21, 14.56s/it]
 30%|██▉       | 11342/37963 [48:36:15<107:16:06, 14.51s/it]
 30%|██▉       | 11343/37963 [48:36:36<119:46:40, 16.20s/it]
 30%|██▉       | 11344/37963 [48:36:49<114:32:34, 15.49s/it]
 30%|██▉       | 11345/37963 [48:37:04<112:11:44, 15.17s/it]
 30%|██▉       | 11346/37963 [48:37:25<124:36:09, 16.85s/it]
 30%|██▉       | 11347/37963 [48:37:38<117:51:34, 15.94s/it]
 30%|██▉       | 11348/37963 [48:37:53<114:35:13, 15.50s/it]
 30%|██▉       | 11349/37963 [48:38:07<112:04:38, 15.16s/it]
 30%|██▉       | 11350/37963 [48:38:28<123:55:57, 16.76s/it]
                                                            
{'loss': '0.1617', 'grad_norm': '3.288', 'learning_rate': '1.644e-05', 'epoch': '0.299'}

 30%|██▉       | 11350/37963 [48:38:28<123:55:57, 16.76s/it]
 30%|██▉       | 11351/37963 [48:38:42<118:36:46, 16.05s/it]
 30%|██▉       | 11352/37963 [48:38:56<114:45:40, 15.53s/it]
 30%|██▉       | 11353/37963 [48:39:11<111:53:10, 15.14s/it]
 30%|██▉       | 11354/37963 [48:39:24<108:49:04, 14.72s/it]
 30%|██▉       | 11355/37963 [48:39:39<107:42:26, 14.57s/it]
 30%|██▉       | 11356/37963 [48:39:53<107:12:09, 14.50s/it]
 30%|██▉       | 11357/37963 [48:40:07<106:57:29, 14.47s/it]
 30%|██▉       | 11358/37963 [48:40:22<106:46:49, 14.45s/it]
 30%|██▉       | 11359/37963 [48:40:36<106:38:27, 14.43s/it]
 30%|██▉       | 11360/37963 [48:40:51<106:42:11, 14.44s/it]
                                                            
{'loss': '0.1726', 'grad_norm': '1.222', 'learning_rate': '1.643e-05', 'epoch': '0.2992'}

 30%|██▉       | 11360/37963 [48:40:51<106:42:11, 14.44s/it]
 30%|██▉       | 11361/37963 [48:41:05<106:35:36, 14.43s/it]
 30%|██▉       | 11362/37963 [48:41:19<106:19:41, 14.39s/it]
 30%|██▉       | 11363/37963 [48:41:34<106:40:40, 14.44s/it]
 30%|██▉       | 11364/37963 [48:41:48<106:24:36, 14.40s/it]
 30%|██▉       | 11365/37963 [48:42:02<106:11:50, 14.37s/it]
 30%|██▉       | 11366/37963 [48:42:23<120:13:58, 16.27s/it]
 30%|██▉       | 11367/37963 [48:42:38<116:10:05, 15.72s/it]
 30%|██▉       | 11368/37963 [48:42:52<112:46:08, 15.26s/it]
 30%|██▉       | 11369/37963 [48:43:06<110:52:45, 15.01s/it]
 30%|██▉       | 11370/37963 [48:43:20<107:55:55, 14.61s/it]
                                                            
{'loss': '0.1574', 'grad_norm': '2.915', 'learning_rate': '1.643e-05', 'epoch': '0.2995'}

 30%|██▉       | 11370/37963 [48:43:20<107:55:55, 14.61s/it]
 30%|██▉       | 11371/37963 [48:43:41<122:28:01, 16.58s/it]
 30%|██▉       | 11372/37963 [48:44:02<131:44:55, 17.84s/it]
 30%|██▉       | 11373/37963 [48:44:16<123:46:57, 16.76s/it]
 30%|██▉       | 11374/37963 [48:44:31<118:35:49, 16.06s/it]
 30%|██▉       | 11375/37963 [48:44:45<114:48:02, 15.54s/it]
 30%|██▉       | 11376/37963 [48:44:59<111:38:49, 15.12s/it]
 30%|██▉       | 11377/37963 [48:45:14<110:41:44, 14.99s/it]
 30%|██▉       | 11378/37963 [48:45:27<107:42:15, 14.58s/it]
 30%|██▉       | 11379/37963 [48:45:42<107:04:23, 14.50s/it]
 30%|██▉       | 11380/37963 [48:45:56<106:49:02, 14.47s/it]
                                                            
{'loss': '0.1499', 'grad_norm': '2.356', 'learning_rate': '1.642e-05', 'epoch': '0.2998'}

 30%|██▉       | 11380/37963 [48:45:56<106:49:02, 14.47s/it]
 30%|██▉       | 11381/37963 [48:46:10<106:14:05, 14.39s/it]
 30%|██▉       | 11382/37963 [48:46:31<120:35:44, 16.33s/it]
 30%|██▉       | 11383/37963 [48:46:52<130:15:16, 17.64s/it]
 30%|██▉       | 11384/37963 [48:47:06<122:36:00, 16.61s/it]
 30%|██▉       | 11385/37963 [48:47:20<117:14:00, 15.88s/it]
 30%|██▉       | 11386/37963 [48:47:35<114:09:36, 15.46s/it]
 30%|██▉       | 11387/37963 [48:47:49<111:34:46, 15.11s/it]
 30%|██▉       | 11388/37963 [48:48:03<109:07:40, 14.78s/it]
 30%|███       | 11389/37963 [48:48:17<108:10:01, 14.65s/it]
 30%|███       | 11390/37963 [48:48:38<121:16:50, 16.43s/it]
                                                            
{'loss': '0.1497', 'grad_norm': '1.613', 'learning_rate': '1.641e-05', 'epoch': '0.3'}

 30%|███       | 11390/37963 [48:48:38<121:16:50, 16.43s/it]
 30%|███       | 11391/37963 [48:48:52<116:34:51, 15.79s/it]
 30%|███       | 11392/37963 [48:49:07<113:18:35, 15.35s/it]
 30%|███       | 11393/37963 [48:49:21<111:00:57, 15.04s/it]
 30%|███       | 11394/37963 [48:49:35<109:37:52, 14.85s/it]
 30%|███       | 11395/37963 [48:49:57<124:06:31, 16.82s/it]
 30%|███       | 11396/37963 [48:50:11<118:47:51, 16.10s/it]
 30%|███       | 11397/37963 [48:50:25<114:52:42, 15.57s/it]
 30%|███       | 11398/37963 [48:50:46<126:25:43, 17.13s/it]
 30%|███       | 11399/37963 [48:51:01<120:23:30, 16.32s/it]
 30%|███       | 11400/37963 [48:51:15<115:53:11, 15.71s/it]
                                                            
{'loss': '0.1494', 'grad_norm': '2.42', 'learning_rate': '1.641e-05', 'epoch': '0.3003'}

 30%|███       | 11400/37963 [48:51:15<115:53:11, 15.71s/it]
 30%|███       | 11401/37963 [48:51:29<112:57:36, 15.31s/it]
 30%|███       | 11402/37963 [48:51:44<110:55:24, 15.03s/it]
 30%|███       | 11403/37963 [48:51:58<109:14:17, 14.81s/it]
 30%|███       | 11404/37963 [48:52:12<108:12:18, 14.67s/it]
 30%|███       | 11405/37963 [48:52:27<107:27:03, 14.57s/it]
 30%|███       | 11406/37963 [48:52:41<106:46:20, 14.47s/it]
 30%|███       | 11407/37963 [48:52:55<105:10:18, 14.26s/it]
 30%|███       | 11408/37963 [48:53:09<105:04:39, 14.25s/it]
 30%|███       | 11409/37963 [48:53:23<104:27:57, 14.16s/it]
 30%|███       | 11410/37963 [48:53:37<104:28:25, 14.16s/it]
                                                            
{'loss': '0.1635', 'grad_norm': '0.825', 'learning_rate': '1.64e-05', 'epoch': '0.3006'}

 30%|███       | 11410/37963 [48:53:37<104:28:25, 14.16s/it]
 30%|███       | 11411/37963 [48:53:51<104:43:59, 14.20s/it]
 30%|███       | 11412/37963 [48:54:06<104:52:22, 14.22s/it]
 30%|███       | 11413/37963 [48:54:26<119:36:33, 16.22s/it]
 30%|███       | 11414/37963 [48:54:40<114:08:41, 15.48s/it]
 30%|███       | 11415/37963 [48:54:55<111:43:46, 15.15s/it]
 30%|███       | 11416/37963 [48:55:09<110:03:55, 14.93s/it]
 30%|███       | 11417/37963 [48:55:23<108:53:26, 14.77s/it]
 30%|███       | 11418/37963 [48:55:44<122:51:22, 16.66s/it]
 30%|███       | 11419/37963 [48:55:59<118:00:08, 16.00s/it]
 30%|███       | 11420/37963 [48:56:13<114:48:23, 15.57s/it]
                                                            
{'loss': '0.1657', 'grad_norm': '1.86', 'learning_rate': '1.639e-05', 'epoch': '0.3008'}

 30%|███       | 11420/37963 [48:56:13<114:48:23, 15.57s/it]
 30%|███       | 11421/37963 [48:56:34<126:27:22, 17.15s/it]
 30%|███       | 11422/37963 [48:56:49<120:06:45, 16.29s/it]
 30%|███       | 11423/37963 [48:57:03<115:46:51, 15.71s/it]
 30%|███       | 11424/37963 [48:57:17<112:24:43, 15.25s/it]
 30%|███       | 11425/37963 [48:57:31<110:24:46, 14.98s/it]
 30%|███       | 11426/37963 [48:57:46<108:30:20, 14.72s/it]
 30%|███       | 11427/37963 [48:58:00<107:41:09, 14.61s/it]
 30%|███       | 11428/37963 [48:58:14<106:21:40, 14.43s/it]
 30%|███       | 11429/37963 [48:58:28<106:06:33, 14.40s/it]
 30%|███       | 11430/37963 [48:58:48<118:46:06, 16.11s/it]
                                                            
{'loss': '0.1557', 'grad_norm': '1.841', 'learning_rate': '1.639e-05', 'epoch': '0.3011'}

 30%|███       | 11430/37963 [48:58:48<118:46:06, 16.11s/it]
 30%|███       | 11431/37963 [48:59:10<129:52:55, 17.62s/it]
 30%|███       | 11432/37963 [48:59:24<122:54:02, 16.68s/it]
 30%|███       | 11433/37963 [48:59:38<116:56:00, 15.87s/it]
 30%|███       | 11434/37963 [48:59:52<113:44:06, 15.43s/it]
 30%|███       | 11435/37963 [49:00:07<111:36:06, 15.14s/it]
 30%|███       | 11436/37963 [49:00:21<110:28:52, 14.99s/it]
 30%|███       | 11437/37963 [49:00:36<109:00:25, 14.79s/it]
 30%|███       | 11438/37963 [49:00:56<121:10:48, 16.45s/it]
 30%|███       | 11439/37963 [49:01:10<116:25:00, 15.80s/it]
 30%|███       | 11440/37963 [49:01:25<113:16:35, 15.38s/it]
                                                            
{'loss': '0.1689', 'grad_norm': '2.73', 'learning_rate': '1.638e-05', 'epoch': '0.3013'}

 30%|███       | 11440/37963 [49:01:25<113:16:35, 15.38s/it]
 30%|███       | 11441/37963 [49:01:39<110:59:11, 15.06s/it]
 30%|███       | 11442/37963 [49:01:54<109:33:44, 14.87s/it]
 30%|███       | 11443/37963 [49:02:15<123:35:05, 16.78s/it]
 30%|███       | 11444/37963 [49:02:29<118:16:55, 16.06s/it]
 30%|███       | 11445/37963 [49:02:43<114:28:40, 15.54s/it]
 30%|███       | 11446/37963 [49:03:04<125:52:37, 17.09s/it]
 30%|███       | 11447/37963 [49:03:19<119:49:31, 16.27s/it]
 30%|███       | 11448/37963 [49:03:33<115:32:43, 15.69s/it]
 30%|███       | 11449/37963 [49:03:47<112:24:42, 15.26s/it]
 30%|███       | 11450/37963 [49:04:01<110:17:13, 14.98s/it]
                                                            
{'loss': '0.1554', 'grad_norm': '1.577', 'learning_rate': '1.637e-05', 'epoch': '0.3016'}

 30%|███       | 11450/37963 [49:04:01<110:17:13, 14.98s/it]
 30%|███       | 11451/37963 [49:04:16<108:25:00, 14.72s/it]
 30%|███       | 11452/37963 [49:04:30<107:40:03, 14.62s/it]
 30%|███       | 11453/37963 [49:04:44<105:48:35, 14.37s/it]
 30%|███       | 11454/37963 [49:04:58<105:42:00, 14.35s/it]
 30%|███       | 11455/37963 [49:05:12<105:46:27, 14.37s/it]
 30%|███       | 11456/37963 [49:05:27<106:04:12, 14.41s/it]
 30%|███       | 11457/37963 [49:05:41<104:47:52, 14.23s/it]
 30%|███       | 11458/37963 [49:05:55<105:04:41, 14.27s/it]
 30%|███       | 11459/37963 [49:06:16<119:19:26, 16.21s/it]
 30%|███       | 11460/37963 [49:06:30<115:10:41, 15.65s/it]
                                                            
{'loss': '0.1635', 'grad_norm': '1.132', 'learning_rate': '1.637e-05', 'epoch': '0.3019'}

 30%|███       | 11460/37963 [49:06:30<115:10:41, 15.65s/it]
 30%|███       | 11461/37963 [49:06:45<112:24:21, 15.27s/it]
 30%|███       | 11462/37963 [49:06:59<110:30:28, 15.01s/it]
 30%|███       | 11463/37963 [49:07:13<108:01:00, 14.67s/it]
 30%|███       | 11464/37963 [49:07:27<107:19:41, 14.58s/it]
 30%|███       | 11465/37963 [49:07:42<106:39:15, 14.49s/it]
 30%|███       | 11466/37963 [49:07:56<106:29:06, 14.47s/it]
 30%|███       | 11467/37963 [49:08:17<120:59:18, 16.44s/it]
 30%|███       | 11468/37963 [49:08:31<114:52:55, 15.61s/it]
 30%|███       | 11469/37963 [49:08:52<126:29:05, 17.19s/it]
 30%|███       | 11470/37963 [49:09:06<120:21:24, 16.35s/it]
                                                            
{'loss': '0.1796', 'grad_norm': '4.37', 'learning_rate': '1.636e-05', 'epoch': '0.3021'}

 30%|███       | 11470/37963 [49:09:06<120:21:24, 16.35s/it]
 30%|███       | 11471/37963 [49:09:20<115:52:17, 15.75s/it]
 30%|███       | 11472/37963 [49:09:35<112:43:59, 15.32s/it]
 30%|███       | 11473/37963 [49:09:49<110:36:13, 15.03s/it]
 30%|███       | 11474/37963 [49:10:03<109:03:18, 14.82s/it]
 30%|███       | 11475/37963 [49:10:18<108:00:32, 14.68s/it]
 30%|███       | 11476/37963 [49:10:32<107:16:59, 14.58s/it]
 30%|███       | 11477/37963 [49:10:53<120:33:01, 16.39s/it]
 30%|███       | 11478/37963 [49:11:06<114:39:25, 15.58s/it]
 30%|███       | 11479/37963 [49:11:27<126:42:31, 17.22s/it]
 30%|███       | 11480/37963 [49:11:41<118:58:03, 16.17s/it]
                                                            
{'loss': '0.1444', 'grad_norm': '5.133', 'learning_rate': '1.635e-05', 'epoch': '0.3024'}

 30%|███       | 11480/37963 [49:11:41<118:58:03, 16.17s/it]
 30%|███       | 11481/37963 [49:11:55<114:49:51, 15.61s/it]
 30%|███       | 11482/37963 [49:12:10<112:12:13, 15.25s/it]
 30%|███       | 11483/37963 [49:12:24<108:52:33, 14.80s/it]
 30%|███       | 11484/37963 [49:12:38<107:58:45, 14.68s/it]
 30%|███       | 11485/37963 [49:12:52<107:16:21, 14.59s/it]
 30%|███       | 11486/37963 [49:13:07<106:47:07, 14.52s/it]
 30%|███       | 11487/37963 [49:13:21<106:28:50, 14.48s/it]
 30%|███       | 11488/37963 [49:13:42<119:52:33, 16.30s/it]
 30%|███       | 11489/37963 [49:13:56<115:34:16, 15.72s/it]
 30%|███       | 11490/37963 [49:14:10<112:44:58, 15.33s/it]
                                                            
{'loss': '0.1581', 'grad_norm': '3.909', 'learning_rate': '1.635e-05', 'epoch': '0.3027'}

 30%|███       | 11490/37963 [49:14:10<112:44:58, 15.33s/it]
 30%|███       | 11491/37963 [49:14:32<125:40:20, 17.09s/it]
 30%|███       | 11492/37963 [49:14:46<119:43:02, 16.28s/it]
 30%|███       | 11493/37963 [49:15:00<115:20:29, 15.69s/it]
 30%|███       | 11494/37963 [49:15:20<124:48:22, 16.97s/it]
 30%|███       | 11495/37963 [49:15:34<117:26:56, 15.97s/it]
 30%|███       | 11496/37963 [49:15:48<113:45:19, 15.47s/it]
 30%|███       | 11497/37963 [49:16:03<111:17:27, 15.14s/it]
 30%|███       | 11498/37963 [49:16:17<109:38:21, 14.91s/it]
 30%|███       | 11499/37963 [49:16:31<108:20:45, 14.74s/it]
 30%|███       | 11500/37963 [49:16:45<106:47:49, 14.53s/it]
                                                            
{'loss': '0.1582', 'grad_norm': '2.55', 'learning_rate': '1.634e-05', 'epoch': '0.3029'}

 30%|███       | 11500/37963 [49:16:45<106:47:49, 14.53s/it]
 30%|███       | 11501/37963 [49:17:00<106:14:40, 14.45s/it]
 30%|███       | 11502/37963 [49:17:14<106:05:16, 14.43s/it]
 30%|███       | 11503/37963 [49:17:28<105:22:50, 14.34s/it]
 30%|███       | 11504/37963 [49:17:42<104:20:29, 14.20s/it]
 30%|███       | 11505/37963 [49:17:56<105:00:38, 14.29s/it]
 30%|███       | 11506/37963 [49:18:11<105:30:12, 14.36s/it]
 30%|███       | 11507/37963 [49:18:25<105:18:10, 14.33s/it]
 30%|███       | 11508/37963 [49:18:45<117:36:18, 16.00s/it]
 30%|███       | 11509/37963 [49:19:00<113:58:36, 15.51s/it]
 30%|███       | 11510/37963 [49:19:14<111:39:36, 15.20s/it]
                                                            
{'loss': '0.1717', 'grad_norm': '3.097', 'learning_rate': '1.634e-05', 'epoch': '0.3032'}

 30%|███       | 11510/37963 [49:19:14<111:39:36, 15.20s/it]
 30%|███       | 11511/37963 [49:19:28<107:59:18, 14.70s/it]
 30%|███       | 11512/37963 [49:19:42<107:16:09, 14.60s/it]
 30%|███       | 11513/37963 [49:19:56<106:48:46, 14.54s/it]
 30%|███       | 11514/37963 [49:20:10<106:01:11, 14.43s/it]
 30%|███       | 11515/37963 [49:20:25<105:52:01, 14.41s/it]
 30%|███       | 11516/37963 [49:20:46<120:57:44, 16.47s/it]
 30%|███       | 11517/37963 [49:21:07<130:10:40, 17.72s/it]
 30%|███       | 11518/37963 [49:21:21<122:12:05, 16.64s/it]
 30%|███       | 11519/37963 [49:21:35<116:48:19, 15.90s/it]
 30%|███       | 11520/37963 [49:21:49<112:56:47, 15.38s/it]
                                                            
{'loss': '0.155', 'grad_norm': '6.167', 'learning_rate': '1.633e-05', 'epoch': '0.3035'}

 30%|███       | 11520/37963 [49:21:49<112:56:47, 15.38s/it]
 30%|███       | 11521/37963 [49:22:04<110:53:09, 15.10s/it]
 30%|███       | 11522/37963 [49:22:18<109:25:17, 14.90s/it]
 30%|███       | 11523/37963 [49:22:32<107:48:11, 14.68s/it]
 30%|███       | 11524/37963 [49:22:47<106:58:10, 14.57s/it]
 30%|███       | 11525/37963 [49:23:01<106:31:17, 14.50s/it]
 30%|███       | 11526/37963 [49:23:15<106:02:37, 14.44s/it]
 30%|███       | 11527/37963 [49:23:36<120:34:29, 16.42s/it]
 30%|███       | 11528/37963 [49:23:57<130:44:48, 17.81s/it]
 30%|███       | 11529/37963 [49:24:12<123:27:45, 16.81s/it]
 30%|███       | 11530/37963 [49:24:26<117:54:40, 16.06s/it]
                                                            
{'loss': '0.1539', 'grad_norm': '1.825', 'learning_rate': '1.632e-05', 'epoch': '0.3037'}

 30%|███       | 11530/37963 [49:24:26<117:54:40, 16.06s/it]
 30%|███       | 11531/37963 [49:24:40<114:17:42, 15.57s/it]
 30%|███       | 11532/37963 [49:24:55<111:37:15, 15.20s/it]
 30%|███       | 11533/37963 [49:25:09<109:59:20, 14.98s/it]
 30%|███       | 11534/37963 [49:25:24<108:33:18, 14.79s/it]
 30%|███       | 11535/37963 [49:25:37<106:14:43, 14.47s/it]
 30%|███       | 11536/37963 [49:25:58<119:16:13, 16.25s/it]
 30%|███       | 11537/37963 [49:26:12<114:29:10, 15.60s/it]
 30%|███       | 11538/37963 [49:26:26<111:45:36, 15.23s/it]
 30%|███       | 11539/37963 [49:26:41<109:47:43, 14.96s/it]
 30%|███       | 11540/37963 [49:26:55<108:27:58, 14.78s/it]
                                                            
{'loss': '0.163', 'grad_norm': '4.208', 'learning_rate': '1.632e-05', 'epoch': '0.304'}

 30%|███       | 11540/37963 [49:26:55<108:27:58, 14.78s/it]
 30%|███       | 11541/37963 [49:27:16<121:49:11, 16.60s/it]
 30%|███       | 11542/37963 [49:27:30<116:42:05, 15.90s/it]
 30%|███       | 11543/37963 [49:27:50<126:37:44, 17.25s/it]
 30%|███       | 11544/37963 [49:28:04<118:42:04, 16.17s/it]
 30%|███       | 11545/37963 [49:28:18<114:39:15, 15.62s/it]
 30%|███       | 11546/37963 [49:28:33<111:30:16, 15.20s/it]
 30%|███       | 11547/37963 [49:28:47<108:41:08, 14.81s/it]
 30%|███       | 11548/37963 [49:29:00<106:07:32, 14.46s/it]
 30%|███       | 11549/37963 [49:29:15<106:03:45, 14.46s/it]
 30%|███       | 11550/37963 [49:29:29<106:01:40, 14.45s/it]
                                                            
{'loss': '0.1615', 'grad_norm': '2.374', 'learning_rate': '1.631e-05', 'epoch': '0.3042'}

 30%|███       | 11550/37963 [49:29:29<106:01:40, 14.45s/it]
 30%|███       | 11551/37963 [49:29:43<105:55:24, 14.44s/it]
 30%|███       | 11552/37963 [49:29:58<105:45:47, 14.42s/it]
 30%|███       | 11553/37963 [49:30:12<105:24:05, 14.37s/it]
 30%|███       | 11554/37963 [49:30:27<105:51:35, 14.43s/it]
 30%|███       | 11555/37963 [49:30:41<105:43:14, 14.41s/it]
 30%|███       | 11556/37963 [49:31:02<119:16:38, 16.26s/it]
 30%|███       | 11557/37963 [49:31:16<115:05:12, 15.69s/it]
 30%|███       | 11558/37963 [49:31:30<112:08:34, 15.29s/it]
 30%|███       | 11559/37963 [49:31:45<110:18:00, 15.04s/it]
 30%|███       | 11560/37963 [49:31:59<108:42:14, 14.82s/it]
                                                            
{'loss': '0.1706', 'grad_norm': '2.106', 'learning_rate': '1.63e-05', 'epoch': '0.3045'}

 30%|███       | 11560/37963 [49:31:59<108:42:14, 14.82s/it]
 30%|███       | 11561/37963 [49:32:13<107:35:08, 14.67s/it]
 30%|███       | 11562/37963 [49:32:28<106:47:45, 14.56s/it]
 30%|███       | 11563/37963 [49:32:42<107:06:34, 14.61s/it]
 30%|███       | 11564/37963 [49:33:03<121:16:13, 16.54s/it]
 30%|███       | 11565/37963 [49:33:18<116:38:04, 15.91s/it]
 30%|███       | 11566/37963 [49:33:32<111:57:42, 15.27s/it]
 30%|███       | 11567/37963 [49:33:46<109:59:01, 15.00s/it]
 30%|███       | 11568/37963 [49:34:07<122:16:24, 16.68s/it]
 30%|███       | 11569/37963 [49:34:21<116:20:51, 15.87s/it]
 30%|███       | 11570/37963 [49:34:35<112:34:06, 15.35s/it]
                                                            
{'loss': '0.171', 'grad_norm': '1.846', 'learning_rate': '1.63e-05', 'epoch': '0.3048'}

 30%|███       | 11570/37963 [49:34:35<112:34:06, 15.35s/it]
 30%|███       | 11571/37963 [49:34:49<109:52:54, 14.99s/it]
 30%|███       | 11572/37963 [49:35:03<108:32:50, 14.81s/it]
 30%|███       | 11573/37963 [49:35:17<106:47:02, 14.57s/it]
 30%|███       | 11574/37963 [49:35:38<120:45:05, 16.47s/it]
 30%|███       | 11575/37963 [49:35:52<115:45:59, 15.79s/it]
 30%|███       | 11576/37963 [49:36:07<113:03:28, 15.42s/it]
 30%|███       | 11577/37963 [49:36:21<109:54:11, 14.99s/it]
 30%|███       | 11578/37963 [49:36:42<123:20:43, 16.83s/it]
 31%|███       | 11579/37963 [49:36:56<118:02:26, 16.11s/it]
 31%|███       | 11580/37963 [49:37:11<114:14:23, 15.59s/it]
                                                            
{'loss': '0.1656', 'grad_norm': '1.212', 'learning_rate': '1.629e-05', 'epoch': '0.305'}

 31%|███       | 11580/37963 [49:37:11<114:14:23, 15.59s/it]
 31%|███       | 11581/37963 [49:37:25<111:27:24, 15.21s/it]
 31%|███       | 11582/37963 [49:37:40<109:35:30, 14.96s/it]
 31%|███       | 11583/37963 [49:38:00<121:36:17, 16.60s/it]
 31%|███       | 11584/37963 [49:38:14<116:40:29, 15.92s/it]
 31%|███       | 11585/37963 [49:38:29<113:12:32, 15.45s/it]
 31%|███       | 11586/37963 [49:38:43<110:49:25, 15.13s/it]
 31%|███       | 11587/37963 [49:38:57<107:52:22, 14.72s/it]
 31%|███       | 11588/37963 [49:39:11<106:58:58, 14.60s/it]
 31%|███       | 11589/37963 [49:39:25<104:34:12, 14.27s/it]
 31%|███       | 11590/37963 [49:39:46<119:27:57, 16.31s/it]
                                                            
{'loss': '0.1712', 'grad_norm': '4.242', 'learning_rate': '1.628e-05', 'epoch': '0.3053'}

 31%|███       | 11590/37963 [49:39:46<119:27:57, 16.31s/it]
 31%|███       | 11591/37963 [49:40:00<115:09:22, 15.72s/it]
 31%|███       | 11592/37963 [49:40:14<111:42:40, 15.25s/it]
 31%|███       | 11593/37963 [49:40:35<123:56:44, 16.92s/it]
 31%|███       | 11594/37963 [49:40:49<117:49:58, 16.09s/it]
 31%|███       | 11595/37963 [49:41:03<113:35:33, 15.51s/it]
 31%|███       | 11596/37963 [49:41:18<110:58:29, 15.15s/it]
 31%|███       | 11597/37963 [49:41:31<107:59:01, 14.74s/it]
 31%|███       | 11598/37963 [49:41:45<105:38:07, 14.42s/it]
 31%|███       | 11599/37963 [49:41:59<104:10:17, 14.22s/it]
 31%|███       | 11600/37963 [49:42:13<104:29:54, 14.27s/it]
                                                            
{'loss': '0.161', 'grad_norm': '2.399', 'learning_rate': '1.628e-05', 'epoch': '0.3056'}

 31%|███       | 11600/37963 [49:42:13<104:29:54, 14.27s/it]
 31%|███       | 11601/37963 [49:42:28<104:37:39, 14.29s/it]
 31%|███       | 11602/37963 [49:42:42<104:48:04, 14.31s/it]
 31%|███       | 11603/37963 [49:42:56<105:00:54, 14.34s/it]
 31%|███       | 11604/37963 [49:43:10<104:16:25, 14.24s/it]
 31%|███       | 11605/37963 [49:43:25<104:03:52, 14.21s/it]
 31%|███       | 11606/37963 [49:43:45<118:15:59, 16.15s/it]
 31%|███       | 11607/37963 [49:44:00<114:13:08, 15.60s/it]
 31%|███       | 11608/37963 [49:44:13<110:11:37, 15.05s/it]
 31%|███       | 11609/37963 [49:44:28<108:39:28, 14.84s/it]
 31%|███       | 11610/37963 [49:44:42<107:39:14, 14.71s/it]
                                                            
{'loss': '0.1591', 'grad_norm': '1.734', 'learning_rate': '1.627e-05', 'epoch': '0.3058'}

 31%|███       | 11610/37963 [49:44:42<107:39:14, 14.71s/it]
 31%|███       | 11611/37963 [49:44:56<106:26:10, 14.54s/it]
 31%|███       | 11612/37963 [49:45:11<105:56:11, 14.47s/it]
 31%|███       | 11613/37963 [49:45:25<105:49:18, 14.46s/it]
 31%|███       | 11614/37963 [49:45:47<121:44:51, 16.63s/it]
 31%|███       | 11615/37963 [49:46:07<130:56:47, 17.89s/it]
 31%|███       | 11616/37963 [49:46:22<123:18:21, 16.85s/it]
 31%|███       | 11617/37963 [49:46:36<117:37:56, 16.07s/it]
 31%|███       | 11618/37963 [49:46:51<114:01:35, 15.58s/it]
 31%|███       | 11619/37963 [49:47:04<109:24:46, 14.95s/it]
 31%|███       | 11620/37963 [49:47:18<107:59:02, 14.76s/it]
                                                            
{'loss': '0.1739', 'grad_norm': '0.9424', 'learning_rate': '1.626e-05', 'epoch': '0.3061'}

 31%|███       | 11620/37963 [49:47:18<107:59:02, 14.76s/it]
 31%|███       | 11621/37963 [49:47:39<121:43:23, 16.64s/it]
 31%|███       | 11622/37963 [49:47:54<116:44:19, 15.95s/it]
 31%|███       | 11623/37963 [49:48:08<113:11:30, 15.47s/it]
 31%|███       | 11624/37963 [49:48:22<110:30:34, 15.10s/it]
 31%|███       | 11625/37963 [49:48:36<108:15:47, 14.80s/it]
 31%|███       | 11626/37963 [49:48:51<107:09:51, 14.65s/it]
 31%|███       | 11627/37963 [49:49:12<121:24:16, 16.60s/it]
 31%|███       | 11628/37963 [49:49:26<116:30:44, 15.93s/it]
 31%|███       | 11629/37963 [49:49:40<112:13:10, 15.34s/it]
 31%|███       | 11630/37963 [49:49:55<110:03:23, 15.05s/it]
                                                            
{'loss': '0.1675', 'grad_norm': '1.636', 'learning_rate': '1.626e-05', 'epoch': '0.3064'}

 31%|███       | 11630/37963 [49:49:55<110:03:23, 15.05s/it]
 31%|███       | 11631/37963 [49:50:09<108:09:52, 14.79s/it]
 31%|███       | 11632/37963 [49:50:30<121:44:35, 16.64s/it]
 31%|███       | 11633/37963 [49:50:44<116:38:42, 15.95s/it]
 31%|███       | 11634/37963 [49:50:59<113:22:29, 15.50s/it]
 31%|███       | 11635/37963 [49:51:13<110:38:38, 15.13s/it]
 31%|███       | 11636/37963 [49:51:27<108:52:02, 14.89s/it]
 31%|███       | 11637/37963 [49:51:41<107:05:08, 14.64s/it]
 31%|███       | 11638/37963 [49:52:02<120:41:16, 16.50s/it]
 31%|███       | 11639/37963 [49:52:16<116:00:17, 15.86s/it]
 31%|███       | 11640/37963 [49:52:30<111:57:47, 15.31s/it]
                                                            
{'loss': '0.171', 'grad_norm': '4.322', 'learning_rate': '1.625e-05', 'epoch': '0.3066'}

 31%|███       | 11640/37963 [49:52:30<111:57:47, 15.31s/it]
 31%|███       | 11641/37963 [49:52:45<109:35:25, 14.99s/it]
 31%|███       | 11642/37963 [49:52:59<107:47:42, 14.74s/it]
 31%|███       | 11643/37963 [49:53:20<121:24:06, 16.61s/it]
 31%|███       | 11644/37963 [49:53:34<116:25:05, 15.92s/it]
 31%|███       | 11645/37963 [49:53:48<111:41:46, 15.28s/it]
 31%|███       | 11646/37963 [49:54:02<109:40:18, 15.00s/it]
 31%|███       | 11647/37963 [49:54:17<108:12:24, 14.80s/it]
 31%|███       | 11648/37963 [49:54:31<107:03:31, 14.65s/it]
 31%|███       | 11649/37963 [49:54:45<105:46:29, 14.47s/it]
 31%|███       | 11650/37963 [49:54:59<104:00:38, 14.23s/it]
                                                            
{'loss': '0.1536', 'grad_norm': '3.026', 'learning_rate': '1.624e-05', 'epoch': '0.3069'}

 31%|███       | 11650/37963 [49:54:59<104:00:38, 14.23s/it]
 31%|███       | 11651/37963 [49:55:13<104:10:05, 14.25s/it]
 31%|███       | 11652/37963 [49:55:27<104:48:03, 14.34s/it]
 31%|███       | 11653/37963 [49:55:42<104:52:20, 14.35s/it]
 31%|███       | 11654/37963 [49:55:56<104:50:49, 14.35s/it]
 31%|███       | 11655/37963 [49:56:11<104:59:16, 14.37s/it]
 31%|███       | 11656/37963 [49:56:31<119:18:12, 16.33s/it]
 31%|███       | 11657/37963 [49:56:46<115:07:27, 15.75s/it]
 31%|███       | 11658/37963 [49:57:00<111:39:45, 15.28s/it]
 31%|███       | 11659/37963 [49:57:14<109:30:12, 14.99s/it]
 31%|███       | 11660/37963 [49:57:29<107:56:38, 14.77s/it]
                                                            
{'loss': '0.1611', 'grad_norm': '1.497', 'learning_rate': '1.624e-05', 'epoch': '0.3071'}

 31%|███       | 11660/37963 [49:57:29<107:56:38, 14.77s/it]
 31%|███       | 11661/37963 [49:57:43<106:12:13, 14.54s/it]
 31%|███       | 11662/37963 [49:57:57<105:56:02, 14.50s/it]
 31%|███       | 11663/37963 [49:58:18<119:21:33, 16.34s/it]
 31%|███       | 11664/37963 [49:58:32<115:07:09, 15.76s/it]
 31%|███       | 11665/37963 [49:58:46<111:12:32, 15.22s/it]
 31%|███       | 11666/37963 [49:59:07<123:26:43, 16.90s/it]
 31%|███       | 11667/37963 [49:59:21<117:57:25, 16.15s/it]
 31%|███       | 11668/37963 [49:59:36<114:03:41, 15.62s/it]
 31%|███       | 11669/37963 [49:59:56<125:29:03, 17.18s/it]
 31%|███       | 11670/37963 [50:00:11<118:52:24, 16.28s/it]
                                                            
{'loss': '0.1512', 'grad_norm': '2.293', 'learning_rate': '1.623e-05', 'epoch': '0.3074'}

 31%|███       | 11670/37963 [50:00:11<118:52:24, 16.28s/it]
 31%|███       | 11671/37963 [50:00:25<114:34:25, 15.69s/it]
 31%|███       | 11672/37963 [50:00:39<111:43:17, 15.30s/it]
 31%|███       | 11673/37963 [50:00:54<109:38:44, 15.01s/it]
 31%|███       | 11674/37963 [50:01:08<108:08:17, 14.81s/it]
 31%|███       | 11675/37963 [50:01:23<107:32:57, 14.73s/it]
 31%|███       | 11676/37963 [50:01:44<123:22:07, 16.90s/it]
 31%|███       | 11677/37963 [50:01:59<117:46:39, 16.13s/it]
 31%|███       | 11678/37963 [50:02:13<113:32:33, 15.55s/it]
 31%|███       | 11679/37963 [50:02:27<110:51:46, 15.18s/it]
 31%|███       | 11680/37963 [50:02:48<122:41:55, 16.81s/it]
                                                            
{'loss': '0.1484', 'grad_norm': '3.745', 'learning_rate': '1.622e-05', 'epoch': '0.3077'}

 31%|███       | 11680/37963 [50:02:48<122:41:55, 16.81s/it]
 31%|███       | 11681/37963 [50:03:02<117:20:23, 16.07s/it]
 31%|███       | 11682/37963 [50:03:16<112:07:43, 15.36s/it]
 31%|███       | 11683/37963 [50:03:30<109:58:35, 15.07s/it]
 31%|███       | 11684/37963 [50:03:45<108:35:54, 14.88s/it]
 31%|███       | 11685/37963 [50:03:59<107:26:22, 14.72s/it]
 31%|███       | 11686/37963 [50:04:14<106:42:49, 14.62s/it]
 31%|███       | 11687/37963 [50:04:34<120:13:39, 16.47s/it]
 31%|███       | 11688/37963 [50:04:48<114:43:56, 15.72s/it]
 31%|███       | 11689/37963 [50:05:03<112:03:00, 15.35s/it]
 31%|███       | 11690/37963 [50:05:24<124:36:16, 17.07s/it]
                                                            
{'loss': '0.1695', 'grad_norm': '4.224', 'learning_rate': '1.622e-05', 'epoch': '0.3079'}

 31%|███       | 11690/37963 [50:05:24<124:36:16, 17.07s/it]
 31%|███       | 11691/37963 [50:05:38<118:47:05, 16.28s/it]
 31%|███       | 11692/37963 [50:05:53<114:43:09, 15.72s/it]
 31%|███       | 11693/37963 [50:06:07<111:37:44, 15.30s/it]
 31%|███       | 11694/37963 [50:06:21<109:10:03, 14.96s/it]
 31%|███       | 11695/37963 [50:06:36<107:54:25, 14.79s/it]
 31%|███       | 11696/37963 [50:06:50<106:55:04, 14.65s/it]
 31%|███       | 11697/37963 [50:07:04<106:17:10, 14.57s/it]
 31%|███       | 11698/37963 [50:07:19<105:54:15, 14.52s/it]
 31%|███       | 11699/37963 [50:07:33<105:00:54, 14.39s/it]
 31%|███       | 11700/37963 [50:07:47<104:58:52, 14.39s/it]
                                                            
{'loss': '0.1656', 'grad_norm': '2.002', 'learning_rate': '1.621e-05', 'epoch': '0.3082'}

 31%|███       | 11700/37963 [50:07:47<104:58:52, 14.39s/it]
 31%|███       | 11701/37963 [50:08:02<105:00:55, 14.40s/it]
 31%|███       | 11702/37963 [50:08:16<104:25:02, 14.31s/it]
 31%|███       | 11703/37963 [50:08:30<104:27:35, 14.32s/it]
 31%|███       | 11704/37963 [50:08:51<118:32:38, 16.25s/it]
 31%|███       | 11705/37963 [50:09:05<114:27:05, 15.69s/it]
 31%|███       | 11706/37963 [50:09:20<111:43:16, 15.32s/it]
 31%|███       | 11707/37963 [50:09:34<108:29:35, 14.88s/it]
 31%|███       | 11708/37963 [50:09:48<106:50:00, 14.65s/it]
 31%|███       | 11709/37963 [50:10:02<106:14:34, 14.57s/it]
 31%|███       | 11710/37963 [50:10:16<105:41:24, 14.49s/it]
                                                            
{'loss': '0.1453', 'grad_norm': '2.033', 'learning_rate': '1.62e-05', 'epoch': '0.3085'}

 31%|███       | 11710/37963 [50:10:16<105:41:24, 14.49s/it]
 31%|███       | 11711/37963 [50:10:30<104:53:02, 14.38s/it]
 31%|███       | 11712/37963 [50:10:45<104:47:14, 14.37s/it]
 31%|███       | 11713/37963 [50:10:59<104:39:08, 14.35s/it]
 31%|███       | 11714/37963 [50:11:13<104:38:56, 14.35s/it]
 31%|███       | 11715/37963 [50:11:35<119:23:44, 16.38s/it]
 31%|███       | 11716/37963 [50:11:55<129:23:00, 17.75s/it]
 31%|███       | 11717/37963 [50:12:17<137:44:28, 18.89s/it]
 31%|███       | 11718/37963 [50:12:31<127:44:03, 17.52s/it]
 31%|███       | 11719/37963 [50:12:46<120:47:52, 16.57s/it]
 31%|███       | 11720/37963 [50:13:00<115:59:42, 15.91s/it]
                                                            
{'loss': '0.1645', 'grad_norm': '1.615', 'learning_rate': '1.62e-05', 'epoch': '0.3087'}

 31%|███       | 11720/37963 [50:13:00<115:59:42, 15.91s/it]
 31%|███       | 11721/37963 [50:13:14<111:35:38, 15.31s/it]
 31%|███       | 11722/37963 [50:13:28<109:40:24, 15.05s/it]
 31%|███       | 11723/37963 [50:13:43<108:05:35, 14.83s/it]
 31%|███       | 11724/37963 [50:14:04<121:20:32, 16.65s/it]
 31%|███       | 11725/37963 [50:14:18<116:09:30, 15.94s/it]
 31%|███       | 11726/37963 [50:14:32<112:43:45, 15.47s/it]
 31%|███       | 11727/37963 [50:14:46<109:10:46, 14.98s/it]
 31%|███       | 11728/37963 [50:15:01<107:54:46, 14.81s/it]
 31%|███       | 11729/37963 [50:15:22<121:58:49, 16.74s/it]
 31%|███       | 11730/37963 [50:15:36<117:02:39, 16.06s/it]
                                                            
{'loss': '0.1753', 'grad_norm': '2.702', 'learning_rate': '1.619e-05', 'epoch': '0.309'}

 31%|███       | 11730/37963 [50:15:36<117:02:39, 16.06s/it]
 31%|███       | 11731/37963 [50:15:50<111:58:21, 15.37s/it]
 31%|███       | 11732/37963 [50:16:04<109:44:45, 15.06s/it]
 31%|███       | 11733/37963 [50:16:19<108:09:45, 14.85s/it]
 31%|███       | 11734/37963 [50:16:33<107:04:37, 14.70s/it]
 31%|███       | 11735/37963 [50:16:47<106:11:56, 14.58s/it]
 31%|███       | 11736/37963 [50:17:15<134:29:20, 18.46s/it]
 31%|███       | 11737/37963 [50:17:29<125:04:21, 17.17s/it]
 31%|███       | 11738/37963 [50:17:43<117:48:16, 16.17s/it]
 31%|███       | 11739/37963 [50:17:57<113:45:43, 15.62s/it]
 31%|███       | 11740/37963 [50:18:12<110:59:16, 15.24s/it]
                                                            
{'loss': '0.1492', 'grad_norm': '2.243', 'learning_rate': '1.618e-05', 'epoch': '0.3092'}

 31%|███       | 11740/37963 [50:18:12<110:59:16, 15.24s/it]
 31%|███       | 11741/37963 [50:18:26<109:03:56, 14.97s/it]
 31%|███       | 11742/37963 [50:18:40<106:04:47, 14.56s/it]
 31%|███       | 11743/37963 [50:18:54<105:40:04, 14.51s/it]
 31%|███       | 11744/37963 [50:19:08<105:37:41, 14.50s/it]
 31%|███       | 11745/37963 [50:19:22<103:42:33, 14.24s/it]
 31%|███       | 11746/37963 [50:19:36<103:57:44, 14.28s/it]
 31%|███       | 11747/37963 [50:19:50<103:33:41, 14.22s/it]
 31%|███       | 11748/37963 [50:20:05<103:44:08, 14.25s/it]
 31%|███       | 11749/37963 [50:20:19<103:48:11, 14.26s/it]
 31%|███       | 11750/37963 [50:20:33<103:32:43, 14.22s/it]
                                                            
{'loss': '0.1618', 'grad_norm': '2.734', 'learning_rate': '1.618e-05', 'epoch': '0.3095'}

 31%|███       | 11750/37963 [50:20:33<103:32:43, 14.22s/it]
 31%|███       | 11751/37963 [50:20:47<103:42:58, 14.24s/it]
 31%|███       | 11752/37963 [50:21:02<103:31:51, 14.22s/it]
 31%|███       | 11753/37963 [50:21:22<117:44:41, 16.17s/it]
 31%|███       | 11754/37963 [50:21:36<113:06:12, 15.54s/it]
 31%|███       | 11755/37963 [50:21:51<110:25:28, 15.17s/it]
 31%|███       | 11756/37963 [50:22:05<108:33:48, 14.91s/it]
 31%|███       | 11757/37963 [50:22:19<107:29:42, 14.77s/it]
 31%|███       | 11758/37963 [50:22:34<106:49:03, 14.67s/it]
 31%|███       | 11759/37963 [50:22:48<105:51:14, 14.54s/it]
 31%|███       | 11760/37963 [50:23:03<105:21:46, 14.48s/it]
                                                            
{'loss': '0.1681', 'grad_norm': '1.905', 'learning_rate': '1.617e-05', 'epoch': '0.3098'}

 31%|███       | 11760/37963 [50:23:03<105:21:46, 14.48s/it]
 31%|███       | 11761/37963 [50:23:17<105:00:56, 14.43s/it]
 31%|███       | 11762/37963 [50:23:31<103:28:32, 14.22s/it]
 31%|███       | 11763/37963 [50:23:52<118:25:40, 16.27s/it]
 31%|███       | 11764/37963 [50:24:13<129:03:49, 17.73s/it]
 31%|███       | 11765/37963 [50:24:27<121:33:40, 16.70s/it]
 31%|███       | 11766/37963 [50:24:48<130:32:39, 17.94s/it]
 31%|███       | 11767/37963 [50:25:02<122:00:29, 16.77s/it]
 31%|███       | 11768/37963 [50:25:16<116:52:23, 16.06s/it]
 31%|███       | 11769/37963 [50:25:30<112:18:55, 15.44s/it]
 31%|███       | 11770/37963 [50:25:44<109:13:41, 15.01s/it]
                                                            
{'loss': '0.1599', 'grad_norm': '4.172', 'learning_rate': '1.616e-05', 'epoch': '0.31'}

 31%|███       | 11770/37963 [50:25:44<109:13:41, 15.01s/it]
 31%|███       | 11771/37963 [50:25:59<107:51:55, 14.83s/it]
 31%|███       | 11772/37963 [50:26:20<121:53:16, 16.75s/it]
 31%|███       | 11773/37963 [50:26:34<115:56:55, 15.94s/it]
 31%|███       | 11774/37963 [50:26:48<112:32:13, 15.47s/it]
 31%|███       | 11775/37963 [50:27:03<109:44:32, 15.09s/it]
 31%|███       | 11776/37963 [50:27:17<107:27:43, 14.77s/it]
 31%|███       | 11777/37963 [50:27:38<121:20:03, 16.68s/it]
 31%|███       | 11778/37963 [50:27:52<115:31:28, 15.88s/it]
 31%|███       | 11779/37963 [50:28:06<112:19:39, 15.44s/it]
 31%|███       | 11780/37963 [50:28:21<109:55:07, 15.11s/it]
                                                            
{'loss': '0.1558', 'grad_norm': '2.835', 'learning_rate': '1.616e-05', 'epoch': '0.3103'}

 31%|███       | 11780/37963 [50:28:21<109:55:07, 15.11s/it]
 31%|███       | 11781/37963 [50:28:35<108:08:18, 14.87s/it]
 31%|███       | 11782/37963 [50:28:49<107:04:59, 14.72s/it]
 31%|███       | 11783/37963 [50:29:04<106:17:01, 14.62s/it]
 31%|███       | 11784/37963 [50:29:31<133:21:03, 18.34s/it]
 31%|███       | 11785/37963 [50:29:45<124:06:01, 17.07s/it]
 31%|███       | 11786/37963 [50:29:58<116:11:44, 15.98s/it]
 31%|███       | 11787/37963 [50:30:13<112:50:51, 15.52s/it]
 31%|███       | 11788/37963 [50:30:27<110:14:29, 15.16s/it]
 31%|███       | 11789/37963 [50:30:41<108:26:19, 14.91s/it]
 31%|███       | 11790/37963 [50:30:56<107:07:20, 14.73s/it]
                                                            
{'loss': '0.1381', 'grad_norm': '1.262', 'learning_rate': '1.615e-05', 'epoch': '0.3106'}

 31%|███       | 11790/37963 [50:30:56<107:07:20, 14.73s/it]
 31%|███       | 11791/37963 [50:31:10<106:23:20, 14.63s/it]
 31%|███       | 11792/37963 [50:31:24<105:55:58, 14.57s/it]
 31%|███       | 11793/37963 [50:31:38<104:31:25, 14.38s/it]
 31%|███       | 11794/37963 [50:31:52<104:00:32, 14.31s/it]
 31%|███       | 11795/37963 [50:32:07<104:02:07, 14.31s/it]
 31%|███       | 11796/37963 [50:32:20<102:39:22, 14.12s/it]
 31%|███       | 11797/37963 [50:32:35<103:04:50, 14.18s/it]
 31%|███       | 11798/37963 [50:32:49<103:31:04, 14.24s/it]
 31%|███       | 11799/37963 [50:33:04<103:50:48, 14.29s/it]
 31%|███       | 11800/37963 [50:33:18<104:03:25, 14.32s/it]
                                                            
{'loss': '0.1532', 'grad_norm': '2.314', 'learning_rate': '1.614e-05', 'epoch': '0.3108'}

 31%|███       | 11800/37963 [50:33:18<104:03:25, 14.32s/it]
 31%|███       | 11801/37963 [50:33:32<104:02:40, 14.32s/it]
 31%|███       | 11802/37963 [50:33:47<104:02:55, 14.32s/it]
 31%|███       | 11803/37963 [50:34:08<118:36:23, 16.32s/it]
 31%|███       | 11804/37963 [50:34:22<114:11:30, 15.72s/it]
 31%|███       | 11805/37963 [50:34:36<110:56:23, 15.27s/it]
 31%|███       | 11806/37963 [50:34:50<108:59:20, 15.00s/it]
 31%|███       | 11807/37963 [50:35:04<105:42:00, 14.55s/it]
 31%|███       | 11808/37963 [50:35:18<105:09:05, 14.47s/it]
 31%|███       | 11809/37963 [50:35:33<104:52:36, 14.44s/it]
 31%|███       | 11810/37963 [50:35:47<104:42:47, 14.41s/it]
                                                            
{'loss': '0.1687', 'grad_norm': '3.265', 'learning_rate': '1.614e-05', 'epoch': '0.3111'}

 31%|███       | 11810/37963 [50:35:47<104:42:47, 14.41s/it]
 31%|███       | 11811/37963 [50:36:01<103:07:14, 14.20s/it]
 31%|███       | 11812/37963 [50:36:15<103:28:35, 14.24s/it]
 31%|███       | 11813/37963 [50:36:43<134:14:23, 18.48s/it]
 31%|███       | 11814/37963 [50:36:58<124:47:35, 17.18s/it]
 31%|███       | 11815/37963 [50:37:12<118:39:57, 16.34s/it]
 31%|███       | 11816/37963 [50:37:26<113:30:03, 15.63s/it]
 31%|███       | 11817/37963 [50:37:40<110:43:44, 15.25s/it]
 31%|███       | 11818/37963 [50:38:01<123:00:17, 16.94s/it]
 31%|███       | 11819/37963 [50:38:15<117:21:36, 16.16s/it]
 31%|███       | 11820/37963 [50:38:30<113:45:26, 15.66s/it]
                                                            
{'loss': '0.1456', 'grad_norm': '1.729', 'learning_rate': '1.613e-05', 'epoch': '0.3114'}

 31%|███       | 11820/37963 [50:38:30<113:45:26, 15.66s/it]
 31%|███       | 11821/37963 [50:38:51<124:38:48, 17.17s/it]
 31%|███       | 11822/37963 [50:39:05<118:21:08, 16.30s/it]
 31%|███       | 11823/37963 [50:39:19<114:04:07, 15.71s/it]
 31%|███       | 11824/37963 [50:39:33<110:43:10, 15.25s/it]
 31%|███       | 11825/37963 [50:39:54<122:43:23, 16.90s/it]
 31%|███       | 11826/37963 [50:40:08<115:58:40, 15.97s/it]
 31%|███       | 11827/37963 [50:40:22<112:09:46, 15.45s/it]
 31%|███       | 11828/37963 [50:40:37<110:01:14, 15.15s/it]
 31%|███       | 11829/37963 [50:40:51<108:17:48, 14.92s/it]
 31%|███       | 11830/37963 [50:41:12<121:28:27, 16.73s/it]
                                                            
{'loss': '0.1697', 'grad_norm': '2.424', 'learning_rate': '1.612e-05', 'epoch': '0.3116'}

 31%|███       | 11830/37963 [50:41:12<121:28:27, 16.73s/it]
 31%|███       | 11831/37963 [50:41:27<116:39:56, 16.07s/it]
 31%|███       | 11832/37963 [50:41:41<112:59:13, 15.57s/it]
 31%|███       | 11833/37963 [50:42:03<126:06:14, 17.37s/it]
 31%|███       | 11834/37963 [50:42:17<119:16:13, 16.43s/it]
 31%|███       | 11835/37963 [50:42:31<114:35:55, 15.79s/it]
 31%|███       | 11836/37963 [50:42:45<110:49:07, 15.27s/it]
 31%|███       | 11837/37963 [50:42:59<108:48:07, 14.99s/it]
 31%|███       | 11838/37963 [50:43:14<107:23:26, 14.80s/it]
 31%|███       | 11839/37963 [50:43:28<106:15:24, 14.64s/it]
 31%|███       | 11840/37963 [50:43:42<105:23:09, 14.52s/it]
                                                            
{'loss': '0.1554', 'grad_norm': '2.307', 'learning_rate': '1.611e-05', 'epoch': '0.3119'}

 31%|███       | 11840/37963 [50:43:42<105:23:09, 14.52s/it]
 31%|███       | 11841/37963 [50:43:56<104:00:36, 14.33s/it]
 31%|███       | 11842/37963 [50:44:10<103:23:27, 14.25s/it]
 31%|███       | 11843/37963 [50:44:24<103:16:38, 14.23s/it]
 31%|███       | 11844/37963 [50:44:39<103:39:27, 14.29s/it]
 31%|███       | 11845/37963 [50:44:53<103:58:50, 14.33s/it]
 31%|███       | 11846/37963 [50:45:08<104:08:45, 14.36s/it]
 31%|███       | 11847/37963 [50:45:22<103:26:24, 14.26s/it]
 31%|███       | 11848/37963 [50:45:36<103:34:05, 14.28s/it]
 31%|███       | 11849/37963 [50:45:51<104:06:04, 14.35s/it]
 31%|███       | 11850/37963 [50:46:05<103:42:31, 14.30s/it]
                                                            
{'loss': '0.1735', 'grad_norm': '1.793', 'learning_rate': '1.611e-05', 'epoch': '0.3121'}

 31%|███       | 11850/37963 [50:46:05<103:42:31, 14.30s/it]
 31%|███       | 11851/37963 [50:46:26<117:43:06, 16.23s/it]
 31%|███       | 11852/37963 [50:46:40<113:39:53, 15.67s/it]
 31%|███       | 11853/37963 [50:46:54<110:35:00, 15.25s/it]
 31%|███       | 11854/37963 [50:47:08<108:02:52, 14.90s/it]
 31%|███       | 11855/37963 [50:47:22<106:37:37, 14.70s/it]
 31%|███       | 11856/37963 [50:47:37<105:34:45, 14.56s/it]
 31%|███       | 11857/37963 [50:47:51<104:14:31, 14.37s/it]
 31%|███       | 11858/37963 [50:48:05<103:54:14, 14.33s/it]
 31%|███       | 11859/37963 [50:48:19<103:59:10, 14.34s/it]
 31%|███       | 11860/37963 [50:48:40<117:19:15, 16.18s/it]
                                                            
{'loss': '0.1539', 'grad_norm': '2.674', 'learning_rate': '1.61e-05', 'epoch': '0.3124'}

 31%|███       | 11860/37963 [50:48:40<117:19:15, 16.18s/it]
 31%|███       | 11861/37963 [50:48:54<113:25:05, 15.64s/it]
 31%|███       | 11862/37963 [50:49:15<124:25:54, 17.16s/it]
 31%|███       | 11863/37963 [50:49:29<118:15:21, 16.31s/it]
 31%|███▏      | 11864/37963 [50:49:44<114:05:55, 15.74s/it]
 31%|███▏      | 11865/37963 [50:49:58<111:13:54, 15.34s/it]
 31%|███▏      | 11866/37963 [50:50:12<109:12:10, 15.06s/it]
 31%|███▏      | 11867/37963 [50:50:33<120:38:55, 16.64s/it]
 31%|███▏      | 11868/37963 [50:50:47<115:36:18, 15.95s/it]
 31%|███▏      | 11869/37963 [50:51:08<127:02:00, 17.53s/it]
 31%|███▏      | 11870/37963 [50:51:22<119:50:50, 16.54s/it]
                                                            
{'loss': '0.1525', 'grad_norm': '3.478', 'learning_rate': '1.609e-05', 'epoch': '0.3127'}

 31%|███▏      | 11870/37963 [50:51:22<119:50:50, 16.54s/it]
 31%|███▏      | 11871/37963 [50:51:37<115:01:55, 15.87s/it]
 31%|███▏      | 11872/37963 [50:51:51<111:47:11, 15.42s/it]
 31%|███▏      | 11873/37963 [50:52:12<124:15:43, 17.15s/it]
 31%|███▏      | 11874/37963 [50:52:27<118:15:26, 16.32s/it]
 31%|███▏      | 11875/37963 [50:52:41<113:56:11, 15.72s/it]
 31%|███▏      | 11876/37963 [50:52:55<110:23:25, 15.23s/it]
 31%|███▏      | 11877/37963 [50:53:09<108:27:28, 14.97s/it]
 31%|███▏      | 11878/37963 [50:53:24<107:00:28, 14.77s/it]
 31%|███▏      | 11879/37963 [50:53:38<105:53:40, 14.62s/it]
 31%|███▏      | 11880/37963 [50:53:58<117:29:57, 16.22s/it]
                                                            
{'loss': '0.1596', 'grad_norm': '2.102', 'learning_rate': '1.609e-05', 'epoch': '0.3129'}

 31%|███▏      | 11880/37963 [50:53:58<117:29:57, 16.22s/it]
 31%|███▏      | 11881/37963 [50:54:19<128:12:29, 17.70s/it]
 31%|███▏      | 11882/37963 [50:54:33<120:45:36, 16.67s/it]
 31%|███▏      | 11883/37963 [50:54:48<115:16:39, 15.91s/it]
 31%|███▏      | 11884/37963 [50:55:02<112:04:35, 15.47s/it]
 31%|███▏      | 11885/37963 [50:55:16<109:34:51, 15.13s/it]
 31%|███▏      | 11886/37963 [50:55:31<108:10:26, 14.93s/it]
 31%|███▏      | 11887/37963 [50:55:45<106:52:05, 14.75s/it]
 31%|███▏      | 11888/37963 [50:55:59<105:55:36, 14.62s/it]
 31%|███▏      | 11889/37963 [50:56:14<105:23:51, 14.55s/it]
 31%|███▏      | 11890/37963 [50:56:28<105:11:27, 14.52s/it]
                                                            
{'loss': '0.1592', 'grad_norm': '3.885', 'learning_rate': '1.608e-05', 'epoch': '0.3132'}

 31%|███▏      | 11890/37963 [50:56:28<105:11:27, 14.52s/it]
 31%|███▏      | 11891/37963 [50:56:43<104:53:14, 14.48s/it]
 31%|███▏      | 11892/37963 [50:56:57<104:32:19, 14.44s/it]
 31%|███▏      | 11893/37963 [50:57:11<104:11:49, 14.39s/it]
 31%|███▏      | 11894/37963 [50:57:25<103:21:57, 14.27s/it]
 31%|███▏      | 11895/37963 [50:57:40<103:37:42, 14.31s/it]
 31%|███▏      | 11896/37963 [50:57:54<103:36:40, 14.31s/it]
 31%|███▏      | 11897/37963 [50:58:08<103:36:15, 14.31s/it]
 31%|███▏      | 11898/37963 [50:58:23<103:45:41, 14.33s/it]
 31%|███▏      | 11899/37963 [50:58:37<102:45:00, 14.19s/it]
 31%|███▏      | 11900/37963 [50:58:57<117:09:19, 16.18s/it]
                                                            
{'loss': '0.1425', 'grad_norm': '2.898', 'learning_rate': '1.607e-05', 'epoch': '0.3135'}

 31%|███▏      | 11900/37963 [50:58:57<117:09:19, 16.18s/it]
 31%|███▏      | 11901/37963 [50:59:12<112:54:44, 15.60s/it]
 31%|███▏      | 11902/37963 [50:59:26<110:01:13, 15.20s/it]
 31%|███▏      | 11903/37963 [50:59:40<106:59:54, 14.78s/it]
 31%|███▏      | 11904/37963 [50:59:53<104:42:59, 14.47s/it]
 31%|███▏      | 11905/37963 [51:00:08<104:04:14, 14.38s/it]
 31%|███▏      | 11906/37963 [51:00:22<104:01:55, 14.37s/it]
 31%|███▏      | 11907/37963 [51:00:36<104:01:22, 14.37s/it]
 31%|███▏      | 11908/37963 [51:00:51<104:21:01, 14.42s/it]
 31%|███▏      | 11909/37963 [51:01:12<118:14:33, 16.34s/it]
 31%|███▏      | 11910/37963 [51:01:25<112:08:37, 15.50s/it]
                                                            
{'loss': '0.1456', 'grad_norm': '1.256', 'learning_rate': '1.607e-05', 'epoch': '0.3137'}

 31%|███▏      | 11910/37963 [51:01:25<112:08:37, 15.50s/it]
 31%|███▏      | 11911/37963 [51:01:40<109:38:54, 15.15s/it]
 31%|███▏      | 11912/37963 [51:02:01<122:33:12, 16.94s/it]
 31%|███▏      | 11913/37963 [51:02:15<116:55:06, 16.16s/it]
 31%|███▏      | 11914/37963 [51:02:35<125:52:35, 17.40s/it]
 31%|███▏      | 11915/37963 [51:02:49<117:42:02, 16.27s/it]
 31%|███▏      | 11916/37963 [51:03:03<112:15:30, 15.52s/it]
 31%|███▏      | 11917/37963 [51:03:17<109:46:21, 15.17s/it]
 31%|███▏      | 11918/37963 [51:03:38<122:33:00, 16.94s/it]
 31%|███▏      | 11919/37963 [51:03:52<116:50:39, 16.15s/it]
 31%|███▏      | 11920/37963 [51:04:13<125:41:05, 17.37s/it]
                                                            
{'loss': '0.1593', 'grad_norm': '0.9297', 'learning_rate': '1.606e-05', 'epoch': '0.314'}

 31%|███▏      | 11920/37963 [51:04:13<125:41:05, 17.37s/it]
 31%|███▏      | 11921/37963 [51:04:27<119:11:01, 16.48s/it]
 31%|███▏      | 11922/37963 [51:04:41<113:56:27, 15.75s/it]
 31%|███▏      | 11923/37963 [51:04:55<110:31:04, 15.28s/it]
 31%|███▏      | 11924/37963 [51:05:10<108:41:30, 15.03s/it]
 31%|███▏      | 11925/37963 [51:05:24<107:15:20, 14.83s/it]
 31%|███▏      | 11926/37963 [51:05:38<106:11:42, 14.68s/it]
 31%|███▏      | 11927/37963 [51:05:53<105:28:12, 14.58s/it]
 31%|███▏      | 11928/37963 [51:06:06<103:23:50, 14.30s/it]
 31%|███▏      | 11929/37963 [51:06:34<131:40:57, 18.21s/it]
 31%|███▏      | 11930/37963 [51:06:48<123:09:40, 17.03s/it]
                                                            
{'loss': '0.1555', 'grad_norm': '3.035', 'learning_rate': '1.605e-05', 'epoch': '0.3143'}

 31%|███▏      | 11930/37963 [51:06:48<123:09:40, 17.03s/it]
 31%|███▏      | 11931/37963 [51:07:02<117:30:26, 16.25s/it]
 31%|███▏      | 11932/37963 [51:07:17<113:31:09, 15.70s/it]
 31%|███▏      | 11933/37963 [51:07:31<109:01:51, 15.08s/it]
 31%|███▏      | 11934/37963 [51:07:45<107:47:11, 14.91s/it]
 31%|███▏      | 11935/37963 [51:07:59<106:05:19, 14.67s/it]
 31%|███▏      | 11936/37963 [51:08:14<105:27:55, 14.59s/it]
 31%|███▏      | 11937/37963 [51:08:28<104:27:12, 14.45s/it]
 31%|███▏      | 11938/37963 [51:08:41<102:26:26, 14.17s/it]
 31%|███▏      | 11939/37963 [51:08:55<101:42:25, 14.07s/it]
 31%|███▏      | 11940/37963 [51:09:09<102:24:57, 14.17s/it]
                                                            
{'loss': '0.1555', 'grad_norm': '2.328', 'learning_rate': '1.605e-05', 'epoch': '0.3145'}

 31%|███▏      | 11940/37963 [51:09:09<102:24:57, 14.17s/it]
 31%|███▏      | 11941/37963 [51:09:24<102:49:33, 14.23s/it]
 31%|███▏      | 11942/37963 [51:09:38<103:06:19, 14.26s/it]
 31%|███▏      | 11943/37963 [51:09:52<102:59:29, 14.25s/it]
 31%|███▏      | 11944/37963 [51:10:07<102:52:11, 14.23s/it]
 31%|███▏      | 11945/37963 [51:10:21<103:14:10, 14.28s/it]
 31%|███▏      | 11946/37963 [51:10:35<101:59:12, 14.11s/it]
 31%|███▏      | 11947/37963 [51:10:49<102:33:55, 14.19s/it]
 31%|███▏      | 11948/37963 [51:11:10<118:12:59, 16.36s/it]
 31%|███▏      | 11949/37963 [51:11:25<113:15:10, 15.67s/it]
 31%|███▏      | 11950/37963 [51:11:39<110:30:59, 15.29s/it]
                                                            
{'loss': '0.1658', 'grad_norm': '1.662', 'learning_rate': '1.604e-05', 'epoch': '0.3148'}

 31%|███▏      | 11950/37963 [51:11:39<110:30:59, 15.29s/it]
 31%|███▏      | 11951/37963 [51:11:53<108:34:43, 15.03s/it]
 31%|███▏      | 11952/37963 [51:12:07<106:21:05, 14.72s/it]
 31%|███▏      | 11953/37963 [51:12:22<105:28:05, 14.60s/it]
 31%|███▏      | 11954/37963 [51:12:36<105:40:12, 14.63s/it]
 31%|███▏      | 11955/37963 [51:12:51<105:16:25, 14.57s/it]
 31%|███▏      | 11956/37963 [51:13:05<104:50:30, 14.51s/it]
 31%|███▏      | 11957/37963 [51:13:20<104:34:51, 14.48s/it]
 31%|███▏      | 11958/37963 [51:13:40<117:21:44, 16.25s/it]
 32%|███▏      | 11959/37963 [51:14:01<127:58:33, 17.72s/it]
 32%|███▏      | 11960/37963 [51:14:15<119:51:12, 16.59s/it]
                                                            
{'loss': '0.1501', 'grad_norm': '2.64', 'learning_rate': '1.603e-05', 'epoch': '0.315'}

 32%|███▏      | 11960/37963 [51:14:15<119:51:12, 16.59s/it]
 32%|███▏      | 11961/37963 [51:14:29<115:08:04, 15.94s/it]
 32%|███▏      | 11962/37963 [51:14:44<111:36:34, 15.45s/it]
 32%|███▏      | 11963/37963 [51:14:58<109:09:10, 15.11s/it]
 32%|███▏      | 11964/37963 [51:15:18<119:07:18, 16.49s/it]
 32%|███▏      | 11965/37963 [51:15:32<113:41:58, 15.74s/it]
 32%|███▏      | 11966/37963 [51:15:46<110:39:49, 15.32s/it]
 32%|███▏      | 11967/37963 [51:16:08<123:46:25, 17.14s/it]
 32%|███▏      | 11968/37963 [51:16:22<117:49:48, 16.32s/it]
 32%|███▏      | 11969/37963 [51:16:42<126:11:45, 17.48s/it]
 32%|███▏      | 11970/37963 [51:16:57<119:47:25, 16.59s/it]
                                                            
{'loss': '0.1646', 'grad_norm': '1.435', 'learning_rate': '1.603e-05', 'epoch': '0.3153'}

 32%|███▏      | 11970/37963 [51:16:57<119:47:25, 16.59s/it]
 32%|███▏      | 11971/37963 [51:17:11<114:37:27, 15.88s/it]
 32%|███▏      | 11972/37963 [51:17:25<110:38:44, 15.33s/it]
 32%|███▏      | 11973/37963 [51:17:39<108:29:28, 15.03s/it]
 32%|███▏      | 11974/37963 [51:17:54<106:56:47, 14.81s/it]
 32%|███▏      | 11975/37963 [51:18:08<105:49:14, 14.66s/it]
 32%|███▏      | 11976/37963 [51:18:22<104:09:54, 14.43s/it]
 32%|███▏      | 11977/37963 [51:18:43<119:08:10, 16.50s/it]
 32%|███▏      | 11978/37963 [51:18:57<114:27:25, 15.86s/it]
 32%|███▏      | 11979/37963 [51:19:18<124:13:53, 17.21s/it]
 32%|███▏      | 11980/37963 [51:19:32<117:27:39, 16.27s/it]
                                                            
{'loss': '0.158', 'grad_norm': '2.275', 'learning_rate': '1.602e-05', 'epoch': '0.3156'}

 32%|███▏      | 11980/37963 [51:19:32<117:27:39, 16.27s/it]
 32%|███▏      | 11981/37963 [51:19:46<113:11:47, 15.68s/it]
 32%|███▏      | 11982/37963 [51:20:01<110:22:06, 15.29s/it]
 32%|███▏      | 11983/37963 [51:20:15<108:11:15, 14.99s/it]
 32%|███▏      | 11984/37963 [51:20:29<106:57:46, 14.82s/it]
 32%|███▏      | 11985/37963 [51:20:44<106:12:59, 14.72s/it]
 32%|███▏      | 11986/37963 [51:20:58<105:23:23, 14.61s/it]
 32%|███▏      | 11987/37963 [51:21:12<103:59:47, 14.41s/it]
 32%|███▏      | 11988/37963 [51:21:26<103:53:45, 14.40s/it]
 32%|███▏      | 11989/37963 [51:21:41<103:46:46, 14.38s/it]
 32%|███▏      | 11990/37963 [51:21:55<103:46:00, 14.38s/it]
                                                            
{'loss': '0.1582', 'grad_norm': '2.389', 'learning_rate': '1.601e-05', 'epoch': '0.3158'}

 32%|███▏      | 11990/37963 [51:21:55<103:46:00, 14.38s/it]
 32%|███▏      | 11991/37963 [51:22:09<103:14:46, 14.31s/it]
 32%|███▏      | 11992/37963 [51:22:24<103:20:17, 14.32s/it]
 32%|███▏      | 11993/37963 [51:22:38<103:19:36, 14.32s/it]
 32%|███▏      | 11994/37963 [51:22:52<103:20:35, 14.33s/it]
 32%|███▏      | 11995/37963 [51:23:06<102:26:05, 14.20s/it]
 32%|███▏      | 11996/37963 [51:23:21<103:05:38, 14.29s/it]
 32%|███▏      | 11997/37963 [51:23:41<115:58:22, 16.08s/it]
 32%|███▏      | 11998/37963 [51:23:55<111:00:25, 15.39s/it]
 32%|███▏      | 11999/37963 [51:24:09<108:52:33, 15.10s/it]
 32%|███▏      | 12000/37963 [51:24:23<106:53:20, 14.82s/it]
                                                            
{'loss': '0.1636', 'grad_norm': '1.8', 'learning_rate': '1.601e-05', 'epoch': '0.3161'}

 32%|███▏      | 12000/37963 [51:24:23<106:53:20, 14.82s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.13s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.14s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 32%|███▏      | 12001/37963 [51:26:08<301:47:18, 41.85s/it]
 32%|███▏      | 12002/37963 [51:26:23<242:23:46, 33.61s/it]
 32%|███▏      | 12003/37963 [51:26:37<199:50:12, 27.71s/it]
 32%|███▏      | 12004/37963 [51:26:51<170:07:12, 23.59s/it]
 32%|███▏      | 12005/37963 [51:27:05<149:16:03, 20.70s/it]
 32%|███▏      | 12006/37963 [51:27:26<149:56:29, 20.80s/it]
 32%|███▏      | 12007/37963 [51:27:40<136:13:21, 18.89s/it]
 32%|███▏      | 12008/37963 [51:28:02<142:45:59, 19.80s/it]
 32%|███▏      | 12009/37963 [51:28:16<131:04:56, 18.18s/it]
 32%|███▏      | 12010/37963 [51:28:31<122:53:43, 17.05s/it]
                                                            
{'loss': '0.1622', 'grad_norm': '1.304', 'learning_rate': '1.6e-05', 'epoch': '0.3164'}

 32%|███▏      | 12010/37963 [51:28:31<122:53:43, 17.05s/it]
 32%|███▏      | 12011/37963 [51:28:45<117:25:24, 16.29s/it]
 32%|███▏      | 12012/37963 [51:28:59<112:57:10, 15.67s/it]
 32%|███▏      | 12013/37963 [51:29:21<125:31:23, 17.41s/it]
 32%|███▏      | 12014/37963 [51:29:42<134:06:30, 18.61s/it]
 32%|███▏      | 12015/37963 [51:29:56<124:07:26, 17.22s/it]
 32%|███▏      | 12016/37963 [51:30:11<117:43:16, 16.33s/it]
 32%|███▏      | 12017/37963 [51:30:31<127:13:54, 17.65s/it]
 32%|███▏      | 12018/37963 [51:30:46<120:18:18, 16.69s/it]
 32%|███▏      | 12019/37963 [51:31:00<115:14:12, 15.99s/it]
 32%|███▏      | 12020/37963 [51:31:15<112:01:47, 15.55s/it]
                                                            
{'loss': '0.1622', 'grad_norm': '2.334', 'learning_rate': '1.599e-05', 'epoch': '0.3166'}

 32%|███▏      | 12020/37963 [51:31:15<112:01:47, 15.55s/it]
 32%|███▏      | 12021/37963 [51:31:29<109:24:37, 15.18s/it]
 32%|███▏      | 12022/37963 [51:31:43<106:23:09, 14.76s/it]
 32%|███▏      | 12023/37963 [51:31:57<105:23:43, 14.63s/it]
 32%|███▏      | 12024/37963 [51:32:11<104:14:59, 14.47s/it]
 32%|███▏      | 12025/37963 [51:32:32<117:09:19, 16.26s/it]
 32%|███▏      | 12026/37963 [51:32:46<112:13:50, 15.58s/it]
 32%|███▏      | 12027/37963 [51:32:59<108:02:58, 15.00s/it]
 32%|███▏      | 12028/37963 [51:33:14<106:29:35, 14.78s/it]
 32%|███▏      | 12029/37963 [51:33:28<105:34:37, 14.66s/it]
 32%|███▏      | 12030/37963 [51:33:42<103:57:28, 14.43s/it]
                                                            
{'loss': '0.1477', 'grad_norm': '1.267', 'learning_rate': '1.599e-05', 'epoch': '0.3169'}

 32%|███▏      | 12030/37963 [51:33:42<103:57:28, 14.43s/it]
 32%|███▏      | 12031/37963 [51:34:03<118:14:00, 16.41s/it]
 32%|███▏      | 12032/37963 [51:34:17<113:51:58, 15.81s/it]
 32%|███▏      | 12033/37963 [51:34:32<111:07:39, 15.43s/it]
 32%|███▏      | 12034/37963 [51:34:46<108:49:33, 15.11s/it]
 32%|███▏      | 12035/37963 [51:35:01<107:18:58, 14.90s/it]
 32%|███▏      | 12036/37963 [51:35:15<106:00:54, 14.72s/it]
 32%|███▏      | 12037/37963 [51:35:28<103:37:33, 14.39s/it]
 32%|███▏      | 12038/37963 [51:35:43<103:07:36, 14.32s/it]
 32%|███▏      | 12039/37963 [51:35:57<102:34:20, 14.24s/it]
 32%|███▏      | 12040/37963 [51:36:11<102:49:13, 14.28s/it]
                                                            
{'loss': '0.1671', 'grad_norm': '2.41', 'learning_rate': '1.598e-05', 'epoch': '0.3172'}

 32%|███▏      | 12040/37963 [51:36:11<102:49:13, 14.28s/it]
 32%|███▏      | 12041/37963 [51:36:25<103:07:07, 14.32s/it]
 32%|███▏      | 12042/37963 [51:36:40<103:35:06, 14.39s/it]
 32%|███▏      | 12043/37963 [51:36:54<103:24:22, 14.36s/it]
 32%|███▏      | 12044/37963 [51:37:09<103:34:21, 14.39s/it]
 32%|███▏      | 12045/37963 [51:37:23<103:41:34, 14.40s/it]
 32%|███▏      | 12046/37963 [51:37:38<103:33:07, 14.38s/it]
 32%|███▏      | 12047/37963 [51:37:58<117:21:23, 16.30s/it]
 32%|███▏      | 12048/37963 [51:38:13<113:04:49, 15.71s/it]
 32%|███▏      | 12049/37963 [51:38:27<109:57:01, 15.27s/it]
 32%|███▏      | 12050/37963 [51:38:41<108:00:49, 15.01s/it]
                                                            
{'loss': '0.1633', 'grad_norm': '2.065', 'learning_rate': '1.597e-05', 'epoch': '0.3174'}

 32%|███▏      | 12050/37963 [51:38:41<108:00:49, 15.01s/it]
 32%|███▏      | 12051/37963 [51:38:55<105:52:51, 14.71s/it]
 32%|███▏      | 12052/37963 [51:39:09<104:37:01, 14.54s/it]
 32%|███▏      | 12053/37963 [51:39:30<118:17:41, 16.44s/it]
 32%|███▏      | 12054/37963 [51:39:45<113:53:06, 15.82s/it]
 32%|███▏      | 12055/37963 [51:39:59<110:46:37, 15.39s/it]
 32%|███▏      | 12056/37963 [51:40:13<108:29:27, 15.08s/it]
 32%|███▏      | 12057/37963 [51:40:27<105:09:18, 14.61s/it]
 32%|███▏      | 12058/37963 [51:40:48<120:00:22, 16.68s/it]
 32%|███▏      | 12059/37963 [51:41:09<127:44:48, 17.75s/it]
 32%|███▏      | 12060/37963 [51:41:23<120:23:20, 16.73s/it]
                                                            
{'loss': '0.1549', 'grad_norm': '2.302', 'learning_rate': '1.597e-05', 'epoch': '0.3177'}

 32%|███▏      | 12060/37963 [51:41:23<120:23:20, 16.73s/it]
 32%|███▏      | 12061/37963 [51:41:37<114:31:27, 15.92s/it]
 32%|███▏      | 12062/37963 [51:41:51<111:19:12, 15.47s/it]
 32%|███▏      | 12063/37963 [51:42:12<121:47:30, 16.93s/it]
 32%|███▏      | 12064/37963 [51:42:26<116:24:12, 16.18s/it]
 32%|███▏      | 12065/37963 [51:42:41<112:19:24, 15.61s/it]
 32%|███▏      | 12066/37963 [51:43:01<123:21:32, 17.15s/it]
 32%|███▏      | 12067/37963 [51:43:16<117:25:51, 16.32s/it]
 32%|███▏      | 12068/37963 [51:43:30<112:59:52, 15.71s/it]
 32%|███▏      | 12069/37963 [51:43:44<110:00:19, 15.29s/it]
 32%|███▏      | 12070/37963 [51:43:59<107:59:36, 15.01s/it]
                                                            
{'loss': '0.1563', 'grad_norm': '1.684', 'learning_rate': '1.596e-05', 'epoch': '0.3179'}

 32%|███▏      | 12070/37963 [51:43:59<107:59:36, 15.01s/it]
 32%|███▏      | 12071/37963 [51:44:13<106:29:21, 14.81s/it]
 32%|███▏      | 12072/37963 [51:44:27<105:29:01, 14.67s/it]
 32%|███▏      | 12073/37963 [51:44:48<119:07:25, 16.56s/it]
 32%|███▏      | 12074/37963 [51:45:03<114:40:35, 15.95s/it]
 32%|███▏      | 12075/37963 [51:45:17<111:18:08, 15.48s/it]
 32%|███▏      | 12076/37963 [51:45:31<107:22:57, 14.93s/it]
 32%|███▏      | 12077/37963 [51:45:45<106:24:16, 14.80s/it]
 32%|███▏      | 12078/37963 [51:46:06<118:45:00, 16.52s/it]
 32%|███▏      | 12079/37963 [51:46:20<114:17:39, 15.90s/it]
 32%|███▏      | 12080/37963 [51:46:34<110:36:23, 15.38s/it]
                                                            
{'loss': '0.1572', 'grad_norm': '1.61', 'learning_rate': '1.595e-05', 'epoch': '0.3182'}

 32%|███▏      | 12080/37963 [51:46:34<110:36:23, 15.38s/it]
 32%|███▏      | 12081/37963 [51:46:49<108:28:04, 15.09s/it]
 32%|███▏      | 12082/37963 [51:47:03<106:08:58, 14.77s/it]
 32%|███▏      | 12083/37963 [51:47:17<105:30:32, 14.68s/it]
 32%|███▏      | 12084/37963 [51:47:32<104:38:01, 14.56s/it]
 32%|███▏      | 12085/37963 [51:47:46<103:26:34, 14.39s/it]
 32%|███▏      | 12086/37963 [51:48:00<102:29:07, 14.26s/it]
 32%|███▏      | 12087/37963 [51:48:14<102:39:20, 14.28s/it]
 32%|███▏      | 12088/37963 [51:48:28<103:03:22, 14.34s/it]
 32%|███▏      | 12089/37963 [51:48:43<102:56:08, 14.32s/it]
 32%|███▏      | 12090/37963 [51:48:57<102:53:59, 14.32s/it]
                                                            
{'loss': '0.1625', 'grad_norm': '3.961', 'learning_rate': '1.594e-05', 'epoch': '0.3185'}

 32%|███▏      | 12090/37963 [51:48:57<102:53:59, 14.32s/it]
 32%|███▏      | 12091/37963 [51:49:11<101:53:35, 14.18s/it]
 32%|███▏      | 12092/37963 [51:49:25<102:19:29, 14.24s/it]
 32%|███▏      | 12093/37963 [51:49:40<103:04:13, 14.34s/it]
 32%|███▏      | 12094/37963 [51:50:00<115:28:30, 16.07s/it]
 32%|███▏      | 12095/37963 [51:50:14<111:55:12, 15.58s/it]
 32%|███▏      | 12096/37963 [51:50:29<109:22:01, 15.22s/it]
 32%|███▏      | 12097/37963 [51:50:43<107:01:14, 14.90s/it]
 32%|███▏      | 12098/37963 [51:50:57<106:00:40, 14.76s/it]
 32%|███▏      | 12099/37963 [51:51:11<104:47:54, 14.59s/it]
 32%|███▏      | 12100/37963 [51:51:26<104:18:02, 14.52s/it]
                                                            
{'loss': '0.1557', 'grad_norm': '0.9142', 'learning_rate': '1.594e-05', 'epoch': '0.3187'}

 32%|███▏      | 12100/37963 [51:51:26<104:18:02, 14.52s/it]
 32%|███▏      | 12101/37963 [51:51:40<104:03:47, 14.49s/it]
 32%|███▏      | 12102/37963 [51:51:55<104:09:45, 14.50s/it]
 32%|███▏      | 12103/37963 [51:52:09<104:06:10, 14.49s/it]
 32%|███▏      | 12104/37963 [51:52:24<104:17:40, 14.52s/it]
 32%|███▏      | 12105/37963 [51:52:45<118:11:03, 16.45s/it]
 32%|███▏      | 12106/37963 [51:52:59<113:49:31, 15.85s/it]
 32%|███▏      | 12107/37963 [51:53:26<138:01:04, 19.22s/it]
 32%|███▏      | 12108/37963 [51:53:41<127:31:03, 17.76s/it]
 32%|███▏      | 12109/37963 [51:53:55<119:41:23, 16.67s/it]
 32%|███▏      | 12110/37963 [51:54:09<114:42:45, 15.97s/it]
                                                            
{'loss': '0.1547', 'grad_norm': '1.337', 'learning_rate': '1.593e-05', 'epoch': '0.319'}

 32%|███▏      | 12110/37963 [51:54:09<114:42:45, 15.97s/it]
 32%|███▏      | 12111/37963 [51:54:24<111:24:49, 15.51s/it]
 32%|███▏      | 12112/37963 [51:54:44<122:39:19, 17.08s/it]
 32%|███▏      | 12113/37963 [51:54:59<116:42:35, 16.25s/it]
 32%|███▏      | 12114/37963 [51:55:13<111:53:31, 15.58s/it]
 32%|███▏      | 12115/37963 [51:55:34<124:25:36, 17.33s/it]
 32%|███▏      | 12116/37963 [51:55:48<117:55:21, 16.42s/it]
 32%|███▏      | 12117/37963 [51:56:02<112:16:41, 15.64s/it]
 32%|███▏      | 12118/37963 [51:56:17<109:28:34, 15.25s/it]
 32%|███▏      | 12119/37963 [51:56:31<107:07:03, 14.92s/it]
 32%|███▏      | 12120/37963 [51:56:45<105:31:20, 14.70s/it]
                                                            
{'loss': '0.1517', 'grad_norm': '1.293', 'learning_rate': '1.592e-05', 'epoch': '0.3193'}

 32%|███▏      | 12120/37963 [51:56:45<105:31:20, 14.70s/it]
 32%|███▏      | 12121/37963 [51:57:06<119:29:35, 16.65s/it]
 32%|███▏      | 12122/37963 [51:57:20<114:30:33, 15.95s/it]
 32%|███▏      | 12123/37963 [51:57:35<111:09:16, 15.49s/it]
 32%|███▏      | 12124/37963 [51:57:49<108:50:11, 15.16s/it]
 32%|███▏      | 12125/37963 [51:58:04<107:04:46, 14.92s/it]
 32%|███▏      | 12126/37963 [51:58:18<105:46:34, 14.74s/it]
 32%|███▏      | 12127/37963 [51:58:39<118:49:36, 16.56s/it]
 32%|███▏      | 12128/37963 [51:58:53<114:01:57, 15.89s/it]
 32%|███▏      | 12129/37963 [51:59:07<110:15:09, 15.36s/it]
 32%|███▏      | 12130/37963 [51:59:21<107:39:39, 15.00s/it]
                                                            
{'loss': '0.1692', 'grad_norm': '1.757', 'learning_rate': '1.592e-05', 'epoch': '0.3195'}

 32%|███▏      | 12130/37963 [51:59:21<107:39:39, 15.00s/it]
 32%|███▏      | 12131/37963 [51:59:36<106:31:38, 14.85s/it]
 32%|███▏      | 12132/37963 [51:59:50<105:16:54, 14.67s/it]
 32%|███▏      | 12133/37963 [52:00:04<104:31:11, 14.57s/it]
 32%|███▏      | 12134/37963 [52:00:19<104:05:16, 14.51s/it]
 32%|███▏      | 12135/37963 [52:00:33<103:54:07, 14.48s/it]
 32%|███▏      | 12136/37963 [52:00:48<103:53:52, 14.48s/it]
 32%|███▏      | 12137/37963 [52:01:01<101:36:44, 14.16s/it]
 32%|███▏      | 12138/37963 [52:01:15<101:56:14, 14.21s/it]
 32%|███▏      | 12139/37963 [52:01:30<102:17:15, 14.26s/it]
 32%|███▏      | 12140/37963 [52:01:44<102:35:08, 14.30s/it]
                                                            
{'loss': '0.1561', 'grad_norm': '0.737', 'learning_rate': '1.591e-05', 'epoch': '0.3198'}

 32%|███▏      | 12140/37963 [52:01:44<102:35:08, 14.30s/it]
 32%|███▏      | 12141/37963 [52:01:59<102:44:52, 14.32s/it]
 32%|███▏      | 12142/37963 [52:02:13<102:51:13, 14.34s/it]
 32%|███▏      | 12143/37963 [52:02:33<115:27:10, 16.10s/it]
 32%|███▏      | 12144/37963 [52:02:47<111:36:37, 15.56s/it]
 32%|███▏      | 12145/37963 [52:03:01<107:53:02, 15.04s/it]
 32%|███▏      | 12146/37963 [52:03:16<106:14:02, 14.81s/it]
 32%|███▏      | 12147/37963 [52:03:30<105:08:13, 14.66s/it]
 32%|███▏      | 12148/37963 [52:03:44<104:00:00, 14.50s/it]
 32%|███▏      | 12149/37963 [52:03:58<103:51:42, 14.48s/it]
 32%|███▏      | 12150/37963 [52:04:13<103:33:22, 14.44s/it]
                                                            
{'loss': '0.1601', 'grad_norm': '3.459', 'learning_rate': '1.59e-05', 'epoch': '0.32'}

 32%|███▏      | 12150/37963 [52:04:13<103:33:22, 14.44s/it]
 32%|███▏      | 12151/37963 [52:04:27<102:04:25, 14.24s/it]
 32%|███▏      | 12152/37963 [52:04:48<116:49:19, 16.29s/it]
 32%|███▏      | 12153/37963 [52:05:02<112:55:49, 15.75s/it]
 32%|███▏      | 12154/37963 [52:05:23<123:25:38, 17.22s/it]
 32%|███▏      | 12155/37963 [52:05:37<117:13:28, 16.35s/it]
 32%|███▏      | 12156/37963 [52:05:51<111:34:03, 15.56s/it]
 32%|███▏      | 12157/37963 [52:06:05<108:49:14, 15.18s/it]
 32%|███▏      | 12158/37963 [52:06:26<120:50:12, 16.86s/it]
 32%|███▏      | 12159/37963 [52:06:40<115:34:00, 16.12s/it]
 32%|███▏      | 12160/37963 [52:06:55<111:53:46, 15.61s/it]
                                                            
{'loss': '0.1565', 'grad_norm': '1.949', 'learning_rate': '1.59e-05', 'epoch': '0.3203'}

 32%|███▏      | 12160/37963 [52:06:55<111:53:46, 15.61s/it]
 32%|███▏      | 12161/37963 [52:07:16<123:35:20, 17.24s/it]
 32%|███▏      | 12162/37963 [52:07:30<117:39:07, 16.42s/it]
 32%|███▏      | 12163/37963 [52:07:51<127:15:53, 17.76s/it]
 32%|███▏      | 12164/37963 [52:08:05<119:12:19, 16.63s/it]
 32%|███▏      | 12165/37963 [52:08:19<114:05:35, 15.92s/it]
 32%|███▏      | 12166/37963 [52:08:34<110:30:59, 15.42s/it]
 32%|███▏      | 12167/37963 [52:08:48<108:26:41, 15.13s/it]
 32%|███▏      | 12168/37963 [52:09:02<106:40:02, 14.89s/it]
 32%|███▏      | 12169/37963 [52:09:17<105:18:59, 14.70s/it]
 32%|███▏      | 12170/37963 [52:09:38<119:11:09, 16.64s/it]
                                                            
{'loss': '0.1638', 'grad_norm': '2.541', 'learning_rate': '1.589e-05', 'epoch': '0.3206'}

 32%|███▏      | 12170/37963 [52:09:38<119:11:09, 16.64s/it]
 32%|███▏      | 12171/37963 [52:09:52<114:05:48, 15.93s/it]
 32%|███▏      | 12172/37963 [52:10:07<110:53:18, 15.48s/it]
 32%|███▏      | 12173/37963 [52:10:21<108:26:25, 15.14s/it]
 32%|███▏      | 12174/37963 [52:10:35<106:44:17, 14.90s/it]
 32%|███▏      | 12175/37963 [52:10:55<118:18:20, 16.52s/it]
 32%|███▏      | 12176/37963 [52:11:10<113:41:09, 15.87s/it]
 32%|███▏      | 12177/37963 [52:11:24<110:24:18, 15.41s/it]
 32%|███▏      | 12178/37963 [52:11:38<108:00:20, 15.08s/it]
 32%|███▏      | 12179/37963 [52:11:53<105:55:19, 14.79s/it]
 32%|███▏      | 12180/37963 [52:12:07<104:19:03, 14.57s/it]
                                                            
{'loss': '0.1614', 'grad_norm': '5.778', 'learning_rate': '1.588e-05', 'epoch': '0.3208'}

 32%|███▏      | 12180/37963 [52:12:07<104:19:03, 14.57s/it]
 32%|███▏      | 12181/37963 [52:12:21<103:04:32, 14.39s/it]
 32%|███▏      | 12182/37963 [52:12:35<102:47:21, 14.35s/it]
 32%|███▏      | 12183/37963 [52:12:49<101:18:39, 14.15s/it]
 32%|███▏      | 12184/37963 [52:13:03<101:50:06, 14.22s/it]
 32%|███▏      | 12185/37963 [52:13:17<102:00:13, 14.25s/it]
 32%|███▏      | 12186/37963 [52:13:32<102:28:28, 14.31s/it]
 32%|███▏      | 12187/37963 [52:13:46<102:32:34, 14.32s/it]
 32%|███▏      | 12188/37963 [52:14:01<103:01:11, 14.39s/it]
 32%|███▏      | 12189/37963 [52:14:14<101:52:00, 14.23s/it]
 32%|███▏      | 12190/37963 [52:14:29<101:46:19, 14.22s/it]
                                                            
{'loss': '0.1604', 'grad_norm': '0.8029', 'learning_rate': '1.588e-05', 'epoch': '0.3211'}

 32%|███▏      | 12190/37963 [52:14:29<101:46:19, 14.22s/it]
 32%|███▏      | 12191/37963 [52:14:43<102:05:09, 14.26s/it]
 32%|███▏      | 12192/37963 [52:14:57<102:14:28, 14.28s/it]
 32%|███▏      | 12193/37963 [52:15:18<115:49:38, 16.18s/it]
 32%|███▏      | 12194/37963 [52:15:32<111:20:57, 15.56s/it]
 32%|███▏      | 12195/37963 [52:15:47<109:00:15, 15.23s/it]
 32%|███▏      | 12196/37963 [52:16:01<106:32:29, 14.89s/it]
 32%|███▏      | 12197/37963 [52:16:15<105:35:13, 14.75s/it]
 32%|███▏      | 12198/37963 [52:16:29<104:15:59, 14.57s/it]
 32%|███▏      | 12199/37963 [52:16:44<103:57:18, 14.53s/it]
 32%|███▏      | 12200/37963 [52:16:58<103:35:21, 14.48s/it]
                                                            
{'loss': '0.1637', 'grad_norm': '1.031', 'learning_rate': '1.587e-05', 'epoch': '0.3214'}

 32%|███▏      | 12200/37963 [52:16:58<103:35:21, 14.48s/it]
 32%|███▏      | 12201/37963 [52:17:19<118:16:59, 16.53s/it]
 32%|███▏      | 12202/37963 [52:17:40<127:35:41, 17.83s/it]
 32%|███▏      | 12203/37963 [52:17:54<119:21:16, 16.68s/it]
 32%|███▏      | 12204/37963 [52:18:09<114:20:45, 15.98s/it]
 32%|███▏      | 12205/37963 [52:18:23<110:48:52, 15.49s/it]
 32%|███▏      | 12206/37963 [52:18:37<107:50:54, 15.07s/it]
 32%|███▏      | 12207/37963 [52:18:58<120:32:02, 16.85s/it]
 32%|███▏      | 12208/37963 [52:19:12<115:07:41, 16.09s/it]
 32%|███▏      | 12209/37963 [52:19:33<125:18:10, 17.52s/it]
 32%|███▏      | 12210/37963 [52:19:48<118:41:09, 16.59s/it]
                                                            
{'loss': '0.1438', 'grad_norm': '2.606', 'learning_rate': '1.586e-05', 'epoch': '0.3216'}

 32%|███▏      | 12210/37963 [52:19:48<118:41:09, 16.59s/it]
 32%|███▏      | 12211/37963 [52:20:02<113:51:47, 15.92s/it]
 32%|███▏      | 12212/37963 [52:20:16<110:34:04, 15.46s/it]
 32%|███▏      | 12213/37963 [52:20:38<123:11:55, 17.22s/it]
 32%|███▏      | 12214/37963 [52:20:52<117:00:31, 16.36s/it]
 32%|███▏      | 12215/37963 [52:21:06<112:14:34, 15.69s/it]
 32%|███▏      | 12216/37963 [52:21:20<108:57:47, 15.24s/it]
 32%|███▏      | 12217/37963 [52:21:35<107:05:05, 14.97s/it]
 32%|███▏      | 12218/37963 [52:21:56<120:39:07, 16.87s/it]
 32%|███▏      | 12219/37963 [52:22:10<114:53:35, 16.07s/it]
 32%|███▏      | 12220/37963 [52:22:24<110:15:45, 15.42s/it]
                                                            
{'loss': '0.1742', 'grad_norm': '1.733', 'learning_rate': '1.586e-05', 'epoch': '0.3219'}

 32%|███▏      | 12220/37963 [52:22:24<110:15:45, 15.42s/it]
 32%|███▏      | 12221/37963 [52:22:38<108:08:36, 15.12s/it]
 32%|███▏      | 12222/37963 [52:22:53<106:20:15, 14.87s/it]
 32%|███▏      | 12223/37963 [52:23:07<105:16:53, 14.72s/it]
 32%|███▏      | 12224/37963 [52:23:28<118:11:06, 16.53s/it]
 32%|███▏      | 12225/37963 [52:23:42<113:26:49, 15.87s/it]
 32%|███▏      | 12226/37963 [52:23:57<110:16:12, 15.42s/it]
 32%|███▏      | 12227/37963 [52:24:10<106:43:57, 14.93s/it]
 32%|███▏      | 12228/37963 [52:24:25<105:30:43, 14.76s/it]
 32%|███▏      | 12229/37963 [52:24:38<103:20:10, 14.46s/it]
 32%|███▏      | 12230/37963 [52:24:53<103:02:43, 14.42s/it]
                                                            
{'loss': '0.1389', 'grad_norm': '0.8338', 'learning_rate': '1.585e-05', 'epoch': '0.3222'}

 32%|███▏      | 12230/37963 [52:24:53<103:02:43, 14.42s/it]
 32%|███▏      | 12231/37963 [52:25:07<101:35:43, 14.21s/it]
 32%|███▏      | 12232/37963 [52:25:21<102:03:20, 14.28s/it]
 32%|███▏      | 12233/37963 [52:25:36<102:43:57, 14.37s/it]
 32%|███▏      | 12234/37963 [52:25:50<102:59:59, 14.41s/it]
 32%|███▏      | 12235/37963 [52:26:04<102:49:32, 14.39s/it]
 32%|███▏      | 12236/37963 [52:26:19<103:01:02, 14.42s/it]
 32%|███▏      | 12237/37963 [52:26:33<103:11:42, 14.44s/it]
 32%|███▏      | 12238/37963 [52:26:48<103:08:25, 14.43s/it]
 32%|███▏      | 12239/37963 [52:27:02<102:48:55, 14.39s/it]
 32%|███▏      | 12240/37963 [52:27:17<103:05:25, 14.43s/it]
                                                            
{'loss': '0.1557', 'grad_norm': '4.72', 'learning_rate': '1.584e-05', 'epoch': '0.3224'}

 32%|███▏      | 12240/37963 [52:27:17<103:05:25, 14.43s/it]
 32%|███▏      | 12241/37963 [52:27:37<115:43:18, 16.20s/it]
 32%|███▏      | 12242/37963 [52:27:51<112:03:19, 15.68s/it]
 32%|███▏      | 12243/37963 [52:28:05<108:13:46, 15.15s/it]
 32%|███▏      | 12244/37963 [52:28:20<106:11:48, 14.86s/it]
 32%|███▏      | 12245/37963 [52:28:34<105:01:36, 14.70s/it]
 32%|███▏      | 12246/37963 [52:28:48<103:52:27, 14.54s/it]
 32%|███▏      | 12247/37963 [52:29:02<101:54:17, 14.27s/it]
 32%|███▏      | 12248/37963 [52:29:16<102:08:45, 14.30s/it]
 32%|███▏      | 12249/37963 [52:29:37<116:36:24, 16.33s/it]
 32%|███▏      | 12250/37963 [52:29:58<125:52:37, 17.62s/it]
                                                            
{'loss': '0.1686', 'grad_norm': '1.276', 'learning_rate': '1.583e-05', 'epoch': '0.3227'}

 32%|███▏      | 12250/37963 [52:29:58<125:52:37, 17.62s/it]
 32%|███▏      | 12251/37963 [52:30:12<118:51:38, 16.64s/it]
 32%|███▏      | 12252/37963 [52:30:26<113:57:31, 15.96s/it]
 32%|███▏      | 12253/37963 [52:30:41<110:35:04, 15.48s/it]
 32%|███▏      | 12254/37963 [52:31:01<121:21:22, 16.99s/it]
 32%|███▏      | 12255/37963 [52:31:16<115:49:44, 16.22s/it]
 32%|███▏      | 12256/37963 [52:31:30<111:59:01, 15.68s/it]
 32%|███▏      | 12257/37963 [52:31:44<108:38:34, 15.21s/it]
 32%|███▏      | 12258/37963 [52:32:05<121:19:32, 16.99s/it]
 32%|███▏      | 12259/37963 [52:32:20<115:30:20, 16.18s/it]
 32%|███▏      | 12260/37963 [52:32:34<110:50:27, 15.52s/it]
                                                            
{'loss': '0.164', 'grad_norm': '3.04', 'learning_rate': '1.583e-05', 'epoch': '0.3229'}

 32%|███▏      | 12260/37963 [52:32:34<110:50:27, 15.52s/it]
 32%|███▏      | 12261/37963 [52:32:54<120:52:53, 16.93s/it]
 32%|███▏      | 12262/37963 [52:33:08<115:20:35, 16.16s/it]
 32%|███▏      | 12263/37963 [52:33:23<111:23:32, 15.60s/it]
 32%|███▏      | 12264/37963 [52:33:37<108:17:20, 15.17s/it]
 32%|███▏      | 12265/37963 [52:33:51<106:48:54, 14.96s/it]
 32%|███▏      | 12266/37963 [52:34:06<105:50:41, 14.83s/it]
 32%|███▏      | 12267/37963 [52:34:27<119:14:57, 16.71s/it]
 32%|███▏      | 12268/37963 [52:34:41<114:17:07, 16.01s/it]
 32%|███▏      | 12269/37963 [52:34:55<109:11:36, 15.30s/it]
 32%|███▏      | 12270/37963 [52:35:09<107:13:21, 15.02s/it]
                                                            
{'loss': '0.1425', 'grad_norm': '2.575', 'learning_rate': '1.582e-05', 'epoch': '0.3232'}

 32%|███▏      | 12270/37963 [52:35:09<107:13:21, 15.02s/it]
 32%|███▏      | 12271/37963 [52:35:24<105:49:03, 14.83s/it]
 32%|███▏      | 12272/37963 [52:35:38<104:45:43, 14.68s/it]
 32%|███▏      | 12273/37963 [52:35:59<119:01:10, 16.68s/it]
 32%|███▏      | 12274/37963 [52:36:14<114:08:03, 15.99s/it]
 32%|███▏      | 12275/37963 [52:36:28<110:55:57, 15.55s/it]
 32%|███▏      | 12276/37963 [52:36:42<108:18:44, 15.18s/it]
 32%|███▏      | 12277/37963 [52:36:57<106:31:24, 14.93s/it]
 32%|███▏      | 12278/37963 [52:37:11<105:09:57, 14.74s/it]
 32%|███▏      | 12279/37963 [52:37:25<104:15:50, 14.61s/it]
 32%|███▏      | 12280/37963 [52:37:39<102:12:26, 14.33s/it]
                                                            
{'loss': '0.1508', 'grad_norm': '0.9074', 'learning_rate': '1.581e-05', 'epoch': '0.3235'}

 32%|███▏      | 12280/37963 [52:37:39<102:12:26, 14.33s/it]
 32%|███▏      | 12281/37963 [52:37:53<101:24:34, 14.22s/it]
 32%|███▏      | 12282/37963 [52:38:07<101:42:49, 14.26s/it]
 32%|███▏      | 12283/37963 [52:38:22<102:00:10, 14.30s/it]
 32%|███▏      | 12284/37963 [52:38:36<102:18:03, 14.34s/it]
 32%|███▏      | 12285/37963 [52:38:51<102:12:45, 14.33s/it]
 32%|███▏      | 12286/37963 [52:39:05<102:14:18, 14.33s/it]
 32%|███▏      | 12287/37963 [52:39:19<101:45:30, 14.27s/it]
 32%|███▏      | 12288/37963 [52:39:33<102:06:17, 14.32s/it]
 32%|███▏      | 12289/37963 [52:39:47<101:18:16, 14.20s/it]
 32%|███▏      | 12290/37963 [52:40:08<114:17:04, 16.03s/it]
                                                            
{'loss': '0.1637', 'grad_norm': '1.486', 'learning_rate': '1.581e-05', 'epoch': '0.3237'}

 32%|███▏      | 12290/37963 [52:40:08<114:17:04, 16.03s/it]
 32%|███▏      | 12291/37963 [52:40:22<110:37:23, 15.51s/it]
 32%|███▏      | 12292/37963 [52:40:36<108:03:48, 15.15s/it]
 32%|███▏      | 12293/37963 [52:40:51<106:24:28, 14.92s/it]
 32%|███▏      | 12294/37963 [52:41:05<105:13:12, 14.76s/it]
 32%|███▏      | 12295/37963 [52:41:19<104:24:34, 14.64s/it]
 32%|███▏      | 12296/37963 [52:41:34<103:50:55, 14.57s/it]
 32%|███▏      | 12297/37963 [52:41:48<103:02:20, 14.45s/it]
 32%|███▏      | 12298/37963 [52:42:09<117:16:39, 16.45s/it]
 32%|███▏      | 12299/37963 [52:42:30<126:13:44, 17.71s/it]
 32%|███▏      | 12300/37963 [52:42:44<119:17:06, 16.73s/it]
                                                            
{'loss': '0.1669', 'grad_norm': '1.192', 'learning_rate': '1.58e-05', 'epoch': '0.324'}

 32%|███▏      | 12300/37963 [52:42:44<119:17:06, 16.73s/it]
 32%|███▏      | 12301/37963 [52:43:06<129:27:18, 18.16s/it]
 32%|███▏      | 12302/37963 [52:43:20<120:52:03, 16.96s/it]
 32%|███▏      | 12303/37963 [52:43:34<115:15:51, 16.17s/it]
 32%|███▏      | 12304/37963 [52:43:49<111:23:05, 15.63s/it]
 32%|███▏      | 12305/37963 [52:44:03<108:39:36, 15.25s/it]
 32%|███▏      | 12306/37963 [52:44:17<106:49:08, 14.99s/it]
 32%|███▏      | 12307/37963 [52:44:39<120:15:59, 16.88s/it]
 32%|███▏      | 12308/37963 [52:44:53<114:19:07, 16.04s/it]
 32%|███▏      | 12309/37963 [52:45:07<110:43:49, 15.54s/it]
 32%|███▏      | 12310/37963 [52:45:21<107:10:02, 15.04s/it]
                                                            
{'loss': '0.1732', 'grad_norm': '1.232', 'learning_rate': '1.579e-05', 'epoch': '0.3243'}

 32%|███▏      | 12310/37963 [52:45:21<107:10:02, 15.04s/it]
 32%|███▏      | 12311/37963 [52:45:42<119:32:56, 16.78s/it]
 32%|███▏      | 12312/37963 [52:45:56<114:39:09, 16.09s/it]
 32%|███▏      | 12313/37963 [52:46:11<110:49:54, 15.56s/it]
 32%|███▏      | 12314/37963 [52:46:25<108:24:42, 15.22s/it]
 32%|███▏      | 12315/37963 [52:46:46<120:59:07, 16.98s/it]
 32%|███▏      | 12316/37963 [52:47:00<114:41:07, 16.10s/it]
 32%|███▏      | 12317/37963 [52:47:15<111:23:06, 15.64s/it]
 32%|███▏      | 12318/37963 [52:47:29<108:12:21, 15.19s/it]
 32%|███▏      | 12319/37963 [52:47:43<106:35:22, 14.96s/it]
 32%|███▏      | 12320/37963 [52:47:58<105:15:02, 14.78s/it]
                                                            
{'loss': '0.1587', 'grad_norm': '3.865', 'learning_rate': '1.579e-05', 'epoch': '0.3245'}

 32%|███▏      | 12320/37963 [52:47:58<105:15:02, 14.78s/it]
 32%|███▏      | 12321/37963 [52:48:12<104:27:39, 14.67s/it]
 32%|███▏      | 12322/37963 [52:48:26<103:50:03, 14.58s/it]
 32%|███▏      | 12323/37963 [52:48:47<117:14:03, 16.46s/it]
 32%|███▏      | 12324/37963 [52:49:01<112:33:09, 15.80s/it]
 32%|███▏      | 12325/37963 [52:49:16<109:29:53, 15.38s/it]
 32%|███▏      | 12326/37963 [52:49:30<107:23:33, 15.08s/it]
 32%|███▏      | 12327/37963 [52:49:44<105:30:25, 14.82s/it]
 32%|███▏      | 12328/37963 [52:49:59<104:33:32, 14.68s/it]
 32%|███▏      | 12329/37963 [52:50:13<103:50:16, 14.58s/it]
 32%|███▏      | 12330/37963 [52:50:28<103:18:37, 14.51s/it]
                                                            
{'loss': '0.1593', 'grad_norm': '1.239', 'learning_rate': '1.578e-05', 'epoch': '0.3248'}

 32%|███▏      | 12330/37963 [52:50:28<103:18:37, 14.51s/it]
 32%|███▏      | 12331/37963 [52:50:41<101:10:58, 14.21s/it]
 32%|███▏      | 12332/37963 [52:50:55<101:36:19, 14.27s/it]
 32%|███▏      | 12333/37963 [52:51:10<101:45:47, 14.29s/it]
 32%|███▏      | 12334/37963 [52:51:24<101:51:16, 14.31s/it]
 32%|███▏      | 12335/37963 [52:51:39<102:05:20, 14.34s/it]
 32%|███▏      | 12336/37963 [52:51:53<101:51:38, 14.31s/it]
 32%|███▏      | 12337/37963 [52:52:07<101:54:30, 14.32s/it]
 33%|███▎      | 12338/37963 [52:52:22<102:05:27, 14.34s/it]
 33%|███▎      | 12339/37963 [52:52:43<116:20:24, 16.35s/it]
 33%|███▎      | 12340/37963 [52:52:57<111:47:45, 15.71s/it]
                                                            
{'loss': '0.1525', 'grad_norm': '1.759', 'learning_rate': '1.577e-05', 'epoch': '0.3251'}

 33%|███▎      | 12340/37963 [52:52:57<111:47:45, 15.71s/it]
 33%|███▎      | 12341/37963 [52:53:11<108:56:00, 15.31s/it]
 33%|███▎      | 12342/37963 [52:53:25<106:10:47, 14.92s/it]
 33%|███▎      | 12343/37963 [52:53:40<105:07:10, 14.77s/it]
 33%|███▎      | 12344/37963 [52:53:54<104:09:19, 14.64s/it]
 33%|███▎      | 12345/37963 [52:54:08<102:58:51, 14.47s/it]
 33%|███▎      | 12346/37963 [52:54:22<102:42:02, 14.43s/it]
 33%|███▎      | 12347/37963 [52:54:43<116:31:10, 16.38s/it]
 33%|███▎      | 12348/37963 [52:55:10<139:27:49, 19.60s/it]
 33%|███▎      | 12349/37963 [52:55:24<127:06:16, 17.86s/it]
 33%|███▎      | 12350/37963 [52:55:38<118:30:29, 16.66s/it]
                                                            
{'loss': '0.1671', 'grad_norm': '0.9924', 'learning_rate': '1.576e-05', 'epoch': '0.3253'}

 33%|███▎      | 12350/37963 [52:55:38<118:30:29, 16.66s/it]
 33%|███▎      | 12351/37963 [52:55:52<113:36:58, 15.97s/it]
 33%|███▎      | 12352/37963 [52:56:07<109:42:52, 15.42s/it]
 33%|███▎      | 12353/37963 [52:56:21<107:21:05, 15.09s/it]
 33%|███▎      | 12354/37963 [52:56:35<105:41:19, 14.86s/it]
 33%|███▎      | 12355/37963 [52:56:49<103:50:58, 14.60s/it]
 33%|███▎      | 12356/37963 [52:57:10<117:55:54, 16.58s/it]
 33%|███▎      | 12357/37963 [52:57:25<113:06:31, 15.90s/it]
 33%|███▎      | 12358/37963 [52:57:39<109:42:13, 15.42s/it]
 33%|███▎      | 12359/37963 [52:57:53<107:32:56, 15.12s/it]
 33%|███▎      | 12360/37963 [52:58:08<105:57:59, 14.90s/it]
                                                            
{'loss': '0.1538', 'grad_norm': '1.278', 'learning_rate': '1.576e-05', 'epoch': '0.3256'}

 33%|███▎      | 12360/37963 [52:58:08<105:57:59, 14.90s/it]
 33%|███▎      | 12361/37963 [52:58:29<118:30:48, 16.66s/it]
 33%|███▎      | 12362/37963 [52:58:43<113:44:53, 16.00s/it]
 33%|███▎      | 12363/37963 [52:59:04<123:50:36, 17.42s/it]
 33%|███▎      | 12364/37963 [52:59:18<117:25:34, 16.51s/it]
 33%|███▎      | 12365/37963 [52:59:32<112:38:08, 15.84s/it]
 33%|███▎      | 12366/37963 [52:59:47<109:25:00, 15.39s/it]
 33%|███▎      | 12367/37963 [53:00:01<106:13:35, 14.94s/it]
 33%|███▎      | 12368/37963 [53:00:15<105:07:06, 14.79s/it]
 33%|███▎      | 12369/37963 [53:00:29<103:50:50, 14.61s/it]
 33%|███▎      | 12370/37963 [53:00:50<117:04:03, 16.47s/it]
                                                            
{'loss': '0.1508', 'grad_norm': '1.286', 'learning_rate': '1.575e-05', 'epoch': '0.3258'}

 33%|███▎      | 12370/37963 [53:00:50<117:04:03, 16.47s/it]
 33%|███▎      | 12371/37963 [53:01:04<112:03:09, 15.76s/it]
 33%|███▎      | 12372/37963 [53:01:19<109:01:25, 15.34s/it]
 33%|███▎      | 12373/37963 [53:01:33<106:26:48, 14.97s/it]
 33%|███▎      | 12374/37963 [53:01:47<104:41:29, 14.73s/it]
 33%|███▎      | 12375/37963 [53:02:01<103:16:15, 14.53s/it]
 33%|███▎      | 12376/37963 [53:02:15<103:14:42, 14.53s/it]
 33%|███▎      | 12377/37963 [53:02:30<102:46:01, 14.46s/it]
 33%|███▎      | 12378/37963 [53:02:44<102:32:05, 14.43s/it]
 33%|███▎      | 12379/37963 [53:02:59<102:57:15, 14.49s/it]
 33%|███▎      | 12380/37963 [53:03:13<102:38:10, 14.44s/it]
                                                            
{'loss': '0.1722', 'grad_norm': '3.49', 'learning_rate': '1.574e-05', 'epoch': '0.3261'}

 33%|███▎      | 12380/37963 [53:03:13<102:38:10, 14.44s/it]
 33%|███▎      | 12381/37963 [53:03:27<102:24:36, 14.41s/it]
 33%|███▎      | 12382/37963 [53:03:42<102:27:04, 14.42s/it]
 33%|███▎      | 12383/37963 [53:03:56<102:05:43, 14.37s/it]
 33%|███▎      | 12384/37963 [53:04:10<101:49:39, 14.33s/it]
 33%|███▎      | 12385/37963 [53:04:24<101:34:03, 14.30s/it]
 33%|███▎      | 12386/37963 [53:04:45<115:46:44, 16.30s/it]
 33%|███▎      | 12387/37963 [53:05:00<111:58:36, 15.76s/it]
 33%|███▎      | 12388/37963 [53:05:14<108:54:30, 15.33s/it]
 33%|███▎      | 12389/37963 [53:05:29<106:52:35, 15.04s/it]
 33%|███▎      | 12390/37963 [53:05:43<105:25:51, 14.84s/it]
                                                            
{'loss': '0.1529', 'grad_norm': '1.93', 'learning_rate': '1.574e-05', 'epoch': '0.3264'}

 33%|███▎      | 12390/37963 [53:05:43<105:25:51, 14.84s/it]
 33%|███▎      | 12391/37963 [53:05:57<102:43:40, 14.46s/it]
 33%|███▎      | 12392/37963 [53:06:11<102:31:51, 14.43s/it]
 33%|███▎      | 12393/37963 [53:06:25<102:18:16, 14.40s/it]
 33%|███▎      | 12394/37963 [53:06:40<102:16:44, 14.40s/it]
 33%|███▎      | 12395/37963 [53:07:00<115:47:22, 16.30s/it]
 33%|███▎      | 12396/37963 [53:07:21<125:46:51, 17.71s/it]
 33%|███▎      | 12397/37963 [53:07:42<132:12:31, 18.62s/it]
 33%|███▎      | 12398/37963 [53:07:56<123:00:10, 17.32s/it]
 33%|███▎      | 12399/37963 [53:08:10<115:26:56, 16.26s/it]
 33%|███▎      | 12400/37963 [53:08:25<111:23:19, 15.69s/it]
                                                            
{'loss': '0.1455', 'grad_norm': '2.378', 'learning_rate': '1.573e-05', 'epoch': '0.3266'}

 33%|███▎      | 12400/37963 [53:08:25<111:23:19, 15.69s/it]
 33%|███▎      | 12401/37963 [53:08:39<108:30:13, 15.28s/it]
 33%|███▎      | 12402/37963 [53:08:53<106:37:26, 15.02s/it]
 33%|███▎      | 12403/37963 [53:09:08<105:08:30, 14.81s/it]
 33%|███▎      | 12404/37963 [53:09:29<118:33:17, 16.70s/it]
 33%|███▎      | 12405/37963 [53:09:43<113:42:23, 16.02s/it]
 33%|███▎      | 12406/37963 [53:09:57<109:51:46, 15.48s/it]
 33%|███▎      | 12407/37963 [53:10:12<107:03:38, 15.08s/it]
 33%|███▎      | 12408/37963 [53:10:26<105:36:21, 14.88s/it]
 33%|███▎      | 12409/37963 [53:10:40<102:53:20, 14.49s/it]
 33%|███▎      | 12410/37963 [53:11:00<115:56:17, 16.33s/it]
                                                            
{'loss': '0.1694', 'grad_norm': '4.188', 'learning_rate': '1.572e-05', 'epoch': '0.3269'}

 33%|███▎      | 12410/37963 [53:11:00<115:56:17, 16.33s/it]
 33%|███▎      | 12411/37963 [53:11:14<111:34:28, 15.72s/it]
 33%|███▎      | 12412/37963 [53:11:28<107:17:59, 15.12s/it]
 33%|███▎      | 12413/37963 [53:11:50<120:45:52, 17.02s/it]
 33%|███▎      | 12414/37963 [53:12:04<115:01:42, 16.21s/it]
 33%|███▎      | 12415/37963 [53:12:18<111:08:54, 15.66s/it]
 33%|███▎      | 12416/37963 [53:12:32<107:44:10, 15.18s/it]
 33%|███▎      | 12417/37963 [53:12:47<105:59:44, 14.94s/it]
 33%|███▎      | 12418/37963 [53:13:07<117:41:25, 16.59s/it]
 33%|███▎      | 12419/37963 [53:13:22<113:25:05, 15.98s/it]
 33%|███▎      | 12420/37963 [53:13:36<109:55:36, 15.49s/it]
                                                            
{'loss': '0.1557', 'grad_norm': '2.146', 'learning_rate': '1.572e-05', 'epoch': '0.3272'}

 33%|███▎      | 12420/37963 [53:13:36<109:55:36, 15.49s/it]
 33%|███▎      | 12421/37963 [53:13:50<107:24:59, 15.14s/it]
 33%|███▎      | 12422/37963 [53:14:05<105:35:03, 14.88s/it]
 33%|███▎      | 12423/37963 [53:14:19<104:23:27, 14.71s/it]
 33%|███▎      | 12424/37963 [53:14:33<103:33:06, 14.60s/it]
 33%|███▎      | 12425/37963 [53:14:48<102:56:19, 14.51s/it]
 33%|███▎      | 12426/37963 [53:15:02<102:17:20, 14.42s/it]
 33%|███▎      | 12427/37963 [53:15:15<100:15:45, 14.13s/it]
 33%|███▎      | 12428/37963 [53:15:30<100:50:58, 14.22s/it]
 33%|███▎      | 12429/37963 [53:15:44<101:14:17, 14.27s/it]
 33%|███▎      | 12430/37963 [53:15:58<100:24:07, 14.16s/it]
                                                            
{'loss': '0.1582', 'grad_norm': '5.435', 'learning_rate': '1.571e-05', 'epoch': '0.3274'}

 33%|███▎      | 12430/37963 [53:15:58<100:24:07, 14.16s/it]
 33%|███▎      | 12431/37963 [53:16:12<100:52:53, 14.22s/it]
 33%|███▎      | 12432/37963 [53:16:27<101:33:16, 14.32s/it]
 33%|███▎      | 12433/37963 [53:16:48<115:37:54, 16.31s/it]
 33%|███▎      | 12434/37963 [53:17:02<110:50:06, 15.63s/it]
 33%|███▎      | 12435/37963 [53:17:16<107:46:18, 15.20s/it]
 33%|███▎      | 12436/37963 [53:17:30<105:43:53, 14.91s/it]
 33%|███▎      | 12437/37963 [53:17:45<104:27:11, 14.73s/it]
 33%|███▎      | 12438/37963 [53:17:58<102:07:51, 14.40s/it]
 33%|███▎      | 12439/37963 [53:18:13<101:56:00, 14.38s/it]
 33%|███▎      | 12440/37963 [53:18:27<101:27:57, 14.31s/it]
                                                            
{'loss': '0.161', 'grad_norm': '2.034', 'learning_rate': '1.57e-05', 'epoch': '0.3277'}

 33%|███▎      | 12440/37963 [53:18:27<101:27:57, 14.31s/it]
 33%|███▎      | 12441/37963 [53:18:41<101:29:38, 14.32s/it]
 33%|███▎      | 12442/37963 [53:18:55<101:28:26, 14.31s/it]
 33%|███▎      | 12443/37963 [53:19:16<115:25:42, 16.28s/it]
 33%|███▎      | 12444/37963 [53:19:31<111:13:00, 15.69s/it]
 33%|███▎      | 12445/37963 [53:19:52<122:48:46, 17.33s/it]
 33%|███▎      | 12446/37963 [53:20:13<130:35:14, 18.42s/it]
 33%|███▎      | 12447/37963 [53:20:27<121:59:37, 17.21s/it]
 33%|███▎      | 12448/37963 [53:20:41<115:50:23, 16.34s/it]
 33%|███▎      | 12449/37963 [53:20:56<111:32:12, 15.74s/it]
 33%|███▎      | 12450/37963 [53:21:10<108:14:07, 15.27s/it]
                                                            
{'loss': '0.1628', 'grad_norm': '5.074', 'learning_rate': '1.57e-05', 'epoch': '0.328'}

 33%|███▎      | 12450/37963 [53:21:10<108:14:07, 15.27s/it]
 33%|███▎      | 12451/37963 [53:21:24<106:15:34, 14.99s/it]
 33%|███▎      | 12452/37963 [53:21:39<104:31:52, 14.75s/it]
 33%|███▎      | 12453/37963 [53:21:53<103:40:42, 14.63s/it]
 33%|███▎      | 12454/37963 [53:22:14<117:27:43, 16.58s/it]
 33%|███▎      | 12455/37963 [53:22:28<112:28:44, 15.87s/it]
 33%|███▎      | 12456/37963 [53:22:43<109:11:00, 15.41s/it]
 33%|███▎      | 12457/37963 [53:22:57<106:46:31, 15.07s/it]
 33%|███▎      | 12458/37963 [53:23:11<105:04:38, 14.83s/it]
 33%|███▎      | 12459/37963 [53:23:25<103:28:21, 14.61s/it]
 33%|███▎      | 12460/37963 [53:23:45<115:35:08, 16.32s/it]
                                                            
{'loss': '0.1539', 'grad_norm': '6.319', 'learning_rate': '1.569e-05', 'epoch': '0.3282'}

 33%|███▎      | 12460/37963 [53:23:45<115:35:08, 16.32s/it]
 33%|███▎      | 12461/37963 [53:24:00<110:41:28, 15.63s/it]
 33%|███▎      | 12462/37963 [53:24:20<121:27:53, 17.15s/it]
 33%|███▎      | 12463/37963 [53:24:34<115:05:52, 16.25s/it]
 33%|███▎      | 12464/37963 [53:24:49<111:00:33, 15.67s/it]
 33%|███▎      | 12465/37963 [53:25:02<106:55:58, 15.10s/it]
 33%|███▎      | 12466/37963 [53:25:17<105:23:47, 14.88s/it]
 33%|███▎      | 12467/37963 [53:25:37<117:05:55, 16.53s/it]
 33%|███▎      | 12468/37963 [53:25:51<112:06:17, 15.83s/it]
 33%|███▎      | 12469/37963 [53:26:05<107:39:00, 15.20s/it]
 33%|███▎      | 12470/37963 [53:26:19<104:58:00, 14.82s/it]
                                                            
{'loss': '0.1442', 'grad_norm': '2.493', 'learning_rate': '1.568e-05', 'epoch': '0.3285'}

 33%|███▎      | 12470/37963 [53:26:19<104:58:00, 14.82s/it]
 33%|███▎      | 12471/37963 [53:26:33<103:33:07, 14.62s/it]
 33%|███▎      | 12472/37963 [53:26:48<103:04:32, 14.56s/it]
 33%|███▎      | 12473/37963 [53:27:01<101:26:54, 14.33s/it]
 33%|███▎      | 12474/37963 [53:27:16<101:09:25, 14.29s/it]
 33%|███▎      | 12475/37963 [53:27:30<101:14:30, 14.30s/it]
 33%|███▎      | 12476/37963 [53:27:44<100:09:18, 14.15s/it]
 33%|███▎      | 12477/37963 [53:27:58<100:42:31, 14.23s/it]
 33%|███▎      | 12478/37963 [53:28:13<101:10:12, 14.29s/it]
 33%|███▎      | 12479/37963 [53:28:27<101:15:42, 14.30s/it]
 33%|███▎      | 12480/37963 [53:28:41<100:48:59, 14.24s/it]
                                                            
{'loss': '0.1394', 'grad_norm': '5.767', 'learning_rate': '1.567e-05', 'epoch': '0.3287'}

 33%|███▎      | 12480/37963 [53:28:41<100:48:59, 14.24s/it]
 33%|███▎      | 12481/37963 [53:29:02<114:43:47, 16.21s/it]
 33%|███▎      | 12482/37963 [53:29:16<110:41:26, 15.64s/it]
 33%|███▎      | 12483/37963 [53:29:30<107:09:55, 15.14s/it]
 33%|███▎      | 12484/37963 [53:29:44<104:47:11, 14.81s/it]
 33%|███▎      | 12485/37963 [53:29:58<103:44:27, 14.66s/it]
 33%|███▎      | 12486/37963 [53:30:13<102:38:56, 14.50s/it]
 33%|███▎      | 12487/37963 [53:30:27<102:17:18, 14.45s/it]
 33%|███▎      | 12488/37963 [53:30:41<102:08:24, 14.43s/it]
 33%|███▎      | 12489/37963 [53:31:03<117:00:53, 16.54s/it]
 33%|███▎      | 12490/37963 [53:31:17<112:25:25, 15.89s/it]
                                                            
{'loss': '0.1522', 'grad_norm': '3.793', 'learning_rate': '1.567e-05', 'epoch': '0.329'}

 33%|███▎      | 12490/37963 [53:31:17<112:25:25, 15.89s/it]
 33%|███▎      | 12491/37963 [53:31:31<108:01:23, 15.27s/it]
 33%|███▎      | 12492/37963 [53:31:45<106:04:57, 14.99s/it]
 33%|███▎      | 12493/37963 [53:32:00<104:41:37, 14.80s/it]
 33%|███▎      | 12494/37963 [53:32:14<103:38:37, 14.65s/it]
 33%|███▎      | 12495/37963 [53:32:42<131:02:23, 18.52s/it]
 33%|███▎      | 12496/37963 [53:32:56<122:13:30, 17.28s/it]
 33%|███▎      | 12497/37963 [53:33:10<116:10:23, 16.42s/it]
 33%|███▎      | 12498/37963 [53:33:25<111:35:42, 15.78s/it]
 33%|███▎      | 12499/37963 [53:33:39<108:34:13, 15.35s/it]
 33%|███▎      | 12500/37963 [53:33:53<106:34:44, 15.07s/it]
                                                            
{'loss': '0.162', 'grad_norm': '2.652', 'learning_rate': '1.566e-05', 'epoch': '0.3293'}

 33%|███▎      | 12500/37963 [53:33:53<106:34:44, 15.07s/it]
 33%|███▎      | 12501/37963 [53:34:08<104:53:45, 14.83s/it]
 33%|███▎      | 12502/37963 [53:34:29<118:19:40, 16.73s/it]
 33%|███▎      | 12503/37963 [53:34:43<113:07:04, 15.99s/it]
 33%|███▎      | 12504/37963 [53:34:57<109:47:51, 15.53s/it]
 33%|███▎      | 12505/37963 [53:35:12<107:26:48, 15.19s/it]
 33%|███▎      | 12506/37963 [53:35:26<105:28:35, 14.92s/it]
 33%|███▎      | 12507/37963 [53:35:40<104:05:00, 14.72s/it]
 33%|███▎      | 12508/37963 [53:35:55<103:13:57, 14.60s/it]
 33%|███▎      | 12509/37963 [53:36:15<115:38:37, 16.36s/it]
 33%|███▎      | 12510/37963 [53:36:30<111:21:11, 15.75s/it]
                                                            
{'loss': '0.1537', 'grad_norm': '2.451', 'learning_rate': '1.565e-05', 'epoch': '0.3295'}

 33%|███▎      | 12510/37963 [53:36:30<111:21:11, 15.75s/it]
 33%|███▎      | 12511/37963 [53:36:51<122:33:36, 17.34s/it]
 33%|███▎      | 12512/37963 [53:37:05<116:10:58, 16.43s/it]
 33%|███▎      | 12513/37963 [53:37:19<110:38:28, 15.65s/it]
 33%|███▎      | 12514/37963 [53:37:33<108:02:36, 15.28s/it]
 33%|███▎      | 12515/37963 [53:37:47<105:51:39, 14.98s/it]
 33%|███▎      | 12516/37963 [53:38:07<116:17:51, 16.45s/it]
 33%|███▎      | 12517/37963 [53:38:21<109:47:15, 15.53s/it]
 33%|███▎      | 12518/37963 [53:38:34<105:37:01, 14.94s/it]
 33%|███▎      | 12519/37963 [53:38:48<103:59:21, 14.71s/it]
 33%|███▎      | 12520/37963 [53:39:03<103:17:50, 14.62s/it]
                                                            
{'loss': '0.1586', 'grad_norm': '1.762', 'learning_rate': '1.565e-05', 'epoch': '0.3298'}

 33%|███▎      | 12520/37963 [53:39:03<103:17:50, 14.62s/it]
 33%|███▎      | 12521/37963 [53:39:17<102:56:35, 14.57s/it]
 33%|███▎      | 12522/37963 [53:39:32<102:38:35, 14.52s/it]
 33%|███▎      | 12523/37963 [53:39:46<102:15:21, 14.47s/it]
 33%|███▎      | 12524/37963 [53:40:00<101:56:23, 14.43s/it]
 33%|███▎      | 12525/37963 [53:40:14<101:09:22, 14.32s/it]
 33%|███▎      | 12526/37963 [53:40:29<101:21:59, 14.35s/it]
 33%|███▎      | 12527/37963 [53:40:43<101:48:10, 14.41s/it]
 33%|███▎      | 12528/37963 [53:40:58<101:19:24, 14.34s/it]
 33%|███▎      | 12529/37963 [53:41:18<114:47:34, 16.25s/it]
 33%|███▎      | 12530/37963 [53:41:33<110:37:49, 15.66s/it]
                                                            
{'loss': '0.1668', 'grad_norm': '2.043', 'learning_rate': '1.564e-05', 'epoch': '0.3301'}

 33%|███▎      | 12530/37963 [53:41:33<110:37:49, 15.66s/it]
 33%|███▎      | 12531/37963 [53:41:47<107:58:49, 15.29s/it]
 33%|███▎      | 12532/37963 [53:42:01<104:45:34, 14.83s/it]
 33%|███▎      | 12533/37963 [53:42:15<103:45:13, 14.69s/it]
 33%|███▎      | 12534/37963 [53:42:30<103:08:14, 14.60s/it]
 33%|███▎      | 12535/37963 [53:42:44<102:36:18, 14.53s/it]
 33%|███▎      | 12536/37963 [53:42:58<102:13:41, 14.47s/it]
 33%|███▎      | 12537/37963 [53:43:18<114:12:31, 16.17s/it]
 33%|███▎      | 12538/37963 [53:43:33<110:38:11, 15.67s/it]
 33%|███▎      | 12539/37963 [53:43:47<106:28:40, 15.08s/it]
 33%|███▎      | 12540/37963 [53:44:01<105:12:28, 14.90s/it]
                                                            
{'loss': '0.1596', 'grad_norm': '3.851', 'learning_rate': '1.563e-05', 'epoch': '0.3303'}

 33%|███▎      | 12540/37963 [53:44:01<105:12:28, 14.90s/it]
 33%|███▎      | 12541/37963 [53:44:15<104:02:04, 14.73s/it]
 33%|███▎      | 12542/37963 [53:44:35<115:26:14, 16.35s/it]
 33%|███▎      | 12543/37963 [53:44:56<124:53:11, 17.69s/it]
 33%|███▎      | 12544/37963 [53:45:10<116:25:42, 16.49s/it]
 33%|███▎      | 12545/37963 [53:45:24<111:36:05, 15.81s/it]
 33%|███▎      | 12546/37963 [53:45:38<107:55:11, 15.29s/it]
 33%|███▎      | 12547/37963 [53:45:53<105:56:32, 15.01s/it]
 33%|███▎      | 12548/37963 [53:46:07<104:34:11, 14.81s/it]
 33%|███▎      | 12549/37963 [53:46:21<103:48:14, 14.70s/it]
 33%|███▎      | 12550/37963 [53:46:35<101:26:21, 14.37s/it]
                                                            
{'loss': '0.1496', 'grad_norm': '0.9945', 'learning_rate': '1.562e-05', 'epoch': '0.3306'}

 33%|███▎      | 12550/37963 [53:46:35<101:26:21, 14.37s/it]
 33%|███▎      | 12551/37963 [53:46:56<115:58:48, 16.43s/it]
 33%|███▎      | 12552/37963 [53:47:11<111:37:44, 15.81s/it]
 33%|███▎      | 12553/37963 [53:47:25<107:59:38, 15.30s/it]
 33%|███▎      | 12554/37963 [53:47:39<105:59:52, 15.02s/it]
 33%|███▎      | 12555/37963 [53:47:53<104:29:30, 14.81s/it]
 33%|███▎      | 12556/37963 [53:48:14<116:38:44, 16.53s/it]
 33%|███▎      | 12557/37963 [53:48:28<111:51:17, 15.85s/it]
 33%|███▎      | 12558/37963 [53:48:43<108:40:49, 15.40s/it]
 33%|███▎      | 12559/37963 [53:48:57<106:30:34, 15.09s/it]
 33%|███▎      | 12560/37963 [53:49:18<119:33:04, 16.94s/it]
                                                            
{'loss': '0.1525', 'grad_norm': '3.117', 'learning_rate': '1.562e-05', 'epoch': '0.3308'}

 33%|███▎      | 12560/37963 [53:49:18<119:33:04, 16.94s/it]
 33%|███▎      | 12561/37963 [53:49:33<114:03:52, 16.17s/it]
 33%|███▎      | 12562/37963 [53:49:47<110:16:21, 15.63s/it]
 33%|███▎      | 12563/37963 [53:50:01<107:08:14, 15.18s/it]
 33%|███▎      | 12564/37963 [53:50:22<118:30:31, 16.80s/it]
 33%|███▎      | 12565/37963 [53:50:36<113:16:38, 16.06s/it]
 33%|███▎      | 12566/37963 [53:50:50<109:42:31, 15.55s/it]
 33%|███▎      | 12567/37963 [53:51:04<106:00:03, 15.03s/it]
 33%|███▎      | 12568/37963 [53:51:18<104:34:08, 14.82s/it]
 33%|███▎      | 12569/37963 [53:51:33<103:25:43, 14.66s/it]
 33%|███▎      | 12570/37963 [53:51:47<102:45:29, 14.57s/it]
                                                            
{'loss': '0.1513', 'grad_norm': '2.313', 'learning_rate': '1.561e-05', 'epoch': '0.3311'}

 33%|███▎      | 12570/37963 [53:51:47<102:45:29, 14.57s/it]
 33%|███▎      | 12571/37963 [53:52:02<102:24:46, 14.52s/it]
 33%|███▎      | 12572/37963 [53:52:16<101:14:16, 14.35s/it]
 33%|███▎      | 12573/37963 [53:52:29<100:26:49, 14.24s/it]
 33%|███▎      | 12574/37963 [53:52:44<100:48:54, 14.29s/it]
 33%|███▎      | 12575/37963 [53:52:58<100:19:02, 14.22s/it]
 33%|███▎      | 12576/37963 [53:53:12<100:20:00, 14.23s/it]
 33%|███▎      | 12577/37963 [53:53:27<100:36:04, 14.27s/it]
 33%|███▎      | 12578/37963 [53:53:47<114:36:43, 16.25s/it]
 33%|███▎      | 12579/37963 [53:54:02<110:27:27, 15.67s/it]
 33%|███▎      | 12580/37963 [53:54:16<107:39:13, 15.27s/it]
                                                            
{'loss': '0.1608', 'grad_norm': '2.788', 'learning_rate': '1.56e-05', 'epoch': '0.3314'}

 33%|███▎      | 12580/37963 [53:54:16<107:39:13, 15.27s/it]
 33%|███▎      | 12581/37963 [53:54:30<104:43:47, 14.85s/it]
 33%|███▎      | 12582/37963 [53:54:44<103:49:27, 14.73s/it]
 33%|███▎      | 12583/37963 [53:54:59<103:01:24, 14.61s/it]
 33%|███▎      | 12584/37963 [53:55:13<102:28:59, 14.54s/it]
 33%|███▎      | 12585/37963 [53:55:34<116:18:49, 16.50s/it]
 33%|███▎      | 12586/37963 [53:55:48<110:46:14, 15.71s/it]
 33%|███▎      | 12587/37963 [53:56:02<107:33:00, 15.26s/it]
 33%|███▎      | 12588/37963 [53:56:16<104:40:49, 14.85s/it]
 33%|███▎      | 12589/37963 [53:56:31<103:45:36, 14.72s/it]
 33%|███▎      | 12590/37963 [53:56:45<103:02:52, 14.62s/it]
                                                            
{'loss': '0.1539', 'grad_norm': '3.444', 'learning_rate': '1.56e-05', 'epoch': '0.3316'}

 33%|███▎      | 12590/37963 [53:56:45<103:02:52, 14.62s/it]
 33%|███▎      | 12591/37963 [53:56:59<102:12:08, 14.50s/it]
 33%|███▎      | 12592/37963 [53:57:20<114:40:00, 16.27s/it]
 33%|███▎      | 12593/37963 [53:57:34<110:32:42, 15.69s/it]
 33%|███▎      | 12594/37963 [53:57:54<120:31:04, 17.10s/it]
 33%|███▎      | 12595/37963 [53:58:09<114:37:01, 16.27s/it]
 33%|███▎      | 12596/37963 [53:58:23<110:03:40, 15.62s/it]
 33%|███▎      | 12597/37963 [53:58:37<107:34:12, 15.27s/it]
 33%|███▎      | 12598/37963 [53:58:51<105:06:53, 14.92s/it]
 33%|███▎      | 12599/37963 [53:59:12<117:58:46, 16.75s/it]
 33%|███▎      | 12600/37963 [53:59:27<113:00:36, 16.04s/it]
                                                            
{'loss': '0.1508', 'grad_norm': '1.292', 'learning_rate': '1.559e-05', 'epoch': '0.3319'}

 33%|███▎      | 12600/37963 [53:59:27<113:00:36, 16.04s/it]
 33%|███▎      | 12601/37963 [53:59:41<109:48:06, 15.59s/it]
 33%|███▎      | 12602/37963 [53:59:56<107:09:44, 15.21s/it]
 33%|███▎      | 12603/37963 [54:00:10<105:15:49, 14.94s/it]
 33%|███▎      | 12604/37963 [54:00:24<103:10:07, 14.65s/it]
 33%|███▎      | 12605/37963 [54:00:45<116:47:41, 16.58s/it]
 33%|███▎      | 12606/37963 [54:00:59<112:17:34, 15.94s/it]
 33%|███▎      | 12607/37963 [54:01:13<107:54:03, 15.32s/it]
 33%|███▎      | 12608/37963 [54:01:34<120:12:52, 17.07s/it]
 33%|███▎      | 12609/37963 [54:01:49<114:28:22, 16.25s/it]
 33%|███▎      | 12610/37963 [54:02:03<110:32:38, 15.70s/it]
                                                            
{'loss': '0.1732', 'grad_norm': '2.384', 'learning_rate': '1.558e-05', 'epoch': '0.3322'}

 33%|███▎      | 12610/37963 [54:02:03<110:32:38, 15.70s/it]
 33%|███▎      | 12611/37963 [54:02:17<107:19:24, 15.24s/it]
 33%|███▎      | 12612/37963 [54:02:32<105:05:19, 14.92s/it]
 33%|███▎      | 12613/37963 [54:02:46<103:27:33, 14.69s/it]
 33%|███▎      | 12614/37963 [54:03:00<102:39:42, 14.58s/it]
 33%|███▎      | 12615/37963 [54:03:14<102:12:28, 14.52s/it]
 33%|███▎      | 12616/37963 [54:03:28<100:29:29, 14.27s/it]
 33%|███▎      | 12617/37963 [54:03:49<114:08:29, 16.21s/it]
 33%|███▎      | 12618/37963 [54:04:03<110:08:41, 15.64s/it]
 33%|███▎      | 12619/37963 [54:04:18<107:35:19, 15.28s/it]
 33%|███▎      | 12620/37963 [54:04:32<105:42:40, 15.02s/it]
                                                            
{'loss': '0.1432', 'grad_norm': '2.224', 'learning_rate': '1.558e-05', 'epoch': '0.3324'}

 33%|███▎      | 12620/37963 [54:04:32<105:42:40, 15.02s/it]
 33%|███▎      | 12621/37963 [54:04:46<103:56:42, 14.77s/it]
 33%|███▎      | 12622/37963 [54:05:00<103:05:18, 14.64s/it]
 33%|███▎      | 12623/37963 [54:05:15<102:09:00, 14.51s/it]
 33%|███▎      | 12624/37963 [54:05:29<101:58:04, 14.49s/it]
 33%|███▎      | 12625/37963 [54:05:43<101:42:29, 14.45s/it]
 33%|███▎      | 12626/37963 [54:05:58<101:43:00, 14.45s/it]
 33%|███▎      | 12627/37963 [54:06:12<101:26:12, 14.41s/it]
 33%|███▎      | 12628/37963 [54:06:27<101:14:24, 14.39s/it]
 33%|███▎      | 12629/37963 [54:06:41<100:48:21, 14.32s/it]
 33%|███▎      | 12630/37963 [54:07:02<114:59:31, 16.34s/it]
                                                            
{'loss': '0.1569', 'grad_norm': '2.638', 'learning_rate': '1.557e-05', 'epoch': '0.3327'}

 33%|███▎      | 12630/37963 [54:07:02<114:59:31, 16.34s/it]
 33%|███▎      | 12631/37963 [54:07:15<108:04:24, 15.36s/it]
 33%|███▎      | 12632/37963 [54:07:29<105:37:34, 15.01s/it]
 33%|███▎      | 12633/37963 [54:07:50<118:08:15, 16.79s/it]
 33%|███▎      | 12634/37963 [54:08:04<112:43:58, 16.02s/it]
 33%|███▎      | 12635/37963 [54:08:19<109:32:35, 15.57s/it]
 33%|███▎      | 12636/37963 [54:08:33<107:05:14, 15.22s/it]
 33%|███▎      | 12637/37963 [54:08:47<104:42:30, 14.88s/it]
 33%|███▎      | 12638/37963 [54:09:02<103:32:49, 14.72s/it]
 33%|███▎      | 12639/37963 [54:09:16<102:00:56, 14.50s/it]
 33%|███▎      | 12640/37963 [54:09:30<101:14:29, 14.39s/it]
                                                            
{'loss': '0.1591', 'grad_norm': '4.353', 'learning_rate': '1.556e-05', 'epoch': '0.333'}

 33%|███▎      | 12640/37963 [54:09:30<101:14:29, 14.39s/it]
 33%|███▎      | 12641/37963 [54:09:57<129:15:55, 18.38s/it]
 33%|███▎      | 12642/37963 [54:10:12<120:49:31, 17.18s/it]
 33%|███▎      | 12643/37963 [54:10:26<114:51:58, 16.33s/it]
 33%|███▎      | 12644/37963 [54:10:40<109:48:22, 15.61s/it]
 33%|███▎      | 12645/37963 [54:10:55<107:17:26, 15.26s/it]
 33%|███▎      | 12646/37963 [54:11:08<104:23:59, 14.85s/it]
 33%|███▎      | 12647/37963 [54:11:22<102:36:31, 14.59s/it]
 33%|███▎      | 12648/37963 [54:11:44<116:34:55, 16.58s/it]
 33%|███▎      | 12649/37963 [54:11:58<111:27:37, 15.85s/it]
 33%|███▎      | 12650/37963 [54:12:12<108:17:00, 15.40s/it]
                                                            
{'loss': '0.1574', 'grad_norm': '1.81', 'learning_rate': '1.555e-05', 'epoch': '0.3332'}

 33%|███▎      | 12650/37963 [54:12:12<108:17:00, 15.40s/it]
 33%|███▎      | 12651/37963 [54:12:26<104:55:34, 14.92s/it]
 33%|███▎      | 12652/37963 [54:12:40<102:19:42, 14.55s/it]
 33%|███▎      | 12653/37963 [54:13:00<114:04:17, 16.23s/it]
 33%|███▎      | 12654/37963 [54:13:14<110:07:05, 15.66s/it]
 33%|███▎      | 12655/37963 [54:13:28<107:28:21, 15.29s/it]
 33%|███▎      | 12656/37963 [54:13:43<105:31:21, 15.01s/it]
 33%|███▎      | 12657/37963 [54:13:57<103:49:26, 14.77s/it]
 33%|███▎      | 12658/37963 [54:14:19<118:35:55, 16.87s/it]
 33%|███▎      | 12659/37963 [54:14:33<113:27:17, 16.14s/it]
 33%|███▎      | 12660/37963 [54:14:48<109:35:51, 15.59s/it]
                                                            
{'loss': '0.1551', 'grad_norm': '1.188', 'learning_rate': '1.555e-05', 'epoch': '0.3335'}

 33%|███▎      | 12660/37963 [54:14:48<109:35:51, 15.59s/it]
 33%|███▎      | 12661/37963 [54:15:02<106:54:01, 15.21s/it]
 33%|███▎      | 12662/37963 [54:15:16<105:29:22, 15.01s/it]
 33%|███▎      | 12663/37963 [54:15:31<103:47:17, 14.77s/it]
 33%|███▎      | 12664/37963 [54:15:45<102:56:28, 14.65s/it]
 33%|███▎      | 12665/37963 [54:16:06<116:02:02, 16.51s/it]
 33%|███▎      | 12666/37963 [54:16:20<111:14:50, 15.83s/it]
 33%|███▎      | 12667/37963 [54:16:34<108:06:59, 15.39s/it]
 33%|███▎      | 12668/37963 [54:16:49<105:48:40, 15.06s/it]
 33%|███▎      | 12669/37963 [54:17:03<104:21:01, 14.85s/it]
 33%|███▎      | 12670/37963 [54:17:17<102:30:58, 14.59s/it]
                                                            
{'loss': '0.1532', 'grad_norm': '2.884', 'learning_rate': '1.554e-05', 'epoch': '0.3337'}

 33%|███▎      | 12670/37963 [54:17:17<102:30:58, 14.59s/it]
 33%|███▎      | 12671/37963 [54:17:31<101:56:03, 14.51s/it]
 33%|███▎      | 12672/37963 [54:17:46<101:43:18, 14.48s/it]
 33%|███▎      | 12673/37963 [54:18:00<101:28:33, 14.44s/it]
 33%|███▎      | 12674/37963 [54:18:15<101:23:55, 14.43s/it]
 33%|███▎      | 12675/37963 [54:18:29<101:15:37, 14.42s/it]
 33%|███▎      | 12676/37963 [54:18:43<101:23:23, 14.43s/it]
 33%|███▎      | 12677/37963 [54:18:57<100:12:43, 14.27s/it]
 33%|███▎      | 12678/37963 [54:19:25<128:57:36, 18.36s/it]
 33%|███▎      | 12679/37963 [54:19:39<119:04:08, 16.95s/it]
 33%|███▎      | 12680/37963 [54:19:53<112:19:12, 15.99s/it]
                                                            
{'loss': '0.1561', 'grad_norm': '2.405', 'learning_rate': '1.553e-05', 'epoch': '0.334'}

 33%|███▎      | 12680/37963 [54:19:53<112:19:12, 15.99s/it]
 33%|███▎      | 12681/37963 [54:20:07<108:35:28, 15.46s/it]
 33%|███▎      | 12682/37963 [54:20:21<106:27:12, 15.16s/it]
 33%|███▎      | 12683/37963 [54:20:36<104:37:59, 14.90s/it]
 33%|███▎      | 12684/37963 [54:20:50<103:36:50, 14.76s/it]
 33%|███▎      | 12685/37963 [54:21:04<102:49:45, 14.64s/it]
 33%|███▎      | 12686/37963 [54:21:19<102:10:58, 14.55s/it]
 33%|███▎      | 12687/37963 [54:21:40<115:37:13, 16.47s/it]
 33%|███▎      | 12688/37963 [54:21:54<110:35:44, 15.75s/it]
 33%|███▎      | 12689/37963 [54:22:08<108:00:20, 15.38s/it]
 33%|███▎      | 12690/37963 [54:22:29<120:01:20, 17.10s/it]
                                                            
{'loss': '0.1583', 'grad_norm': '3.901', 'learning_rate': '1.553e-05', 'epoch': '0.3343'}

 33%|███▎      | 12690/37963 [54:22:29<120:01:20, 17.10s/it]
 33%|███▎      | 12691/37963 [54:22:44<114:25:25, 16.30s/it]
 33%|███▎      | 12692/37963 [54:22:58<110:21:42, 15.72s/it]
 33%|███▎      | 12693/37963 [54:23:13<107:25:30, 15.30s/it]
 33%|███▎      | 12694/37963 [54:23:27<105:32:21, 15.04s/it]
 33%|███▎      | 12695/37963 [54:23:41<104:06:56, 14.83s/it]
 33%|███▎      | 12696/37963 [54:23:56<103:07:47, 14.69s/it]
 33%|███▎      | 12697/37963 [54:24:10<101:43:41, 14.49s/it]
 33%|███▎      | 12698/37963 [54:24:30<114:40:13, 16.34s/it]
 33%|███▎      | 12699/37963 [54:24:45<110:25:11, 15.73s/it]
 33%|███▎      | 12700/37963 [54:24:59<107:24:11, 15.31s/it]
                                                            
{'loss': '0.1468', 'grad_norm': '2.762', 'learning_rate': '1.552e-05', 'epoch': '0.3345'}

 33%|███▎      | 12700/37963 [54:24:59<107:24:11, 15.31s/it]
 33%|███▎      | 12701/37963 [54:25:13<105:16:23, 15.00s/it]
 33%|███▎      | 12702/37963 [54:25:28<104:20:46, 14.87s/it]
 33%|███▎      | 12703/37963 [54:25:49<116:54:50, 16.66s/it]
 33%|███▎      | 12704/37963 [54:26:03<111:54:52, 15.95s/it]
 33%|███▎      | 12705/37963 [54:26:17<108:38:01, 15.48s/it]
 33%|███▎      | 12706/37963 [54:26:39<120:27:51, 17.17s/it]
 33%|███▎      | 12707/37963 [54:26:53<114:38:26, 16.34s/it]
 33%|███▎      | 12708/37963 [54:27:07<110:29:26, 15.75s/it]
 33%|███▎      | 12709/37963 [54:27:22<107:36:59, 15.34s/it]
 33%|███▎      | 12710/37963 [54:27:36<105:36:26, 15.06s/it]
                                                            
{'loss': '0.163', 'grad_norm': '1.496', 'learning_rate': '1.551e-05', 'epoch': '0.3348'}

 33%|███▎      | 12710/37963 [54:27:36<105:36:26, 15.06s/it]
 33%|███▎      | 12711/37963 [54:27:50<104:16:27, 14.87s/it]
 33%|███▎      | 12712/37963 [54:28:05<103:12:40, 14.71s/it]
 33%|███▎      | 12713/37963 [54:28:19<102:22:51, 14.60s/it]
 33%|███▎      | 12714/37963 [54:28:34<101:56:23, 14.53s/it]
 33%|███▎      | 12715/37963 [54:28:48<101:50:40, 14.52s/it]
 33%|███▎      | 12716/37963 [54:29:02<101:36:53, 14.49s/it]
 33%|███▎      | 12717/37963 [54:29:23<114:45:32, 16.36s/it]
 34%|███▎      | 12718/37963 [54:29:37<109:43:35, 15.65s/it]
 34%|███▎      | 12719/37963 [54:29:52<107:00:17, 15.26s/it]
 34%|███▎      | 12720/37963 [54:30:06<104:58:23, 14.97s/it]
                                                            
{'loss': '0.1543', 'grad_norm': '2', 'learning_rate': '1.55e-05', 'epoch': '0.3351'}

 34%|███▎      | 12720/37963 [54:30:06<104:58:23, 14.97s/it]
 34%|███▎      | 12721/37963 [54:30:20<102:28:00, 14.61s/it]
 34%|███▎      | 12722/37963 [54:30:34<101:31:11, 14.48s/it]
 34%|███▎      | 12723/37963 [54:30:48<101:20:10, 14.45s/it]
 34%|███▎      | 12724/37963 [54:31:02<100:31:49, 14.34s/it]
 34%|███▎      | 12725/37963 [54:31:16<100:01:32, 14.27s/it]
 34%|███▎      | 12726/37963 [54:31:37<113:07:15, 16.14s/it]
 34%|███▎      | 12727/37963 [54:31:57<122:14:58, 17.44s/it]
 34%|███▎      | 12728/37963 [54:32:12<115:54:25, 16.54s/it]
 34%|███▎      | 12729/37963 [54:32:26<110:11:49, 15.72s/it]
 34%|███▎      | 12730/37963 [54:32:40<107:15:53, 15.30s/it]
                                                            
{'loss': '0.1568', 'grad_norm': '3.013', 'learning_rate': '1.55e-05', 'epoch': '0.3353'}

 34%|███▎      | 12730/37963 [54:32:40<107:15:53, 15.30s/it]
 34%|███▎      | 12731/37963 [54:32:54<105:07:00, 15.00s/it]
 34%|███▎      | 12732/37963 [54:33:09<103:54:10, 14.83s/it]
 34%|███▎      | 12733/37963 [54:33:23<102:46:34, 14.66s/it]
 34%|███▎      | 12734/37963 [54:33:44<116:59:42, 16.69s/it]
 34%|███▎      | 12735/37963 [54:33:59<112:10:18, 16.01s/it]
 34%|███▎      | 12736/37963 [54:34:13<108:25:19, 15.47s/it]
 34%|███▎      | 12737/37963 [54:34:34<119:55:57, 17.12s/it]
 34%|███▎      | 12738/37963 [54:34:48<114:04:04, 16.28s/it]
 34%|███▎      | 12739/37963 [54:35:02<109:15:29, 15.59s/it]
 34%|███▎      | 12740/37963 [54:35:17<106:32:49, 15.21s/it]
                                                            
{'loss': '0.1563', 'grad_norm': '1.531', 'learning_rate': '1.549e-05', 'epoch': '0.3356'}

 34%|███▎      | 12740/37963 [54:35:17<106:32:49, 15.21s/it]
 34%|███▎      | 12741/37963 [54:35:31<104:37:44, 14.93s/it]
 34%|███▎      | 12742/37963 [54:35:45<103:36:51, 14.79s/it]
 34%|███▎      | 12743/37963 [54:36:00<102:36:57, 14.65s/it]
 34%|███▎      | 12744/37963 [54:36:14<101:59:24, 14.56s/it]
 34%|███▎      | 12745/37963 [54:36:28<101:29:29, 14.49s/it]
 34%|███▎      | 12746/37963 [54:36:43<101:09:02, 14.44s/it]
 34%|███▎      | 12747/37963 [54:37:04<115:41:34, 16.52s/it]
 34%|███▎      | 12748/37963 [54:37:18<111:00:58, 15.85s/it]
 34%|███▎      | 12749/37963 [54:37:33<108:25:15, 15.48s/it]
 34%|███▎      | 12750/37963 [54:37:47<106:04:46, 15.15s/it]
                                                            
{'loss': '0.1636', 'grad_norm': '3.232', 'learning_rate': '1.548e-05', 'epoch': '0.3359'}

 34%|███▎      | 12750/37963 [54:37:47<106:04:46, 15.15s/it]
 34%|███▎      | 12751/37963 [54:38:08<118:08:40, 16.87s/it]
 34%|███▎      | 12752/37963 [54:38:22<112:07:14, 16.01s/it]
 34%|███▎      | 12753/37963 [54:38:36<107:51:42, 15.40s/it]
 34%|███▎      | 12754/37963 [54:38:50<105:34:47, 15.08s/it]
 34%|███▎      | 12755/37963 [54:39:12<118:33:54, 16.93s/it]
 34%|███▎      | 12756/37963 [54:39:26<113:08:27, 16.16s/it]
 34%|███▎      | 12757/37963 [54:39:40<109:17:43, 15.61s/it]
 34%|███▎      | 12758/37963 [54:39:55<106:51:17, 15.26s/it]
 34%|███▎      | 12759/37963 [54:40:09<105:24:24, 15.06s/it]
 34%|███▎      | 12760/37963 [54:40:24<103:51:14, 14.83s/it]
                                                            
{'loss': '0.1469', 'grad_norm': '3.051', 'learning_rate': '1.548e-05', 'epoch': '0.3361'}

 34%|███▎      | 12760/37963 [54:40:24<103:51:14, 14.83s/it]
 34%|███▎      | 12761/37963 [54:40:38<102:45:41, 14.68s/it]
 34%|███▎      | 12762/37963 [54:40:52<101:33:50, 14.51s/it]
 34%|███▎      | 12763/37963 [54:41:06<101:08:45, 14.45s/it]
 34%|███▎      | 12764/37963 [54:41:21<101:03:36, 14.44s/it]
 34%|███▎      | 12765/37963 [54:41:35<100:52:04, 14.41s/it]
 34%|███▎      | 12766/37963 [54:41:50<100:48:46, 14.40s/it]
 34%|███▎      | 12767/37963 [54:42:10<113:37:33, 16.23s/it]
 34%|███▎      | 12768/37963 [54:42:24<109:36:34, 15.66s/it]
 34%|███▎      | 12769/37963 [54:42:39<106:49:33, 15.26s/it]
 34%|███▎      | 12770/37963 [54:42:53<104:53:29, 14.99s/it]
                                                            
{'loss': '0.1751', 'grad_norm': '4.683', 'learning_rate': '1.547e-05', 'epoch': '0.3364'}

 34%|███▎      | 12770/37963 [54:42:53<104:53:29, 14.99s/it]
 34%|███▎      | 12771/37963 [54:43:07<103:25:58, 14.78s/it]
 34%|███▎      | 12772/37963 [54:43:21<101:49:00, 14.55s/it]
 34%|███▎      | 12773/37963 [54:43:36<101:35:22, 14.52s/it]
 34%|███▎      | 12774/37963 [54:43:56<114:13:24, 16.32s/it]
 34%|███▎      | 12775/37963 [54:44:11<110:09:30, 15.74s/it]
 34%|███▎      | 12776/37963 [54:44:25<107:43:33, 15.40s/it]
 34%|███▎      | 12777/37963 [54:44:40<105:37:07, 15.10s/it]
 34%|███▎      | 12778/37963 [54:44:54<104:08:00, 14.89s/it]
 34%|███▎      | 12779/37963 [54:45:14<115:27:19, 16.50s/it]
 34%|███▎      | 12780/37963 [54:45:29<110:58:03, 15.86s/it]
                                                            
{'loss': '0.1542', 'grad_norm': '3.683', 'learning_rate': '1.546e-05', 'epoch': '0.3366'}

 34%|███▎      | 12780/37963 [54:45:29<110:58:03, 15.86s/it]
 34%|███▎      | 12781/37963 [54:45:43<107:08:09, 15.32s/it]
 34%|███▎      | 12782/37963 [54:45:57<105:03:39, 15.02s/it]
 34%|███▎      | 12783/37963 [54:46:18<117:28:21, 16.80s/it]
 34%|███▎      | 12784/37963 [54:46:32<112:15:14, 16.05s/it]
 34%|███▎      | 12785/37963 [54:46:53<122:34:32, 17.53s/it]
 34%|███▎      | 12786/37963 [54:47:07<115:08:13, 16.46s/it]
 34%|███▎      | 12787/37963 [54:47:22<110:35:46, 15.81s/it]
 34%|███▎      | 12788/37963 [54:47:36<107:32:17, 15.38s/it]
 34%|███▎      | 12789/37963 [54:47:51<105:34:41, 15.10s/it]
 34%|███▎      | 12790/37963 [54:48:05<104:03:32, 14.88s/it]
                                                            
{'loss': '0.1577', 'grad_norm': '2.763', 'learning_rate': '1.545e-05', 'epoch': '0.3369'}

 34%|███▎      | 12790/37963 [54:48:05<104:03:32, 14.88s/it]
 34%|███▎      | 12791/37963 [54:48:19<103:18:40, 14.78s/it]
 34%|███▎      | 12792/37963 [54:48:34<102:47:18, 14.70s/it]
 34%|███▎      | 12793/37963 [54:48:48<101:43:09, 14.55s/it]
 34%|███▎      | 12794/37963 [54:49:02<100:57:01, 14.44s/it]
 34%|███▎      | 12795/37963 [54:49:24<115:48:09, 16.56s/it]
 34%|███▎      | 12796/37963 [54:49:38<111:11:25, 15.91s/it]
 34%|███▎      | 12797/37963 [54:49:53<108:07:24, 15.47s/it]
 34%|███▎      | 12798/37963 [54:50:07<105:06:45, 15.04s/it]
 34%|███▎      | 12799/37963 [54:50:21<102:53:34, 14.72s/it]
 34%|███▎      | 12800/37963 [54:50:35<102:09:58, 14.62s/it]
                                                            
{'loss': '0.1743', 'grad_norm': '2.783', 'learning_rate': '1.545e-05', 'epoch': '0.3372'}

 34%|███▎      | 12800/37963 [54:50:35<102:09:58, 14.62s/it]
 34%|███▎      | 12801/37963 [54:50:49<100:49:09, 14.42s/it]
 34%|███▎      | 12802/37963 [54:51:10<114:38:15, 16.40s/it]
 34%|███▎      | 12803/37963 [54:51:30<122:34:56, 17.54s/it]
 34%|███▎      | 12804/37963 [54:51:45<115:49:43, 16.57s/it]
 34%|███▎      | 12805/37963 [54:51:59<110:47:36, 15.85s/it]
 34%|███▎      | 12806/37963 [54:52:13<107:28:09, 15.38s/it]
 34%|███▎      | 12807/37963 [54:52:27<105:17:03, 15.07s/it]
 34%|███▎      | 12808/37963 [54:52:42<103:36:19, 14.83s/it]
 34%|███▎      | 12809/37963 [54:52:56<102:36:19, 14.68s/it]
 34%|███▎      | 12810/37963 [54:53:10<101:57:07, 14.59s/it]
                                                            
{'loss': '0.1562', 'grad_norm': '2.884', 'learning_rate': '1.544e-05', 'epoch': '0.3374'}

 34%|███▎      | 12810/37963 [54:53:10<101:57:07, 14.59s/it]
 34%|███▎      | 12811/37963 [54:53:25<101:05:03, 14.47s/it]
 34%|███▎      | 12812/37963 [54:53:39<100:59:38, 14.46s/it]
 34%|███▍      | 12813/37963 [54:53:53<100:42:06, 14.41s/it]
 34%|███▍      | 12814/37963 [54:54:08<100:41:29, 14.41s/it]
 34%|███▍      | 12815/37963 [54:54:28<113:20:45, 16.23s/it]
 34%|███▍      | 12816/37963 [54:54:43<109:32:22, 15.68s/it]
 34%|███▍      | 12817/37963 [54:54:57<106:44:30, 15.28s/it]
 34%|███▍      | 12818/37963 [54:55:11<104:44:44, 15.00s/it]
 34%|███▍      | 12819/37963 [54:55:26<103:33:44, 14.83s/it]
 34%|███▍      | 12820/37963 [54:55:40<102:28:51, 14.67s/it]
                                                            
{'loss': '0.1455', 'grad_norm': '1.702', 'learning_rate': '1.543e-05', 'epoch': '0.3377'}

 34%|███▍      | 12820/37963 [54:55:40<102:28:51, 14.67s/it]
 34%|███▍      | 12821/37963 [54:56:00<114:27:13, 16.39s/it]
 34%|███▍      | 12822/37963 [54:56:14<109:28:13, 15.68s/it]
 34%|███▍      | 12823/37963 [54:56:29<106:51:24, 15.30s/it]
 34%|███▍      | 12824/37963 [54:56:43<103:46:11, 14.86s/it]
 34%|███▍      | 12825/37963 [54:56:57<102:50:13, 14.73s/it]
 34%|███▍      | 12826/37963 [54:57:11<102:05:50, 14.62s/it]
 34%|███▍      | 12827/37963 [54:57:26<101:40:45, 14.56s/it]
 34%|███▍      | 12828/37963 [54:57:47<115:21:24, 16.52s/it]
 34%|███▍      | 12829/37963 [54:58:01<110:45:21, 15.86s/it]
 34%|███▍      | 12830/37963 [54:58:15<106:19:26, 15.23s/it]
                                                            
{'loss': '0.152', 'grad_norm': '3.929', 'learning_rate': '1.543e-05', 'epoch': '0.338'}

 34%|███▍      | 12830/37963 [54:58:15<106:19:26, 15.23s/it]
 34%|███▍      | 12831/37963 [54:58:36<118:10:29, 16.93s/it]
 34%|███▍      | 12832/37963 [54:58:50<112:58:31, 16.18s/it]
 34%|███▍      | 12833/37963 [54:59:05<109:00:57, 15.62s/it]
 34%|███▍      | 12834/37963 [54:59:19<105:41:21, 15.14s/it]
 34%|███▍      | 12835/37963 [54:59:40<118:13:01, 16.94s/it]
 34%|███▍      | 12836/37963 [54:59:54<112:54:32, 16.18s/it]
 34%|███▍      | 12837/37963 [55:00:08<108:16:47, 15.51s/it]
 34%|███▍      | 12838/37963 [55:00:22<104:29:14, 14.97s/it]
 34%|███▍      | 12839/37963 [55:00:36<102:00:09, 14.62s/it]
 34%|███▍      | 12840/37963 [55:00:49<100:21:31, 14.38s/it]
                                                            
{'loss': '0.1546', 'grad_norm': '1.372', 'learning_rate': '1.542e-05', 'epoch': '0.3382'}

 34%|███▍      | 12840/37963 [55:00:49<100:21:31, 14.38s/it]
 34%|███▍      | 12841/37963 [55:01:04<100:18:14, 14.37s/it]
 34%|███▍      | 12842/37963 [55:01:18<100:15:31, 14.37s/it]
 34%|███▍      | 12843/37963 [55:01:39<114:11:41, 16.37s/it]
 34%|███▍      | 12844/37963 [55:01:54<109:52:35, 15.75s/it]
 34%|███▍      | 12845/37963 [55:02:08<106:58:56, 15.33s/it]
 34%|███▍      | 12846/37963 [55:02:22<103:38:55, 14.86s/it]
 34%|███▍      | 12847/37963 [55:02:36<102:24:02, 14.68s/it]
 34%|███▍      | 12848/37963 [55:02:51<102:19:18, 14.67s/it]
 34%|███▍      | 12849/37963 [55:03:11<115:06:09, 16.50s/it]
 34%|███▍      | 12850/37963 [55:03:26<110:16:58, 15.81s/it]
                                                            
{'loss': '0.1516', 'grad_norm': '2.559', 'learning_rate': '1.541e-05', 'epoch': '0.3385'}

 34%|███▍      | 12850/37963 [55:03:26<110:16:58, 15.81s/it]
 34%|███▍      | 12851/37963 [55:03:40<107:05:52, 15.35s/it]
 34%|███▍      | 12852/37963 [55:04:01<119:04:24, 17.07s/it]
 34%|███▍      | 12853/37963 [55:04:15<113:30:31, 16.27s/it]
 34%|███▍      | 12854/37963 [55:04:30<109:28:47, 15.70s/it]
 34%|███▍      | 12855/37963 [55:04:44<106:42:41, 15.30s/it]
 34%|███▍      | 12856/37963 [55:04:58<104:24:14, 14.97s/it]
 34%|███▍      | 12857/37963 [55:05:13<103:06:09, 14.78s/it]
 34%|███▍      | 12858/37963 [55:05:27<102:17:45, 14.67s/it]
 34%|███▍      | 12859/37963 [55:05:41<101:41:52, 14.58s/it]
 34%|███▍      | 12860/37963 [55:05:56<101:23:30, 14.54s/it]
                                                            
{'loss': '0.1666', 'grad_norm': '1.679', 'learning_rate': '1.54e-05', 'epoch': '0.3388'}

 34%|███▍      | 12860/37963 [55:05:56<101:23:30, 14.54s/it]
 34%|███▍      | 12861/37963 [55:06:10<100:59:47, 14.48s/it]
 34%|███▍      | 12862/37963 [55:06:25<100:43:47, 14.45s/it]
 34%|███▍      | 12863/37963 [55:06:39<100:32:26, 14.42s/it]
 34%|███▍      | 12864/37963 [55:06:59<112:52:43, 16.19s/it]
 34%|███▍      | 12865/37963 [55:07:14<109:13:02, 15.67s/it]
 34%|███▍      | 12866/37963 [55:07:28<106:39:42, 15.30s/it]
 34%|███▍      | 12867/37963 [55:07:42<104:37:13, 15.01s/it]
 34%|███▍      | 12868/37963 [55:08:02<114:45:11, 16.46s/it]
 34%|███▍      | 12869/37963 [55:08:17<110:21:10, 15.83s/it]
 34%|███▍      | 12870/37963 [55:08:31<107:17:32, 15.39s/it]
                                                            
{'loss': '0.1562', 'grad_norm': '3.041', 'learning_rate': '1.54e-05', 'epoch': '0.339'}

 34%|███▍      | 12870/37963 [55:08:31<107:17:32, 15.39s/it]
 34%|███▍      | 12871/37963 [55:08:45<104:50:04, 15.04s/it]
 34%|███▍      | 12872/37963 [55:09:00<103:24:05, 14.84s/it]
 34%|███▍      | 12873/37963 [55:09:14<102:29:39, 14.71s/it]
 34%|███▍      | 12874/37963 [55:09:28<101:55:12, 14.62s/it]
 34%|███▍      | 12875/37963 [55:09:49<115:19:31, 16.55s/it]
 34%|███▍      | 12876/37963 [55:10:04<110:39:46, 15.88s/it]
 34%|███▍      | 12877/37963 [55:10:18<106:40:06, 15.31s/it]
 34%|███▍      | 12878/37963 [55:10:39<118:06:07, 16.95s/it]
 34%|███▍      | 12879/37963 [55:10:53<112:36:17, 16.16s/it]
 34%|███▍      | 12880/37963 [55:11:06<107:17:18, 15.40s/it]
                                                            
{'loss': '0.1588', 'grad_norm': '1.549', 'learning_rate': '1.539e-05', 'epoch': '0.3393'}

 34%|███▍      | 12880/37963 [55:11:06<107:17:18, 15.40s/it]
 34%|███▍      | 12881/37963 [55:11:21<104:48:39, 15.04s/it]
 34%|███▍      | 12882/37963 [55:11:35<102:33:46, 14.72s/it]
 34%|███▍      | 12883/37963 [55:11:49<101:41:49, 14.60s/it]
 34%|███▍      | 12884/37963 [55:12:10<115:16:55, 16.55s/it]
 34%|███▍      | 12885/37963 [55:12:24<110:43:53, 15.90s/it]
 34%|███▍      | 12886/37963 [55:12:39<107:10:54, 15.39s/it]
 34%|███▍      | 12887/37963 [55:12:53<105:07:34, 15.09s/it]
 34%|███▍      | 12888/37963 [55:13:07<103:03:42, 14.80s/it]
 34%|███▍      | 12889/37963 [55:13:21<102:08:51, 14.67s/it]
 34%|███▍      | 12890/37963 [55:13:36<101:29:35, 14.57s/it]
                                                            
{'loss': '0.1579', 'grad_norm': '1.041', 'learning_rate': '1.538e-05', 'epoch': '0.3395'}

 34%|███▍      | 12890/37963 [55:13:36<101:29:35, 14.57s/it]
 34%|███▍      | 12891/37963 [55:13:50<100:55:39, 14.49s/it]
 34%|███▍      | 12892/37963 [55:14:11<114:49:24, 16.49s/it]
 34%|███▍      | 12893/37963 [55:14:26<110:46:04, 15.91s/it]
 34%|███▍      | 12894/37963 [55:14:40<107:32:47, 15.44s/it]
 34%|███▍      | 12895/37963 [55:14:55<105:11:31, 15.11s/it]
 34%|███▍      | 12896/37963 [55:15:16<117:31:04, 16.88s/it]
 34%|███▍      | 12897/37963 [55:15:30<112:17:07, 16.13s/it]
 34%|███▍      | 12898/37963 [55:15:44<107:52:43, 15.49s/it]
 34%|███▍      | 12899/37963 [55:15:58<105:46:20, 15.19s/it]
 34%|███▍      | 12900/37963 [55:16:13<104:03:49, 14.95s/it]
                                                            
{'loss': '0.1504', 'grad_norm': '3.59', 'learning_rate': '1.538e-05', 'epoch': '0.3398'}

 34%|███▍      | 12900/37963 [55:16:13<104:03:49, 14.95s/it]
 34%|███▍      | 12901/37963 [55:16:34<117:13:51, 16.84s/it]
 34%|███▍      | 12902/37963 [55:16:48<112:08:26, 16.11s/it]
 34%|███▍      | 12903/37963 [55:17:03<108:36:37, 15.60s/it]
 34%|███▍      | 12904/37963 [55:17:17<106:27:08, 15.29s/it]
 34%|███▍      | 12905/37963 [55:17:32<104:31:30, 15.02s/it]
 34%|███▍      | 12906/37963 [55:17:46<102:41:09, 14.75s/it]
 34%|███▍      | 12907/37963 [55:18:00<101:55:46, 14.65s/it]
 34%|███▍      | 12908/37963 [55:18:15<101:21:13, 14.56s/it]
 34%|███▍      | 12909/37963 [55:18:29<100:53:21, 14.50s/it]
 34%|███▍      | 12910/37963 [55:18:44<100:56:18, 14.50s/it]
                                                            
{'loss': '0.1621', 'grad_norm': '3.698', 'learning_rate': '1.537e-05', 'epoch': '0.3401'}

 34%|███▍      | 12910/37963 [55:18:44<100:56:18, 14.50s/it]
 34%|███▍      | 12911/37963 [55:18:58<100:38:43, 14.46s/it]
 34%|███▍      | 12912/37963 [55:19:12<100:29:02, 14.44s/it]
 34%|███▍      | 12913/37963 [55:19:33<114:07:44, 16.40s/it]
 34%|███▍      | 12914/37963 [55:19:48<110:04:14, 15.82s/it]
 34%|███▍      | 12915/37963 [55:20:09<120:42:17, 17.35s/it]
 34%|███▍      | 12916/37963 [55:20:23<114:25:25, 16.45s/it]
 34%|███▍      | 12917/37963 [55:20:37<109:33:21, 15.75s/it]
 34%|███▍      | 12918/37963 [55:20:52<106:56:10, 15.37s/it]
 34%|███▍      | 12919/37963 [55:21:06<104:45:04, 15.06s/it]
 34%|███▍      | 12920/37963 [55:21:20<102:38:03, 14.75s/it]
                                                            
{'loss': '0.1596', 'grad_norm': '3.1', 'learning_rate': '1.536e-05', 'epoch': '0.3403'}

 34%|███▍      | 12920/37963 [55:21:20<102:38:03, 14.75s/it]
 34%|███▍      | 12921/37963 [55:21:40<113:46:49, 16.36s/it]
 34%|███▍      | 12922/37963 [55:21:54<109:06:45, 15.69s/it]
 34%|███▍      | 12923/37963 [55:22:09<106:28:40, 15.31s/it]
 34%|███▍      | 12924/37963 [55:22:23<103:42:10, 14.91s/it]
 34%|███▍      | 12925/37963 [55:22:37<102:25:55, 14.73s/it]
 34%|███▍      | 12926/37963 [55:22:51<101:40:50, 14.62s/it]
 34%|███▍      | 12927/37963 [55:23:06<100:53:24, 14.51s/it]
 34%|███▍      | 12928/37963 [55:23:20<100:35:12, 14.46s/it]
 34%|███▍      | 12929/37963 [55:23:34<100:11:55, 14.41s/it]
 34%|███▍      | 12930/37963 [55:23:48<99:45:26, 14.35s/it] 
                                                           
{'loss': '0.1538', 'grad_norm': '1.009', 'learning_rate': '1.535e-05', 'epoch': '0.3406'}

 34%|███▍      | 12930/37963 [55:23:48<99:45:26, 14.35s/it]
 34%|███▍      | 12931/37963 [55:24:09<112:37:18, 16.20s/it]
 34%|███▍      | 12932/37963 [55:24:23<108:54:48, 15.66s/it]
 34%|███▍      | 12933/37963 [55:24:44<118:51:21, 17.09s/it]
 34%|███▍      | 12934/37963 [55:24:58<113:08:18, 16.27s/it]
 34%|███▍      | 12935/37963 [55:25:12<108:24:23, 15.59s/it]
 34%|███▍      | 12936/37963 [55:25:26<105:16:03, 15.14s/it]
 34%|███▍      | 12937/37963 [55:25:41<103:54:26, 14.95s/it]
 34%|███▍      | 12938/37963 [55:25:55<102:22:31, 14.73s/it]
 34%|███▍      | 12939/37963 [55:26:16<116:22:02, 16.74s/it]
 34%|███▍      | 12940/37963 [55:26:31<111:14:15, 16.00s/it]
                                                            
{'loss': '0.1465', 'grad_norm': '4.448', 'learning_rate': '1.535e-05', 'epoch': '0.3409'}

 34%|███▍      | 12940/37963 [55:26:31<111:14:15, 16.00s/it]
 34%|███▍      | 12941/37963 [55:26:45<107:44:48, 15.50s/it]
 34%|███▍      | 12942/37963 [55:26:59<105:10:50, 15.13s/it]
 34%|███▍      | 12943/37963 [55:27:14<103:43:30, 14.92s/it]
 34%|███▍      | 12944/37963 [55:27:28<102:31:17, 14.75s/it]
 34%|███▍      | 12945/37963 [55:27:49<115:09:36, 16.57s/it]
 34%|███▍      | 12946/37963 [55:28:03<111:01:11, 15.98s/it]
 34%|███▍      | 12947/37963 [55:28:18<107:40:20, 15.49s/it]
 34%|███▍      | 12948/37963 [55:28:32<104:12:54, 15.00s/it]
 34%|███▍      | 12949/37963 [55:28:46<102:47:31, 14.79s/it]
 34%|███▍      | 12950/37963 [55:29:07<116:05:27, 16.71s/it]
                                                            
{'loss': '0.1486', 'grad_norm': '4.571', 'learning_rate': '1.534e-05', 'epoch': '0.3411'}

 34%|███▍      | 12950/37963 [55:29:07<116:05:27, 16.71s/it]
 34%|███▍      | 12951/37963 [55:29:21<110:20:05, 15.88s/it]
 34%|███▍      | 12952/37963 [55:29:35<105:39:29, 15.21s/it]
 34%|███▍      | 12953/37963 [55:29:49<103:56:42, 14.96s/it]
 34%|███▍      | 12954/37963 [55:30:04<102:43:07, 14.79s/it]
 34%|███▍      | 12955/37963 [55:30:18<101:40:30, 14.64s/it]
 34%|███▍      | 12956/37963 [55:30:32<101:06:43, 14.56s/it]
 34%|███▍      | 12957/37963 [55:30:47<100:48:33, 14.51s/it]
 34%|███▍      | 12958/37963 [55:31:01<100:22:24, 14.45s/it]
 34%|███▍      | 12959/37963 [55:31:15<98:47:34, 14.22s/it] 
 34%|███▍      | 12960/37963 [55:31:29<98:56:08, 14.25s/it]
                                                           
{'loss': '0.1564', 'grad_norm': '3.392', 'learning_rate': '1.533e-05', 'epoch': '0.3414'}

 34%|███▍      | 12960/37963 [55:31:29<98:56:08, 14.25s/it]
 34%|███▍      | 12961/37963 [55:31:43<99:28:38, 14.32s/it]
 34%|███▍      | 12962/37963 [55:31:58<99:46:30, 14.37s/it]
 34%|███▍      | 12963/37963 [55:32:18<112:03:45, 16.14s/it]
 34%|███▍      | 12964/37963 [55:32:38<120:11:02, 17.31s/it]
 34%|███▍      | 12965/37963 [55:32:52<113:13:31, 16.31s/it]
 34%|███▍      | 12966/37963 [55:33:06<108:57:53, 15.69s/it]
 34%|███▍      | 12967/37963 [55:33:27<119:30:58, 17.21s/it]
 34%|███▍      | 12968/37963 [55:33:41<113:19:24, 16.32s/it]
 34%|███▍      | 12969/37963 [55:33:56<108:58:37, 15.70s/it]
 34%|███▍      | 12970/37963 [55:34:10<106:18:28, 15.31s/it]
                                                            
{'loss': '0.1589', 'grad_norm': '1.466', 'learning_rate': '1.532e-05', 'epoch': '0.3416'}

 34%|███▍      | 12970/37963 [55:34:10<106:18:28, 15.31s/it]
 34%|███▍      | 12971/37963 [55:34:24<104:15:21, 15.02s/it]
 34%|███▍      | 12972/37963 [55:34:39<102:50:14, 14.81s/it]
 34%|███▍      | 12973/37963 [55:34:53<102:00:03, 14.69s/it]
 34%|███▍      | 12974/37963 [55:35:07<101:04:24, 14.56s/it]
 34%|███▍      | 12975/37963 [55:35:22<100:35:02, 14.49s/it]
 34%|███▍      | 12976/37963 [55:35:36<100:39:30, 14.50s/it]
 34%|███▍      | 12977/37963 [55:35:50<99:37:34, 14.35s/it] 
 34%|███▍      | 12978/37963 [55:36:11<112:54:22, 16.27s/it]
 34%|███▍      | 12979/37963 [55:36:25<108:41:05, 15.66s/it]
 34%|███▍      | 12980/37963 [55:36:46<119:50:02, 17.27s/it]
                                                            
{'loss': '0.1539', 'grad_norm': '2.388', 'learning_rate': '1.532e-05', 'epoch': '0.3419'}

 34%|███▍      | 12980/37963 [55:36:46<119:50:02, 17.27s/it]
 34%|███▍      | 12981/37963 [55:37:01<113:47:29, 16.40s/it]
 34%|███▍      | 12982/37963 [55:37:15<109:37:58, 15.80s/it]
 34%|███▍      | 12983/37963 [55:37:29<106:01:42, 15.28s/it]
 34%|███▍      | 12984/37963 [55:37:43<103:59:37, 14.99s/it]
 34%|███▍      | 12985/37963 [55:37:58<102:46:20, 14.81s/it]
 34%|███▍      | 12986/37963 [55:38:12<101:53:35, 14.69s/it]
 34%|███▍      | 12987/37963 [55:38:27<101:12:37, 14.59s/it]
 34%|███▍      | 12988/37963 [55:38:41<100:42:53, 14.52s/it]
 34%|███▍      | 12989/37963 [55:39:02<113:39:17, 16.38s/it]
 34%|███▍      | 12990/37963 [55:39:16<108:47:08, 15.68s/it]
                                                            
{'loss': '0.148', 'grad_norm': '2.259', 'learning_rate': '1.531e-05', 'epoch': '0.3422'}

 34%|███▍      | 12990/37963 [55:39:16<108:47:08, 15.68s/it]
 34%|███▍      | 12991/37963 [55:39:30<106:19:24, 15.33s/it]
 34%|███▍      | 12992/37963 [55:39:45<104:16:22, 15.03s/it]
 34%|███▍      | 12993/37963 [55:40:05<116:36:59, 16.81s/it]
 34%|███▍      | 12994/37963 [55:40:20<111:12:35, 16.03s/it]
 34%|███▍      | 12995/37963 [55:40:34<107:18:31, 15.47s/it]
 34%|███▍      | 12996/37963 [55:40:48<105:00:05, 15.14s/it]
 34%|███▍      | 12997/37963 [55:41:03<103:20:28, 14.90s/it]
 34%|███▍      | 12998/37963 [55:41:24<116:24:42, 16.79s/it]
 34%|███▍      | 12999/37963 [55:41:38<111:19:44, 16.05s/it]
 34%|███▍      | 13000/37963 [55:41:52<107:49:54, 15.55s/it]
                                                            
{'loss': '0.1626', 'grad_norm': '2.669', 'learning_rate': '1.53e-05', 'epoch': '0.3424'}

 34%|███▍      | 13000/37963 [55:41:52<107:49:54, 15.55s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.58s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.58s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 34%|███▍      | 13001/37963 [55:43:41<300:29:09, 43.34s/it]
 34%|███▍      | 13002/37963 [55:43:55<240:13:01, 34.65s/it]
 34%|███▍      | 13003/37963 [55:44:09<197:41:20, 28.51s/it]
 34%|███▍      | 13004/37963 [55:44:24<168:16:46, 24.27s/it]
 34%|███▍      | 13005/37963 [55:44:38<147:28:45, 21.27s/it]
 34%|███▍      | 13006/37963 [55:44:52<133:04:03, 19.19s/it]
 34%|███▍      | 13007/37963 [55:45:07<123:00:58, 17.75s/it]
 34%|███▍      | 13008/37963 [55:45:21<115:13:30, 16.62s/it]
 34%|███▍      | 13009/37963 [55:45:35<110:42:27, 15.97s/it]
 34%|███▍      | 13010/37963 [55:45:56<120:47:17, 17.43s/it]
                                                            
{'loss': '0.1574', 'grad_norm': '3.512', 'learning_rate': '1.53e-05', 'epoch': '0.3427'}

 34%|███▍      | 13010/37963 [55:45:56<120:47:17, 17.43s/it]
 34%|███▍      | 13011/37963 [55:46:16<126:00:39, 18.18s/it]
 34%|███▍      | 13012/37963 [55:46:29<116:22:37, 16.79s/it]
 34%|███▍      | 13013/37963 [55:46:43<110:28:10, 15.94s/it]
 34%|███▍      | 13014/37963 [55:47:04<120:44:21, 17.42s/it]
 34%|███▍      | 13015/37963 [55:47:19<114:24:44, 16.51s/it]
 34%|███▍      | 13016/37963 [55:47:33<109:45:53, 15.84s/it]
 34%|███▍      | 13017/37963 [55:47:47<106:43:43, 15.40s/it]
 34%|███▍      | 13018/37963 [55:48:02<104:28:31, 15.08s/it]
 34%|███▍      | 13019/37963 [55:48:16<103:01:05, 14.87s/it]
 34%|███▍      | 13020/37963 [55:48:30<101:55:04, 14.71s/it]
                                                            
{'loss': '0.1588', 'grad_norm': '3.193', 'learning_rate': '1.529e-05', 'epoch': '0.343'}

 34%|███▍      | 13020/37963 [55:48:30<101:55:04, 14.71s/it]
 34%|███▍      | 13021/37963 [55:48:45<101:09:14, 14.60s/it]
 34%|███▍      | 13022/37963 [55:48:59<100:38:47, 14.53s/it]
 34%|███▍      | 13023/37963 [55:49:13<100:25:46, 14.50s/it]
 34%|███▍      | 13024/37963 [55:49:28<100:15:12, 14.47s/it]
 34%|███▍      | 13025/37963 [55:49:42<100:21:56, 14.49s/it]
 34%|███▍      | 13026/37963 [55:50:02<111:42:53, 16.13s/it]
 34%|███▍      | 13027/37963 [55:50:16<106:59:20, 15.45s/it]
 34%|███▍      | 13028/37963 [55:50:30<103:55:28, 15.00s/it]
 34%|███▍      | 13029/37963 [55:50:52<118:14:59, 17.07s/it]
 34%|███▍      | 13030/37963 [55:51:06<112:35:02, 16.26s/it]
                                                            
{'loss': '0.1841', 'grad_norm': '3.519', 'learning_rate': '1.528e-05', 'epoch': '0.3432'}

 34%|███▍      | 13030/37963 [55:51:06<112:35:02, 16.26s/it]
 34%|███▍      | 13031/37963 [55:51:21<108:39:05, 15.69s/it]
 34%|███▍      | 13032/37963 [55:51:35<105:56:23, 15.30s/it]
 34%|███▍      | 13033/37963 [55:51:49<103:44:18, 14.98s/it]
 34%|███▍      | 13034/37963 [55:52:04<102:22:15, 14.78s/it]
 34%|███▍      | 13035/37963 [55:52:25<115:56:49, 16.74s/it]
 34%|███▍      | 13036/37963 [55:52:39<110:36:40, 15.97s/it]
 34%|███▍      | 13037/37963 [55:52:54<107:48:46, 15.57s/it]
 34%|███▍      | 13038/37963 [55:53:08<104:57:02, 15.16s/it]
 34%|███▍      | 13039/37963 [55:53:22<102:34:56, 14.82s/it]
 34%|███▍      | 13040/37963 [55:53:36<101:36:24, 14.68s/it]
                                                            
{'loss': '0.1542', 'grad_norm': '2.438', 'learning_rate': '1.527e-05', 'epoch': '0.3435'}

 34%|███▍      | 13040/37963 [55:53:36<101:36:24, 14.68s/it]
 34%|███▍      | 13041/37963 [55:53:58<115:22:53, 16.67s/it]
 34%|███▍      | 13042/37963 [55:54:12<110:32:51, 15.97s/it]
 34%|███▍      | 13043/37963 [55:54:26<107:18:39, 15.50s/it]
 34%|███▍      | 13044/37963 [55:54:41<104:57:55, 15.16s/it]
 34%|███▍      | 13045/37963 [55:54:55<103:17:43, 14.92s/it]
 34%|███▍      | 13046/37963 [55:55:10<102:08:24, 14.76s/it]
 34%|███▍      | 13047/37963 [55:55:31<115:23:28, 16.67s/it]
 34%|███▍      | 13048/37963 [55:55:45<110:37:18, 15.98s/it]
 34%|███▍      | 13049/37963 [55:55:59<107:17:30, 15.50s/it]
 34%|███▍      | 13050/37963 [55:56:14<104:51:15, 15.15s/it]
                                                            
{'loss': '0.1548', 'grad_norm': '5.711', 'learning_rate': '1.527e-05', 'epoch': '0.3438'}

 34%|███▍      | 13050/37963 [55:56:14<104:51:15, 15.15s/it]
 34%|███▍      | 13051/37963 [55:56:28<102:25:47, 14.80s/it]
 34%|███▍      | 13052/37963 [55:56:42<101:31:55, 14.67s/it]
 34%|███▍      | 13053/37963 [55:56:56<100:38:10, 14.54s/it]
 34%|███▍      | 13054/37963 [55:57:11<100:27:04, 14.52s/it]
 34%|███▍      | 13055/37963 [55:57:25<99:58:38, 14.45s/it] 
 34%|███▍      | 13056/37963 [55:57:39<99:45:01, 14.42s/it]
 34%|███▍      | 13057/37963 [55:58:00<112:21:39, 16.24s/it]
 34%|███▍      | 13058/37963 [55:58:14<108:00:04, 15.61s/it]
 34%|███▍      | 13059/37963 [55:58:28<105:30:21, 15.25s/it]
 34%|███▍      | 13060/37963 [55:58:49<117:20:04, 16.96s/it]
                                                            
{'loss': '0.1563', 'grad_norm': '4.418', 'learning_rate': '1.526e-05', 'epoch': '0.344'}

 34%|███▍      | 13060/37963 [55:58:49<117:20:04, 16.96s/it]
 34%|███▍      | 13061/37963 [55:59:10<125:37:07, 18.16s/it]
 34%|███▍      | 13062/37963 [55:59:25<117:40:32, 17.01s/it]
 34%|███▍      | 13063/37963 [55:59:39<111:54:08, 16.18s/it]
 34%|███▍      | 13064/37963 [55:59:53<108:19:18, 15.66s/it]
 34%|███▍      | 13065/37963 [56:00:08<105:12:00, 15.21s/it]
 34%|███▍      | 13066/37963 [56:00:22<103:09:31, 14.92s/it]
 34%|███▍      | 13067/37963 [56:00:36<101:54:03, 14.74s/it]
 34%|███▍      | 13068/37963 [56:00:50<100:40:10, 14.56s/it]
 34%|███▍      | 13069/37963 [56:01:05<100:14:19, 14.50s/it]
 34%|███▍      | 13070/37963 [56:01:19<99:56:13, 14.45s/it] 
                                                           
{'loss': '0.1547', 'grad_norm': '4.176', 'learning_rate': '1.525e-05', 'epoch': '0.3443'}

 34%|███▍      | 13070/37963 [56:01:19<99:56:13, 14.45s/it]
 34%|███▍      | 13071/37963 [56:01:33<99:40:46, 14.42s/it]
 34%|███▍      | 13072/37963 [56:01:48<99:38:33, 14.41s/it]
 34%|███▍      | 13073/37963 [56:02:02<98:54:44, 14.31s/it]
 34%|███▍      | 13074/37963 [56:02:23<112:18:21, 16.24s/it]
 34%|███▍      | 13075/37963 [56:02:37<108:25:19, 15.68s/it]
 34%|███▍      | 13076/37963 [56:02:51<105:40:53, 15.29s/it]
 34%|███▍      | 13077/37963 [56:03:06<103:46:05, 15.01s/it]
 34%|███▍      | 13078/37963 [56:03:27<116:25:48, 16.84s/it]
 34%|███▍      | 13079/37963 [56:03:41<111:17:42, 16.10s/it]
 34%|███▍      | 13080/37963 [56:03:55<106:30:42, 15.41s/it]
                                                            
{'loss': '0.1644', 'grad_norm': '4.194', 'learning_rate': '1.525e-05', 'epoch': '0.3445'}

 34%|███▍      | 13080/37963 [56:03:55<106:30:42, 15.41s/it]
 34%|███▍      | 13081/37963 [56:04:09<104:30:58, 15.12s/it]
 34%|███▍      | 13082/37963 [56:04:24<102:55:10, 14.89s/it]
 34%|███▍      | 13083/37963 [56:04:38<101:53:47, 14.74s/it]
 34%|███▍      | 13084/37963 [56:04:59<114:47:04, 16.61s/it]
 34%|███▍      | 13085/37963 [56:05:13<110:01:54, 15.92s/it]
 34%|███▍      | 13086/37963 [56:05:28<106:41:56, 15.44s/it]
 34%|███▍      | 13087/37963 [56:05:42<103:20:06, 14.95s/it]
 34%|███▍      | 13088/37963 [56:05:56<102:00:50, 14.76s/it]
 34%|███▍      | 13089/37963 [56:06:10<100:57:56, 14.61s/it]
 34%|███▍      | 13090/37963 [56:06:32<115:01:12, 16.65s/it]
                                                            
{'loss': '0.1607', 'grad_norm': '0.7208', 'learning_rate': '1.524e-05', 'epoch': '0.3448'}

 34%|███▍      | 13090/37963 [56:06:32<115:01:12, 16.65s/it]
 34%|███▍      | 13091/37963 [56:06:46<109:48:22, 15.89s/it]
 34%|███▍      | 13092/37963 [56:07:00<106:39:56, 15.44s/it]
 34%|███▍      | 13093/37963 [56:07:14<103:24:33, 14.97s/it]
 34%|███▍      | 13094/37963 [56:07:28<102:06:34, 14.78s/it]
 34%|███▍      | 13095/37963 [56:07:49<115:19:24, 16.69s/it]
 34%|███▍      | 13096/37963 [56:08:04<110:32:31, 16.00s/it]
 34%|███▍      | 13097/37963 [56:08:18<107:10:05, 15.52s/it]
 35%|███▍      | 13098/37963 [56:08:33<104:55:27, 15.19s/it]
 35%|███▍      | 13099/37963 [56:08:47<103:06:25, 14.93s/it]
 35%|███▍      | 13100/37963 [56:09:01<101:47:56, 14.74s/it]
                                                            
{'loss': '0.1513', 'grad_norm': '1.749', 'learning_rate': '1.523e-05', 'epoch': '0.3451'}

 35%|███▍      | 13100/37963 [56:09:01<101:47:56, 14.74s/it]
 35%|███▍      | 13101/37963 [56:09:16<100:57:15, 14.62s/it]
 35%|███▍      | 13102/37963 [56:09:30<100:23:58, 14.54s/it]
 35%|███▍      | 13103/37963 [56:09:44<100:07:13, 14.50s/it]
 35%|███▍      | 13104/37963 [56:09:59<99:53:55, 14.47s/it] 
 35%|███▍      | 13105/37963 [56:10:12<98:27:17, 14.26s/it]
 35%|███▍      | 13106/37963 [56:10:33<111:47:30, 16.19s/it]
 35%|███▍      | 13107/37963 [56:10:47<107:15:49, 15.54s/it]
 35%|███▍      | 13108/37963 [56:11:07<116:29:58, 16.87s/it]
 35%|███▍      | 13109/37963 [56:11:27<123:37:03, 17.91s/it]
 35%|███▍      | 13110/37963 [56:11:42<116:24:20, 16.86s/it]
                                                            
{'loss': '0.1449', 'grad_norm': '2.515', 'learning_rate': '1.522e-05', 'epoch': '0.3453'}

 35%|███▍      | 13110/37963 [56:11:42<116:24:20, 16.86s/it]
 35%|███▍      | 13111/37963 [56:11:56<111:18:46, 16.12s/it]
 35%|███▍      | 13112/37963 [56:12:10<106:44:43, 15.46s/it]
 35%|███▍      | 13113/37963 [56:12:25<104:22:14, 15.12s/it]
 35%|███▍      | 13114/37963 [56:12:39<102:47:43, 14.89s/it]
 35%|███▍      | 13115/37963 [56:12:53<101:24:41, 14.69s/it]
 35%|███▍      | 13116/37963 [56:13:07<100:40:45, 14.59s/it]
 35%|███▍      | 13117/37963 [56:13:22<100:20:23, 14.54s/it]
 35%|███▍      | 13118/37963 [56:13:36<99:58:48, 14.49s/it] 
 35%|███▍      | 13119/37963 [56:13:51<99:49:41, 14.47s/it]
 35%|███▍      | 13120/37963 [56:14:05<99:42:21, 14.45s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '4.267', 'learning_rate': '1.522e-05', 'epoch': '0.3456'}

 35%|███▍      | 13120/37963 [56:14:05<99:42:21, 14.45s/it]
 35%|███▍      | 13121/37963 [56:14:20<99:36:30, 14.43s/it]
 35%|███▍      | 13122/37963 [56:14:34<99:24:07, 14.41s/it]
 35%|███▍      | 13123/37963 [56:14:48<99:23:10, 14.40s/it]
 35%|███▍      | 13124/37963 [56:15:02<98:29:26, 14.27s/it]
 35%|███▍      | 13125/37963 [56:15:23<112:23:38, 16.29s/it]
 35%|███▍      | 13126/37963 [56:15:44<122:14:10, 17.72s/it]
 35%|███▍      | 13127/37963 [56:15:58<114:51:04, 16.65s/it]
 35%|███▍      | 13128/37963 [56:16:13<110:11:55, 15.97s/it]
 35%|███▍      | 13129/37963 [56:16:27<107:01:24, 15.51s/it]
 35%|███▍      | 13130/37963 [56:16:42<104:54:16, 15.21s/it]
                                                            
{'loss': '0.1731', 'grad_norm': '3.52', 'learning_rate': '1.521e-05', 'epoch': '0.3459'}

 35%|███▍      | 13130/37963 [56:16:42<104:54:16, 15.21s/it]
 35%|███▍      | 13131/37963 [56:16:56<103:00:32, 14.93s/it]
 35%|███▍      | 13132/37963 [56:17:17<115:55:03, 16.81s/it]
 35%|███▍      | 13133/37963 [56:17:32<110:47:09, 16.06s/it]
 35%|███▍      | 13134/37963 [56:17:46<107:17:55, 15.56s/it]
 35%|███▍      | 13135/37963 [56:18:00<104:46:08, 15.19s/it]
 35%|███▍      | 13136/37963 [56:18:15<103:02:00, 14.94s/it]
 35%|███▍      | 13137/37963 [56:18:29<101:45:18, 14.76s/it]
 35%|███▍      | 13138/37963 [56:18:50<114:22:43, 16.59s/it]
 35%|███▍      | 13139/37963 [56:19:04<109:01:46, 15.81s/it]
 35%|███▍      | 13140/37963 [56:19:18<105:46:11, 15.34s/it]
                                                            
{'loss': '0.1475', 'grad_norm': '0.7061', 'learning_rate': '1.52e-05', 'epoch': '0.3461'}

 35%|███▍      | 13140/37963 [56:19:18<105:46:11, 15.34s/it]
 35%|███▍      | 13141/37963 [56:19:32<103:54:47, 15.07s/it]
 35%|███▍      | 13142/37963 [56:19:47<102:22:44, 14.85s/it]
 35%|███▍      | 13143/37963 [56:20:08<115:00:45, 16.68s/it]
 35%|███▍      | 13144/37963 [56:20:21<108:38:17, 15.76s/it]
 35%|███▍      | 13145/37963 [56:20:36<105:47:36, 15.35s/it]
 35%|███▍      | 13146/37963 [56:20:50<103:49:14, 15.06s/it]
 35%|███▍      | 13147/37963 [56:21:04<101:53:12, 14.78s/it]
 35%|███▍      | 13148/37963 [56:21:18<100:37:23, 14.60s/it]
 35%|███▍      | 13149/37963 [56:21:33<99:50:18, 14.48s/it] 
 35%|███▍      | 13150/37963 [56:21:47<98:50:13, 14.34s/it]
                                                           
{'loss': '0.1648', 'grad_norm': '2.125', 'learning_rate': '1.519e-05', 'epoch': '0.3464'}

 35%|███▍      | 13150/37963 [56:21:47<98:50:13, 14.34s/it]
 35%|███▍      | 13151/37963 [56:22:01<98:53:27, 14.35s/it]
 35%|███▍      | 13152/37963 [56:22:16<99:10:04, 14.39s/it]
 35%|███▍      | 13153/37963 [56:22:30<98:56:37, 14.36s/it]
 35%|███▍      | 13154/37963 [56:22:44<98:51:06, 14.34s/it]
 35%|███▍      | 13155/37963 [56:23:05<111:39:15, 16.20s/it]
 35%|███▍      | 13156/37963 [56:23:19<107:45:24, 15.64s/it]
 35%|███▍      | 13157/37963 [56:23:33<105:18:08, 15.28s/it]
 35%|███▍      | 13158/37963 [56:23:53<115:07:54, 16.71s/it]
 35%|███▍      | 13159/37963 [56:24:15<124:53:35, 18.13s/it]
 35%|███▍      | 13160/37963 [56:24:29<117:15:00, 17.02s/it]
                                                            
{'loss': '0.1581', 'grad_norm': '2.901', 'learning_rate': '1.519e-05', 'epoch': '0.3467'}

 35%|███▍      | 13160/37963 [56:24:29<117:15:00, 17.02s/it]
 35%|███▍      | 13161/37963 [56:24:43<111:05:03, 16.12s/it]
 35%|███▍      | 13162/37963 [56:24:58<107:26:29, 15.60s/it]
 35%|███▍      | 13163/37963 [56:25:12<104:23:37, 15.15s/it]
 35%|███▍      | 13164/37963 [56:25:26<103:00:19, 14.95s/it]
 35%|███▍      | 13165/37963 [56:25:40<101:09:12, 14.68s/it]
 35%|███▍      | 13166/37963 [56:25:55<100:31:21, 14.59s/it]
 35%|███▍      | 13167/37963 [56:26:09<100:11:01, 14.55s/it]
 35%|███▍      | 13168/37963 [56:26:23<99:12:09, 14.40s/it] 
 35%|███▍      | 13169/37963 [56:26:38<99:01:19, 14.38s/it]
 35%|███▍      | 13170/37963 [56:26:52<99:02:22, 14.38s/it]
                                                           
{'loss': '0.1477', 'grad_norm': '0.7968', 'learning_rate': '1.518e-05', 'epoch': '0.3469'}

 35%|███▍      | 13170/37963 [56:26:52<99:02:22, 14.38s/it]
 35%|███▍      | 13171/37963 [56:27:06<98:59:24, 14.37s/it]
 35%|███▍      | 13172/37963 [56:27:21<98:51:37, 14.36s/it]
 35%|███▍      | 13173/37963 [56:27:48<125:38:23, 18.25s/it]
 35%|███▍      | 13174/37963 [56:28:02<117:15:42, 17.03s/it]
 35%|███▍      | 13175/37963 [56:28:17<112:18:03, 16.31s/it]
 35%|███▍      | 13176/37963 [56:28:31<108:15:34, 15.72s/it]
 35%|███▍      | 13177/37963 [56:28:45<105:03:23, 15.26s/it]
 35%|███▍      | 13178/37963 [56:29:00<103:19:58, 15.01s/it]
 35%|███▍      | 13179/37963 [56:29:14<101:02:56, 14.68s/it]
 35%|███▍      | 13180/37963 [56:29:28<100:31:42, 14.60s/it]
                                                            
{'loss': '0.1538', 'grad_norm': '4.04', 'learning_rate': '1.517e-05', 'epoch': '0.3472'}

 35%|███▍      | 13180/37963 [56:29:28<100:31:42, 14.60s/it]
 35%|███▍      | 13181/37963 [56:29:43<100:26:05, 14.59s/it]
 35%|███▍      | 13182/37963 [56:30:04<114:22:37, 16.62s/it]
 35%|███▍      | 13183/37963 [56:30:18<109:37:59, 15.93s/it]
 35%|███▍      | 13184/37963 [56:30:33<106:19:13, 15.45s/it]
 35%|███▍      | 13185/37963 [56:30:47<104:18:37, 15.16s/it]
 35%|███▍      | 13186/37963 [56:31:01<100:58:47, 14.67s/it]
 35%|███▍      | 13187/37963 [56:31:22<114:03:16, 16.57s/it]
 35%|███▍      | 13188/37963 [56:31:36<109:45:40, 15.95s/it]
 35%|███▍      | 13189/37963 [56:31:51<106:37:14, 15.49s/it]
 35%|███▍      | 13190/37963 [56:32:05<104:21:24, 15.17s/it]
                                                            
{'loss': '0.1639', 'grad_norm': '3.685', 'learning_rate': '1.517e-05', 'epoch': '0.3474'}

 35%|███▍      | 13190/37963 [56:32:05<104:21:24, 15.17s/it]
 35%|███▍      | 13191/37963 [56:32:19<102:36:39, 14.91s/it]
 35%|███▍      | 13192/37963 [56:32:41<115:54:59, 16.85s/it]
 35%|███▍      | 13193/37963 [56:32:55<109:56:07, 15.98s/it]
 35%|███▍      | 13194/37963 [56:33:08<105:02:46, 15.27s/it]
 35%|███▍      | 13195/37963 [56:33:22<102:23:17, 14.88s/it]
 35%|███▍      | 13196/37963 [56:33:37<101:21:51, 14.73s/it]
 35%|███▍      | 13197/37963 [56:33:51<100:37:22, 14.63s/it]
 35%|███▍      | 13198/37963 [56:34:05<98:45:01, 14.36s/it] 
 35%|███▍      | 13199/37963 [56:34:19<98:44:43, 14.35s/it]
 35%|███▍      | 13200/37963 [56:34:33<98:48:31, 14.36s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '4.729', 'learning_rate': '1.516e-05', 'epoch': '0.3477'}

 35%|███▍      | 13200/37963 [56:34:33<98:48:31, 14.36s/it]
 35%|███▍      | 13201/37963 [56:34:48<98:46:16, 14.36s/it]
 35%|███▍      | 13202/37963 [56:35:02<98:32:30, 14.33s/it]
 35%|███▍      | 13203/37963 [56:35:22<110:46:11, 16.11s/it]
 35%|███▍      | 13204/37963 [56:35:36<106:12:51, 15.44s/it]
 35%|███▍      | 13205/37963 [56:35:50<102:57:26, 14.97s/it]
 35%|███▍      | 13206/37963 [56:36:10<114:08:33, 16.60s/it]
 35%|███▍      | 13207/37963 [56:36:32<123:18:08, 17.93s/it]
 35%|███▍      | 13208/37963 [56:36:46<115:52:51, 16.85s/it]
 35%|███▍      | 13209/37963 [56:37:00<110:55:13, 16.13s/it]
 35%|███▍      | 13210/37963 [56:37:15<107:13:20, 15.59s/it]
                                                            
{'loss': '0.1501', 'grad_norm': '2.888', 'learning_rate': '1.515e-05', 'epoch': '0.348'}

 35%|███▍      | 13210/37963 [56:37:15<107:13:20, 15.59s/it]
 35%|███▍      | 13211/37963 [56:37:29<104:37:39, 15.22s/it]
 35%|███▍      | 13212/37963 [56:37:43<102:46:15, 14.95s/it]
 35%|███▍      | 13213/37963 [56:37:57<100:49:15, 14.66s/it]
 35%|███▍      | 13214/37963 [56:38:12<100:12:43, 14.58s/it]
 35%|███▍      | 13215/37963 [56:38:26<99:28:46, 14.47s/it] 
 35%|███▍      | 13216/37963 [56:38:40<99:09:04, 14.42s/it]
 35%|███▍      | 13217/37963 [56:38:54<97:01:32, 14.12s/it]
 35%|███▍      | 13218/37963 [56:39:08<97:20:08, 14.16s/it]
 35%|███▍      | 13219/37963 [56:39:22<97:43:59, 14.22s/it]
 35%|███▍      | 13220/37963 [56:39:36<97:08:38, 14.13s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '1.593', 'learning_rate': '1.514e-05', 'epoch': '0.3482'}

 35%|███▍      | 13220/37963 [56:39:36<97:08:38, 14.13s/it]
 35%|███▍      | 13221/37963 [56:39:50<97:30:20, 14.19s/it]
 35%|███▍      | 13222/37963 [56:40:05<97:40:59, 14.21s/it]
 35%|███▍      | 13223/37963 [56:40:26<111:44:46, 16.26s/it]
 35%|███▍      | 13224/37963 [56:40:47<121:26:02, 17.67s/it]
 35%|███▍      | 13225/37963 [56:41:01<114:41:37, 16.69s/it]
 35%|███▍      | 13226/37963 [56:41:15<109:32:36, 15.94s/it]
 35%|███▍      | 13227/37963 [56:41:30<106:21:58, 15.48s/it]
 35%|███▍      | 13228/37963 [56:41:44<103:49:29, 15.11s/it]
 35%|███▍      | 13229/37963 [56:41:58<102:02:38, 14.85s/it]
 35%|███▍      | 13230/37963 [56:42:13<101:00:39, 14.70s/it]
                                                            
{'loss': '0.1683', 'grad_norm': '2.575', 'learning_rate': '1.514e-05', 'epoch': '0.3485'}

 35%|███▍      | 13230/37963 [56:42:13<101:00:39, 14.70s/it]
 35%|███▍      | 13231/37963 [56:42:33<112:59:58, 16.45s/it]
 35%|███▍      | 13232/37963 [56:42:48<108:44:31, 15.83s/it]
 35%|███▍      | 13233/37963 [56:43:01<104:55:21, 15.27s/it]
 35%|███▍      | 13234/37963 [56:43:16<102:20:13, 14.90s/it]
 35%|███▍      | 13235/37963 [56:43:30<101:15:46, 14.74s/it]
 35%|███▍      | 13236/37963 [56:43:51<113:28:35, 16.52s/it]
 35%|███▍      | 13237/37963 [56:44:05<108:34:42, 15.81s/it]
 35%|███▍      | 13238/37963 [56:44:18<104:21:33, 15.19s/it]
 35%|███▍      | 13239/37963 [56:44:33<102:36:22, 14.94s/it]
 35%|███▍      | 13240/37963 [56:44:54<115:40:57, 16.84s/it]
                                                            
{'loss': '0.1459', 'grad_norm': '1.009', 'learning_rate': '1.513e-05', 'epoch': '0.3488'}

 35%|███▍      | 13240/37963 [56:44:54<115:40:57, 16.84s/it]
 35%|███▍      | 13241/37963 [56:45:08<110:33:46, 16.10s/it]
 35%|███▍      | 13242/37963 [56:45:23<106:38:49, 15.53s/it]
 35%|███▍      | 13243/37963 [56:45:37<104:16:37, 15.19s/it]
 35%|███▍      | 13244/37963 [56:45:52<102:48:10, 14.97s/it]
 35%|███▍      | 13245/37963 [56:46:06<101:27:48, 14.78s/it]
 35%|███▍      | 13246/37963 [56:46:20<100:33:47, 14.65s/it]
 35%|███▍      | 13247/37963 [56:46:35<99:54:31, 14.55s/it] 
 35%|███▍      | 13248/37963 [56:46:49<98:44:24, 14.38s/it]
 35%|███▍      | 13249/37963 [56:47:03<98:34:31, 14.36s/it]
 35%|███▍      | 13250/37963 [56:47:17<98:46:24, 14.39s/it]
                                                           
{'loss': '0.1584', 'grad_norm': '2.482', 'learning_rate': '1.512e-05', 'epoch': '0.349'}

 35%|███▍      | 13250/37963 [56:47:17<98:46:24, 14.39s/it]
 35%|███▍      | 13251/37963 [56:47:38<111:04:54, 16.18s/it]
 35%|███▍      | 13252/37963 [56:47:52<107:20:12, 15.64s/it]
 35%|███▍      | 13253/37963 [56:48:06<104:53:02, 15.28s/it]
 35%|███▍      | 13254/37963 [56:48:27<116:12:14, 16.93s/it]
 35%|███▍      | 13255/37963 [56:48:48<124:30:10, 18.14s/it]
 35%|███▍      | 13256/37963 [56:49:02<115:53:21, 16.89s/it]
 35%|███▍      | 13257/37963 [56:49:17<110:44:24, 16.14s/it]
 35%|███▍      | 13258/37963 [56:49:30<106:07:00, 15.46s/it]
 35%|███▍      | 13259/37963 [56:49:45<103:46:15, 15.12s/it]
 35%|███▍      | 13260/37963 [56:49:59<101:57:49, 14.86s/it]
                                                            
{'loss': '0.1538', 'grad_norm': '3.954', 'learning_rate': '1.511e-05', 'epoch': '0.3493'}

 35%|███▍      | 13260/37963 [56:49:59<101:57:49, 14.86s/it]
 35%|███▍      | 13261/37963 [56:50:13<101:00:17, 14.72s/it]
 35%|███▍      | 13262/37963 [56:50:28<100:16:01, 14.61s/it]
 35%|███▍      | 13263/37963 [56:50:42<99:40:33, 14.53s/it] 
 35%|███▍      | 13264/37963 [56:50:56<99:20:08, 14.48s/it]
 35%|███▍      | 13265/37963 [56:51:11<98:56:58, 14.42s/it]
 35%|███▍      | 13266/37963 [56:51:25<98:46:53, 14.40s/it]
 35%|███▍      | 13267/37963 [56:51:39<97:16:38, 14.18s/it]
 35%|███▍      | 13268/37963 [56:51:53<97:40:16, 14.24s/it]
 35%|███▍      | 13269/37963 [56:52:07<97:27:23, 14.21s/it]
 35%|███▍      | 13270/37963 [56:52:28<110:31:36, 16.11s/it]
                                                            
{'loss': '0.1521', 'grad_norm': '1.865', 'learning_rate': '1.511e-05', 'epoch': '0.3496'}

 35%|███▍      | 13270/37963 [56:52:28<110:31:36, 16.11s/it]
 35%|███▍      | 13271/37963 [56:52:49<120:44:32, 17.60s/it]
 35%|███▍      | 13272/37963 [56:53:03<113:51:50, 16.60s/it]
 35%|███▍      | 13273/37963 [56:53:18<109:12:45, 15.92s/it]
 35%|███▍      | 13274/37963 [56:53:31<105:10:50, 15.34s/it]
 35%|███▍      | 13275/37963 [56:53:46<103:09:55, 15.04s/it]
 35%|███▍      | 13276/37963 [56:54:00<101:14:24, 14.76s/it]
 35%|███▍      | 13277/37963 [56:54:14<100:21:39, 14.64s/it]
 35%|███▍      | 13278/37963 [56:54:29<99:55:29, 14.57s/it] 
 35%|███▍      | 13279/37963 [56:54:50<113:51:33, 16.61s/it]
 35%|███▍      | 13280/37963 [56:55:04<109:10:26, 15.92s/it]
                                                            
{'loss': '0.1453', 'grad_norm': '2.432', 'learning_rate': '1.51e-05', 'epoch': '0.3498'}

 35%|███▍      | 13280/37963 [56:55:04<109:10:26, 15.92s/it]
 35%|███▍      | 13281/37963 [56:55:19<106:02:45, 15.47s/it]
 35%|███▍      | 13282/37963 [56:55:33<103:49:42, 15.14s/it]
 35%|███▍      | 13283/37963 [56:55:54<115:25:40, 16.84s/it]
 35%|███▍      | 13284/37963 [56:56:08<110:27:07, 16.11s/it]
 35%|███▍      | 13285/37963 [56:56:23<106:51:39, 15.59s/it]
 35%|███▍      | 13286/37963 [56:56:37<104:31:02, 15.25s/it]
 35%|███▍      | 13287/37963 [56:56:51<101:57:41, 14.88s/it]
 35%|███▌      | 13288/37963 [56:57:06<100:52:13, 14.72s/it]
 35%|███▌      | 13289/37963 [56:57:27<113:50:45, 16.61s/it]
 35%|███▌      | 13290/37963 [56:57:41<109:11:56, 15.93s/it]
                                                            
{'loss': '0.1829', 'grad_norm': '5.204', 'learning_rate': '1.509e-05', 'epoch': '0.3501'}

 35%|███▌      | 13290/37963 [56:57:41<109:11:56, 15.93s/it]
 35%|███▌      | 13291/37963 [56:57:55<105:56:27, 15.46s/it]
 35%|███▌      | 13292/37963 [56:58:10<103:35:59, 15.12s/it]
 35%|███▌      | 13293/37963 [56:58:24<102:15:05, 14.92s/it]
 35%|███▌      | 13294/37963 [56:58:38<101:07:23, 14.76s/it]
 35%|███▌      | 13295/37963 [56:58:53<100:17:17, 14.64s/it]
 35%|███▌      | 13296/37963 [56:59:07<99:11:27, 14.48s/it] 
 35%|███▌      | 13297/37963 [56:59:21<99:00:48, 14.45s/it]
 35%|███▌      | 13298/37963 [56:59:36<98:50:19, 14.43s/it]
 35%|███▌      | 13299/37963 [56:59:50<99:30:57, 14.53s/it]
 35%|███▌      | 13300/37963 [57:00:11<112:06:55, 16.37s/it]
                                                            
{'loss': '0.1523', 'grad_norm': '3.614', 'learning_rate': '1.508e-05', 'epoch': '0.3503'}

 35%|███▌      | 13300/37963 [57:00:11<112:06:55, 16.37s/it]
 35%|███▌      | 13301/37963 [57:00:25<106:14:46, 15.51s/it]
 35%|███▌      | 13302/37963 [57:00:39<103:55:12, 15.17s/it]
 35%|███▌      | 13303/37963 [57:01:06<129:00:01, 18.83s/it]
 35%|███▌      | 13304/37963 [57:01:21<119:58:11, 17.51s/it]
 35%|███▌      | 13305/37963 [57:01:35<113:21:08, 16.55s/it]
 35%|███▌      | 13306/37963 [57:01:49<108:10:35, 15.79s/it]
 35%|███▌      | 13307/37963 [57:02:03<104:12:23, 15.22s/it]
 35%|███▌      | 13308/37963 [57:02:17<102:26:47, 14.96s/it]
 35%|███▌      | 13309/37963 [57:02:31<100:43:53, 14.71s/it]
 35%|███▌      | 13310/37963 [57:02:46<99:57:57, 14.60s/it] 
                                                           
{'loss': '0.1471', 'grad_norm': '1.994', 'learning_rate': '1.508e-05', 'epoch': '0.3506'}

 35%|███▌      | 13310/37963 [57:02:46<99:57:57, 14.60s/it]
 35%|███▌      | 13311/37963 [57:03:00<99:46:37, 14.57s/it]
 35%|███▌      | 13312/37963 [57:03:15<99:21:58, 14.51s/it]
 35%|███▌      | 13313/37963 [57:03:29<99:13:18, 14.49s/it]
 35%|███▌      | 13314/37963 [57:03:43<97:55:45, 14.30s/it]
 35%|███▌      | 13315/37963 [57:03:57<97:58:17, 14.31s/it]
 35%|███▌      | 13316/37963 [57:04:12<98:18:42, 14.36s/it]
 35%|███▌      | 13317/37963 [57:04:26<98:06:33, 14.33s/it]
 35%|███▌      | 13318/37963 [57:04:47<111:34:42, 16.30s/it]
 35%|███▌      | 13319/37963 [57:05:08<120:43:46, 17.64s/it]
 35%|███▌      | 13320/37963 [57:05:22<114:01:01, 16.66s/it]
                                                            
{'loss': '0.1615', 'grad_norm': '0.9905', 'learning_rate': '1.507e-05', 'epoch': '0.3509'}

 35%|███▌      | 13320/37963 [57:05:22<114:01:01, 16.66s/it]
 35%|███▌      | 13321/37963 [57:05:36<109:04:00, 15.93s/it]
 35%|███▌      | 13322/37963 [57:05:51<105:54:11, 15.47s/it]
 35%|███▌      | 13323/37963 [57:06:04<102:19:52, 14.95s/it]
 35%|███▌      | 13324/37963 [57:06:19<101:13:19, 14.79s/it]
 35%|███▌      | 13325/37963 [57:06:33<99:32:55, 14.55s/it] 
 35%|███▌      | 13326/37963 [57:06:47<99:05:26, 14.48s/it]
 35%|███▌      | 13327/37963 [57:07:08<112:30:29, 16.44s/it]
 35%|███▌      | 13328/37963 [57:07:23<108:07:48, 15.80s/it]
 35%|███▌      | 13329/37963 [57:07:37<105:17:16, 15.39s/it]
 35%|███▌      | 13330/37963 [57:07:51<102:48:25, 15.02s/it]
                                                            
{'loss': '0.1756', 'grad_norm': '2.731', 'learning_rate': '1.506e-05', 'epoch': '0.3511'}

 35%|███▌      | 13330/37963 [57:07:51<102:48:25, 15.02s/it]
 35%|███▌      | 13331/37963 [57:08:12<114:41:37, 16.76s/it]
 35%|███▌      | 13332/37963 [57:08:26<109:47:32, 16.05s/it]
 35%|███▌      | 13333/37963 [57:08:40<105:31:40, 15.42s/it]
 35%|███▌      | 13334/37963 [57:08:55<103:17:45, 15.10s/it]
 35%|███▌      | 13335/37963 [57:09:09<101:24:53, 14.82s/it]
 35%|███▌      | 13336/37963 [57:09:23<100:39:59, 14.72s/it]
 35%|███▌      | 13337/37963 [57:09:44<113:50:50, 16.64s/it]
 35%|███▌      | 13338/37963 [57:09:58<108:06:29, 15.80s/it]
 35%|███▌      | 13339/37963 [57:10:13<105:28:07, 15.42s/it]
 35%|███▌      | 13340/37963 [57:10:27<102:30:14, 14.99s/it]
                                                            
{'loss': '0.1477', 'grad_norm': '3.641', 'learning_rate': '1.506e-05', 'epoch': '0.3514'}

 35%|███▌      | 13340/37963 [57:10:27<102:30:14, 14.99s/it]
 35%|███▌      | 13341/37963 [57:10:41<101:18:17, 14.81s/it]
 35%|███▌      | 13342/37963 [57:10:55<100:00:58, 14.62s/it]
 35%|███▌      | 13343/37963 [57:11:10<99:27:21, 14.54s/it] 
 35%|███▌      | 13344/37963 [57:11:24<99:01:11, 14.48s/it]
 35%|███▌      | 13345/37963 [57:11:38<98:54:41, 14.46s/it]
 35%|███▌      | 13346/37963 [57:11:52<97:19:08, 14.23s/it]
 35%|███▌      | 13347/37963 [57:12:07<97:41:43, 14.29s/it]
 35%|███▌      | 13348/37963 [57:12:20<96:34:19, 14.12s/it]
 35%|███▌      | 13349/37963 [57:12:41<109:47:37, 16.06s/it]
 35%|███▌      | 13350/37963 [57:12:55<106:34:29, 15.59s/it]
                                                            
{'loss': '0.1575', 'grad_norm': '1.847', 'learning_rate': '1.505e-05', 'epoch': '0.3517'}

 35%|███▌      | 13350/37963 [57:12:55<106:34:29, 15.59s/it]
 35%|███▌      | 13351/37963 [57:13:16<116:00:17, 16.97s/it]
 35%|███▌      | 13352/37963 [57:13:36<123:42:26, 18.10s/it]
 35%|███▌      | 13353/37963 [57:13:50<115:23:47, 16.88s/it]
 35%|███▌      | 13354/37963 [57:14:04<109:46:49, 16.06s/it]
 35%|███▌      | 13355/37963 [57:14:19<105:38:56, 15.46s/it]
 35%|███▌      | 13356/37963 [57:14:33<103:16:48, 15.11s/it]
 35%|███▌      | 13357/37963 [57:14:47<101:52:07, 14.90s/it]
 35%|███▌      | 13358/37963 [57:15:01<99:25:56, 14.55s/it] 
 35%|███▌      | 13359/37963 [57:15:15<99:06:15, 14.50s/it]
 35%|███▌      | 13360/37963 [57:15:30<98:48:08, 14.46s/it]
                                                           
{'loss': '0.148', 'grad_norm': '1.778', 'learning_rate': '1.504e-05', 'epoch': '0.3519'}

 35%|███▌      | 13360/37963 [57:15:30<98:48:08, 14.46s/it]
 35%|███▌      | 13361/37963 [57:15:44<97:55:06, 14.33s/it]
 35%|███▌      | 13362/37963 [57:15:58<98:04:47, 14.35s/it]
 35%|███▌      | 13363/37963 [57:16:12<97:58:17, 14.34s/it]
 35%|███▌      | 13364/37963 [57:16:27<97:46:55, 14.31s/it]
 35%|███▌      | 13365/37963 [57:16:41<98:15:34, 14.38s/it]
 35%|███▌      | 13366/37963 [57:16:56<98:06:31, 14.36s/it]
 35%|███▌      | 13367/37963 [57:17:17<112:33:01, 16.47s/it]
 35%|███▌      | 13368/37963 [57:17:38<121:40:08, 17.81s/it]
 35%|███▌      | 13369/37963 [57:17:52<114:36:34, 16.78s/it]
 35%|███▌      | 13370/37963 [57:18:06<109:17:12, 16.00s/it]
                                                            
{'loss': '0.1564', 'grad_norm': '3.731', 'learning_rate': '1.503e-05', 'epoch': '0.3522'}

 35%|███▌      | 13370/37963 [57:18:06<109:17:12, 16.00s/it]
 35%|███▌      | 13371/37963 [57:18:21<106:06:22, 15.53s/it]
 35%|███▌      | 13372/37963 [57:18:35<103:44:24, 15.19s/it]
 35%|███▌      | 13373/37963 [57:18:50<102:01:11, 14.94s/it]
 35%|███▌      | 13374/37963 [57:19:04<100:53:26, 14.77s/it]
 35%|███▌      | 13375/37963 [57:19:18<100:08:37, 14.66s/it]
 35%|███▌      | 13376/37963 [57:19:40<114:12:12, 16.72s/it]
 35%|███▌      | 13377/37963 [57:19:54<109:34:51, 16.05s/it]
 35%|███▌      | 13378/37963 [57:20:09<106:16:12, 15.56s/it]
 35%|███▌      | 13379/37963 [57:20:23<103:52:00, 15.21s/it]
 35%|███▌      | 13380/37963 [57:20:44<115:18:26, 16.89s/it]
                                                            
{'loss': '0.1721', 'grad_norm': '0.8277', 'learning_rate': '1.503e-05', 'epoch': '0.3524'}

 35%|███▌      | 13380/37963 [57:20:44<115:18:26, 16.89s/it]
 35%|███▌      | 13381/37963 [57:20:58<110:10:18, 16.13s/it]
 35%|███▌      | 13382/37963 [57:21:13<106:28:13, 15.59s/it]
 35%|███▌      | 13383/37963 [57:21:27<104:06:05, 15.25s/it]
 35%|███▌      | 13384/37963 [57:21:48<116:07:01, 17.01s/it]
 35%|███▌      | 13385/37963 [57:22:03<110:57:40, 16.25s/it]
 35%|███▌      | 13386/37963 [57:22:16<105:37:28, 15.47s/it]
 35%|███▌      | 13387/37963 [57:22:31<103:09:51, 15.11s/it]
 35%|███▌      | 13388/37963 [57:22:45<101:39:41, 14.89s/it]
 35%|███▌      | 13389/37963 [57:22:59<100:28:34, 14.72s/it]
 35%|███▌      | 13390/37963 [57:23:14<99:43:19, 14.61s/it] 
                                                           
{'loss': '0.1548', 'grad_norm': '4.831', 'learning_rate': '1.502e-05', 'epoch': '0.3527'}

 35%|███▌      | 13390/37963 [57:23:14<99:43:19, 14.61s/it]
 35%|███▌      | 13391/37963 [57:23:27<97:23:42, 14.27s/it]
 35%|███▌      | 13392/37963 [57:23:41<97:17:13, 14.25s/it]
 35%|███▌      | 13393/37963 [57:23:56<97:48:23, 14.33s/it]
 35%|███▌      | 13394/37963 [57:24:10<97:49:08, 14.33s/it]
 35%|███▌      | 13395/37963 [57:24:25<97:49:47, 14.34s/it]
 35%|███▌      | 13396/37963 [57:24:45<109:42:59, 16.08s/it]
 35%|███▌      | 13397/37963 [57:24:59<106:12:18, 15.56s/it]
 35%|███▌      | 13398/37963 [57:25:14<103:48:25, 15.21s/it]
 35%|███▌      | 13399/37963 [57:25:28<101:52:31, 14.93s/it]
 35%|███▌      | 13400/37963 [57:25:42<100:31:06, 14.73s/it]
                                                            
{'loss': '0.1578', 'grad_norm': '2.74', 'learning_rate': '1.501e-05', 'epoch': '0.353'}

 35%|███▌      | 13400/37963 [57:25:42<100:31:06, 14.73s/it]
 35%|███▌      | 13401/37963 [57:25:56<99:44:51, 14.62s/it] 
 35%|███▌      | 13402/37963 [57:26:17<112:35:24, 16.50s/it]
 35%|███▌      | 13403/37963 [57:26:38<121:22:32, 17.79s/it]
 35%|███▌      | 13404/37963 [57:26:52<114:09:10, 16.73s/it]
 35%|███▌      | 13405/37963 [57:27:07<109:14:48, 16.01s/it]
 35%|███▌      | 13406/37963 [57:27:21<105:48:43, 15.51s/it]
 35%|███▌      | 13407/37963 [57:27:35<103:29:08, 15.17s/it]
 35%|███▌      | 13408/37963 [57:27:49<100:16:53, 14.70s/it]
 35%|███▌      | 13409/37963 [57:28:03<99:36:16, 14.60s/it] 
 35%|███▌      | 13410/37963 [57:28:18<99:17:26, 14.56s/it]
                                                           
{'loss': '0.1576', 'grad_norm': '5.731', 'learning_rate': '1.5e-05', 'epoch': '0.3532'}

 35%|███▌      | 13410/37963 [57:28:18<99:17:26, 14.56s/it]
 35%|███▌      | 13411/37963 [57:28:32<98:15:37, 14.41s/it]
 35%|███▌      | 13412/37963 [57:28:46<98:14:47, 14.41s/it]
 35%|███▌      | 13413/37963 [57:29:01<98:12:02, 14.40s/it]
 35%|███▌      | 13414/37963 [57:29:15<98:41:19, 14.47s/it]
 35%|███▌      | 13415/37963 [57:29:36<111:18:18, 16.32s/it]
 35%|███▌      | 13416/37963 [57:29:50<107:14:29, 15.73s/it]
 35%|███▌      | 13417/37963 [57:30:05<104:36:12, 15.34s/it]
 35%|███▌      | 13418/37963 [57:30:26<116:42:27, 17.12s/it]
 35%|███▌      | 13419/37963 [57:30:40<111:07:57, 16.30s/it]
 35%|███▌      | 13420/37963 [57:30:55<107:19:56, 15.74s/it]
                                                            
{'loss': '0.1617', 'grad_norm': '5.118', 'learning_rate': '1.5e-05', 'epoch': '0.3535'}

 35%|███▌      | 13420/37963 [57:30:55<107:19:56, 15.74s/it]
 35%|███▌      | 13421/37963 [57:31:09<103:37:49, 15.20s/it]
 35%|███▌      | 13422/37963 [57:31:23<100:47:26, 14.79s/it]
 35%|███▌      | 13423/37963 [57:31:43<113:13:24, 16.61s/it]
 35%|███▌      | 13424/37963 [57:31:58<108:35:04, 15.93s/it]
 35%|███▌      | 13425/37963 [57:32:12<105:23:03, 15.46s/it]
 35%|███▌      | 13426/37963 [57:32:27<103:20:11, 15.16s/it]
 35%|███▌      | 13427/37963 [57:32:48<115:04:09, 16.88s/it]
 35%|███▌      | 13428/37963 [57:33:01<108:50:24, 15.97s/it]
 35%|███▌      | 13429/37963 [57:33:15<104:15:44, 15.30s/it]
 35%|███▌      | 13430/37963 [57:33:29<102:16:17, 15.01s/it]
                                                            
{'loss': '0.1468', 'grad_norm': '1.996', 'learning_rate': '1.499e-05', 'epoch': '0.3538'}

 35%|███▌      | 13430/37963 [57:33:29<102:16:17, 15.01s/it]
 35%|███▌      | 13431/37963 [57:33:44<100:38:37, 14.77s/it]
 35%|███▌      | 13432/37963 [57:33:58<99:51:38, 14.65s/it] 
 35%|███▌      | 13433/37963 [57:34:19<113:20:06, 16.63s/it]
 35%|███▌      | 13434/37963 [57:34:34<108:38:48, 15.95s/it]
 35%|███▌      | 13435/37963 [57:34:48<105:01:00, 15.41s/it]
 35%|███▌      | 13436/37963 [57:35:02<102:50:16, 15.09s/it]
 35%|███▌      | 13437/37963 [57:35:17<101:17:51, 14.87s/it]
 35%|███▌      | 13438/37963 [57:35:31<100:25:24, 14.74s/it]
 35%|███▌      | 13439/37963 [57:35:45<99:40:58, 14.63s/it] 
 35%|███▌      | 13440/37963 [57:35:59<98:38:19, 14.48s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '5.975', 'learning_rate': '1.498e-05', 'epoch': '0.354'}

 35%|███▌      | 13440/37963 [57:35:59<98:38:19, 14.48s/it]
 35%|███▌      | 13441/37963 [57:36:14<98:24:50, 14.45s/it]
 35%|███▌      | 13442/37963 [57:36:28<96:58:42, 14.24s/it]
 35%|███▌      | 13443/37963 [57:36:42<97:10:56, 14.27s/it]
 35%|███▌      | 13444/37963 [57:36:56<96:22:14, 14.15s/it]
 35%|███▌      | 13445/37963 [57:37:17<110:38:12, 16.24s/it]
 35%|███▌      | 13446/37963 [57:37:31<106:20:07, 15.61s/it]
 35%|███▌      | 13447/37963 [57:37:45<103:45:55, 15.24s/it]
 35%|███▌      | 13448/37963 [57:38:00<102:04:20, 14.99s/it]
 35%|███▌      | 13449/37963 [57:38:14<100:54:57, 14.82s/it]
 35%|███▌      | 13450/37963 [57:38:28<98:53:07, 14.52s/it] 
                                                           
{'loss': '0.1663', 'grad_norm': '4.953', 'learning_rate': '1.497e-05', 'epoch': '0.3543'}

 35%|███▌      | 13450/37963 [57:38:28<98:53:07, 14.52s/it]
 35%|███▌      | 13451/37963 [57:38:49<112:08:26, 16.47s/it]
 35%|███▌      | 13452/37963 [57:39:10<120:58:57, 17.77s/it]
 35%|███▌      | 13453/37963 [57:39:24<113:59:45, 16.74s/it]
 35%|███▌      | 13454/37963 [57:39:38<108:43:23, 15.97s/it]
 35%|███▌      | 13455/37963 [57:39:52<104:40:55, 15.38s/it]
 35%|███▌      | 13456/37963 [57:40:07<102:17:15, 15.03s/it]
 35%|███▌      | 13457/37963 [57:40:21<100:49:04, 14.81s/it]
 35%|███▌      | 13458/37963 [57:40:35<99:58:33, 14.69s/it] 
 35%|███▌      | 13459/37963 [57:40:50<99:07:24, 14.56s/it]
 35%|███▌      | 13460/37963 [57:41:03<97:13:44, 14.28s/it]
                                                           
{'loss': '0.1507', 'grad_norm': '3.001', 'learning_rate': '1.497e-05', 'epoch': '0.3546'}

 35%|███▌      | 13460/37963 [57:41:03<97:13:44, 14.28s/it]
 35%|███▌      | 13461/37963 [57:41:18<97:19:41, 14.30s/it]
 35%|███▌      | 13462/37963 [57:41:32<96:59:22, 14.25s/it]
 35%|███▌      | 13463/37963 [57:41:46<97:07:58, 14.27s/it]
 35%|███▌      | 13464/37963 [57:42:07<110:51:05, 16.29s/it]
 35%|███▌      | 13465/37963 [57:42:21<106:56:09, 15.71s/it]
 35%|███▌      | 13466/37963 [57:42:36<104:05:06, 15.30s/it]
 35%|███▌      | 13467/37963 [57:42:57<116:11:48, 17.08s/it]
 35%|███▌      | 13468/37963 [57:43:11<109:41:52, 16.12s/it]
 35%|███▌      | 13469/37963 [57:43:25<106:03:17, 15.59s/it]
 35%|███▌      | 13470/37963 [57:43:40<104:06:53, 15.30s/it]
                                                            
{'loss': '0.155', 'grad_norm': '5.035', 'learning_rate': '1.496e-05', 'epoch': '0.3548'}

 35%|███▌      | 13470/37963 [57:43:40<104:06:53, 15.30s/it]
 35%|███▌      | 13471/37963 [57:44:01<115:35:29, 16.99s/it]
 35%|███▌      | 13472/37963 [57:44:15<110:31:06, 16.25s/it]
 35%|███▌      | 13473/37963 [57:44:29<104:58:15, 15.43s/it]
 35%|███▌      | 13474/37963 [57:44:43<102:59:17, 15.14s/it]
 35%|███▌      | 13475/37963 [57:45:04<114:38:45, 16.85s/it]
 35%|███▌      | 13476/37963 [57:45:19<109:52:02, 16.15s/it]
 36%|███▌      | 13477/37963 [57:45:33<106:12:29, 15.62s/it]
 36%|███▌      | 13478/37963 [57:45:47<103:39:24, 15.24s/it]
 36%|███▌      | 13479/37963 [57:46:01<101:08:02, 14.87s/it]
 36%|███▌      | 13480/37963 [57:46:15<98:30:21, 14.48s/it] 
                                                           
{'loss': '0.1599', 'grad_norm': '2.677', 'learning_rate': '1.495e-05', 'epoch': '0.3551'}

 36%|███▌      | 13480/37963 [57:46:15<98:30:21, 14.48s/it]
 36%|███▌      | 13481/37963 [57:46:29<97:28:07, 14.33s/it]
 36%|███▌      | 13482/37963 [57:46:50<111:17:30, 16.37s/it]
 36%|███▌      | 13483/37963 [57:47:04<106:57:10, 15.73s/it]
 36%|███▌      | 13484/37963 [57:47:18<102:53:18, 15.13s/it]
 36%|███▌      | 13485/37963 [57:47:33<101:45:13, 14.96s/it]
 36%|███▌      | 13486/37963 [57:47:47<100:16:20, 14.75s/it]
 36%|███▌      | 13487/37963 [57:48:01<99:29:23, 14.63s/it] 
 36%|███▌      | 13488/37963 [57:48:16<99:04:35, 14.57s/it]
 36%|███▌      | 13489/37963 [57:48:30<98:50:50, 14.54s/it]
 36%|███▌      | 13490/37963 [57:48:44<97:48:14, 14.39s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '0.6191', 'learning_rate': '1.494e-05', 'epoch': '0.3553'}

 36%|███▌      | 13490/37963 [57:48:44<97:48:14, 14.39s/it]
 36%|███▌      | 13491/37963 [57:48:59<97:50:45, 14.39s/it]
 36%|███▌      | 13492/37963 [57:49:13<97:46:18, 14.38s/it]
 36%|███▌      | 13493/37963 [57:49:27<96:45:29, 14.23s/it]
 36%|███▌      | 13494/37963 [57:49:48<110:16:51, 16.23s/it]
 36%|███▌      | 13495/37963 [57:50:02<106:33:04, 15.68s/it]
 36%|███▌      | 13496/37963 [57:50:16<103:58:50, 15.30s/it]
 36%|███▌      | 13497/37963 [57:50:30<101:15:22, 14.90s/it]
 36%|███▌      | 13498/37963 [57:50:45<100:13:28, 14.75s/it]
 36%|███▌      | 13499/37963 [57:51:05<111:23:59, 16.39s/it]
 36%|███▌      | 13500/37963 [57:51:19<107:22:30, 15.80s/it]
                                                            
{'loss': '0.1456', 'grad_norm': '1.471', 'learning_rate': '1.494e-05', 'epoch': '0.3556'}

 36%|███▌      | 13500/37963 [57:51:19<107:22:30, 15.80s/it]
 36%|███▌      | 13501/37963 [57:51:40<117:58:00, 17.36s/it]
 36%|███▌      | 13502/37963 [57:51:54<110:48:43, 16.31s/it]
 36%|███▌      | 13503/37963 [57:52:09<106:59:33, 15.75s/it]
 36%|███▌      | 13504/37963 [57:52:23<104:16:22, 15.35s/it]
 36%|███▌      | 13505/37963 [57:52:37<102:06:53, 15.03s/it]
 36%|███▌      | 13506/37963 [57:52:52<101:11:38, 14.90s/it]
 36%|███▌      | 13507/37963 [57:53:06<100:06:41, 14.74s/it]
 36%|███▌      | 13508/37963 [57:53:21<99:01:54, 14.58s/it] 
 36%|███▌      | 13509/37963 [57:53:35<98:44:34, 14.54s/it]
 36%|███▌      | 13510/37963 [57:53:49<98:01:08, 14.43s/it]
                                                           
{'loss': '0.1552', 'grad_norm': '3.501', 'learning_rate': '1.493e-05', 'epoch': '0.3559'}

 36%|███▌      | 13510/37963 [57:53:49<98:01:08, 14.43s/it]
 36%|███▌      | 13511/37963 [57:54:03<97:16:57, 14.32s/it]
 36%|███▌      | 13512/37963 [57:54:18<98:08:11, 14.45s/it]
 36%|███▌      | 13513/37963 [57:54:39<110:31:48, 16.27s/it]
 36%|███▌      | 13514/37963 [57:54:53<106:40:20, 15.71s/it]
 36%|███▌      | 13515/37963 [57:55:07<104:03:21, 15.32s/it]
 36%|███▌      | 13516/37963 [57:55:29<115:53:41, 17.07s/it]
 36%|███▌      | 13517/37963 [57:55:43<110:26:01, 16.26s/it]
 36%|███▌      | 13518/37963 [57:55:57<105:51:09, 15.59s/it]
 36%|███▌      | 13519/37963 [57:56:17<115:41:11, 17.04s/it]
 36%|███▌      | 13520/37963 [57:56:32<110:07:54, 16.22s/it]
                                                            
{'loss': '0.1539', 'grad_norm': '2.604', 'learning_rate': '1.492e-05', 'epoch': '0.3561'}

 36%|███▌      | 13520/37963 [57:56:32<110:07:54, 16.22s/it]
 36%|███▌      | 13521/37963 [57:56:46<106:30:29, 15.69s/it]
 36%|███▌      | 13522/37963 [57:57:01<103:59:08, 15.32s/it]
 36%|███▌      | 13523/37963 [57:57:15<102:01:04, 15.03s/it]
 36%|███▌      | 13524/37963 [57:57:29<99:59:08, 14.73s/it] 
 36%|███▌      | 13525/37963 [57:57:50<112:19:12, 16.55s/it]
 36%|███▌      | 13526/37963 [57:58:04<107:26:16, 15.83s/it]
 36%|███▌      | 13527/37963 [57:58:18<104:37:32, 15.41s/it]
 36%|███▌      | 13528/37963 [57:58:33<102:21:07, 15.08s/it]
 36%|███▌      | 13529/37963 [57:58:47<101:14:29, 14.92s/it]
 36%|███▌      | 13530/37963 [57:59:02<100:08:27, 14.75s/it]
                                                            
{'loss': '0.1578', 'grad_norm': '2.793', 'learning_rate': '1.491e-05', 'epoch': '0.3564'}

 36%|███▌      | 13530/37963 [57:59:02<100:08:27, 14.75s/it]
 36%|███▌      | 13531/37963 [57:59:16<99:20:17, 14.64s/it] 
 36%|███▌      | 13532/37963 [57:59:37<113:10:27, 16.68s/it]
 36%|███▌      | 13533/37963 [57:59:51<107:38:58, 15.86s/it]
 36%|███▌      | 13534/37963 [58:00:06<104:20:33, 15.38s/it]
 36%|███▌      | 13535/37963 [58:00:20<102:17:09, 15.07s/it]
 36%|███▌      | 13536/37963 [58:00:34<100:57:01, 14.88s/it]
 36%|███▌      | 13537/37963 [58:00:49<99:33:50, 14.67s/it] 
 36%|███▌      | 13538/37963 [58:01:03<99:04:22, 14.60s/it]
 36%|███▌      | 13539/37963 [58:01:17<98:28:12, 14.51s/it]
 36%|███▌      | 13540/37963 [58:01:32<98:10:25, 14.47s/it]
                                                           
{'loss': '0.1502', 'grad_norm': '1.21', 'learning_rate': '1.491e-05', 'epoch': '0.3567'}

 36%|███▌      | 13540/37963 [58:01:32<98:10:25, 14.47s/it]
 36%|███▌      | 13541/37963 [58:01:52<110:33:04, 16.30s/it]
 36%|███▌      | 13542/37963 [58:02:07<106:36:33, 15.72s/it]
 36%|███▌      | 13543/37963 [58:02:21<103:50:31, 15.31s/it]
 36%|███▌      | 13544/37963 [58:02:35<101:28:22, 14.96s/it]
 36%|███▌      | 13545/37963 [58:02:49<100:22:03, 14.80s/it]
 36%|███▌      | 13546/37963 [58:03:04<99:21:02, 14.65s/it] 
 36%|███▌      | 13547/37963 [58:03:24<111:32:39, 16.45s/it]
 36%|███▌      | 13548/37963 [58:03:39<107:26:56, 15.84s/it]
 36%|███▌      | 13549/37963 [58:03:53<104:17:38, 15.38s/it]
 36%|███▌      | 13550/37963 [58:04:14<116:01:35, 17.11s/it]
                                                            
{'loss': '0.1485', 'grad_norm': '1.326', 'learning_rate': '1.49e-05', 'epoch': '0.3569'}

 36%|███▌      | 13550/37963 [58:04:14<116:01:35, 17.11s/it]
 36%|███▌      | 13551/37963 [58:04:29<110:35:09, 16.31s/it]
 36%|███▌      | 13552/37963 [58:04:43<106:49:26, 15.75s/it]
 36%|███▌      | 13553/37963 [58:04:57<102:57:12, 15.18s/it]
 36%|███▌      | 13554/37963 [58:05:11<100:57:59, 14.89s/it]
 36%|███▌      | 13555/37963 [58:05:26<99:51:17, 14.73s/it] 
 36%|███▌      | 13556/37963 [58:05:40<99:08:53, 14.62s/it]
 36%|███▌      | 13557/37963 [58:05:54<98:39:54, 14.55s/it]
 36%|███▌      | 13558/37963 [58:06:09<98:36:30, 14.55s/it]
 36%|███▌      | 13559/37963 [58:06:23<98:23:19, 14.51s/it]
 36%|███▌      | 13560/37963 [58:06:38<98:10:04, 14.48s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '3.904', 'learning_rate': '1.489e-05', 'epoch': '0.3572'}

 36%|███▌      | 13560/37963 [58:06:38<98:10:04, 14.48s/it]
 36%|███▌      | 13561/37963 [58:06:52<97:56:23, 14.45s/it]
 36%|███▌      | 13562/37963 [58:07:07<97:47:22, 14.43s/it]
 36%|███▌      | 13563/37963 [58:07:27<110:39:08, 16.33s/it]
 36%|███▌      | 13564/37963 [58:07:48<118:38:09, 17.50s/it]
 36%|███▌      | 13565/37963 [58:08:02<112:23:48, 16.58s/it]
 36%|███▌      | 13566/37963 [58:08:16<106:34:10, 15.73s/it]
 36%|███▌      | 13567/37963 [58:08:29<102:13:28, 15.08s/it]
 36%|███▌      | 13568/37963 [58:08:50<114:31:53, 16.90s/it]
 36%|███▌      | 13569/37963 [58:09:05<109:41:23, 16.19s/it]
 36%|███▌      | 13570/37963 [58:09:20<106:31:49, 15.72s/it]
                                                            
{'loss': '0.1491', 'grad_norm': '1.001', 'learning_rate': '1.488e-05', 'epoch': '0.3575'}

 36%|███▌      | 13570/37963 [58:09:20<106:31:49, 15.72s/it]
 36%|███▌      | 13571/37963 [58:09:34<103:49:10, 15.32s/it]
 36%|███▌      | 13572/37963 [58:09:55<114:36:21, 16.92s/it]
 36%|███▌      | 13573/37963 [58:10:09<109:29:41, 16.16s/it]
 36%|███▌      | 13574/37963 [58:10:23<105:29:37, 15.57s/it]
 36%|███▌      | 13575/37963 [58:10:38<103:20:24, 15.25s/it]
 36%|███▌      | 13576/37963 [58:10:52<100:30:23, 14.84s/it]
 36%|███▌      | 13577/37963 [58:11:06<99:29:20, 14.69s/it] 
 36%|███▌      | 13578/37963 [58:11:20<98:50:44, 14.59s/it]
 36%|███▌      | 13579/37963 [58:11:35<98:22:39, 14.52s/it]
 36%|███▌      | 13580/37963 [58:11:49<97:53:35, 14.45s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '1.756', 'learning_rate': '1.488e-05', 'epoch': '0.3577'}

 36%|███▌      | 13580/37963 [58:11:49<97:53:35, 14.45s/it]
 36%|███▌      | 13581/37963 [58:12:10<111:55:53, 16.53s/it]
 36%|███▌      | 13582/37963 [58:12:25<107:35:01, 15.89s/it]
 36%|███▌      | 13583/37963 [58:12:39<104:33:29, 15.44s/it]
 36%|███▌      | 13584/37963 [58:12:53<102:01:16, 15.07s/it]
 36%|███▌      | 13585/37963 [58:13:08<100:37:27, 14.86s/it]
 36%|███▌      | 13586/37963 [58:13:22<99:05:31, 14.63s/it] 
 36%|███▌      | 13587/37963 [58:13:43<111:39:55, 16.49s/it]
 36%|███▌      | 13588/37963 [58:13:57<107:28:58, 15.87s/it]
 36%|███▌      | 13589/37963 [58:14:11<104:11:03, 15.39s/it]
 36%|███▌      | 13590/37963 [58:14:26<102:05:14, 15.08s/it]
                                                            
{'loss': '0.1632', 'grad_norm': '1.715', 'learning_rate': '1.487e-05', 'epoch': '0.358'}

 36%|███▌      | 13590/37963 [58:14:26<102:05:14, 15.08s/it]
 36%|███▌      | 13591/37963 [58:14:40<100:35:07, 14.86s/it]
 36%|███▌      | 13592/37963 [58:14:54<99:24:28, 14.68s/it] 
 36%|███▌      | 13593/37963 [58:15:09<98:52:07, 14.61s/it]
 36%|███▌      | 13594/37963 [58:15:23<98:05:45, 14.49s/it]
 36%|███▌      | 13595/37963 [58:15:37<97:47:41, 14.45s/it]
 36%|███▌      | 13596/37963 [58:15:52<97:35:19, 14.42s/it]
 36%|███▌      | 13597/37963 [58:16:12<110:36:12, 16.34s/it]
 36%|███▌      | 13598/37963 [58:16:27<106:41:58, 15.77s/it]
 36%|███▌      | 13599/37963 [58:16:41<103:46:20, 15.33s/it]
 36%|███▌      | 13600/37963 [58:16:56<101:48:59, 15.04s/it]
                                                            
{'loss': '0.1586', 'grad_norm': '2.486', 'learning_rate': '1.486e-05', 'epoch': '0.3582'}

 36%|███▌      | 13600/37963 [58:16:56<101:48:59, 15.04s/it]
 36%|███▌      | 13601/37963 [58:17:16<113:44:19, 16.81s/it]
 36%|███▌      | 13602/37963 [58:17:31<108:46:45, 16.08s/it]
 36%|███▌      | 13603/37963 [58:17:45<105:19:38, 15.57s/it]
 36%|███▌      | 13604/37963 [58:18:00<102:46:20, 15.19s/it]
 36%|███▌      | 13605/37963 [58:18:14<101:12:32, 14.96s/it]
 36%|███▌      | 13606/37963 [58:18:28<99:49:21, 14.75s/it] 
 36%|███▌      | 13607/37963 [58:18:43<99:00:26, 14.63s/it]
 36%|███▌      | 13608/37963 [58:18:57<98:36:08, 14.57s/it]
 36%|███▌      | 13609/37963 [58:19:17<109:16:19, 16.15s/it]
 36%|███▌      | 13610/37963 [58:19:31<105:41:40, 15.62s/it]
                                                            
{'loss': '0.1596', 'grad_norm': '1.17', 'learning_rate': '1.485e-05', 'epoch': '0.3585'}

 36%|███▌      | 13610/37963 [58:19:31<105:41:40, 15.62s/it]
 36%|███▌      | 13611/37963 [58:19:45<102:36:18, 15.17s/it]
 36%|███▌      | 13612/37963 [58:20:00<100:59:03, 14.93s/it]
 36%|███▌      | 13613/37963 [58:20:13<98:26:24, 14.55s/it] 
 36%|███▌      | 13614/37963 [58:20:27<97:30:50, 14.42s/it]
 36%|███▌      | 13615/37963 [58:20:48<110:35:13, 16.35s/it]
 36%|███▌      | 13616/37963 [58:21:09<120:12:09, 17.77s/it]
 36%|███▌      | 13617/37963 [58:21:24<113:08:56, 16.73s/it]
 36%|███▌      | 13618/37963 [58:21:37<106:59:09, 15.82s/it]
 36%|███▌      | 13619/37963 [58:21:51<102:41:08, 15.19s/it]
 36%|███▌      | 13620/37963 [58:22:05<100:59:26, 14.94s/it]
                                                            
{'loss': '0.1513', 'grad_norm': '3.588', 'learning_rate': '1.485e-05', 'epoch': '0.3588'}

 36%|███▌      | 13620/37963 [58:22:05<100:59:26, 14.94s/it]
 36%|███▌      | 13621/37963 [58:22:26<112:49:23, 16.69s/it]
 36%|███▌      | 13622/37963 [58:22:41<108:17:49, 16.02s/it]
 36%|███▌      | 13623/37963 [58:22:55<104:49:54, 15.51s/it]
 36%|███▌      | 13624/37963 [58:23:09<101:21:28, 14.99s/it]
 36%|███▌      | 13625/37963 [58:23:23<99:57:19, 14.79s/it] 
 36%|███▌      | 13626/37963 [58:23:38<99:18:04, 14.69s/it]
 36%|███▌      | 13627/37963 [58:23:52<97:50:31, 14.47s/it]
 36%|███▌      | 13628/37963 [58:24:06<97:31:19, 14.43s/it]
 36%|███▌      | 13629/37963 [58:24:27<111:14:55, 16.46s/it]
 36%|███▌      | 13630/37963 [58:24:42<107:18:45, 15.88s/it]
                                                            
{'loss': '0.1615', 'grad_norm': '0.9335', 'learning_rate': '1.484e-05', 'epoch': '0.359'}

 36%|███▌      | 13630/37963 [58:24:42<107:18:45, 15.88s/it]
 36%|███▌      | 13631/37963 [58:24:56<103:27:07, 15.31s/it]
 36%|███▌      | 13632/37963 [58:25:10<101:41:36, 15.05s/it]
 36%|███▌      | 13633/37963 [58:25:24<99:31:13, 14.73s/it] 
 36%|███▌      | 13634/37963 [58:25:38<98:26:45, 14.57s/it]
 36%|███▌      | 13635/37963 [58:25:53<98:01:16, 14.50s/it]
 36%|███▌      | 13636/37963 [58:26:13<110:20:38, 16.33s/it]
 36%|███▌      | 13637/37963 [58:26:28<106:29:03, 15.76s/it]
 36%|███▌      | 13638/37963 [58:26:42<103:37:46, 15.34s/it]
 36%|███▌      | 13639/37963 [58:26:56<101:43:58, 15.06s/it]
 36%|███▌      | 13640/37963 [58:27:11<100:12:51, 14.83s/it]
                                                            
{'loss': '0.1343', 'grad_norm': '4.106', 'learning_rate': '1.483e-05', 'epoch': '0.3593'}

 36%|███▌      | 13640/37963 [58:27:11<100:12:51, 14.83s/it]
 36%|███▌      | 13641/37963 [58:27:25<98:56:54, 14.65s/it] 
 36%|███▌      | 13642/37963 [58:27:39<97:40:46, 14.46s/it]
 36%|███▌      | 13643/37963 [58:27:53<97:23:33, 14.42s/it]
 36%|███▌      | 13644/37963 [58:28:08<97:23:54, 14.42s/it]
 36%|███▌      | 13645/37963 [58:28:22<97:01:08, 14.36s/it]
 36%|███▌      | 13646/37963 [58:28:36<96:58:49, 14.36s/it]
 36%|███▌      | 13647/37963 [58:28:50<96:52:39, 14.34s/it]
 36%|███▌      | 13648/37963 [58:29:11<109:03:34, 16.15s/it]
 36%|███▌      | 13649/37963 [58:29:25<105:23:48, 15.61s/it]
 36%|███▌      | 13650/37963 [58:29:40<102:47:03, 15.22s/it]
                                                            
{'loss': '0.1388', 'grad_norm': '1.824', 'learning_rate': '1.483e-05', 'epoch': '0.3596'}

 36%|███▌      | 13650/37963 [58:29:40<102:47:03, 15.22s/it]
 36%|███▌      | 13651/37963 [58:29:53<100:11:00, 14.83s/it]
 36%|███▌      | 13652/37963 [58:30:14<111:54:28, 16.57s/it]
 36%|███▌      | 13653/37963 [58:30:29<107:38:03, 15.94s/it]
 36%|███▌      | 13654/37963 [58:30:43<104:16:47, 15.44s/it]
 36%|███▌      | 13655/37963 [58:30:57<101:19:49, 15.01s/it]
 36%|███▌      | 13656/37963 [58:31:11<99:54:45, 14.80s/it] 
 36%|███▌      | 13657/37963 [58:31:26<99:35:57, 14.75s/it]
 36%|███▌      | 13658/37963 [58:31:46<111:31:07, 16.52s/it]
 36%|███▌      | 13659/37963 [58:32:01<107:00:17, 15.85s/it]
 36%|███▌      | 13660/37963 [58:32:15<104:02:00, 15.41s/it]
                                                            
{'loss': '0.1592', 'grad_norm': '2.833', 'learning_rate': '1.482e-05', 'epoch': '0.3598'}

 36%|███▌      | 13660/37963 [58:32:15<104:02:00, 15.41s/it]
 36%|███▌      | 13661/37963 [58:32:29<101:44:28, 15.07s/it]
 36%|███▌      | 13662/37963 [58:32:44<100:05:10, 14.83s/it]
 36%|███▌      | 13663/37963 [58:33:04<111:44:02, 16.55s/it]
 36%|███▌      | 13664/37963 [58:33:25<120:29:36, 17.85s/it]
 36%|███▌      | 13665/37963 [58:33:40<113:35:09, 16.83s/it]
 36%|███▌      | 13666/37963 [58:33:54<108:28:28, 16.07s/it]
 36%|███▌      | 13667/37963 [58:34:08<105:01:25, 15.56s/it]
 36%|███▌      | 13668/37963 [58:34:29<115:48:57, 17.16s/it]
 36%|███▌      | 13669/37963 [58:34:44<110:19:27, 16.35s/it]
 36%|███▌      | 13670/37963 [58:34:58<106:00:38, 15.71s/it]
                                                            
{'loss': '0.1608', 'grad_norm': '1.329', 'learning_rate': '1.481e-05', 'epoch': '0.3601'}

 36%|███▌      | 13670/37963 [58:34:58<106:00:38, 15.71s/it]
 36%|███▌      | 13671/37963 [58:35:12<103:14:05, 15.30s/it]
 36%|███▌      | 13672/37963 [58:35:27<101:25:54, 15.03s/it]
 36%|███▌      | 13673/37963 [58:35:41<100:11:58, 14.85s/it]
 36%|███▌      | 13674/37963 [58:35:55<99:14:03, 14.71s/it] 
 36%|███▌      | 13675/37963 [58:36:10<98:29:46, 14.60s/it]
 36%|███▌      | 13676/37963 [58:36:24<97:57:57, 14.52s/it]
 36%|███▌      | 13677/37963 [58:36:45<110:32:35, 16.39s/it]
 36%|███▌      | 13678/37963 [58:36:59<106:27:30, 15.78s/it]
 36%|███▌      | 13679/37963 [58:37:13<103:33:15, 15.35s/it]
 36%|███▌      | 13680/37963 [58:37:28<101:35:06, 15.06s/it]
                                                            
{'loss': '0.1604', 'grad_norm': '1.519', 'learning_rate': '1.48e-05', 'epoch': '0.3604'}

 36%|███▌      | 13680/37963 [58:37:28<101:35:06, 15.06s/it]
 36%|███▌      | 13681/37963 [58:37:42<100:00:58, 14.83s/it]
 36%|███▌      | 13682/37963 [58:37:56<97:58:17, 14.53s/it] 
 36%|███▌      | 13683/37963 [58:38:10<97:40:53, 14.48s/it]
 36%|███▌      | 13684/37963 [58:38:24<96:19:31, 14.28s/it]
 36%|███▌      | 13685/37963 [58:38:45<108:59:20, 16.16s/it]
 36%|███▌      | 13686/37963 [58:38:59<105:09:52, 15.59s/it]
 36%|███▌      | 13687/37963 [58:39:13<102:29:38, 15.20s/it]
 36%|███▌      | 13688/37963 [58:39:28<100:46:31, 14.95s/it]
 36%|███▌      | 13689/37963 [58:39:42<99:44:55, 14.79s/it] 
 36%|███▌      | 13690/37963 [58:39:56<99:03:16, 14.69s/it]
                                                           
{'loss': '0.1562', 'grad_norm': '3.677', 'learning_rate': '1.48e-05', 'epoch': '0.3606'}

 36%|███▌      | 13690/37963 [58:39:56<99:03:16, 14.69s/it]
 36%|███▌      | 13691/37963 [58:40:11<98:19:31, 14.58s/it]
 36%|███▌      | 13692/37963 [58:40:25<97:49:58, 14.51s/it]
 36%|███▌      | 13693/37963 [58:40:40<97:32:05, 14.47s/it]
 36%|███▌      | 13694/37963 [58:40:54<97:26:51, 14.46s/it]
 36%|███▌      | 13695/37963 [58:41:09<97:42:29, 14.49s/it]
 36%|███▌      | 13696/37963 [58:41:29<110:05:53, 16.33s/it]
 36%|███▌      | 13697/37963 [58:41:44<106:18:04, 15.77s/it]
 36%|███▌      | 13698/37963 [58:41:58<102:56:04, 15.27s/it]
 36%|███▌      | 13699/37963 [58:42:12<101:13:43, 15.02s/it]
 36%|███▌      | 13700/37963 [58:42:33<113:22:46, 16.82s/it]
                                                            
{'loss': '0.1479', 'grad_norm': '1.559', 'learning_rate': '1.479e-05', 'epoch': '0.3609'}

 36%|███▌      | 13700/37963 [58:42:33<113:22:46, 16.82s/it]
 36%|███▌      | 13701/37963 [58:42:48<109:04:57, 16.19s/it]
 36%|███▌      | 13702/37963 [58:43:02<105:14:11, 15.62s/it]
 36%|███▌      | 13703/37963 [58:43:17<102:45:37, 15.25s/it]
 36%|███▌      | 13704/37963 [58:43:31<101:02:31, 14.99s/it]
 36%|███▌      | 13705/37963 [58:43:45<100:06:55, 14.86s/it]
 36%|███▌      | 13706/37963 [58:44:00<99:11:08, 14.72s/it] 
 36%|███▌      | 13707/37963 [58:44:21<111:57:29, 16.62s/it]
 36%|███▌      | 13708/37963 [58:44:35<106:30:15, 15.81s/it]
 36%|███▌      | 13709/37963 [58:44:49<103:45:23, 15.40s/it]
 36%|███▌      | 13710/37963 [58:45:04<101:41:06, 15.09s/it]
                                                            
{'loss': '0.151', 'grad_norm': '4.719', 'learning_rate': '1.478e-05', 'epoch': '0.3611'}

 36%|███▌      | 13710/37963 [58:45:04<101:41:06, 15.09s/it]
 36%|███▌      | 13711/37963 [58:45:18<100:20:08, 14.89s/it]
 36%|███▌      | 13712/37963 [58:45:33<99:23:21, 14.75s/it] 
 36%|███▌      | 13713/37963 [58:45:54<112:38:55, 16.72s/it]
 36%|███▌      | 13714/37963 [58:46:15<121:30:55, 18.04s/it]
 36%|███▌      | 13715/37963 [58:46:29<113:52:08, 16.91s/it]
 36%|███▌      | 13716/37963 [58:46:44<109:03:29, 16.19s/it]
 36%|███▌      | 13717/37963 [58:46:58<105:32:27, 15.67s/it]
 36%|███▌      | 13718/37963 [58:47:19<115:53:42, 17.21s/it]
 36%|███▌      | 13719/37963 [58:47:33<109:59:52, 16.33s/it]
 36%|███▌      | 13720/37963 [58:47:48<105:57:36, 15.73s/it]
                                                            
{'loss': '0.1577', 'grad_norm': '1.378', 'learning_rate': '1.477e-05', 'epoch': '0.3614'}

 36%|███▌      | 13720/37963 [58:47:48<105:57:36, 15.73s/it]
 36%|███▌      | 13721/37963 [58:48:02<103:11:40, 15.32s/it]
 36%|███▌      | 13722/37963 [58:48:16<101:05:07, 15.01s/it]
 36%|███▌      | 13723/37963 [58:48:31<99:48:21, 14.82s/it] 
 36%|███▌      | 13724/37963 [58:48:45<98:52:55, 14.69s/it]
 36%|███▌      | 13725/37963 [58:48:59<98:20:23, 14.61s/it]
 36%|███▌      | 13726/37963 [58:49:20<110:29:14, 16.41s/it]
 36%|███▌      | 13727/37963 [58:49:34<105:30:38, 15.67s/it]
 36%|███▌      | 13728/37963 [58:49:49<103:17:06, 15.34s/it]
 36%|███▌      | 13729/37963 [58:50:03<101:22:30, 15.06s/it]
 36%|███▌      | 13730/37963 [58:50:17<99:51:07, 14.83s/it] 
                                                           
{'loss': '0.1564', 'grad_norm': '1.571', 'learning_rate': '1.477e-05', 'epoch': '0.3617'}

 36%|███▌      | 13730/37963 [58:50:17<99:51:07, 14.83s/it]
 36%|███▌      | 13731/37963 [58:50:31<98:08:26, 14.58s/it]
 36%|███▌      | 13732/37963 [58:50:52<109:36:58, 16.29s/it]
 36%|███▌      | 13733/37963 [58:51:06<105:45:26, 15.71s/it]
 36%|███▌      | 13734/37963 [58:51:20<103:02:57, 15.31s/it]
 36%|███▌      | 13735/37963 [58:51:34<100:16:14, 14.90s/it]
 36%|███▌      | 13736/37963 [58:51:49<99:03:11, 14.72s/it] 
 36%|███▌      | 13737/37963 [58:52:03<98:15:59, 14.60s/it]
 36%|███▌      | 13738/37963 [58:52:17<97:42:28, 14.52s/it]
 36%|███▌      | 13739/37963 [58:52:31<96:50:03, 14.39s/it]
 36%|███▌      | 13740/37963 [58:52:46<96:34:24, 14.35s/it]
                                                           
{'loss': '0.1674', 'grad_norm': '3.485', 'learning_rate': '1.476e-05', 'epoch': '0.3619'}

 36%|███▌      | 13740/37963 [58:52:46<96:34:24, 14.35s/it]
 36%|███▌      | 13741/37963 [58:53:00<96:29:36, 14.34s/it]
 36%|███▌      | 13742/37963 [58:53:14<96:05:12, 14.28s/it]
 36%|███▌      | 13743/37963 [58:53:28<96:04:46, 14.28s/it]
 36%|███▌      | 13744/37963 [58:53:43<96:19:24, 14.32s/it]
 36%|███▌      | 13745/37963 [58:53:57<96:19:23, 14.32s/it]
 36%|███▌      | 13746/37963 [58:54:17<108:42:58, 16.16s/it]
 36%|███▌      | 13747/37963 [58:54:32<104:56:18, 15.60s/it]
 36%|███▌      | 13748/37963 [58:54:46<102:06:09, 15.18s/it]
 36%|███▌      | 13749/37963 [58:55:07<113:08:22, 16.82s/it]
 36%|███▌      | 13750/37963 [58:55:21<108:19:31, 16.11s/it]
                                                            
{'loss': '0.1542', 'grad_norm': '2.248', 'learning_rate': '1.475e-05', 'epoch': '0.3622'}

 36%|███▌      | 13750/37963 [58:55:21<108:19:31, 16.11s/it]
 36%|███▌      | 13751/37963 [58:55:35<104:47:55, 15.58s/it]
 36%|███▌      | 13752/37963 [58:55:50<102:30:54, 15.24s/it]
 36%|███▌      | 13753/37963 [58:56:04<100:54:14, 15.00s/it]
 36%|███▌      | 13754/37963 [58:56:18<98:55:20, 14.71s/it] 
 36%|███▌      | 13755/37963 [58:56:33<98:15:30, 14.61s/it]
 36%|███▌      | 13756/37963 [58:56:54<110:45:39, 16.47s/it]
 36%|███▌      | 13757/37963 [58:57:08<106:23:34, 15.82s/it]
 36%|███▌      | 13758/37963 [58:57:21<101:41:53, 15.13s/it]
 36%|███▌      | 13759/37963 [58:57:36<100:01:42, 14.88s/it]
 36%|███▌      | 13760/37963 [58:57:50<98:57:34, 14.72s/it] 
                                                           
{'loss': '0.1505', 'grad_norm': '4.723', 'learning_rate': '1.474e-05', 'epoch': '0.3625'}

 36%|███▌      | 13760/37963 [58:57:50<98:57:34, 14.72s/it]
 36%|███▌      | 13761/37963 [58:58:04<98:08:35, 14.60s/it]
 36%|███▋      | 13762/37963 [58:58:26<111:45:08, 16.62s/it]
 36%|███▋      | 13763/37963 [58:58:40<106:11:25, 15.80s/it]
 36%|███▋      | 13764/37963 [58:58:54<102:53:04, 15.31s/it]
 36%|███▋      | 13765/37963 [58:59:15<114:24:51, 17.02s/it]
 36%|███▋      | 13766/37963 [58:59:28<107:52:13, 16.05s/it]
 36%|███▋      | 13767/37963 [58:59:50<117:53:29, 17.54s/it]
 36%|███▋      | 13768/37963 [59:00:04<111:25:47, 16.58s/it]
 36%|███▋      | 13769/37963 [59:00:18<106:35:28, 15.86s/it]
 36%|███▋      | 13770/37963 [59:00:32<103:34:15, 15.41s/it]
                                                            
{'loss': '0.1615', 'grad_norm': '2.239', 'learning_rate': '1.474e-05', 'epoch': '0.3627'}

 36%|███▋      | 13770/37963 [59:00:32<103:34:15, 15.41s/it]
 36%|███▋      | 13771/37963 [59:00:47<101:21:03, 15.08s/it]
 36%|███▋      | 13772/37963 [59:01:01<98:50:42, 14.71s/it] 
 36%|███▋      | 13773/37963 [59:01:15<97:52:01, 14.56s/it]
 36%|███▋      | 13774/37963 [59:01:29<97:29:07, 14.51s/it]
 36%|███▋      | 13775/37963 [59:01:44<97:14:55, 14.47s/it]
 36%|███▋      | 13776/37963 [59:02:04<110:14:08, 16.41s/it]
 36%|███▋      | 13777/37963 [59:02:19<106:26:20, 15.84s/it]
 36%|███▋      | 13778/37963 [59:02:33<103:33:54, 15.42s/it]
 36%|███▋      | 13779/37963 [59:02:48<101:22:07, 15.09s/it]
 36%|███▋      | 13780/37963 [59:03:02<99:59:49, 14.89s/it] 
                                                           
{'loss': '0.1709', 'grad_norm': '2.963', 'learning_rate': '1.473e-05', 'epoch': '0.363'}

 36%|███▋      | 13780/37963 [59:03:02<99:59:49, 14.89s/it]
 36%|███▋      | 13781/37963 [59:03:16<98:54:29, 14.72s/it]
 36%|███▋      | 13782/37963 [59:03:37<110:54:17, 16.51s/it]
 36%|███▋      | 13783/37963 [59:03:51<104:37:36, 15.58s/it]
 36%|███▋      | 13784/37963 [59:04:05<102:07:28, 15.21s/it]
 36%|███▋      | 13785/37963 [59:04:19<100:26:45, 14.96s/it]
 36%|███▋      | 13786/37963 [59:04:34<99:27:20, 14.81s/it] 
 36%|███▋      | 13787/37963 [59:04:48<98:36:11, 14.68s/it]
 36%|███▋      | 13788/37963 [59:05:03<98:11:25, 14.62s/it]
 36%|███▋      | 13789/37963 [59:05:17<97:43:38, 14.55s/it]
 36%|███▋      | 13790/37963 [59:05:31<97:22:45, 14.50s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '5.537', 'learning_rate': '1.472e-05', 'epoch': '0.3632'}

 36%|███▋      | 13790/37963 [59:05:31<97:22:45, 14.50s/it]
 36%|███▋      | 13791/37963 [59:05:46<97:02:08, 14.45s/it]
 36%|███▋      | 13792/37963 [59:06:00<96:02:35, 14.30s/it]
 36%|███▋      | 13793/37963 [59:06:13<94:18:24, 14.05s/it]
 36%|███▋      | 13794/37963 [59:06:28<95:05:31, 14.16s/it]
 36%|███▋      | 13795/37963 [59:06:49<108:51:11, 16.21s/it]
 36%|███▋      | 13796/37963 [59:07:03<105:10:50, 15.67s/it]
 36%|███▋      | 13797/37963 [59:07:17<102:38:01, 15.29s/it]
 36%|███▋      | 13798/37963 [59:07:38<112:40:04, 16.78s/it]
 36%|███▋      | 13799/37963 [59:07:52<107:51:24, 16.07s/it]
 36%|███▋      | 13800/37963 [59:08:06<103:05:49, 15.36s/it]
                                                            
{'loss': '0.1572', 'grad_norm': '3.715', 'learning_rate': '1.471e-05', 'epoch': '0.3635'}

 36%|███▋      | 13800/37963 [59:08:06<103:05:49, 15.36s/it]
 36%|███▋      | 13801/37963 [59:08:20<101:13:08, 15.08s/it]
 36%|███▋      | 13802/37963 [59:08:34<99:40:57, 14.85s/it] 
 36%|███▋      | 13803/37963 [59:08:49<98:37:11, 14.70s/it]
 36%|███▋      | 13804/37963 [59:09:03<97:16:04, 14.49s/it]
 36%|███▋      | 13805/37963 [59:09:24<109:58:25, 16.39s/it]
 36%|███▋      | 13806/37963 [59:09:38<105:30:25, 15.72s/it]
 36%|███▋      | 13807/37963 [59:09:52<102:41:01, 15.30s/it]
 36%|███▋      | 13808/37963 [59:10:13<113:25:37, 16.90s/it]
 36%|███▋      | 13809/37963 [59:10:27<108:09:52, 16.12s/it]
 36%|███▋      | 13810/37963 [59:10:42<104:45:25, 15.61s/it]
                                                            
{'loss': '0.1652', 'grad_norm': '3.219', 'learning_rate': '1.471e-05', 'epoch': '0.3638'}

 36%|███▋      | 13810/37963 [59:10:42<104:45:25, 15.61s/it]
 36%|███▋      | 13811/37963 [59:10:56<102:14:09, 15.24s/it]
 36%|███▋      | 13812/37963 [59:11:10<99:50:44, 14.88s/it] 
 36%|███▋      | 13813/37963 [59:11:31<112:30:07, 16.77s/it]
 36%|███▋      | 13814/37963 [59:11:45<106:45:03, 15.91s/it]
 36%|███▋      | 13815/37963 [59:11:59<103:50:24, 15.48s/it]
 36%|███▋      | 13816/37963 [59:12:14<101:36:30, 15.15s/it]
 36%|███▋      | 13817/37963 [59:12:35<112:40:52, 16.80s/it]
 36%|███▋      | 13818/37963 [59:12:49<107:21:51, 16.01s/it]
 36%|███▋      | 13819/37963 [59:13:03<104:05:55, 15.52s/it]
 36%|███▋      | 13820/37963 [59:13:17<101:48:06, 15.18s/it]
                                                            
{'loss': '0.1635', 'grad_norm': '3.75', 'learning_rate': '1.47e-05', 'epoch': '0.364'}

 36%|███▋      | 13820/37963 [59:13:17<101:48:06, 15.18s/it]
 36%|███▋      | 13821/37963 [59:13:32<99:51:02, 14.89s/it] 
 36%|███▋      | 13822/37963 [59:13:45<97:24:39, 14.53s/it]
 36%|███▋      | 13823/37963 [59:14:00<96:41:47, 14.42s/it]
 36%|███▋      | 13824/37963 [59:14:14<96:30:51, 14.39s/it]
 36%|███▋      | 13825/37963 [59:14:34<108:48:00, 16.23s/it]
 36%|███▋      | 13826/37963 [59:14:49<104:59:41, 15.66s/it]
 36%|███▋      | 13827/37963 [59:15:03<102:42:51, 15.32s/it]
 36%|███▋      | 13828/37963 [59:15:18<100:46:07, 15.03s/it]
 36%|███▋      | 13829/37963 [59:15:32<99:07:35, 14.79s/it] 
 36%|███▋      | 13830/37963 [59:15:46<97:49:06, 14.59s/it]
                                                           
{'loss': '0.1496', 'grad_norm': '1.141', 'learning_rate': '1.469e-05', 'epoch': '0.3643'}

 36%|███▋      | 13830/37963 [59:15:46<97:49:06, 14.59s/it]
 36%|███▋      | 13831/37963 [59:16:07<110:17:49, 16.45s/it]
 36%|███▋      | 13832/37963 [59:16:21<106:05:44, 15.83s/it]
 36%|███▋      | 13833/37963 [59:16:35<103:01:55, 15.37s/it]
 36%|███▋      | 13834/37963 [59:16:50<100:37:40, 15.01s/it]
 36%|███▋      | 13835/37963 [59:17:04<98:58:51, 14.77s/it] 
 36%|███▋      | 13836/37963 [59:17:18<97:50:20, 14.60s/it]
 36%|███▋      | 13837/37963 [59:17:32<96:49:22, 14.45s/it]
 36%|███▋      | 13838/37963 [59:17:46<96:32:01, 14.41s/it]
 36%|███▋      | 13839/37963 [59:18:01<96:30:52, 14.40s/it]
 36%|███▋      | 13840/37963 [59:18:14<95:04:09, 14.19s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '1.626', 'learning_rate': '1.468e-05', 'epoch': '0.3646'}

 36%|███▋      | 13840/37963 [59:18:14<95:04:09, 14.19s/it]
 36%|███▋      | 13841/37963 [59:18:29<96:14:10, 14.36s/it]
 36%|███▋      | 13842/37963 [59:18:44<96:16:20, 14.37s/it]
 36%|███▋      | 13843/37963 [59:18:58<96:00:22, 14.33s/it]
 36%|███▋      | 13844/37963 [59:19:12<96:05:30, 14.34s/it]
 36%|███▋      | 13845/37963 [59:19:32<107:39:37, 16.07s/it]
 36%|███▋      | 13846/37963 [59:19:47<104:20:27, 15.58s/it]
 36%|███▋      | 13847/37963 [59:20:07<113:14:20, 16.90s/it]
 36%|███▋      | 13848/37963 [59:20:21<108:08:59, 16.15s/it]
 36%|███▋      | 13849/37963 [59:20:35<104:22:39, 15.58s/it]
 36%|███▋      | 13850/37963 [59:20:50<102:08:04, 15.25s/it]
                                                            
{'loss': '0.1675', 'grad_norm': '1.726', 'learning_rate': '1.467e-05', 'epoch': '0.3648'}

 36%|███▋      | 13850/37963 [59:20:50<102:08:04, 15.25s/it]
 36%|███▋      | 13851/37963 [59:21:04<100:22:03, 14.99s/it]
 36%|███▋      | 13852/37963 [59:21:18<98:03:41, 14.64s/it] 
 36%|███▋      | 13853/37963 [59:21:32<97:25:06, 14.55s/it]
 36%|███▋      | 13854/37963 [59:21:47<97:14:51, 14.52s/it]
 36%|███▋      | 13855/37963 [59:22:01<97:07:20, 14.50s/it]
 36%|███▋      | 13856/37963 [59:22:22<109:53:59, 16.41s/it]
 37%|███▋      | 13857/37963 [59:22:44<120:51:59, 18.05s/it]
 37%|███▋      | 13858/37963 [59:22:58<113:22:09, 16.93s/it]
 37%|███▋      | 13859/37963 [59:23:13<108:09:48, 16.15s/it]
 37%|███▋      | 13860/37963 [59:23:26<102:42:41, 15.34s/it]
                                                            
{'loss': '0.1607', 'grad_norm': '4.256', 'learning_rate': '1.467e-05', 'epoch': '0.3651'}

 37%|███▋      | 13860/37963 [59:23:26<102:42:41, 15.34s/it]
 37%|███▋      | 13861/37963 [59:23:47<114:36:13, 17.12s/it]
 37%|███▋      | 13862/37963 [59:24:02<109:05:50, 16.30s/it]
 37%|███▋      | 13863/37963 [59:24:16<104:56:08, 15.68s/it]
 37%|███▋      | 13864/37963 [59:24:30<102:12:45, 15.27s/it]
 37%|███▋      | 13865/37963 [59:24:45<100:27:18, 15.01s/it]
 37%|███▋      | 13866/37963 [59:25:06<112:19:05, 16.78s/it]
 37%|███▋      | 13867/37963 [59:25:20<107:38:07, 16.08s/it]
 37%|███▋      | 13868/37963 [59:25:34<102:22:25, 15.30s/it]
 37%|███▋      | 13869/37963 [59:25:48<100:25:26, 15.00s/it]
 37%|███▋      | 13870/37963 [59:26:02<99:22:53, 14.85s/it] 
                                                           
{'loss': '0.1565', 'grad_norm': '1.752', 'learning_rate': '1.466e-05', 'epoch': '0.3654'}

 37%|███▋      | 13870/37963 [59:26:02<99:22:53, 14.85s/it]
 37%|███▋      | 13871/37963 [59:26:17<98:23:06, 14.70s/it]
 37%|███▋      | 13872/37963 [59:26:31<97:36:15, 14.59s/it]
 37%|███▋      | 13873/37963 [59:26:45<97:00:39, 14.50s/it]
 37%|███▋      | 13874/37963 [59:27:07<110:24:00, 16.50s/it]
 37%|███▋      | 13875/37963 [59:27:21<105:49:58, 15.82s/it]
 37%|███▋      | 13876/37963 [59:27:35<102:40:58, 15.35s/it]
 37%|███▋      | 13877/37963 [59:27:56<113:24:46, 16.95s/it]
 37%|███▋      | 13878/37963 [59:28:10<108:20:04, 16.19s/it]
 37%|███▋      | 13879/37963 [59:28:24<103:59:59, 15.55s/it]
 37%|███▋      | 13880/37963 [59:28:39<101:50:03, 15.22s/it]
                                                            
{'loss': '0.1547', 'grad_norm': '3.86', 'learning_rate': '1.465e-05', 'epoch': '0.3656'}

 37%|███▋      | 13880/37963 [59:28:39<101:50:03, 15.22s/it]
 37%|███▋      | 13881/37963 [59:28:53<99:57:59, 14.94s/it] 
 37%|███▋      | 13882/37963 [59:29:07<98:49:24, 14.77s/it]
 37%|███▋      | 13883/37963 [59:29:22<97:59:27, 14.65s/it]
 37%|███▋      | 13884/37963 [59:29:36<97:40:18, 14.60s/it]
 37%|███▋      | 13885/37963 [59:29:50<97:08:15, 14.52s/it]
 37%|███▋      | 13886/37963 [59:30:05<96:43:31, 14.46s/it]
 37%|███▋      | 13887/37963 [59:30:19<96:25:16, 14.42s/it]
 37%|███▋      | 13888/37963 [59:30:33<96:14:21, 14.39s/it]
 37%|███▋      | 13889/37963 [59:30:48<96:13:46, 14.39s/it]
 37%|███▋      | 13890/37963 [59:31:02<96:08:27, 14.38s/it]
                                                           
{'loss': '0.147', 'grad_norm': '3.184', 'learning_rate': '1.464e-05', 'epoch': '0.3659'}

 37%|███▋      | 13890/37963 [59:31:02<96:08:27, 14.38s/it]
 37%|███▋      | 13891/37963 [59:31:16<95:09:51, 14.23s/it]
 37%|███▋      | 13892/37963 [59:31:30<95:24:59, 14.27s/it]
 37%|███▋      | 13893/37963 [59:31:51<108:03:09, 16.16s/it]
 37%|███▋      | 13894/37963 [59:32:05<104:21:17, 15.61s/it]
 37%|███▋      | 13895/37963 [59:32:19<101:09:44, 15.13s/it]
 37%|███▋      | 13896/37963 [59:32:40<112:39:42, 16.85s/it]
 37%|███▋      | 13897/37963 [59:32:54<105:44:18, 15.82s/it]
 37%|███▋      | 13898/37963 [59:33:08<103:21:29, 15.46s/it]
 37%|███▋      | 13899/37963 [59:33:23<101:01:14, 15.11s/it]
 37%|███▋      | 13900/37963 [59:33:37<99:23:16, 14.87s/it] 
                                                           
{'loss': '0.1543', 'grad_norm': '2.765', 'learning_rate': '1.464e-05', 'epoch': '0.3661'}

 37%|███▋      | 13900/37963 [59:33:37<99:23:16, 14.87s/it]
 37%|███▋      | 13901/37963 [59:33:51<98:17:26, 14.71s/it]
 37%|███▋      | 13902/37963 [59:34:05<97:14:36, 14.55s/it]
 37%|███▋      | 13903/37963 [59:34:25<108:14:39, 16.20s/it]
 37%|███▋      | 13904/37963 [59:34:39<103:55:11, 15.55s/it]
 37%|███▋      | 13905/37963 [59:35:01<115:20:46, 17.26s/it]
 37%|███▋      | 13906/37963 [59:35:15<109:25:41, 16.38s/it]
 37%|███▋      | 13907/37963 [59:35:29<104:23:11, 15.62s/it]
 37%|███▋      | 13908/37963 [59:35:43<101:57:08, 15.26s/it]
 37%|███▋      | 13909/37963 [59:35:58<100:00:29, 14.97s/it]
 37%|███▋      | 13910/37963 [59:36:12<98:01:25, 14.67s/it] 
                                                           
{'loss': '0.1455', 'grad_norm': '2.244', 'learning_rate': '1.463e-05', 'epoch': '0.3664'}

 37%|███▋      | 13910/37963 [59:36:12<98:01:25, 14.67s/it]
 37%|███▋      | 13911/37963 [59:36:33<111:01:07, 16.62s/it]
 37%|███▋      | 13912/37963 [59:36:47<106:41:52, 15.97s/it]
 37%|███▋      | 13913/37963 [59:37:02<103:26:15, 15.48s/it]
 37%|███▋      | 13914/37963 [59:37:16<100:45:58, 15.08s/it]
 37%|███▋      | 13915/37963 [59:37:30<99:15:46, 14.86s/it] 
 37%|███▋      | 13916/37963 [59:37:51<110:50:24, 16.59s/it]
 37%|███▋      | 13917/37963 [59:38:04<105:17:12, 15.76s/it]
 37%|███▋      | 13918/37963 [59:38:19<102:33:05, 15.35s/it]
 37%|███▋      | 13919/37963 [59:38:33<100:32:35, 15.05s/it]
 37%|███▋      | 13920/37963 [59:38:47<98:44:10, 14.78s/it] 
                                                           
{'loss': '0.1605', 'grad_norm': '4.232', 'learning_rate': '1.462e-05', 'epoch': '0.3667'}

 37%|███▋      | 13920/37963 [59:38:47<98:44:10, 14.78s/it]
 37%|███▋      | 13921/37963 [59:39:02<97:59:02, 14.67s/it]
 37%|███▋      | 13922/37963 [59:39:16<97:19:19, 14.57s/it]
 37%|███▋      | 13923/37963 [59:39:30<95:18:46, 14.27s/it]
 37%|███▋      | 13924/37963 [59:39:51<108:55:46, 16.31s/it]
 37%|███▋      | 13925/37963 [59:40:05<105:31:44, 15.80s/it]
 37%|███▋      | 13926/37963 [59:40:26<114:39:46, 17.17s/it]
 37%|███▋      | 13927/37963 [59:40:40<108:58:43, 16.32s/it]
 37%|███▋      | 13928/37963 [59:40:55<105:55:31, 15.87s/it]
 37%|███▋      | 13929/37963 [59:41:09<102:21:24, 15.33s/it]
 37%|███▋      | 13930/37963 [59:41:23<100:20:32, 15.03s/it]
                                                            
{'loss': '0.1619', 'grad_norm': '1.356', 'learning_rate': '1.461e-05', 'epoch': '0.3669'}

 37%|███▋      | 13930/37963 [59:41:23<100:20:32, 15.03s/it]
 37%|███▋      | 13931/37963 [59:41:38<99:05:11, 14.84s/it] 
 37%|███▋      | 13932/37963 [59:41:52<98:04:39, 14.69s/it]
 37%|███▋      | 13933/37963 [59:42:06<97:21:54, 14.59s/it]
 37%|███▋      | 13934/37963 [59:42:21<96:59:20, 14.53s/it]
 37%|███▋      | 13935/37963 [59:42:35<96:40:31, 14.48s/it]
 37%|███▋      | 13936/37963 [59:42:49<96:22:06, 14.44s/it]
 37%|███▋      | 13937/37963 [59:43:04<96:15:36, 14.42s/it]
 37%|███▋      | 13938/37963 [59:43:18<96:15:11, 14.42s/it]
 37%|███▋      | 13939/37963 [59:43:33<96:15:51, 14.43s/it]
 37%|███▋      | 13940/37963 [59:43:47<95:39:38, 14.34s/it]
                                                           
{'loss': '0.1621', 'grad_norm': '0.9107', 'learning_rate': '1.461e-05', 'epoch': '0.3672'}

 37%|███▋      | 13940/37963 [59:43:47<95:39:38, 14.34s/it]
 37%|███▋      | 13941/37963 [59:44:01<95:56:36, 14.38s/it]
 37%|███▋      | 13942/37963 [59:44:28<121:29:10, 18.21s/it]
 37%|███▋      | 13943/37963 [59:44:43<113:41:40, 17.04s/it]
 37%|███▋      | 13944/37963 [59:44:57<108:18:09, 16.23s/it]
 37%|███▋      | 13945/37963 [59:45:11<103:34:39, 15.52s/it]
 37%|███▋      | 13946/37963 [59:45:25<99:50:14, 14.97s/it] 
 37%|███▋      | 13947/37963 [59:45:39<98:36:56, 14.78s/it]
 37%|███▋      | 13948/37963 [59:45:53<97:46:41, 14.66s/it]
 37%|███▋      | 13949/37963 [59:46:08<97:06:21, 14.56s/it]
 37%|███▋      | 13950/37963 [59:46:22<96:40:40, 14.49s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '3.861', 'learning_rate': '1.46e-05', 'epoch': '0.3675'}

 37%|███▋      | 13950/37963 [59:46:22<96:40:40, 14.49s/it]
 37%|███▋      | 13951/37963 [59:46:36<95:25:29, 14.31s/it]
 37%|███▋      | 13952/37963 [59:46:50<95:33:31, 14.33s/it]
 37%|███▋      | 13953/37963 [59:47:11<108:41:12, 16.30s/it]
 37%|███▋      | 13954/37963 [59:47:33<118:52:44, 17.83s/it]
 37%|███▋      | 13955/37963 [59:47:47<111:55:14, 16.78s/it]
 37%|███▋      | 13956/37963 [59:48:01<107:16:31, 16.09s/it]
 37%|███▋      | 13957/37963 [59:48:15<102:24:58, 15.36s/it]
 37%|███▋      | 13958/37963 [59:48:29<99:48:05, 14.97s/it] 
 37%|███▋      | 13959/37963 [59:48:50<112:12:32, 16.83s/it]
 37%|███▋      | 13960/37963 [59:49:05<107:06:56, 16.07s/it]
                                                            
{'loss': '0.1485', 'grad_norm': '2.795', 'learning_rate': '1.459e-05', 'epoch': '0.3677'}

 37%|███▋      | 13960/37963 [59:49:05<107:06:56, 16.07s/it]
 37%|███▋      | 13961/37963 [59:49:19<103:50:04, 15.57s/it]
 37%|███▋      | 13962/37963 [59:49:33<101:27:15, 15.22s/it]
 37%|███▋      | 13963/37963 [59:49:47<98:56:31, 14.84s/it] 
 37%|███▋      | 13964/37963 [59:50:08<110:29:23, 16.57s/it]
 37%|███▋      | 13965/37963 [59:50:22<106:08:08, 15.92s/it]
 37%|███▋      | 13966/37963 [59:50:37<103:01:22, 15.46s/it]
 37%|███▋      | 13967/37963 [59:50:51<100:50:04, 15.13s/it]
 37%|███▋      | 13968/37963 [59:51:06<99:25:21, 14.92s/it] 
 37%|███▋      | 13969/37963 [59:51:20<98:13:22, 14.74s/it]
 37%|███▋      | 13970/37963 [59:51:34<97:21:56, 14.61s/it]
                                                           
{'loss': '0.167', 'grad_norm': '1.601', 'learning_rate': '1.458e-05', 'epoch': '0.368'}

 37%|███▋      | 13970/37963 [59:51:34<97:21:56, 14.61s/it]
 37%|███▋      | 13971/37963 [59:51:49<96:57:11, 14.55s/it]
 37%|███▋      | 13972/37963 [59:52:03<96:07:52, 14.43s/it]
 37%|███▋      | 13973/37963 [59:52:24<109:40:27, 16.46s/it]
 37%|███▋      | 13974/37963 [59:52:38<105:38:44, 15.85s/it]
 37%|███▋      | 13975/37963 [59:52:59<115:09:32, 17.28s/it]
 37%|███▋      | 13976/37963 [59:53:13<108:15:34, 16.25s/it]
 37%|███▋      | 13977/37963 [59:53:27<103:42:34, 15.57s/it]
 37%|███▋      | 13978/37963 [59:53:41<101:14:44, 15.20s/it]
 37%|███▋      | 13979/37963 [59:53:55<98:46:24, 14.83s/it] 
 37%|███▋      | 13980/37963 [59:54:10<98:12:28, 14.74s/it]
                                                           
{'loss': '0.1545', 'grad_norm': '0.8712', 'learning_rate': '1.458e-05', 'epoch': '0.3683'}

 37%|███▋      | 13980/37963 [59:54:10<98:12:28, 14.74s/it]
 37%|███▋      | 13981/37963 [59:54:24<97:35:24, 14.65s/it]
 37%|███▋      | 13982/37963 [59:54:38<96:40:20, 14.51s/it]
 37%|███▋      | 13983/37963 [59:54:52<96:04:35, 14.42s/it]
 37%|███▋      | 13984/37963 [59:55:07<95:54:04, 14.40s/it]
 37%|███▋      | 13985/37963 [59:55:21<95:52:24, 14.39s/it]
 37%|███▋      | 13986/37963 [59:55:35<94:38:46, 14.21s/it]
 37%|███▋      | 13987/37963 [59:55:49<94:58:23, 14.26s/it]
 37%|███▋      | 13988/37963 [59:56:03<94:23:33, 14.17s/it]
 37%|███▋      | 13989/37963 [59:56:18<94:36:30, 14.21s/it]
 37%|███▋      | 13990/37963 [59:56:39<108:08:29, 16.24s/it]
                                                            
{'loss': '0.1645', 'grad_norm': '3.285', 'learning_rate': '1.457e-05', 'epoch': '0.3685'}

 37%|███▋      | 13990/37963 [59:56:39<108:08:29, 16.24s/it]
 37%|███▋      | 13991/37963 [59:56:59<117:26:58, 17.64s/it]
 37%|███▋      | 13992/37963 [59:57:14<110:29:46, 16.59s/it]
 37%|███▋      | 13993/37963 [59:57:28<105:56:35, 15.91s/it]
 37%|███▋      | 13994/37963 [59:57:42<102:38:33, 15.42s/it]
 37%|███▋      | 13995/37963 [59:57:56<99:24:07, 14.93s/it] 
 37%|███▋      | 13996/37963 [59:58:10<96:47:38, 14.54s/it]
 37%|███▋      | 13997/37963 [59:58:24<96:30:24, 14.50s/it]
 37%|███▋      | 13998/37963 [59:58:39<96:28:40, 14.49s/it]
 37%|███▋      | 13999/37963 [59:58:53<96:19:50, 14.47s/it]
 37%|███▋      | 14000/37963 [59:59:07<95:02:04, 14.28s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '1.108', 'learning_rate': '1.456e-05', 'epoch': '0.3688'}

 37%|███▋      | 14000/37963 [59:59:07<95:02:04, 14.28s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:22<00:00, 22.29s/it]
Writing model shards: 100%|██████████| 1/1 [00:22<00:00, 22.29s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 37%|███▋      | 14001/37963 [60:01:06<304:45:58, 45.79s/it]
 37%|███▋      | 14002/37963 [60:01:20<240:51:37, 36.19s/it]
 37%|███▋      | 14003/37963 [60:01:34<196:50:54, 29.58s/it]
 37%|███▋      | 14004/37963 [60:01:48<166:25:56, 25.01s/it]
 37%|███▋      | 14005/37963 [60:02:03<145:07:46, 21.81s/it]
 37%|███▋      | 14006/37963 [60:02:24<143:18:09, 21.53s/it]
 37%|███▋      | 14007/37963 [60:02:38<128:54:10, 19.37s/it]
 37%|███▋      | 14008/37963 [60:02:52<118:49:25, 17.86s/it]
 37%|███▋      | 14009/37963 [60:03:06<111:13:55, 16.72s/it]
 37%|███▋      | 14010/37963 [60:03:21<106:34:27, 16.02s/it]
                                                            
{'loss': '0.1704', 'grad_norm': '2.845', 'learning_rate': '1.455e-05', 'epoch': '0.369'}

 37%|███▋      | 14010/37963 [60:03:21<106:34:27, 16.02s/it]
 37%|███▋      | 14011/37963 [60:03:35<103:30:53, 15.56s/it]
 37%|███▋      | 14012/37963 [60:03:49<100:43:53, 15.14s/it]
 37%|███▋      | 14013/37963 [60:04:04<99:05:28, 14.89s/it] 
 37%|███▋      | 14014/37963 [60:04:24<110:42:24, 16.64s/it]
 37%|███▋      | 14015/37963 [60:04:39<105:58:51, 15.93s/it]
 37%|███▋      | 14016/37963 [60:04:52<101:46:55, 15.30s/it]
 37%|███▋      | 14017/37963 [60:05:07<99:58:41, 15.03s/it] 
 37%|███▋      | 14018/37963 [60:05:21<98:34:03, 14.82s/it]
 37%|███▋      | 14019/37963 [60:05:36<97:37:32, 14.68s/it]
 37%|███▋      | 14020/37963 [60:05:50<97:03:05, 14.59s/it]
                                                           
{'loss': '0.1444', 'grad_norm': '0.7847', 'learning_rate': '1.455e-05', 'epoch': '0.3693'}

 37%|███▋      | 14020/37963 [60:05:50<97:03:05, 14.59s/it]
 37%|███▋      | 14021/37963 [60:06:04<96:30:58, 14.51s/it]
 37%|███▋      | 14022/37963 [60:06:32<121:55:17, 18.33s/it]
 37%|███▋      | 14023/37963 [60:06:46<113:50:12, 17.12s/it]
 37%|███▋      | 14024/37963 [60:07:00<108:37:54, 16.34s/it]
 37%|███▋      | 14025/37963 [60:07:14<104:13:05, 15.67s/it]
 37%|███▋      | 14026/37963 [60:07:29<101:02:21, 15.20s/it]
 37%|███▋      | 14027/37963 [60:07:43<99:00:50, 14.89s/it] 
 37%|███▋      | 14028/37963 [60:07:57<97:53:19, 14.72s/it]
 37%|███▋      | 14029/37963 [60:08:11<96:54:58, 14.58s/it]
 37%|███▋      | 14030/37963 [60:08:25<95:42:56, 14.40s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '1.12', 'learning_rate': '1.454e-05', 'epoch': '0.3696'}

 37%|███▋      | 14030/37963 [60:08:25<95:42:56, 14.40s/it]
 37%|███▋      | 14031/37963 [60:08:39<95:07:24, 14.31s/it]
 37%|███▋      | 14032/37963 [60:08:53<94:16:29, 14.18s/it]
 37%|███▋      | 14033/37963 [60:09:08<94:30:58, 14.22s/it]
 37%|███▋      | 14034/37963 [60:09:22<94:51:46, 14.27s/it]
 37%|███▋      | 14035/37963 [60:09:36<95:07:42, 14.31s/it]
 37%|███▋      | 14036/37963 [60:09:57<107:56:16, 16.24s/it]
 37%|███▋      | 14037/37963 [60:10:11<104:06:57, 15.67s/it]
 37%|███▋      | 14038/37963 [60:10:26<101:25:08, 15.26s/it]
 37%|███▋      | 14039/37963 [60:10:47<112:47:22, 16.97s/it]
 37%|███▋      | 14040/37963 [60:11:01<107:37:46, 16.20s/it]
                                                            
{'loss': '0.157', 'grad_norm': '5.05', 'learning_rate': '1.453e-05', 'epoch': '0.3698'}

 37%|███▋      | 14040/37963 [60:11:01<107:37:46, 16.20s/it]
 37%|███▋      | 14041/37963 [60:11:16<104:09:46, 15.68s/it]
 37%|███▋      | 14042/37963 [60:11:30<101:28:29, 15.27s/it]
 37%|███▋      | 14043/37963 [60:11:44<99:34:23, 14.99s/it] 
 37%|███▋      | 14044/37963 [60:11:58<97:57:15, 14.74s/it]
 37%|███▋      | 14045/37963 [60:12:13<97:11:34, 14.63s/it]
 37%|███▋      | 14046/37963 [60:12:27<95:40:26, 14.40s/it]
 37%|███▋      | 14047/37963 [60:12:40<94:24:12, 14.21s/it]
 37%|███▋      | 14048/37963 [60:13:01<107:39:35, 16.21s/it]
 37%|███▋      | 14049/37963 [60:13:21<115:28:44, 17.38s/it]
 37%|███▋      | 14050/37963 [60:13:36<109:38:25, 16.51s/it]
                                                            
{'loss': '0.1729', 'grad_norm': '1.312', 'learning_rate': '1.452e-05', 'epoch': '0.3701'}

 37%|███▋      | 14050/37963 [60:13:36<109:38:25, 16.51s/it]
 37%|███▋      | 14051/37963 [60:13:50<105:14:57, 15.85s/it]
 37%|███▋      | 14052/37963 [60:14:04<102:19:12, 15.41s/it]
 37%|███▋      | 14053/37963 [60:14:19<100:18:03, 15.10s/it]
 37%|███▋      | 14054/37963 [60:14:33<98:45:35, 14.87s/it] 
 37%|███▋      | 14055/37963 [60:14:48<97:45:15, 14.72s/it]
 37%|███▋      | 14056/37963 [60:15:09<110:11:16, 16.59s/it]
 37%|███▋      | 14057/37963 [60:15:23<105:51:26, 15.94s/it]
 37%|███▋      | 14058/37963 [60:15:37<102:32:42, 15.44s/it]
 37%|███▋      | 14059/37963 [60:15:52<100:29:44, 15.13s/it]
 37%|███▋      | 14060/37963 [60:16:06<98:57:39, 14.90s/it] 
                                                           
{'loss': '0.1591', 'grad_norm': '2.157', 'learning_rate': '1.452e-05', 'epoch': '0.3704'}

 37%|███▋      | 14060/37963 [60:16:06<98:57:39, 14.90s/it]
 37%|███▋      | 14061/37963 [60:16:20<97:51:12, 14.74s/it]
 37%|███▋      | 14062/37963 [60:16:41<109:54:19, 16.55s/it]
 37%|███▋      | 14063/37963 [60:16:56<105:40:27, 15.92s/it]
 37%|███▋      | 14064/37963 [60:17:10<102:48:01, 15.49s/it]
 37%|███▋      | 14065/37963 [60:17:24<100:31:14, 15.14s/it]
 37%|███▋      | 14066/37963 [60:17:39<98:56:55, 14.91s/it] 
 37%|███▋      | 14067/37963 [60:17:53<97:15:18, 14.65s/it]
 37%|███▋      | 14068/37963 [60:18:07<96:38:24, 14.56s/it]
 37%|███▋      | 14069/37963 [60:18:21<95:22:03, 14.37s/it]
 37%|███▋      | 14070/37963 [60:18:41<107:20:34, 16.17s/it]
                                                            
{'loss': '0.15', 'grad_norm': '2.679', 'learning_rate': '1.451e-05', 'epoch': '0.3706'}

 37%|███▋      | 14070/37963 [60:18:41<107:20:34, 16.17s/it]
 37%|███▋      | 14071/37963 [60:18:56<103:34:11, 15.61s/it]
 37%|███▋      | 14072/37963 [60:19:17<114:44:32, 17.29s/it]
 37%|███▋      | 14073/37963 [60:19:32<109:12:33, 16.46s/it]
 37%|███▋      | 14074/37963 [60:19:46<105:09:32, 15.85s/it]
 37%|███▋      | 14075/37963 [60:20:00<102:05:26, 15.39s/it]
 37%|███▋      | 14076/37963 [60:20:15<100:12:01, 15.10s/it]
 37%|███▋      | 14077/37963 [60:20:29<98:50:28, 14.90s/it] 
 37%|███▋      | 14078/37963 [60:20:44<98:24:56, 14.83s/it]
 37%|███▋      | 14079/37963 [60:20:58<97:28:34, 14.69s/it]
 37%|███▋      | 14080/37963 [60:21:12<96:45:27, 14.58s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '1.282', 'learning_rate': '1.45e-05', 'epoch': '0.3709'}

 37%|███▋      | 14080/37963 [60:21:12<96:45:27, 14.58s/it]
 37%|███▋      | 14081/37963 [60:21:27<96:17:06, 14.51s/it]
 37%|███▋      | 14082/37963 [60:21:41<95:56:07, 14.46s/it]
 37%|███▋      | 14083/37963 [60:21:55<95:38:24, 14.42s/it]
 37%|███▋      | 14084/37963 [60:22:10<95:37:23, 14.42s/it]
 37%|███▋      | 14085/37963 [60:22:24<95:56:19, 14.46s/it]
 37%|███▋      | 14086/37963 [60:22:46<109:47:31, 16.55s/it]
 37%|███▋      | 14087/37963 [60:23:00<105:27:22, 15.90s/it]
 37%|███▋      | 14088/37963 [60:23:15<102:20:55, 15.43s/it]
 37%|███▋      | 14089/37963 [60:23:29<100:15:57, 15.12s/it]
 37%|███▋      | 14090/37963 [60:23:43<98:11:17, 14.81s/it] 
                                                           
{'loss': '0.1589', 'grad_norm': '1.271', 'learning_rate': '1.449e-05', 'epoch': '0.3712'}

 37%|███▋      | 14090/37963 [60:23:43<98:11:17, 14.81s/it]
 37%|███▋      | 14091/37963 [60:24:05<111:46:05, 16.86s/it]
 37%|███▋      | 14092/37963 [60:24:19<106:49:43, 16.11s/it]
 37%|███▋      | 14093/37963 [60:24:33<102:19:54, 15.43s/it]
 37%|███▋      | 14094/37963 [60:24:47<98:59:44, 14.93s/it] 
 37%|███▋      | 14095/37963 [60:25:01<97:46:04, 14.75s/it]
 37%|███▋      | 14096/37963 [60:25:22<109:13:51, 16.48s/it]
 37%|███▋      | 14097/37963 [60:25:36<104:16:23, 15.73s/it]
 37%|███▋      | 14098/37963 [60:25:50<101:43:36, 15.35s/it]
 37%|███▋      | 14099/37963 [60:26:04<99:45:43, 15.05s/it] 
 37%|███▋      | 14100/37963 [60:26:25<111:25:07, 16.81s/it]
                                                            
{'loss': '0.1576', 'grad_norm': '1.752', 'learning_rate': '1.449e-05', 'epoch': '0.3714'}

 37%|███▋      | 14100/37963 [60:26:25<111:25:07, 16.81s/it]
 37%|███▋      | 14101/37963 [60:26:40<106:31:03, 16.07s/it]
 37%|███▋      | 14102/37963 [60:26:54<102:40:28, 15.49s/it]
 37%|███▋      | 14103/37963 [60:27:15<113:28:42, 17.12s/it]
 37%|███▋      | 14104/37963 [60:27:29<107:59:00, 16.29s/it]
 37%|███▋      | 14105/37963 [60:27:43<103:35:50, 15.63s/it]
 37%|███▋      | 14106/37963 [60:27:57<101:03:25, 15.25s/it]
 37%|███▋      | 14107/37963 [60:28:12<99:21:38, 14.99s/it] 
 37%|███▋      | 14108/37963 [60:28:26<98:12:22, 14.82s/it]
 37%|███▋      | 14109/37963 [60:28:40<96:52:56, 14.62s/it]
 37%|███▋      | 14110/37963 [60:29:02<109:45:11, 16.56s/it]
                                                            
{'loss': '0.1506', 'grad_norm': '2.876', 'learning_rate': '1.448e-05', 'epoch': '0.3717'}

 37%|███▋      | 14110/37963 [60:29:02<109:45:11, 16.56s/it]
 37%|███▋      | 14111/37963 [60:29:16<105:30:12, 15.92s/it]
 37%|███▋      | 14112/37963 [60:29:30<102:26:10, 15.46s/it]
 37%|███▋      | 14113/37963 [60:29:45<100:09:54, 15.12s/it]
 37%|███▋      | 14114/37963 [60:29:59<97:43:42, 14.75s/it] 
 37%|███▋      | 14115/37963 [60:30:13<96:55:11, 14.63s/it]
 37%|███▋      | 14116/37963 [60:30:27<95:47:21, 14.46s/it]
 37%|███▋      | 14117/37963 [60:30:48<107:52:43, 16.29s/it]
 37%|███▋      | 14118/37963 [60:31:02<104:26:22, 15.77s/it]
 37%|███▋      | 14119/37963 [60:31:16<101:32:11, 15.33s/it]
 37%|███▋      | 14120/37963 [60:31:37<112:47:22, 17.03s/it]
                                                            
{'loss': '0.1532', 'grad_norm': '1.876', 'learning_rate': '1.447e-05', 'epoch': '0.3719'}

 37%|███▋      | 14120/37963 [60:31:37<112:47:22, 17.03s/it]
 37%|███▋      | 14121/37963 [60:31:52<107:14:22, 16.19s/it]
 37%|███▋      | 14122/37963 [60:32:06<103:43:22, 15.66s/it]
 37%|███▋      | 14123/37963 [60:32:20<100:29:57, 15.18s/it]
 37%|███▋      | 14124/37963 [60:32:34<98:04:30, 14.81s/it] 
 37%|███▋      | 14125/37963 [60:32:48<97:14:22, 14.69s/it]
 37%|███▋      | 14126/37963 [60:33:03<96:23:53, 14.56s/it]
 37%|███▋      | 14127/37963 [60:33:17<96:17:49, 14.54s/it]
 37%|███▋      | 14128/37963 [60:33:31<93:50:42, 14.17s/it]
 37%|███▋      | 14129/37963 [60:33:45<94:10:28, 14.22s/it]
 37%|███▋      | 14130/37963 [60:33:59<93:29:45, 14.12s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '6.082', 'learning_rate': '1.446e-05', 'epoch': '0.3722'}

 37%|███▋      | 14130/37963 [60:33:59<93:29:45, 14.12s/it]
 37%|███▋      | 14131/37963 [60:34:13<92:47:15, 14.02s/it]
 37%|███▋      | 14132/37963 [60:34:27<93:32:45, 14.13s/it]
 37%|███▋      | 14133/37963 [60:34:48<107:05:14, 16.18s/it]
 37%|███▋      | 14134/37963 [60:35:02<103:02:38, 15.57s/it]
 37%|███▋      | 14135/37963 [60:35:16<100:01:54, 15.11s/it]
 37%|███▋      | 14136/37963 [60:35:30<97:36:32, 14.75s/it] 
 37%|███▋      | 14137/37963 [60:35:44<97:05:29, 14.67s/it]
 37%|███▋      | 14138/37963 [60:35:59<95:53:25, 14.49s/it]
 37%|███▋      | 14139/37963 [60:36:13<95:42:53, 14.46s/it]
 37%|███▋      | 14140/37963 [60:36:27<95:32:21, 14.44s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '1.83', 'learning_rate': '1.445e-05', 'epoch': '0.3725'}

 37%|███▋      | 14140/37963 [60:36:27<95:32:21, 14.44s/it]
 37%|███▋      | 14141/37963 [60:36:48<108:24:48, 16.38s/it]
 37%|███▋      | 14142/37963 [60:37:02<104:12:15, 15.75s/it]
 37%|███▋      | 14143/37963 [60:37:17<101:03:00, 15.27s/it]
 37%|███▋      | 14144/37963 [60:37:31<98:29:37, 14.89s/it] 
 37%|███▋      | 14145/37963 [60:37:45<97:29:52, 14.74s/it]
 37%|███▋      | 14146/37963 [60:38:06<110:17:08, 16.67s/it]
 37%|███▋      | 14147/37963 [60:38:21<105:42:26, 15.98s/it]
 37%|███▋      | 14148/37963 [60:38:35<101:54:02, 15.40s/it]
 37%|███▋      | 14149/37963 [60:38:55<111:35:38, 16.87s/it]
 37%|███▋      | 14150/37963 [60:39:09<106:32:52, 16.11s/it]
                                                            
{'loss': '0.1548', 'grad_norm': '3.255', 'learning_rate': '1.445e-05', 'epoch': '0.3727'}

 37%|███▋      | 14150/37963 [60:39:09<106:32:52, 16.11s/it]
 37%|███▋      | 14151/37963 [60:39:30<116:32:12, 17.62s/it]
 37%|███▋      | 14152/37963 [60:39:45<109:40:32, 16.58s/it]
 37%|███▋      | 14153/37963 [60:39:59<105:19:46, 15.93s/it]
 37%|███▋      | 14154/37963 [60:40:13<102:02:13, 15.43s/it]
 37%|███▋      | 14155/37963 [60:40:28<99:55:10, 15.11s/it] 
 37%|███▋      | 14156/37963 [60:40:42<98:24:04, 14.88s/it]
 37%|███▋      | 14157/37963 [60:40:56<97:17:08, 14.71s/it]
 37%|███▋      | 14158/37963 [60:41:10<95:31:57, 14.45s/it]
 37%|███▋      | 14159/37963 [60:41:24<95:17:16, 14.41s/it]
 37%|███▋      | 14160/37963 [60:41:39<95:12:41, 14.40s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '1.873', 'learning_rate': '1.444e-05', 'epoch': '0.373'}

 37%|███▋      | 14160/37963 [60:41:39<95:12:41, 14.40s/it]
 37%|███▋      | 14161/37963 [60:42:00<107:56:22, 16.33s/it]
 37%|███▋      | 14162/37963 [60:42:14<103:58:51, 15.73s/it]
 37%|███▋      | 14163/37963 [60:42:28<101:19:57, 15.33s/it]
 37%|███▋      | 14164/37963 [60:42:49<111:40:48, 16.89s/it]
 37%|███▋      | 14165/37963 [60:43:03<106:19:20, 16.08s/it]
 37%|███▋      | 14166/37963 [60:43:17<102:53:59, 15.57s/it]
 37%|███▋      | 14167/37963 [60:43:31<99:17:30, 15.02s/it] 
 37%|███▋      | 14168/37963 [60:43:46<98:00:48, 14.83s/it]
 37%|███▋      | 14169/37963 [60:44:07<110:13:02, 16.68s/it]
 37%|███▋      | 14170/37963 [60:44:21<105:40:00, 15.99s/it]
                                                            
{'loss': '0.1638', 'grad_norm': '3.336', 'learning_rate': '1.443e-05', 'epoch': '0.3733'}

 37%|███▋      | 14170/37963 [60:44:21<105:40:00, 15.99s/it]
 37%|███▋      | 14171/37963 [60:44:35<102:17:50, 15.48s/it]
 37%|███▋      | 14172/37963 [60:44:49<99:36:12, 15.07s/it] 
 37%|███▋      | 14173/37963 [60:45:04<98:04:54, 14.84s/it]
 37%|███▋      | 14174/37963 [60:45:18<97:12:48, 14.71s/it]
 37%|███▋      | 14175/37963 [60:45:32<96:31:26, 14.61s/it]
 37%|███▋      | 14176/37963 [60:45:47<95:56:37, 14.52s/it]
 37%|███▋      | 14177/37963 [60:46:01<95:46:20, 14.50s/it]
 37%|███▋      | 14178/37963 [60:46:15<94:53:02, 14.36s/it]
 37%|███▋      | 14179/37963 [60:46:30<94:57:37, 14.37s/it]
 37%|███▋      | 14180/37963 [60:46:44<94:16:15, 14.27s/it]
                                                           
{'loss': '0.1661', 'grad_norm': '2.007', 'learning_rate': '1.442e-05', 'epoch': '0.3735'}

 37%|███▋      | 14180/37963 [60:46:44<94:16:15, 14.27s/it]
 37%|███▋      | 14181/37963 [60:47:04<107:06:04, 16.21s/it]
 37%|███▋      | 14182/37963 [60:47:19<103:21:21, 15.65s/it]
 37%|███▋      | 14183/37963 [60:47:33<100:49:41, 15.26s/it]
 37%|███▋      | 14184/37963 [60:47:48<99:19:29, 15.04s/it] 
 37%|███▋      | 14185/37963 [60:48:02<97:53:52, 14.82s/it]
 37%|███▋      | 14186/37963 [60:48:16<97:06:00, 14.70s/it]
 37%|███▋      | 14187/37963 [60:48:31<96:21:11, 14.59s/it]
 37%|███▋      | 14188/37963 [60:48:51<108:24:52, 16.42s/it]
 37%|███▋      | 14189/37963 [60:49:06<104:24:43, 15.81s/it]
 37%|███▋      | 14190/37963 [60:49:20<101:39:39, 15.39s/it]
                                                            
{'loss': '0.1469', 'grad_norm': '1.499', 'learning_rate': '1.442e-05', 'epoch': '0.3738'}

 37%|███▋      | 14190/37963 [60:49:20<101:39:39, 15.39s/it]
 37%|███▋      | 14191/37963 [60:49:34<99:23:53, 15.05s/it] 
 37%|███▋      | 14192/37963 [60:49:49<98:05:02, 14.85s/it]
 37%|███▋      | 14193/37963 [60:50:03<95:57:23, 14.53s/it]
 37%|███▋      | 14194/37963 [60:50:17<95:42:35, 14.50s/it]
 37%|███▋      | 14195/37963 [60:50:38<109:20:08, 16.56s/it]
 37%|███▋      | 14196/37963 [60:50:53<104:43:26, 15.86s/it]
 37%|███▋      | 14197/37963 [60:51:07<101:34:46, 15.39s/it]
 37%|███▋      | 14198/37963 [60:51:21<98:45:31, 14.96s/it] 
 37%|███▋      | 14199/37963 [60:51:42<111:03:44, 16.82s/it]
 37%|███▋      | 14200/37963 [60:51:56<106:01:46, 16.06s/it]
                                                            
{'loss': '0.1598', 'grad_norm': '3.7', 'learning_rate': '1.441e-05', 'epoch': '0.374'}

 37%|███▋      | 14200/37963 [60:51:56<106:01:46, 16.06s/it]
 37%|███▋      | 14201/37963 [60:52:17<114:35:49, 17.36s/it]
 37%|███▋      | 14202/37963 [60:52:30<107:30:39, 16.29s/it]
 37%|███▋      | 14203/37963 [60:52:45<103:39:29, 15.71s/it]
 37%|███▋      | 14204/37963 [60:52:59<101:01:40, 15.31s/it]
 37%|███▋      | 14205/37963 [60:53:14<99:04:32, 15.01s/it] 
 37%|███▋      | 14206/37963 [60:53:28<97:46:53, 14.82s/it]
 37%|███▋      | 14207/37963 [60:53:42<96:51:16, 14.68s/it]
 37%|███▋      | 14208/37963 [60:53:57<96:13:30, 14.58s/it]
 37%|███▋      | 14209/37963 [60:54:11<95:55:17, 14.54s/it]
 37%|███▋      | 14210/37963 [60:54:31<107:24:08, 16.28s/it]
                                                            
{'loss': '0.1534', 'grad_norm': '4.365', 'learning_rate': '1.44e-05', 'epoch': '0.3743'}

 37%|███▋      | 14210/37963 [60:54:31<107:24:08, 16.28s/it]
 37%|███▋      | 14211/37963 [60:54:46<103:42:33, 15.72s/it]
 37%|███▋      | 14212/37963 [60:55:06<113:18:44, 17.18s/it]
 37%|███▋      | 14213/37963 [60:55:21<107:36:30, 16.31s/it]
 37%|███▋      | 14214/37963 [60:55:35<103:52:13, 15.75s/it]
 37%|███▋      | 14215/37963 [60:55:49<100:45:00, 15.27s/it]
 37%|███▋      | 14216/37963 [60:56:10<111:57:09, 16.97s/it]
 37%|███▋      | 14217/37963 [60:56:24<106:01:31, 16.07s/it]
 37%|███▋      | 14218/37963 [60:56:39<102:40:05, 15.57s/it]
 37%|███▋      | 14219/37963 [60:56:53<100:10:58, 15.19s/it]
 37%|███▋      | 14220/37963 [60:57:07<98:37:37, 14.95s/it] 
                                                           
{'loss': '0.1633', 'grad_norm': '2.122', 'learning_rate': '1.439e-05', 'epoch': '0.3746'}

 37%|███▋      | 14220/37963 [60:57:07<98:37:37, 14.95s/it]
 37%|███▋      | 14221/37963 [60:57:22<97:38:58, 14.81s/it]
 37%|███▋      | 14222/37963 [60:57:36<96:41:39, 14.66s/it]
 37%|███▋      | 14223/37963 [60:57:50<96:03:09, 14.57s/it]
 37%|███▋      | 14224/37963 [60:58:05<95:43:18, 14.52s/it]
 37%|███▋      | 14225/37963 [60:58:19<95:23:24, 14.47s/it]
 37%|███▋      | 14226/37963 [60:58:34<95:10:49, 14.44s/it]
 37%|███▋      | 14227/37963 [60:58:48<95:05:05, 14.42s/it]
 37%|███▋      | 14228/37963 [60:59:02<95:00:38, 14.41s/it]
 37%|███▋      | 14229/37963 [60:59:23<106:59:33, 16.23s/it]
 37%|███▋      | 14230/37963 [60:59:37<102:30:05, 15.55s/it]
                                                            
{'loss': '0.1538', 'grad_norm': '4.989', 'learning_rate': '1.439e-05', 'epoch': '0.3748'}

 37%|███▋      | 14230/37963 [60:59:37<102:30:05, 15.55s/it]
 37%|███▋      | 14231/37963 [60:59:51<100:02:18, 15.18s/it]
 37%|███▋      | 14232/37963 [61:00:05<98:18:04, 14.91s/it] 
 37%|███▋      | 14233/37963 [61:00:19<96:41:01, 14.67s/it]
 37%|███▋      | 14234/37963 [61:00:34<96:03:50, 14.57s/it]
 37%|███▋      | 14235/37963 [61:00:47<93:52:20, 14.24s/it]
 37%|███▋      | 14236/37963 [61:01:02<94:23:08, 14.32s/it]
 38%|███▊      | 14237/37963 [61:01:23<107:14:42, 16.27s/it]
 38%|███▊      | 14238/37963 [61:01:37<103:39:36, 15.73s/it]
 38%|███▊      | 14239/37963 [61:01:52<101:17:10, 15.37s/it]
 38%|███▊      | 14240/37963 [61:02:06<99:26:01, 15.09s/it] 
                                                           
{'loss': '0.1544', 'grad_norm': '2.128', 'learning_rate': '1.438e-05', 'epoch': '0.3751'}

 38%|███▊      | 14240/37963 [61:02:06<99:26:01, 15.09s/it]
 38%|███▊      | 14241/37963 [61:02:20<97:06:28, 14.74s/it]
 38%|███▊      | 14242/37963 [61:02:34<95:48:37, 14.54s/it]
 38%|███▊      | 14243/37963 [61:02:55<108:37:41, 16.49s/it]
 38%|███▊      | 14244/37963 [61:03:10<104:40:50, 15.89s/it]
 38%|███▊      | 14245/37963 [61:03:24<101:41:15, 15.43s/it]
 38%|███▊      | 14246/37963 [61:03:45<113:25:33, 17.22s/it]
 38%|███▊      | 14247/37963 [61:04:00<107:43:11, 16.35s/it]
 38%|███▊      | 14248/37963 [61:04:14<103:42:57, 15.74s/it]
 38%|███▊      | 14249/37963 [61:04:28<100:55:14, 15.32s/it]
 38%|███▊      | 14250/37963 [61:04:49<111:52:21, 16.98s/it]
                                                            
{'loss': '0.1604', 'grad_norm': '0.7625', 'learning_rate': '1.437e-05', 'epoch': '0.3754'}

 38%|███▊      | 14250/37963 [61:04:49<111:52:21, 16.98s/it]
 38%|███▊      | 14251/37963 [61:05:03<106:38:39, 16.19s/it]
 38%|███▊      | 14252/37963 [61:05:18<103:10:36, 15.67s/it]
 38%|███▊      | 14253/37963 [61:05:32<100:42:13, 15.29s/it]
 38%|███▊      | 14254/37963 [61:05:47<98:51:25, 15.01s/it] 
 38%|███▊      | 14255/37963 [61:06:01<97:43:24, 14.84s/it]
 38%|███▊      | 14256/37963 [61:06:15<95:40:51, 14.53s/it]
 38%|███▊      | 14257/37963 [61:06:29<95:15:12, 14.47s/it]
 38%|███▊      | 14258/37963 [61:06:50<107:00:56, 16.25s/it]
 38%|███▊      | 14259/37963 [61:07:03<101:52:28, 15.47s/it]
 38%|███▊      | 14260/37963 [61:07:24<112:37:57, 17.11s/it]
                                                            
{'loss': '0.1566', 'grad_norm': '2.319', 'learning_rate': '1.436e-05', 'epoch': '0.3756'}

 38%|███▊      | 14260/37963 [61:07:24<112:37:57, 17.11s/it]
 38%|███▊      | 14261/37963 [61:07:39<107:28:08, 16.32s/it]
 38%|███▊      | 14262/37963 [61:07:53<102:41:35, 15.60s/it]
 38%|███▊      | 14263/37963 [61:08:07<100:07:21, 15.21s/it]
 38%|███▊      | 14264/37963 [61:08:21<98:15:47, 14.93s/it] 
 38%|███▊      | 14265/37963 [61:08:42<109:50:52, 16.69s/it]
 38%|███▊      | 14266/37963 [61:08:56<105:11:54, 15.98s/it]
 38%|███▊      | 14267/37963 [61:09:10<101:13:17, 15.38s/it]
 38%|███▊      | 14268/37963 [61:09:25<99:15:21, 15.08s/it] 
 38%|███▊      | 14269/37963 [61:09:39<97:28:29, 14.81s/it]
 38%|███▊      | 14270/37963 [61:09:53<96:18:06, 14.63s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '1.544', 'learning_rate': '1.436e-05', 'epoch': '0.3759'}

 38%|███▊      | 14270/37963 [61:09:53<96:18:06, 14.63s/it]
 38%|███▊      | 14271/37963 [61:10:07<95:46:22, 14.55s/it]
 38%|███▊      | 14272/37963 [61:10:22<94:55:52, 14.43s/it]
 38%|███▊      | 14273/37963 [61:10:36<94:51:02, 14.41s/it]
 38%|███▊      | 14274/37963 [61:10:50<94:44:16, 14.40s/it]
 38%|███▊      | 14275/37963 [61:11:05<94:34:31, 14.37s/it]
 38%|███▊      | 14276/37963 [61:11:19<94:36:11, 14.38s/it]
 38%|███▊      | 14277/37963 [61:11:33<94:30:39, 14.36s/it]
 38%|███▊      | 14278/37963 [61:11:54<106:38:56, 16.21s/it]
 38%|███▊      | 14279/37963 [61:12:08<103:05:11, 15.67s/it]
 38%|███▊      | 14280/37963 [61:12:22<99:26:53, 15.12s/it] 
                                                           
{'loss': '0.1767', 'grad_norm': '1.897', 'learning_rate': '1.435e-05', 'epoch': '0.3762'}

 38%|███▊      | 14280/37963 [61:12:22<99:26:53, 15.12s/it]
 38%|███▊      | 14281/37963 [61:12:36<97:50:59, 14.87s/it]
 38%|███▊      | 14282/37963 [61:12:51<96:27:52, 14.66s/it]
 38%|███▊      | 14283/37963 [61:13:05<95:48:25, 14.57s/it]
 38%|███▊      | 14284/37963 [61:13:20<96:14:35, 14.63s/it]
 38%|███▊      | 14285/37963 [61:13:34<95:48:15, 14.57s/it]
 38%|███▊      | 14286/37963 [61:13:48<93:41:29, 14.25s/it]
 38%|███▊      | 14287/37963 [61:14:09<108:03:35, 16.43s/it]
 38%|███▊      | 14288/37963 [61:14:23<103:53:29, 15.80s/it]
 38%|███▊      | 14289/37963 [61:14:38<100:40:34, 15.31s/it]
 38%|███▊      | 14290/37963 [61:14:52<98:51:35, 15.03s/it] 
                                                           
{'loss': '0.1467', 'grad_norm': '3.779', 'learning_rate': '1.434e-05', 'epoch': '0.3764'}

 38%|███▊      | 14290/37963 [61:14:52<98:51:35, 15.03s/it]
 38%|███▊      | 14291/37963 [61:15:06<97:35:03, 14.84s/it]
 38%|███▊      | 14292/37963 [61:15:21<96:34:07, 14.69s/it]
 38%|███▊      | 14293/37963 [61:15:42<109:09:25, 16.60s/it]
 38%|███▊      | 14294/37963 [61:15:56<104:59:08, 15.97s/it]
 38%|███▊      | 14295/37963 [61:16:17<114:32:53, 17.42s/it]
 38%|███▊      | 14296/37963 [61:16:31<108:28:48, 16.50s/it]
 38%|███▊      | 14297/37963 [61:16:46<104:23:45, 15.88s/it]
 38%|███▊      | 14298/37963 [61:17:00<101:20:19, 15.42s/it]
 38%|███▊      | 14299/37963 [61:17:15<99:16:19, 15.10s/it] 
 38%|███▊      | 14300/37963 [61:17:35<110:27:37, 16.81s/it]
                                                            
{'loss': '0.1714', 'grad_norm': '5.709', 'learning_rate': '1.433e-05', 'epoch': '0.3767'}

 38%|███▊      | 14300/37963 [61:17:35<110:27:37, 16.81s/it]
 38%|███▊      | 14301/37963 [61:17:50<105:36:08, 16.07s/it]
 38%|███▊      | 14302/37963 [61:18:04<102:24:06, 15.58s/it]
 38%|███▊      | 14303/37963 [61:18:19<99:58:04, 15.21s/it] 
 38%|███▊      | 14304/37963 [61:18:33<98:12:25, 14.94s/it]
 38%|███▊      | 14305/37963 [61:18:47<96:34:55, 14.70s/it]
 38%|███▊      | 14306/37963 [61:19:07<107:50:54, 16.41s/it]
 38%|███▊      | 14307/37963 [61:19:28<116:21:29, 17.71s/it]
 38%|███▊      | 14308/37963 [61:19:42<109:44:03, 16.70s/it]
 38%|███▊      | 14309/37963 [61:19:57<105:06:56, 16.00s/it]
 38%|███▊      | 14310/37963 [61:20:11<101:49:01, 15.50s/it]
                                                            
{'loss': '0.155', 'grad_norm': '1.726', 'learning_rate': '1.432e-05', 'epoch': '0.3769'}

 38%|███▊      | 14310/37963 [61:20:11<101:49:01, 15.50s/it]
 38%|███▊      | 14311/37963 [61:20:25<98:15:39, 14.96s/it] 
 38%|███▊      | 14312/37963 [61:20:39<97:05:54, 14.78s/it]
 38%|███▊      | 14313/37963 [61:21:00<109:48:57, 16.72s/it]
 38%|███▊      | 14314/37963 [61:21:14<103:46:03, 15.80s/it]
 38%|███▊      | 14315/37963 [61:21:28<100:38:24, 15.32s/it]
 38%|███▊      | 14316/37963 [61:21:43<98:52:49, 15.05s/it] 
 38%|███▊      | 14317/37963 [61:21:57<96:42:40, 14.72s/it]
 38%|███▊      | 14318/37963 [61:22:11<96:00:39, 14.62s/it]
 38%|███▊      | 14319/37963 [61:22:25<94:56:26, 14.46s/it]
 38%|███▊      | 14320/37963 [61:22:40<94:43:30, 14.42s/it]
                                                           
{'loss': '0.1543', 'grad_norm': '1.39', 'learning_rate': '1.432e-05', 'epoch': '0.3772'}

 38%|███▊      | 14320/37963 [61:22:40<94:43:30, 14.42s/it]
 38%|███▊      | 14321/37963 [61:22:54<94:30:30, 14.39s/it]
 38%|███▊      | 14322/37963 [61:23:08<94:26:27, 14.38s/it]
 38%|███▊      | 14323/37963 [61:23:23<94:28:39, 14.39s/it]
 38%|███▊      | 14324/37963 [61:23:37<94:16:25, 14.36s/it]
 38%|███▊      | 14325/37963 [61:23:51<93:21:11, 14.22s/it]
 38%|███▊      | 14326/37963 [61:24:05<93:17:02, 14.21s/it]
 38%|███▊      | 14327/37963 [61:24:19<93:26:11, 14.23s/it]
 38%|███▊      | 14328/37963 [61:24:40<106:36:33, 16.24s/it]
 38%|███▊      | 14329/37963 [61:24:55<102:56:19, 15.68s/it]
 38%|███▊      | 14330/37963 [61:25:08<98:33:43, 15.01s/it] 
                                                           
{'loss': '0.1368', 'grad_norm': '1.745', 'learning_rate': '1.431e-05', 'epoch': '0.3775'}

 38%|███▊      | 14330/37963 [61:25:08<98:33:43, 15.01s/it]
 38%|███▊      | 14331/37963 [61:25:22<97:18:01, 14.82s/it]
 38%|███▊      | 14332/37963 [61:25:37<96:37:01, 14.72s/it]
 38%|███▊      | 14333/37963 [61:25:51<95:05:07, 14.49s/it]
 38%|███▊      | 14334/37963 [61:26:05<94:52:37, 14.46s/it]
 38%|███▊      | 14335/37963 [61:26:20<94:50:23, 14.45s/it]
 38%|███▊      | 14336/37963 [61:26:34<94:37:48, 14.42s/it]
 38%|███▊      | 14337/37963 [61:26:55<107:15:28, 16.34s/it]
 38%|███▊      | 14338/37963 [61:27:09<102:34:49, 15.63s/it]
 38%|███▊      | 14339/37963 [61:27:23<99:14:26, 15.12s/it] 
 38%|███▊      | 14340/37963 [61:27:37<97:29:56, 14.86s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '1.19', 'learning_rate': '1.43e-05', 'epoch': '0.3777'}

 38%|███▊      | 14340/37963 [61:27:37<97:29:56, 14.86s/it]
 38%|███▊      | 14341/37963 [61:27:58<109:51:47, 16.74s/it]
 38%|███▊      | 14342/37963 [61:28:12<104:14:23, 15.89s/it]
 38%|███▊      | 14343/37963 [61:28:33<114:24:19, 17.44s/it]
 38%|███▊      | 14344/37963 [61:28:47<107:38:05, 16.41s/it]
 38%|███▊      | 14345/37963 [61:29:01<103:42:09, 15.81s/it]
 38%|███▊      | 14346/37963 [61:29:16<100:18:45, 15.29s/it]
 38%|███▊      | 14347/37963 [61:29:30<98:09:59, 14.96s/it] 
 38%|███▊      | 14348/37963 [61:29:50<109:36:37, 16.71s/it]
 38%|███▊      | 14349/37963 [61:30:05<105:17:32, 16.05s/it]
 38%|███▊      | 14350/37963 [61:30:20<102:17:13, 15.59s/it]
                                                            
{'loss': '0.148', 'grad_norm': '2.399', 'learning_rate': '1.429e-05', 'epoch': '0.378'}

 38%|███▊      | 14350/37963 [61:30:20<102:17:13, 15.59s/it]
 38%|███▊      | 14351/37963 [61:30:34<99:55:47, 15.24s/it] 
 38%|███▊      | 14352/37963 [61:30:48<98:14:27, 14.98s/it]
 38%|███▊      | 14353/37963 [61:31:03<96:56:36, 14.78s/it]
 38%|███▊      | 14354/37963 [61:31:17<96:13:43, 14.67s/it]
 38%|███▊      | 14355/37963 [61:31:31<95:30:40, 14.56s/it]
 38%|███▊      | 14356/37963 [61:31:52<107:28:05, 16.39s/it]
 38%|███▊      | 14357/37963 [61:32:12<114:45:13, 17.50s/it]
 38%|███▊      | 14358/37963 [61:32:26<108:30:52, 16.55s/it]
 38%|███▊      | 14359/37963 [61:32:40<102:44:37, 15.67s/it]
 38%|███▊      | 14360/37963 [61:32:54<99:58:11, 15.25s/it] 
                                                           
{'loss': '0.1567', 'grad_norm': '2.736', 'learning_rate': '1.429e-05', 'epoch': '0.3783'}

 38%|███▊      | 14360/37963 [61:32:54<99:58:11, 15.25s/it]
 38%|███▊      | 14361/37963 [61:33:08<97:27:47, 14.87s/it]
 38%|███▊      | 14362/37963 [61:33:23<96:36:10, 14.74s/it]
 38%|███▊      | 14363/37963 [61:33:44<109:49:47, 16.75s/it]
 38%|███▊      | 14364/37963 [61:33:59<105:11:28, 16.05s/it]
 38%|███▊      | 14365/37963 [61:34:13<101:59:23, 15.56s/it]
 38%|███▊      | 14366/37963 [61:34:28<100:00:07, 15.26s/it]
 38%|███▊      | 14367/37963 [61:34:42<97:53:54, 14.94s/it] 
 38%|███▊      | 14368/37963 [61:34:56<96:28:57, 14.72s/it]
 38%|███▊      | 14369/37963 [61:35:09<94:03:22, 14.35s/it]
 38%|███▊      | 14370/37963 [61:35:24<94:06:01, 14.36s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '1.773', 'learning_rate': '1.428e-05', 'epoch': '0.3785'}

 38%|███▊      | 14370/37963 [61:35:24<94:06:01, 14.36s/it]
 38%|███▊      | 14371/37963 [61:35:38<94:17:44, 14.39s/it]
 38%|███▊      | 14372/37963 [61:35:53<94:14:39, 14.38s/it]
 38%|███▊      | 14373/37963 [61:36:07<93:56:46, 14.34s/it]
 38%|███▊      | 14374/37963 [61:36:21<93:59:18, 14.34s/it]
 38%|███▊      | 14375/37963 [61:36:42<106:16:50, 16.22s/it]
 38%|███▊      | 14376/37963 [61:36:56<102:36:12, 15.66s/it]
 38%|███▊      | 14377/37963 [61:37:11<100:15:51, 15.30s/it]
 38%|███▊      | 14378/37963 [61:37:25<97:43:04, 14.92s/it] 
 38%|███▊      | 14379/37963 [61:37:39<96:35:57, 14.75s/it]
 38%|███▊      | 14380/37963 [61:37:53<95:39:40, 14.60s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '2.122', 'learning_rate': '1.427e-05', 'epoch': '0.3788'}

 38%|███▊      | 14380/37963 [61:37:53<95:39:40, 14.60s/it]
 38%|███▊      | 14381/37963 [61:38:08<95:17:44, 14.55s/it]
 38%|███▊      | 14382/37963 [61:38:22<94:26:04, 14.42s/it]
 38%|███▊      | 14383/37963 [61:38:36<94:16:30, 14.39s/it]
 38%|███▊      | 14384/37963 [61:38:51<94:10:38, 14.38s/it]
 38%|███▊      | 14385/37963 [61:39:04<92:44:06, 14.16s/it]
 38%|███▊      | 14386/37963 [61:39:25<106:42:29, 16.29s/it]
 38%|███▊      | 14387/37963 [61:39:40<102:58:18, 15.72s/it]
 38%|███▊      | 14388/37963 [61:39:54<100:16:07, 15.31s/it]
 38%|███▊      | 14389/37963 [61:40:15<112:03:41, 17.11s/it]
 38%|███▊      | 14390/37963 [61:40:30<106:34:09, 16.27s/it]
                                                            
{'loss': '0.1471', 'grad_norm': '3.13', 'learning_rate': '1.426e-05', 'epoch': '0.3791'}

 38%|███▊      | 14390/37963 [61:40:30<106:34:09, 16.27s/it]
 38%|███▊      | 14391/37963 [61:40:44<102:02:15, 15.58s/it]
 38%|███▊      | 14392/37963 [61:41:05<112:37:14, 17.20s/it]
 38%|███▊      | 14393/37963 [61:41:19<106:13:21, 16.22s/it]
 38%|███▊      | 14394/37963 [61:41:33<102:32:52, 15.66s/it]
 38%|███▊      | 14395/37963 [61:41:47<99:43:50, 15.23s/it] 
 38%|███▊      | 14396/37963 [61:42:02<98:02:25, 14.98s/it]
 38%|███▊      | 14397/37963 [61:42:16<96:12:46, 14.70s/it]
 38%|███▊      | 14398/37963 [61:42:37<108:28:43, 16.57s/it]
 38%|███▊      | 14399/37963 [61:42:51<103:47:41, 15.86s/it]
 38%|███▊      | 14400/37963 [61:43:05<99:55:50, 15.27s/it] 
                                                           
{'loss': '0.1584', 'grad_norm': '2.269', 'learning_rate': '1.426e-05', 'epoch': '0.3793'}

 38%|███▊      | 14400/37963 [61:43:05<99:55:50, 15.27s/it]
 38%|███▊      | 14401/37963 [61:43:19<97:46:21, 14.94s/it]
 38%|███▊      | 14402/37963 [61:43:33<96:30:18, 14.75s/it]
 38%|███▊      | 14403/37963 [61:43:48<95:44:49, 14.63s/it]
 38%|███▊      | 14404/37963 [61:44:15<120:12:06, 18.37s/it]
 38%|███▊      | 14405/37963 [61:44:29<112:29:39, 17.19s/it]
 38%|███▊      | 14406/37963 [61:44:43<106:48:05, 16.32s/it]
 38%|███▊      | 14407/37963 [61:44:58<103:03:46, 15.75s/it]
 38%|███▊      | 14408/37963 [61:45:12<99:26:39, 15.20s/it] 
 38%|███▊      | 14409/37963 [61:45:26<96:39:53, 14.77s/it]
 38%|███▊      | 14410/37963 [61:45:46<108:31:58, 16.59s/it]
                                                            
{'loss': '0.1475', 'grad_norm': '1.643', 'learning_rate': '1.425e-05', 'epoch': '0.3796'}

 38%|███▊      | 14410/37963 [61:45:46<108:31:58, 16.59s/it]
 38%|███▊      | 14411/37963 [61:46:00<103:37:41, 15.84s/it]
 38%|███▊      | 14412/37963 [61:46:15<100:41:34, 15.39s/it]
 38%|███▊      | 14413/37963 [61:46:29<98:41:05, 15.09s/it] 
 38%|███▊      | 14414/37963 [61:46:43<96:11:21, 14.70s/it]
 38%|███▊      | 14415/37963 [61:46:57<95:41:19, 14.63s/it]
 38%|███▊      | 14416/37963 [61:47:12<95:13:17, 14.56s/it]
 38%|███▊      | 14417/37963 [61:47:26<94:33:44, 14.46s/it]
 38%|███▊      | 14418/37963 [61:47:40<94:24:09, 14.43s/it]
 38%|███▊      | 14419/37963 [61:47:55<94:29:04, 14.45s/it]
 38%|███▊      | 14420/37963 [61:48:09<94:13:31, 14.41s/it]
                                                           
{'loss': '0.1618', 'grad_norm': '1.472', 'learning_rate': '1.424e-05', 'epoch': '0.3798'}

 38%|███▊      | 14420/37963 [61:48:09<94:13:31, 14.41s/it]
 38%|███▊      | 14421/37963 [61:48:24<94:09:46, 14.40s/it]
 38%|███▊      | 14422/37963 [61:48:38<93:57:32, 14.37s/it]
 38%|███▊      | 14423/37963 [61:48:52<93:11:00, 14.25s/it]
 38%|███▊      | 14424/37963 [61:49:13<106:21:36, 16.27s/it]
 38%|███▊      | 14425/37963 [61:49:27<102:39:24, 15.70s/it]
 38%|███▊      | 14426/37963 [61:49:42<100:23:20, 15.35s/it]
 38%|███▊      | 14427/37963 [61:49:56<98:25:54, 15.06s/it] 
 38%|███▊      | 14428/37963 [61:50:10<96:13:09, 14.72s/it]
 38%|███▊      | 14429/37963 [61:50:24<94:59:14, 14.53s/it]
 38%|███▊      | 14430/37963 [61:50:39<95:20:17, 14.58s/it]
                                                           
{'loss': '0.1384', 'grad_norm': '3.718', 'learning_rate': '1.423e-05', 'epoch': '0.3801'}

 38%|███▊      | 14430/37963 [61:50:39<95:20:17, 14.58s/it]
 38%|███▊      | 14431/37963 [61:50:53<94:50:27, 14.51s/it]
 38%|███▊      | 14432/37963 [61:51:07<94:26:24, 14.45s/it]
 38%|███▊      | 14433/37963 [61:51:22<94:25:58, 14.45s/it]
 38%|███▊      | 14434/37963 [61:51:43<106:45:15, 16.33s/it]
 38%|███▊      | 14435/37963 [61:51:57<102:56:05, 15.75s/it]
 38%|███▊      | 14436/37963 [61:52:11<100:07:13, 15.32s/it]
 38%|███▊      | 14437/37963 [61:52:26<98:15:42, 15.04s/it] 
 38%|███▊      | 14438/37963 [61:52:48<111:58:32, 17.14s/it]
 38%|███▊      | 14439/37963 [61:53:02<105:53:51, 16.21s/it]
 38%|███▊      | 14440/37963 [61:53:16<102:13:03, 15.64s/it]
                                                            
{'loss': '0.1668', 'grad_norm': '2.584', 'learning_rate': '1.422e-05', 'epoch': '0.3804'}

 38%|███▊      | 14440/37963 [61:53:16<102:13:03, 15.64s/it]
 38%|███▊      | 14441/37963 [61:53:30<99:35:18, 15.24s/it] 
 38%|███▊      | 14442/37963 [61:53:51<110:54:40, 16.98s/it]
 38%|███▊      | 14443/37963 [61:54:06<105:45:32, 16.19s/it]
 38%|███▊      | 14444/37963 [61:54:20<101:46:55, 15.58s/it]
 38%|███▊      | 14445/37963 [61:54:34<99:19:17, 15.20s/it] 
 38%|███▊      | 14446/37963 [61:54:49<97:37:08, 14.94s/it]
 38%|███▊      | 14447/37963 [61:55:03<96:27:20, 14.77s/it]
 38%|███▊      | 14448/37963 [61:55:24<108:07:57, 16.55s/it]
 38%|███▊      | 14449/37963 [61:55:38<103:56:56, 15.91s/it]
 38%|███▊      | 14450/37963 [61:55:58<112:13:54, 17.18s/it]
                                                            
{'loss': '0.1558', 'grad_norm': '2.864', 'learning_rate': '1.422e-05', 'epoch': '0.3806'}

 38%|███▊      | 14450/37963 [61:55:58<112:13:54, 17.18s/it]
 38%|███▊      | 14451/37963 [61:56:12<105:39:02, 16.18s/it]
 38%|███▊      | 14452/37963 [61:56:27<102:15:31, 15.66s/it]
 38%|███▊      | 14453/37963 [61:56:41<99:43:10, 15.27s/it] 
 38%|███▊      | 14454/37963 [61:57:02<110:17:42, 16.89s/it]
 38%|███▊      | 14455/37963 [61:57:16<105:16:28, 16.12s/it]
 38%|███▊      | 14456/37963 [61:57:30<101:36:32, 15.56s/it]
 38%|███▊      | 14457/37963 [61:57:44<99:10:29, 15.19s/it] 
 38%|███▊      | 14458/37963 [61:58:06<110:35:58, 16.94s/it]
 38%|███▊      | 14459/37963 [61:58:20<105:21:33, 16.14s/it]
 38%|███▊      | 14460/37963 [61:58:34<102:18:29, 15.67s/it]
                                                            
{'loss': '0.1531', 'grad_norm': '2.022', 'learning_rate': '1.421e-05', 'epoch': '0.3809'}

 38%|███▊      | 14460/37963 [61:58:34<102:18:29, 15.67s/it]
 38%|███▊      | 14461/37963 [61:58:49<99:43:00, 15.27s/it] 
 38%|███▊      | 14462/37963 [61:59:03<97:46:43, 14.98s/it]
 38%|███▊      | 14463/37963 [61:59:17<96:28:27, 14.78s/it]
 38%|███▊      | 14464/37963 [61:59:32<95:37:41, 14.65s/it]
 38%|███▊      | 14465/37963 [61:59:46<94:58:50, 14.55s/it]
 38%|███▊      | 14466/37963 [62:00:00<94:36:26, 14.49s/it]
 38%|███▊      | 14467/37963 [62:00:14<93:18:24, 14.30s/it]
 38%|███▊      | 14468/37963 [62:00:29<93:24:03, 14.31s/it]
 38%|███▊      | 14469/37963 [62:00:43<93:56:32, 14.39s/it]
 38%|███▊      | 14470/37963 [62:00:57<93:34:30, 14.34s/it]
                                                           
{'loss': '0.1746', 'grad_norm': '2.736', 'learning_rate': '1.42e-05', 'epoch': '0.3812'}

 38%|███▊      | 14470/37963 [62:00:57<93:34:30, 14.34s/it]
 38%|███▊      | 14471/37963 [62:01:11<92:06:37, 14.12s/it]
 38%|███▊      | 14472/37963 [62:01:25<92:38:09, 14.20s/it]
 38%|███▊      | 14473/37963 [62:01:40<92:58:10, 14.25s/it]
 38%|███▊      | 14474/37963 [62:01:54<93:11:50, 14.28s/it]
 38%|███▊      | 14475/37963 [62:02:08<93:25:44, 14.32s/it]
 38%|███▊      | 14476/37963 [62:02:29<106:15:18, 16.29s/it]
 38%|███▊      | 14477/37963 [62:02:44<102:28:44, 15.71s/it]
 38%|███▊      | 14478/37963 [62:02:58<99:30:48, 15.25s/it] 
 38%|███▊      | 14479/37963 [62:03:12<97:43:41, 14.98s/it]
 38%|███▊      | 14480/37963 [62:03:27<96:31:56, 14.80s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '1.928', 'learning_rate': '1.419e-05', 'epoch': '0.3814'}

 38%|███▊      | 14480/37963 [62:03:27<96:31:56, 14.80s/it]
 38%|███▊      | 14481/37963 [62:03:41<95:44:28, 14.68s/it]
 38%|███▊      | 14482/37963 [62:04:02<107:43:36, 16.52s/it]
 38%|███▊      | 14483/37963 [62:04:16<103:32:36, 15.88s/it]
 38%|███▊      | 14484/37963 [62:04:30<100:06:37, 15.35s/it]
 38%|███▊      | 14485/37963 [62:04:51<111:31:58, 17.10s/it]
 38%|███▊      | 14486/37963 [62:05:06<106:05:46, 16.27s/it]
 38%|███▊      | 14487/37963 [62:05:20<102:17:49, 15.69s/it]
 38%|███▊      | 14488/37963 [62:05:34<99:14:40, 15.22s/it] 
 38%|███▊      | 14489/37963 [62:05:49<97:37:37, 14.97s/it]
 38%|███▊      | 14490/37963 [62:06:03<96:17:38, 14.77s/it]
                                                           
{'loss': '0.1543', 'grad_norm': '1.371', 'learning_rate': '1.419e-05', 'epoch': '0.3817'}

 38%|███▊      | 14490/37963 [62:06:03<96:17:38, 14.77s/it]
 38%|███▊      | 14491/37963 [62:06:24<108:41:14, 16.67s/it]
 38%|███▊      | 14492/37963 [62:06:38<103:40:43, 15.90s/it]
 38%|███▊      | 14493/37963 [62:06:53<100:37:24, 15.43s/it]
 38%|███▊      | 14494/37963 [62:07:07<97:46:41, 15.00s/it] 
 38%|███▊      | 14495/37963 [62:07:21<96:31:07, 14.81s/it]
 38%|███▊      | 14496/37963 [62:07:42<109:02:44, 16.73s/it]
 38%|███▊      | 14497/37963 [62:07:57<104:41:27, 16.06s/it]
 38%|███▊      | 14498/37963 [62:08:11<101:15:05, 15.53s/it]
 38%|███▊      | 14499/37963 [62:08:25<99:07:41, 15.21s/it] 
 38%|███▊      | 14500/37963 [62:08:46<109:26:23, 16.79s/it]
                                                            
{'loss': '0.1538', 'grad_norm': '7.058', 'learning_rate': '1.418e-05', 'epoch': '0.382'}

 38%|███▊      | 14500/37963 [62:08:46<109:26:23, 16.79s/it]
 38%|███▊      | 14501/37963 [62:09:07<117:03:30, 17.96s/it]
 38%|███▊      | 14502/37963 [62:09:21<110:10:21, 16.91s/it]
 38%|███▊      | 14503/37963 [62:09:35<104:10:39, 15.99s/it]
 38%|███▊      | 14504/37963 [62:09:48<99:26:42, 15.26s/it] 
 38%|███▊      | 14505/37963 [62:10:09<110:28:44, 16.95s/it]
 38%|███▊      | 14506/37963 [62:10:24<105:17:51, 16.16s/it]
 38%|███▊      | 14507/37963 [62:10:37<100:50:02, 15.48s/it]
 38%|███▊      | 14508/37963 [62:10:52<98:19:58, 15.09s/it] 
 38%|███▊      | 14509/37963 [62:11:06<96:57:19, 14.88s/it]
 38%|███▊      | 14510/37963 [62:11:20<95:51:53, 14.72s/it]
                                                           
{'loss': '0.1456', 'grad_norm': '5.932', 'learning_rate': '1.417e-05', 'epoch': '0.3822'}

 38%|███▊      | 14510/37963 [62:11:20<95:51:53, 14.72s/it]
 38%|███▊      | 14511/37963 [62:11:35<95:05:29, 14.60s/it]
 38%|███▊      | 14512/37963 [62:11:49<94:40:58, 14.53s/it]
 38%|███▊      | 14513/37963 [62:12:03<93:32:30, 14.36s/it]
 38%|███▊      | 14514/37963 [62:12:17<92:38:04, 14.22s/it]
 38%|███▊      | 14515/37963 [62:12:31<91:47:08, 14.09s/it]
 38%|███▊      | 14516/37963 [62:12:45<92:26:14, 14.19s/it]
 38%|███▊      | 14517/37963 [62:12:59<92:40:06, 14.23s/it]
 38%|███▊      | 14518/37963 [62:13:14<92:52:49, 14.26s/it]
 38%|███▊      | 14519/37963 [62:13:28<92:20:11, 14.18s/it]
 38%|███▊      | 14520/37963 [62:13:42<92:34:07, 14.22s/it]
                                                           
{'loss': '0.1708', 'grad_norm': '2.383', 'learning_rate': '1.416e-05', 'epoch': '0.3825'}

 38%|███▊      | 14520/37963 [62:13:42<92:34:07, 14.22s/it]
 38%|███▊      | 14521/37963 [62:13:56<92:10:07, 14.15s/it]
 38%|███▊      | 14522/37963 [62:14:10<92:31:11, 14.21s/it]
 38%|███▊      | 14523/37963 [62:14:25<92:44:56, 14.24s/it]
 38%|███▊      | 14524/37963 [62:14:45<104:50:39, 16.10s/it]
 38%|███▊      | 14525/37963 [62:15:00<101:23:45, 15.57s/it]
 38%|███▊      | 14526/37963 [62:15:14<99:06:03, 15.22s/it] 
 38%|███▊      | 14527/37963 [62:15:28<97:20:11, 14.95s/it]
 38%|███▊      | 14528/37963 [62:15:43<96:15:11, 14.79s/it]
 38%|███▊      | 14529/37963 [62:15:57<95:17:57, 14.64s/it]
 38%|███▊      | 14530/37963 [62:16:18<108:12:46, 16.62s/it]
                                                            
{'loss': '0.1574', 'grad_norm': '2.713', 'learning_rate': '1.415e-05', 'epoch': '0.3827'}

 38%|███▊      | 14530/37963 [62:16:18<108:12:46, 16.62s/it]
 38%|███▊      | 14531/37963 [62:16:33<103:41:43, 15.93s/it]
 38%|███▊      | 14532/37963 [62:16:46<99:43:17, 15.32s/it] 
 38%|███▊      | 14533/37963 [62:17:01<97:43:01, 15.01s/it]
 38%|███▊      | 14534/37963 [62:17:22<109:34:35, 16.84s/it]
 38%|███▊      | 14535/37963 [62:17:36<104:01:38, 15.99s/it]
 38%|███▊      | 14536/37963 [62:17:50<100:59:03, 15.52s/it]
 38%|███▊      | 14537/37963 [62:18:05<98:37:48, 15.16s/it] 
 38%|███▊      | 14538/37963 [62:18:19<96:16:32, 14.80s/it]
 38%|███▊      | 14539/37963 [62:18:40<108:38:22, 16.70s/it]
 38%|███▊      | 14540/37963 [62:18:54<104:11:28, 16.01s/it]
                                                            
{'loss': '0.1588', 'grad_norm': '1.056', 'learning_rate': '1.415e-05', 'epoch': '0.383'}

 38%|███▊      | 14540/37963 [62:18:54<104:11:28, 16.01s/it]
 38%|███▊      | 14541/37963 [62:19:08<99:49:26, 15.34s/it] 
 38%|███▊      | 14542/37963 [62:19:22<96:49:13, 14.88s/it]
 38%|███▊      | 14543/37963 [62:19:36<95:42:32, 14.71s/it]
 38%|███▊      | 14544/37963 [62:19:50<95:04:06, 14.61s/it]
 38%|███▊      | 14545/37963 [62:20:11<106:54:18, 16.43s/it]
 38%|███▊      | 14546/37963 [62:20:25<102:58:24, 15.83s/it]
 38%|███▊      | 14547/37963 [62:20:40<100:10:00, 15.40s/it]
 38%|███▊      | 14548/37963 [62:21:01<110:45:08, 17.03s/it]
 38%|███▊      | 14549/37963 [62:21:15<105:30:29, 16.22s/it]
 38%|███▊      | 14550/37963 [62:21:36<114:10:48, 17.56s/it]
                                                            
{'loss': '0.1671', 'grad_norm': '1.15', 'learning_rate': '1.414e-05', 'epoch': '0.3833'}

 38%|███▊      | 14550/37963 [62:21:36<114:10:48, 17.56s/it]
 38%|███▊      | 14551/37963 [62:21:49<106:24:59, 16.36s/it]
 38%|███▊      | 14552/37963 [62:22:04<102:28:23, 15.76s/it]
 38%|███▊      | 14553/37963 [62:22:18<99:37:38, 15.32s/it] 
 38%|███▊      | 14554/37963 [62:22:39<111:02:10, 17.08s/it]
 38%|███▊      | 14555/37963 [62:22:53<105:34:35, 16.24s/it]
 38%|███▊      | 14556/37963 [62:23:08<101:53:38, 15.67s/it]
 38%|███▊      | 14557/37963 [62:23:22<99:44:29, 15.34s/it] 
 38%|███▊      | 14558/37963 [62:23:36<97:26:37, 14.99s/it]
 38%|███▊      | 14559/37963 [62:23:50<95:34:24, 14.70s/it]
 38%|███▊      | 14560/37963 [62:24:05<94:15:22, 14.50s/it]
                                                           
{'loss': '0.1771', 'grad_norm': '2.003', 'learning_rate': '1.413e-05', 'epoch': '0.3835'}

 38%|███▊      | 14560/37963 [62:24:05<94:15:22, 14.50s/it]
 38%|███▊      | 14561/37963 [62:24:18<93:12:33, 14.34s/it]
 38%|███▊      | 14562/37963 [62:24:33<93:09:08, 14.33s/it]
 38%|███▊      | 14563/37963 [62:24:47<93:10:36, 14.33s/it]
 38%|███▊      | 14564/37963 [62:25:02<93:17:45, 14.35s/it]
 38%|███▊      | 14565/37963 [62:25:16<93:15:29, 14.35s/it]
 38%|███▊      | 14566/37963 [62:25:30<92:17:17, 14.20s/it]
 38%|███▊      | 14567/37963 [62:25:44<92:26:33, 14.22s/it]
 38%|███▊      | 14568/37963 [62:25:58<92:39:24, 14.26s/it]
 38%|███▊      | 14569/37963 [62:26:13<93:13:43, 14.35s/it]
 38%|███▊      | 14570/37963 [62:26:27<93:07:49, 14.33s/it]
                                                           
{'loss': '0.149', 'grad_norm': '1.166', 'learning_rate': '1.412e-05', 'epoch': '0.3838'}

 38%|███▊      | 14570/37963 [62:26:27<93:07:49, 14.33s/it]
 38%|███▊      | 14571/37963 [62:26:42<93:10:09, 14.34s/it]
 38%|███▊      | 14572/37963 [62:26:56<93:12:06, 14.34s/it]
 38%|███▊      | 14573/37963 [62:27:10<93:07:01, 14.33s/it]
 38%|███▊      | 14574/37963 [62:27:24<92:33:30, 14.25s/it]
 38%|███▊      | 14575/37963 [62:27:45<105:09:05, 16.19s/it]
 38%|███▊      | 14576/37963 [62:27:59<101:34:28, 15.64s/it]
 38%|███▊      | 14577/37963 [62:28:20<111:45:54, 17.20s/it]
 38%|███▊      | 14578/37963 [62:28:34<106:03:10, 16.33s/it]
 38%|███▊      | 14579/37963 [62:28:49<102:12:35, 15.74s/it]
 38%|███▊      | 14580/37963 [62:29:03<98:53:15, 15.22s/it] 
                                                           
{'loss': '0.1618', 'grad_norm': '1.899', 'learning_rate': '1.412e-05', 'epoch': '0.3841'}

 38%|███▊      | 14580/37963 [62:29:03<98:53:15, 15.22s/it]
 38%|███▊      | 14581/37963 [62:29:17<96:09:16, 14.80s/it]
 38%|███▊      | 14582/37963 [62:29:31<95:24:28, 14.69s/it]
 38%|███▊      | 14583/37963 [62:29:53<109:40:31, 16.89s/it]
 38%|███▊      | 14584/37963 [62:30:07<104:41:15, 16.12s/it]
 38%|███▊      | 14585/37963 [62:30:22<101:24:32, 15.62s/it]
 38%|███▊      | 14586/37963 [62:30:36<99:01:09, 15.25s/it] 
 38%|███▊      | 14587/37963 [62:30:51<97:34:47, 15.03s/it]
 38%|███▊      | 14588/37963 [62:31:05<96:18:38, 14.83s/it]
 38%|███▊      | 14589/37963 [62:31:26<107:46:54, 16.60s/it]
 38%|███▊      | 14590/37963 [62:31:40<103:25:58, 15.93s/it]
                                                            
{'loss': '0.1581', 'grad_norm': '6.594', 'learning_rate': '1.411e-05', 'epoch': '0.3843'}

 38%|███▊      | 14590/37963 [62:31:40<103:25:58, 15.93s/it]
 38%|███▊      | 14591/37963 [62:31:55<100:23:12, 15.46s/it]
 38%|███▊      | 14592/37963 [62:32:15<110:17:11, 16.99s/it]
 38%|███▊      | 14593/37963 [62:32:29<105:03:01, 16.18s/it]
 38%|███▊      | 14594/37963 [62:32:44<101:31:14, 15.64s/it]
 38%|███▊      | 14595/37963 [62:32:58<99:07:31, 15.27s/it] 
 38%|███▊      | 14596/37963 [62:33:19<109:42:15, 16.90s/it]
 38%|███▊      | 14597/37963 [62:33:33<104:40:33, 16.13s/it]
 38%|███▊      | 14598/37963 [62:33:48<101:25:09, 15.63s/it]
 38%|███▊      | 14599/37963 [62:34:09<111:38:59, 17.20s/it]
 38%|███▊      | 14600/37963 [62:34:23<106:04:04, 16.34s/it]
                                                            
{'loss': '0.1623', 'grad_norm': '4.335', 'learning_rate': '1.41e-05', 'epoch': '0.3846'}

 38%|███▊      | 14600/37963 [62:34:23<106:04:04, 16.34s/it]
 38%|███▊      | 14601/37963 [62:34:37<102:10:47, 15.75s/it]
 38%|███▊      | 14602/37963 [62:34:51<99:03:03, 15.26s/it] 
 38%|███▊      | 14603/37963 [62:35:13<110:24:40, 17.02s/it]
 38%|███▊      | 14604/37963 [62:35:26<104:00:08, 16.03s/it]
 38%|███▊      | 14605/37963 [62:35:40<100:27:40, 15.48s/it]
 38%|███▊      | 14606/37963 [62:35:54<96:54:43, 14.94s/it] 
 38%|███▊      | 14607/37963 [62:36:09<95:48:13, 14.77s/it]
 38%|███▊      | 14608/37963 [62:36:22<94:09:33, 14.51s/it]
 38%|███▊      | 14609/37963 [62:36:37<93:56:04, 14.48s/it]
 38%|███▊      | 14610/37963 [62:36:51<93:23:33, 14.40s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '1.262', 'learning_rate': '1.409e-05', 'epoch': '0.3848'}

 38%|███▊      | 14610/37963 [62:36:51<93:23:33, 14.40s/it]
 38%|███▊      | 14611/37963 [62:37:05<93:18:15, 14.38s/it]
 38%|███▊      | 14612/37963 [62:37:20<92:56:08, 14.33s/it]
 38%|███▊      | 14613/37963 [62:37:33<91:59:16, 14.18s/it]
 38%|███▊      | 14614/37963 [62:37:48<92:14:59, 14.22s/it]
 38%|███▊      | 14615/37963 [62:38:01<90:38:52, 13.98s/it]
 39%|███▊      | 14616/37963 [62:38:15<91:21:08, 14.09s/it]
 39%|███▊      | 14617/37963 [62:38:30<91:44:37, 14.15s/it]
 39%|███▊      | 14618/37963 [62:38:44<91:06:19, 14.05s/it]
 39%|███▊      | 14619/37963 [62:38:58<91:00:57, 14.04s/it]
 39%|███▊      | 14620/37963 [62:39:12<91:00:20, 14.04s/it]
                                                           
{'loss': '0.1585', 'grad_norm': '1.594', 'learning_rate': '1.408e-05', 'epoch': '0.3851'}

 39%|███▊      | 14620/37963 [62:39:12<91:00:20, 14.04s/it]
 39%|███▊      | 14621/37963 [62:39:26<91:29:05, 14.11s/it]
 39%|███▊      | 14622/37963 [62:39:46<103:40:44, 15.99s/it]
 39%|███▊      | 14623/37963 [62:40:01<100:45:59, 15.54s/it]
 39%|███▊      | 14624/37963 [62:40:15<98:25:21, 15.18s/it] 
 39%|███▊      | 14625/37963 [62:40:30<97:03:40, 14.97s/it]
 39%|███▊      | 14626/37963 [62:40:44<95:59:05, 14.81s/it]
 39%|███▊      | 14627/37963 [62:40:58<95:04:17, 14.67s/it]
 39%|███▊      | 14628/37963 [62:41:12<92:50:34, 14.32s/it]
 39%|███▊      | 14629/37963 [62:41:33<105:33:07, 16.28s/it]
 39%|███▊      | 14630/37963 [62:41:47<101:05:41, 15.60s/it]
                                                            
{'loss': '0.1497', 'grad_norm': '1.734', 'learning_rate': '1.408e-05', 'epoch': '0.3854'}

 39%|███▊      | 14630/37963 [62:41:47<101:05:41, 15.60s/it]
 39%|███▊      | 14631/37963 [62:42:07<110:56:01, 17.12s/it]
 39%|███▊      | 14632/37963 [62:42:22<105:40:13, 16.31s/it]
 39%|███▊      | 14633/37963 [62:42:36<101:44:21, 15.70s/it]
 39%|███▊      | 14634/37963 [62:42:50<99:08:25, 15.30s/it] 
 39%|███▊      | 14635/37963 [62:43:05<96:55:29, 14.96s/it]
 39%|███▊      | 14636/37963 [62:43:26<109:03:25, 16.83s/it]
 39%|███▊      | 14637/37963 [62:43:40<104:11:19, 16.08s/it]
 39%|███▊      | 14638/37963 [62:43:54<100:34:39, 15.52s/it]
 39%|███▊      | 14639/37963 [62:44:09<98:20:50, 15.18s/it] 
 39%|███▊      | 14640/37963 [62:44:23<96:46:42, 14.94s/it]
                                                           
{'loss': '0.1644', 'grad_norm': '0.871', 'learning_rate': '1.407e-05', 'epoch': '0.3856'}

 39%|███▊      | 14640/37963 [62:44:23<96:46:42, 14.94s/it]
 39%|███▊      | 14641/37963 [62:44:44<108:09:21, 16.70s/it]
 39%|███▊      | 14642/37963 [62:44:58<103:27:04, 15.97s/it]
 39%|███▊      | 14643/37963 [62:45:13<100:30:47, 15.52s/it]
 39%|███▊      | 14644/37963 [62:45:33<109:17:34, 16.87s/it]
 39%|███▊      | 14645/37963 [62:45:47<104:36:13, 16.15s/it]
 39%|███▊      | 14646/37963 [62:46:02<101:15:38, 15.63s/it]
 39%|███▊      | 14647/37963 [62:46:16<98:37:17, 15.23s/it] 
 39%|███▊      | 14648/37963 [62:46:37<109:26:56, 16.90s/it]
 39%|███▊      | 14649/37963 [62:46:51<104:02:51, 16.07s/it]
 39%|███▊      | 14650/37963 [62:47:05<100:00:46, 15.44s/it]
                                                            
{'loss': '0.1575', 'grad_norm': '2.468', 'learning_rate': '1.406e-05', 'epoch': '0.3859'}

 39%|███▊      | 14650/37963 [62:47:05<100:00:46, 15.44s/it]
 39%|███▊      | 14651/37963 [62:47:19<97:16:41, 15.02s/it] 
 39%|███▊      | 14652/37963 [62:47:40<109:12:08, 16.86s/it]
 39%|███▊      | 14653/37963 [62:47:54<103:18:32, 15.96s/it]
 39%|███▊      | 14654/37963 [62:48:08<100:16:26, 15.49s/it]
 39%|███▊      | 14655/37963 [62:48:23<98:06:03, 15.15s/it] 
 39%|███▊      | 14656/37963 [62:48:37<96:39:09, 14.93s/it]
 39%|███▊      | 14657/37963 [62:48:52<96:03:04, 14.84s/it]
 39%|███▊      | 14658/37963 [62:49:06<95:04:31, 14.69s/it]
 39%|███▊      | 14659/37963 [62:49:20<94:21:44, 14.58s/it]
 39%|███▊      | 14660/37963 [62:49:35<93:53:55, 14.51s/it]
                                                           
{'loss': '0.1574', 'grad_norm': '3.499', 'learning_rate': '1.405e-05', 'epoch': '0.3862'}

 39%|███▊      | 14660/37963 [62:49:35<93:53:55, 14.51s/it]
 39%|███▊      | 14661/37963 [62:49:49<93:34:55, 14.46s/it]
 39%|███▊      | 14662/37963 [62:50:03<92:55:10, 14.36s/it]
 39%|███▊      | 14663/37963 [62:50:17<92:42:51, 14.32s/it]
 39%|███▊      | 14664/37963 [62:50:32<93:02:45, 14.38s/it]
 39%|███▊      | 14665/37963 [62:50:46<93:02:22, 14.38s/it]
 39%|███▊      | 14666/37963 [62:51:00<92:34:23, 14.30s/it]
 39%|███▊      | 14667/37963 [62:51:15<92:42:10, 14.33s/it]
 39%|███▊      | 14668/37963 [62:51:29<92:43:59, 14.33s/it]
 39%|███▊      | 14669/37963 [62:51:43<92:50:56, 14.35s/it]
 39%|███▊      | 14670/37963 [62:51:58<92:52:28, 14.35s/it]
                                                           
{'loss': '0.1653', 'grad_norm': '1.958', 'learning_rate': '1.405e-05', 'epoch': '0.3864'}

 39%|███▊      | 14670/37963 [62:51:58<92:52:28, 14.35s/it]
 39%|███▊      | 14671/37963 [62:52:12<92:53:28, 14.36s/it]
 39%|███▊      | 14672/37963 [62:52:33<105:08:57, 16.25s/it]
 39%|███▊      | 14673/37963 [62:52:47<100:55:34, 15.60s/it]
 39%|███▊      | 14674/37963 [62:53:01<98:36:36, 15.24s/it] 
 39%|███▊      | 14675/37963 [62:53:16<96:57:31, 14.99s/it]
 39%|███▊      | 14676/37963 [62:53:30<95:42:12, 14.80s/it]
 39%|███▊      | 14677/37963 [62:53:44<94:44:58, 14.65s/it]
 39%|███▊      | 14678/37963 [62:53:59<93:42:59, 14.49s/it]
 39%|███▊      | 14679/37963 [62:54:13<93:21:45, 14.44s/it]
 39%|███▊      | 14680/37963 [62:54:40<117:33:23, 18.18s/it]
                                                            
{'loss': '0.1482', 'grad_norm': '1.91', 'learning_rate': '1.404e-05', 'epoch': '0.3867'}

 39%|███▊      | 14680/37963 [62:54:40<117:33:23, 18.18s/it]
 39%|███▊      | 14681/37963 [62:54:54<109:31:41, 16.94s/it]
 39%|███▊      | 14682/37963 [62:55:08<104:29:36, 16.16s/it]
 39%|███▊      | 14683/37963 [62:55:22<100:55:59, 15.61s/it]
 39%|███▊      | 14684/37963 [62:55:37<98:08:27, 15.18s/it] 
 39%|███▊      | 14685/37963 [62:55:58<109:51:53, 16.99s/it]
 39%|███▊      | 14686/37963 [62:56:12<104:48:50, 16.21s/it]
 39%|███▊      | 14687/37963 [62:56:27<101:14:52, 15.66s/it]
 39%|███▊      | 14688/37963 [62:56:41<98:43:21, 15.27s/it] 
 39%|███▊      | 14689/37963 [62:56:55<97:15:26, 15.04s/it]
 39%|███▊      | 14690/37963 [62:57:10<95:53:48, 14.83s/it]
                                                           
{'loss': '0.1545', 'grad_norm': '1.45', 'learning_rate': '1.403e-05', 'epoch': '0.387'}

 39%|███▊      | 14690/37963 [62:57:10<95:53:48, 14.83s/it]
 39%|███▊      | 14691/37963 [62:57:31<107:32:07, 16.63s/it]
 39%|███▊      | 14692/37963 [62:57:51<115:38:37, 17.89s/it]
 39%|███▊      | 14693/37963 [62:58:06<108:53:09, 16.85s/it]
 39%|███▊      | 14694/37963 [62:58:20<103:58:38, 16.09s/it]
 39%|███▊      | 14695/37963 [62:58:34<100:18:18, 15.52s/it]
 39%|███▊      | 14696/37963 [62:58:48<97:00:58, 15.01s/it] 
 39%|███▊      | 14697/37963 [62:59:03<96:05:16, 14.87s/it]
 39%|███▊      | 14698/37963 [62:59:17<95:07:04, 14.72s/it]
 39%|███▊      | 14699/37963 [62:59:37<105:49:31, 16.38s/it]
 39%|███▊      | 14700/37963 [62:59:59<115:26:40, 17.87s/it]
                                                            
{'loss': '0.1453', 'grad_norm': '1.753', 'learning_rate': '1.402e-05', 'epoch': '0.3872'}

 39%|███▊      | 14700/37963 [62:59:59<115:26:40, 17.87s/it]
 39%|███▊      | 14701/37963 [63:00:13<108:43:12, 16.83s/it]
 39%|███▊      | 14702/37963 [63:00:28<103:58:51, 16.09s/it]
 39%|███▊      | 14703/37963 [63:00:41<99:18:24, 15.37s/it] 
 39%|███▊      | 14704/37963 [63:00:56<97:22:59, 15.07s/it]
 39%|███▊      | 14705/37963 [63:01:10<96:12:47, 14.89s/it]
 39%|███▊      | 14706/37963 [63:01:24<95:14:25, 14.74s/it]
 39%|███▊      | 14707/37963 [63:01:39<94:35:45, 14.64s/it]
 39%|███▊      | 14708/37963 [63:01:53<93:42:57, 14.51s/it]
 39%|███▊      | 14709/37963 [63:02:07<93:21:23, 14.45s/it]
 39%|███▊      | 14710/37963 [63:02:22<93:04:48, 14.41s/it]
                                                           
{'loss': '0.1562', 'grad_norm': '1.301', 'learning_rate': '1.401e-05', 'epoch': '0.3875'}

 39%|███▊      | 14710/37963 [63:02:22<93:04:48, 14.41s/it]
 39%|███▉      | 14711/37963 [63:02:36<92:55:30, 14.39s/it]
 39%|███▉      | 14712/37963 [63:02:50<92:56:40, 14.39s/it]
 39%|███▉      | 14713/37963 [63:03:05<92:39:41, 14.35s/it]
 39%|███▉      | 14714/37963 [63:03:19<92:37:19, 14.34s/it]
 39%|███▉      | 14715/37963 [63:03:33<92:03:26, 14.26s/it]
 39%|███▉      | 14716/37963 [63:03:47<91:43:10, 14.20s/it]
 39%|███▉      | 14717/37963 [63:04:01<91:57:11, 14.24s/it]
 39%|███▉      | 14718/37963 [63:04:16<92:18:28, 14.30s/it]
 39%|███▉      | 14719/37963 [63:04:37<104:41:01, 16.21s/it]
 39%|███▉      | 14720/37963 [63:04:51<101:27:21, 15.71s/it]
                                                            
{'loss': '0.1504', 'grad_norm': '4.093', 'learning_rate': '1.401e-05', 'epoch': '0.3877'}

 39%|███▉      | 14720/37963 [63:04:51<101:27:21, 15.71s/it]
 39%|███▉      | 14721/37963 [63:05:05<98:46:18, 15.30s/it] 
 39%|███▉      | 14722/37963 [63:05:20<96:59:19, 15.02s/it]
 39%|███▉      | 14723/37963 [63:05:34<95:28:12, 14.79s/it]
 39%|███▉      | 14724/37963 [63:05:48<93:40:12, 14.51s/it]
 39%|███▉      | 14725/37963 [63:06:02<93:14:08, 14.44s/it]
 39%|███▉      | 14726/37963 [63:06:17<93:00:55, 14.41s/it]
 39%|███▉      | 14727/37963 [63:06:31<92:20:39, 14.31s/it]
 39%|███▉      | 14728/37963 [63:06:58<117:57:53, 18.28s/it]
 39%|███▉      | 14729/37963 [63:07:12<109:19:04, 16.94s/it]
 39%|███▉      | 14730/37963 [63:07:26<104:11:11, 16.14s/it]
                                                            
{'loss': '0.1611', 'grad_norm': '3.199', 'learning_rate': '1.4e-05', 'epoch': '0.388'}

 39%|███▉      | 14730/37963 [63:07:26<104:11:11, 16.14s/it]
 39%|███▉      | 14731/37963 [63:07:41<100:33:00, 15.58s/it]
 39%|███▉      | 14732/37963 [63:07:55<98:07:04, 15.20s/it] 
 39%|███▉      | 14733/37963 [63:08:16<109:04:13, 16.90s/it]
 39%|███▉      | 14734/37963 [63:08:30<103:20:10, 16.01s/it]
 39%|███▉      | 14735/37963 [63:08:44<100:04:31, 15.51s/it]
 39%|███▉      | 14736/37963 [63:08:58<97:25:20, 15.10s/it] 
 39%|███▉      | 14737/37963 [63:09:12<94:54:50, 14.71s/it]
 39%|███▉      | 14738/37963 [63:09:26<94:10:15, 14.60s/it]
 39%|███▉      | 14739/37963 [63:09:41<93:35:14, 14.51s/it]
 39%|███▉      | 14740/37963 [63:10:01<105:40:23, 16.38s/it]
                                                            
{'loss': '0.1583', 'grad_norm': '2.511', 'learning_rate': '1.399e-05', 'epoch': '0.3883'}

 39%|███▉      | 14740/37963 [63:10:01<105:40:23, 16.38s/it]
 39%|███▉      | 14741/37963 [63:10:23<115:20:51, 17.88s/it]
 39%|███▉      | 14742/37963 [63:10:37<107:31:48, 16.67s/it]
 39%|███▉      | 14743/37963 [63:10:51<103:21:28, 16.02s/it]
 39%|███▉      | 14744/37963 [63:11:05<100:07:34, 15.52s/it]
 39%|███▉      | 14745/37963 [63:11:20<97:53:21, 15.18s/it] 
 39%|███▉      | 14746/37963 [63:11:34<95:15:06, 14.77s/it]
 39%|███▉      | 14747/37963 [63:11:48<94:27:49, 14.65s/it]
 39%|███▉      | 14748/37963 [63:12:15<118:05:18, 18.31s/it]
 39%|███▉      | 14749/37963 [63:12:29<110:19:29, 17.11s/it]
 39%|███▉      | 14750/37963 [63:12:44<105:12:46, 16.32s/it]
                                                            
{'loss': '0.1723', 'grad_norm': '1.69', 'learning_rate': '1.398e-05', 'epoch': '0.3885'}

 39%|███▉      | 14750/37963 [63:12:44<105:12:46, 16.32s/it]
 39%|███▉      | 14751/37963 [63:12:58<101:24:00, 15.73s/it]
 39%|███▉      | 14752/37963 [63:13:12<98:52:29, 15.34s/it] 
 39%|███▉      | 14753/37963 [63:13:27<97:11:56, 15.08s/it]
 39%|███▉      | 14754/37963 [63:13:41<94:38:32, 14.68s/it]
 39%|███▉      | 14755/37963 [63:13:55<94:02:52, 14.59s/it]
 39%|███▉      | 14756/37963 [63:14:09<93:42:32, 14.54s/it]
 39%|███▉      | 14757/37963 [63:14:24<93:15:27, 14.47s/it]
 39%|███▉      | 14758/37963 [63:14:38<92:58:36, 14.42s/it]
 39%|███▉      | 14759/37963 [63:14:52<92:45:52, 14.39s/it]
 39%|███▉      | 14760/37963 [63:15:07<92:38:21, 14.37s/it]
                                                           
{'loss': '0.1504', 'grad_norm': '4.5', 'learning_rate': '1.398e-05', 'epoch': '0.3888'}

 39%|███▉      | 14760/37963 [63:15:07<92:38:21, 14.37s/it]
 39%|███▉      | 14761/37963 [63:15:21<92:28:52, 14.35s/it]
 39%|███▉      | 14762/37963 [63:15:35<92:29:31, 14.35s/it]
 39%|███▉      | 14763/37963 [63:15:50<92:35:56, 14.37s/it]
 39%|███▉      | 14764/37963 [63:16:04<92:31:40, 14.36s/it]
 39%|███▉      | 14765/37963 [63:16:18<92:38:20, 14.38s/it]
 39%|███▉      | 14766/37963 [63:16:33<92:32:29, 14.36s/it]
 39%|███▉      | 14767/37963 [63:16:47<92:31:38, 14.36s/it]
 39%|███▉      | 14768/37963 [63:17:08<104:52:59, 16.28s/it]
 39%|███▉      | 14769/37963 [63:17:22<101:07:21, 15.70s/it]
 39%|███▉      | 14770/37963 [63:17:37<98:35:48, 15.30s/it] 
                                                           
{'loss': '0.1616', 'grad_norm': '2.42', 'learning_rate': '1.397e-05', 'epoch': '0.3891'}

 39%|███▉      | 14770/37963 [63:17:37<98:35:48, 15.30s/it]
 39%|███▉      | 14771/37963 [63:17:51<96:56:29, 15.05s/it]
 39%|███▉      | 14772/37963 [63:18:05<95:39:07, 14.85s/it]
 39%|███▉      | 14773/37963 [63:18:20<94:28:11, 14.67s/it]
 39%|███▉      | 14774/37963 [63:18:34<93:52:32, 14.57s/it]
 39%|███▉      | 14775/37963 [63:18:48<92:45:25, 14.40s/it]
 39%|███▉      | 14776/37963 [63:19:09<105:45:32, 16.42s/it]
 39%|███▉      | 14777/37963 [63:19:24<101:42:50, 15.79s/it]
 39%|███▉      | 14778/37963 [63:19:45<111:52:34, 17.37s/it]
 39%|███▉      | 14779/37963 [63:19:59<105:58:28, 16.46s/it]
 39%|███▉      | 14780/37963 [63:20:13<101:55:59, 15.83s/it]
                                                            
{'loss': '0.1481', 'grad_norm': '3.64', 'learning_rate': '1.396e-05', 'epoch': '0.3893'}

 39%|███▉      | 14780/37963 [63:20:13<101:55:59, 15.83s/it]
 39%|███▉      | 14781/37963 [63:20:28<99:05:18, 15.39s/it] 
 39%|███▉      | 14782/37963 [63:20:42<97:15:48, 15.10s/it]
 39%|███▉      | 14783/37963 [63:21:03<108:38:18, 16.87s/it]
 39%|███▉      | 14784/37963 [63:21:17<103:47:39, 16.12s/it]
 39%|███▉      | 14785/37963 [63:21:32<100:28:59, 15.61s/it]
 39%|███▉      | 14786/37963 [63:21:46<97:45:28, 15.18s/it] 
 39%|███▉      | 14787/37963 [63:22:06<107:35:13, 16.71s/it]
 39%|███▉      | 14788/37963 [63:22:27<114:32:34, 17.79s/it]
 39%|███▉      | 14789/37963 [63:22:41<107:55:26, 16.77s/it]
 39%|███▉      | 14790/37963 [63:22:55<102:31:26, 15.93s/it]
                                                            
{'loss': '0.1572', 'grad_norm': '4.631', 'learning_rate': '1.395e-05', 'epoch': '0.3896'}

 39%|███▉      | 14790/37963 [63:22:55<102:31:26, 15.93s/it]
 39%|███▉      | 14791/37963 [63:23:09<99:29:13, 15.46s/it] 
 39%|███▉      | 14792/37963 [63:23:24<97:13:41, 15.11s/it]
 39%|███▉      | 14793/37963 [63:23:38<95:45:39, 14.88s/it]
 39%|███▉      | 14794/37963 [63:23:52<94:34:35, 14.70s/it]
 39%|███▉      | 14795/37963 [63:24:07<93:45:43, 14.57s/it]
 39%|███▉      | 14796/37963 [63:24:21<93:31:46, 14.53s/it]
 39%|███▉      | 14797/37963 [63:24:42<105:19:02, 16.37s/it]
 39%|███▉      | 14798/37963 [63:25:03<114:38:27, 17.82s/it]
 39%|███▉      | 14799/37963 [63:25:17<107:59:51, 16.78s/it]
 39%|███▉      | 14800/37963 [63:25:32<103:16:35, 16.05s/it]
                                                            
{'loss': '0.1494', 'grad_norm': '1.104', 'learning_rate': '1.394e-05', 'epoch': '0.3899'}

 39%|███▉      | 14800/37963 [63:25:32<103:16:35, 16.05s/it]
 39%|███▉      | 14801/37963 [63:25:46<100:02:01, 15.55s/it]
 39%|███▉      | 14802/37963 [63:26:00<97:53:17, 15.22s/it] 
 39%|███▉      | 14803/37963 [63:26:15<96:11:21, 14.95s/it]
 39%|███▉      | 14804/37963 [63:26:29<95:01:19, 14.77s/it]
 39%|███▉      | 14805/37963 [63:26:43<94:16:20, 14.65s/it]
 39%|███▉      | 14806/37963 [63:26:58<93:37:57, 14.56s/it]
 39%|███▉      | 14807/37963 [63:27:12<92:38:42, 14.40s/it]
 39%|███▉      | 14808/37963 [63:27:26<91:59:34, 14.30s/it]
 39%|███▉      | 14809/37963 [63:27:40<92:04:32, 14.32s/it]
 39%|███▉      | 14810/37963 [63:27:54<92:01:09, 14.31s/it]
                                                           
{'loss': '0.1673', 'grad_norm': '3.735', 'learning_rate': '1.394e-05', 'epoch': '0.3901'}

 39%|███▉      | 14810/37963 [63:27:54<92:01:09, 14.31s/it]
 39%|███▉      | 14811/37963 [63:28:09<91:47:15, 14.27s/it]
 39%|███▉      | 14812/37963 [63:28:23<91:31:51, 14.23s/it]
 39%|███▉      | 14813/37963 [63:28:37<91:53:32, 14.29s/it]
 39%|███▉      | 14814/37963 [63:28:52<92:05:08, 14.32s/it]
 39%|███▉      | 14815/37963 [63:29:06<91:43:43, 14.27s/it]
 39%|███▉      | 14816/37963 [63:29:20<91:51:54, 14.29s/it]
 39%|███▉      | 14817/37963 [63:29:34<91:58:03, 14.30s/it]
 39%|███▉      | 14818/37963 [63:29:49<92:23:13, 14.37s/it]
 39%|███▉      | 14819/37963 [63:30:10<105:40:40, 16.44s/it]
 39%|███▉      | 14820/37963 [63:30:25<101:40:38, 15.82s/it]
                                                            
{'loss': '0.1559', 'grad_norm': '5.801', 'learning_rate': '1.393e-05', 'epoch': '0.3904'}

 39%|███▉      | 14820/37963 [63:30:25<101:40:38, 15.82s/it]
 39%|███▉      | 14821/37963 [63:30:39<98:45:29, 15.36s/it] 
 39%|███▉      | 14822/37963 [63:30:53<96:47:12, 15.06s/it]
 39%|███▉      | 14823/37963 [63:31:07<94:54:57, 14.77s/it]
 39%|███▉      | 14824/37963 [63:31:21<93:38:27, 14.57s/it]
 39%|███▉      | 14825/37963 [63:31:36<93:15:23, 14.51s/it]
 39%|███▉      | 14826/37963 [63:32:04<118:48:38, 18.49s/it]
 39%|███▉      | 14827/37963 [63:32:18<110:19:35, 17.17s/it]
 39%|███▉      | 14828/37963 [63:32:32<104:46:41, 16.30s/it]
 39%|███▉      | 14829/37963 [63:32:46<101:03:02, 15.73s/it]
 39%|███▉      | 14830/37963 [63:33:01<98:20:32, 15.30s/it] 
                                                           
{'loss': '0.1467', 'grad_norm': '3.782', 'learning_rate': '1.392e-05', 'epoch': '0.3906'}

 39%|███▉      | 14830/37963 [63:33:01<98:20:32, 15.30s/it]
 39%|███▉      | 14831/37963 [63:33:22<109:33:23, 17.05s/it]
 39%|███▉      | 14832/37963 [63:33:36<104:26:55, 16.26s/it]
 39%|███▉      | 14833/37963 [63:33:51<100:53:55, 15.70s/it]
 39%|███▉      | 14834/37963 [63:34:05<98:09:44, 15.28s/it] 
 39%|███▉      | 14835/37963 [63:34:26<108:56:46, 16.96s/it]
 39%|███▉      | 14836/37963 [63:34:40<103:32:06, 16.12s/it]
 39%|███▉      | 14837/37963 [63:34:54<99:27:44, 15.48s/it] 
 39%|███▉      | 14838/37963 [63:35:15<109:40:48, 17.07s/it]
 39%|███▉      | 14839/37963 [63:35:29<104:30:05, 16.27s/it]
 39%|███▉      | 14840/37963 [63:35:43<99:40:47, 15.52s/it] 
                                                           
{'loss': '0.153', 'grad_norm': '1.43', 'learning_rate': '1.391e-05', 'epoch': '0.3909'}

 39%|███▉      | 14840/37963 [63:35:43<99:40:47, 15.52s/it]
 39%|███▉      | 14841/37963 [63:35:57<97:00:13, 15.10s/it]
 39%|███▉      | 14842/37963 [63:36:11<95:35:21, 14.88s/it]
 39%|███▉      | 14843/37963 [63:36:26<94:27:21, 14.71s/it]
 39%|███▉      | 14844/37963 [63:36:40<93:30:00, 14.56s/it]
 39%|███▉      | 14845/37963 [63:36:54<93:02:20, 14.49s/it]
 39%|███▉      | 14846/37963 [63:37:15<105:06:40, 16.37s/it]
 39%|███▉      | 14847/37963 [63:37:36<113:22:46, 17.66s/it]
 39%|███▉      | 14848/37963 [63:37:50<107:34:58, 16.76s/it]
 39%|███▉      | 14849/37963 [63:38:05<102:57:06, 16.03s/it]
 39%|███▉      | 14850/37963 [63:38:19<99:47:35, 15.54s/it] 
                                                           
{'loss': '0.1516', 'grad_norm': '1.821', 'learning_rate': '1.39e-05', 'epoch': '0.3912'}

 39%|███▉      | 14850/37963 [63:38:19<99:47:35, 15.54s/it]
 39%|███▉      | 14851/37963 [63:38:33<97:31:36, 15.19s/it]
 39%|███▉      | 14852/37963 [63:38:48<95:28:38, 14.87s/it]
 39%|███▉      | 14853/37963 [63:39:02<94:23:46, 14.70s/it]
 39%|███▉      | 14854/37963 [63:39:16<93:36:58, 14.58s/it]
 39%|███▉      | 14855/37963 [63:39:30<93:07:01, 14.51s/it]
 39%|███▉      | 14856/37963 [63:39:45<92:44:41, 14.45s/it]
 39%|███▉      | 14857/37963 [63:39:59<92:20:45, 14.39s/it]
 39%|███▉      | 14858/37963 [63:40:13<92:20:36, 14.39s/it]
 39%|███▉      | 14859/37963 [63:40:28<92:22:06, 14.39s/it]
 39%|███▉      | 14860/37963 [63:40:42<92:15:48, 14.38s/it]
                                                           
{'loss': '0.1574', 'grad_norm': '4.061', 'learning_rate': '1.39e-05', 'epoch': '0.3914'}

 39%|███▉      | 14860/37963 [63:40:42<92:15:48, 14.38s/it]
 39%|███▉      | 14861/37963 [63:40:56<92:04:19, 14.35s/it]
 39%|███▉      | 14862/37963 [63:41:10<91:28:35, 14.26s/it]
 39%|███▉      | 14863/37963 [63:41:25<91:47:53, 14.31s/it]
 39%|███▉      | 14864/37963 [63:41:39<91:10:41, 14.21s/it]
 39%|███▉      | 14865/37963 [63:41:53<91:26:45, 14.25s/it]
 39%|███▉      | 14866/37963 [63:42:08<91:30:38, 14.26s/it]
 39%|███▉      | 14867/37963 [63:42:28<104:00:19, 16.21s/it]
 39%|███▉      | 14868/37963 [63:42:42<99:42:50, 15.54s/it] 
 39%|███▉      | 14869/37963 [63:42:57<97:55:14, 15.26s/it]
 39%|███▉      | 14870/37963 [63:43:11<96:17:04, 15.01s/it]
                                                           
{'loss': '0.145', 'grad_norm': '4.129', 'learning_rate': '1.389e-05', 'epoch': '0.3917'}

 39%|███▉      | 14870/37963 [63:43:11<96:17:04, 15.01s/it]
 39%|███▉      | 14871/37963 [63:43:26<95:19:16, 14.86s/it]
 39%|███▉      | 14872/37963 [63:43:39<92:51:52, 14.48s/it]
 39%|███▉      | 14873/37963 [63:44:00<105:22:23, 16.43s/it]
 39%|███▉      | 14874/37963 [63:44:21<114:10:14, 17.80s/it]
 39%|███▉      | 14875/37963 [63:44:36<107:26:16, 16.75s/it]
 39%|███▉      | 14876/37963 [63:44:50<102:55:07, 16.05s/it]
 39%|███▉      | 14877/37963 [63:45:04<99:45:29, 15.56s/it] 
 39%|███▉      | 14878/37963 [63:45:19<97:26:40, 15.20s/it]
 39%|███▉      | 14879/37963 [63:45:40<108:29:31, 16.92s/it]
 39%|███▉      | 14880/37963 [63:45:54<103:36:02, 16.16s/it]
                                                            
{'loss': '0.1509', 'grad_norm': '1.662', 'learning_rate': '1.388e-05', 'epoch': '0.392'}

 39%|███▉      | 14880/37963 [63:45:54<103:36:02, 16.16s/it]
 39%|███▉      | 14881/37963 [63:46:09<100:11:27, 15.63s/it]
 39%|███▉      | 14882/37963 [63:46:23<98:01:03, 15.29s/it] 
 39%|███▉      | 14883/37963 [63:46:37<96:07:45, 14.99s/it]
 39%|███▉      | 14884/37963 [63:46:58<107:14:29, 16.73s/it]
 39%|███▉      | 14885/37963 [63:47:18<113:42:56, 17.74s/it]
 39%|███▉      | 14886/37963 [63:47:33<107:14:01, 16.73s/it]
 39%|███▉      | 14887/37963 [63:47:46<101:41:31, 15.86s/it]
 39%|███▉      | 14888/37963 [63:48:01<98:56:36, 15.44s/it] 
 39%|███▉      | 14889/37963 [63:48:15<96:49:30, 15.11s/it]
 39%|███▉      | 14890/37963 [63:48:30<95:33:20, 14.91s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '1.986', 'learning_rate': '1.387e-05', 'epoch': '0.3922'}

 39%|███▉      | 14890/37963 [63:48:30<95:33:20, 14.91s/it]
 39%|███▉      | 14891/37963 [63:48:44<94:28:36, 14.74s/it]
 39%|███▉      | 14892/37963 [63:48:59<93:59:50, 14.67s/it]
 39%|███▉      | 14893/37963 [63:49:19<105:24:40, 16.45s/it]
 39%|███▉      | 14894/37963 [63:49:33<100:28:58, 15.68s/it]
 39%|███▉      | 14895/37963 [63:49:47<98:01:20, 15.30s/it] 
 39%|███▉      | 14896/37963 [63:50:02<96:16:07, 15.02s/it]
 39%|███▉      | 14897/37963 [63:50:23<108:20:07, 16.91s/it]
 39%|███▉      | 14898/37963 [63:50:37<103:26:15, 16.14s/it]
 39%|███▉      | 14899/37963 [63:50:52<99:58:09, 15.60s/it] 
 39%|███▉      | 14900/37963 [63:51:06<97:37:12, 15.24s/it]
                                                           
{'loss': '0.1427', 'grad_norm': '4.043', 'learning_rate': '1.387e-05', 'epoch': '0.3925'}

 39%|███▉      | 14900/37963 [63:51:06<97:37:12, 15.24s/it]
 39%|███▉      | 14901/37963 [63:51:21<95:52:55, 14.97s/it]
 39%|███▉      | 14902/37963 [63:51:35<94:33:43, 14.76s/it]
 39%|███▉      | 14903/37963 [63:51:49<93:42:46, 14.63s/it]
 39%|███▉      | 14904/37963 [63:52:03<91:16:30, 14.25s/it]
 39%|███▉      | 14905/37963 [63:52:17<91:27:53, 14.28s/it]
 39%|███▉      | 14906/37963 [63:52:31<91:33:44, 14.30s/it]
 39%|███▉      | 14907/37963 [63:52:45<90:47:52, 14.18s/it]
 39%|███▉      | 14908/37963 [63:52:59<91:02:59, 14.22s/it]
 39%|███▉      | 14909/37963 [63:53:14<91:19:23, 14.26s/it]
 39%|███▉      | 14910/37963 [63:53:28<91:26:16, 14.28s/it]
                                                           
{'loss': '0.1696', 'grad_norm': '1.692', 'learning_rate': '1.386e-05', 'epoch': '0.3928'}

 39%|███▉      | 14910/37963 [63:53:28<91:26:16, 14.28s/it]
 39%|███▉      | 14911/37963 [63:53:42<91:13:57, 14.25s/it]
 39%|███▉      | 14912/37963 [63:53:57<91:17:25, 14.26s/it]
 39%|███▉      | 14913/37963 [63:54:11<91:24:59, 14.28s/it]
 39%|███▉      | 14914/37963 [63:54:25<91:37:33, 14.31s/it]
 39%|███▉      | 14915/37963 [63:54:39<90:57:57, 14.21s/it]
 39%|███▉      | 14916/37963 [63:55:00<103:47:06, 16.21s/it]
 39%|███▉      | 14917/37963 [63:55:14<100:10:54, 15.65s/it]
 39%|███▉      | 14918/37963 [63:55:29<97:24:31, 15.22s/it] 
 39%|███▉      | 14919/37963 [63:55:43<95:30:36, 14.92s/it]
 39%|███▉      | 14920/37963 [63:55:57<93:17:35, 14.58s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '1.019', 'learning_rate': '1.385e-05', 'epoch': '0.393'}

 39%|███▉      | 14920/37963 [63:55:57<93:17:35, 14.58s/it]
 39%|███▉      | 14921/37963 [63:56:10<91:22:00, 14.27s/it]
 39%|███▉      | 14922/37963 [63:56:31<104:21:36, 16.31s/it]
 39%|███▉      | 14923/37963 [63:56:52<113:42:04, 17.77s/it]
 39%|███▉      | 14924/37963 [63:57:07<107:21:33, 16.78s/it]
 39%|███▉      | 14925/37963 [63:57:21<102:34:00, 16.03s/it]
 39%|███▉      | 14926/37963 [63:57:36<99:26:18, 15.54s/it] 
 39%|███▉      | 14927/37963 [63:57:50<97:00:29, 15.16s/it]
 39%|███▉      | 14928/37963 [63:58:04<94:12:55, 14.72s/it]
 39%|███▉      | 14929/37963 [63:58:18<93:35:33, 14.63s/it]
 39%|███▉      | 14930/37963 [63:58:32<92:48:09, 14.50s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '2.212', 'learning_rate': '1.384e-05', 'epoch': '0.3933'}

 39%|███▉      | 14930/37963 [63:58:32<92:48:09, 14.50s/it]
 39%|███▉      | 14931/37963 [63:58:53<104:18:25, 16.30s/it]
 39%|███▉      | 14932/37963 [63:59:07<99:50:32, 15.61s/it] 
 39%|███▉      | 14933/37963 [63:59:21<97:24:51, 15.23s/it]
 39%|███▉      | 14934/37963 [63:59:35<94:27:39, 14.77s/it]
 39%|███▉      | 14935/37963 [64:00:02<118:40:36, 18.55s/it]
 39%|███▉      | 14936/37963 [64:00:16<109:56:29, 17.19s/it]
 39%|███▉      | 14937/37963 [64:00:30<103:43:19, 16.22s/it]
 39%|███▉      | 14938/37963 [64:00:44<99:57:14, 15.63s/it] 
 39%|███▉      | 14939/37963 [64:00:59<97:34:55, 15.26s/it]
 39%|███▉      | 14940/37963 [64:01:13<95:45:30, 14.97s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '4.101', 'learning_rate': '1.383e-05', 'epoch': '0.3935'}

 39%|███▉      | 14940/37963 [64:01:13<95:45:30, 14.97s/it]
 39%|███▉      | 14941/37963 [64:01:27<94:13:16, 14.73s/it]
 39%|███▉      | 14942/37963 [64:01:47<104:34:27, 16.35s/it]
 39%|███▉      | 14943/37963 [64:02:02<100:48:21, 15.76s/it]
 39%|███▉      | 14944/37963 [64:02:16<97:59:47, 15.33s/it] 
 39%|███▉      | 14945/37963 [64:02:30<96:08:48, 15.04s/it]
 39%|███▉      | 14946/37963 [64:02:51<107:35:59, 16.83s/it]
 39%|███▉      | 14947/37963 [64:03:06<102:43:35, 16.07s/it]
 39%|███▉      | 14948/37963 [64:03:20<99:15:20, 15.53s/it] 
 39%|███▉      | 14949/37963 [64:03:34<97:13:52, 15.21s/it]
 39%|███▉      | 14950/37963 [64:03:49<95:38:49, 14.96s/it]
                                                           
{'loss': '0.1562', 'grad_norm': '3.377', 'learning_rate': '1.383e-05', 'epoch': '0.3938'}

 39%|███▉      | 14950/37963 [64:03:49<95:38:49, 14.96s/it]
 39%|███▉      | 14951/37963 [64:04:03<94:34:05, 14.79s/it]
 39%|███▉      | 14952/37963 [64:04:17<92:24:42, 14.46s/it]
 39%|███▉      | 14953/37963 [64:04:31<91:08:05, 14.26s/it]
 39%|███▉      | 14954/37963 [64:04:45<91:11:37, 14.27s/it]
 39%|███▉      | 14955/37963 [64:04:59<91:13:35, 14.27s/it]
 39%|███▉      | 14956/37963 [64:05:14<91:24:03, 14.30s/it]
 39%|███▉      | 14957/37963 [64:05:28<91:30:38, 14.32s/it]
 39%|███▉      | 14958/37963 [64:05:43<92:02:06, 14.40s/it]
 39%|███▉      | 14959/37963 [64:05:57<91:51:06, 14.37s/it]
 39%|███▉      | 14960/37963 [64:06:11<91:46:30, 14.36s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '1.081', 'learning_rate': '1.382e-05', 'epoch': '0.3941'}

 39%|███▉      | 14960/37963 [64:06:11<91:46:30, 14.36s/it]
 39%|███▉      | 14961/37963 [64:06:26<92:02:44, 14.41s/it]
 39%|███▉      | 14962/37963 [64:06:39<90:43:34, 14.20s/it]
 39%|███▉      | 14963/37963 [64:06:54<90:37:19, 14.18s/it]
 39%|███▉      | 14964/37963 [64:07:14<103:28:10, 16.20s/it]
 39%|███▉      | 14965/37963 [64:07:29<99:55:17, 15.64s/it] 
 39%|███▉      | 14966/37963 [64:07:43<97:28:39, 15.26s/it]
 39%|███▉      | 14967/37963 [64:07:58<95:48:16, 15.00s/it]
 39%|███▉      | 14968/37963 [64:08:12<94:56:59, 14.86s/it]
 39%|███▉      | 14969/37963 [64:08:26<93:55:57, 14.71s/it]
 39%|███▉      | 14970/37963 [64:08:41<92:58:28, 14.56s/it]
                                                           
{'loss': '0.146', 'grad_norm': '0.9107', 'learning_rate': '1.381e-05', 'epoch': '0.3943'}

 39%|███▉      | 14970/37963 [64:08:41<92:58:28, 14.56s/it]
 39%|███▉      | 14971/37963 [64:09:08<117:57:48, 18.47s/it]
 39%|███▉      | 14972/37963 [64:09:23<110:09:44, 17.25s/it]
 39%|███▉      | 14973/37963 [64:09:37<104:37:59, 16.38s/it]
 39%|███▉      | 14974/37963 [64:09:51<100:35:42, 15.75s/it]
 39%|███▉      | 14975/37963 [64:10:06<97:49:56, 15.32s/it] 
 39%|███▉      | 14976/37963 [64:10:20<95:26:04, 14.95s/it]
 39%|███▉      | 14977/37963 [64:10:34<94:14:53, 14.76s/it]
 39%|███▉      | 14978/37963 [64:10:48<93:37:30, 14.66s/it]
 39%|███▉      | 14979/37963 [64:11:03<92:41:51, 14.52s/it]
 39%|███▉      | 14980/37963 [64:11:24<105:25:37, 16.51s/it]
                                                            
{'loss': '0.1529', 'grad_norm': '1.295', 'learning_rate': '1.38e-05', 'epoch': '0.3946'}

 39%|███▉      | 14980/37963 [64:11:24<105:25:37, 16.51s/it]
 39%|███▉      | 14981/37963 [64:11:38<100:16:07, 15.71s/it]
 39%|███▉      | 14982/37963 [64:11:52<97:41:02, 15.30s/it] 
 39%|███▉      | 14983/37963 [64:12:06<95:20:23, 14.94s/it]
 39%|███▉      | 14984/37963 [64:12:27<106:06:28, 16.62s/it]
 39%|███▉      | 14985/37963 [64:12:41<101:45:13, 15.94s/it]
 39%|███▉      | 14986/37963 [64:13:02<110:58:42, 17.39s/it]
 39%|███▉      | 14987/37963 [64:13:16<105:07:13, 16.47s/it]
 39%|███▉      | 14988/37963 [64:13:30<101:00:45, 15.83s/it]
 39%|███▉      | 14989/37963 [64:13:44<97:28:04, 15.27s/it] 
 39%|███▉      | 14990/37963 [64:13:59<95:47:11, 15.01s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '3.189', 'learning_rate': '1.379e-05', 'epoch': '0.3949'}

 39%|███▉      | 14990/37963 [64:13:59<95:47:11, 15.01s/it]
 39%|███▉      | 14991/37963 [64:14:20<106:48:53, 16.74s/it]
 39%|███▉      | 14992/37963 [64:14:34<102:13:04, 16.02s/it]
 39%|███▉      | 14993/37963 [64:14:48<99:00:02, 15.52s/it] 
 39%|███▉      | 14994/37963 [64:15:02<96:03:40, 15.06s/it]
 39%|███▉      | 14995/37963 [64:15:23<107:16:58, 16.82s/it]
 40%|███▉      | 14996/37963 [64:15:38<102:50:08, 16.12s/it]
 40%|███▉      | 14997/37963 [64:15:52<99:42:38, 15.63s/it] 
 40%|███▉      | 14998/37963 [64:16:06<96:40:03, 15.15s/it]
 40%|███▉      | 14999/37963 [64:16:20<94:02:49, 14.74s/it]
 40%|███▉      | 15000/37963 [64:16:34<92:58:00, 14.57s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '1.906', 'learning_rate': '1.379e-05', 'epoch': '0.3951'}

 40%|███▉      | 15000/37963 [64:16:34<92:58:00, 14.57s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.49s/it]
Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.49s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 40%|███▉      | 15001/37963 [64:18:21<269:21:30, 42.23s/it]
 40%|███▉      | 15002/37963 [64:18:35<215:58:22, 33.86s/it]
 40%|███▉      | 15003/37963 [64:18:50<178:40:20, 28.01s/it]
 40%|███▉      | 15004/37963 [64:19:04<152:29:24, 23.91s/it]
 40%|███▉      | 15005/37963 [64:19:18<133:52:06, 20.99s/it]
 40%|███▉      | 15006/37963 [64:19:33<121:24:20, 19.04s/it]
 40%|███▉      | 15007/37963 [64:19:47<112:25:18, 17.63s/it]
 40%|███▉      | 15008/37963 [64:20:01<106:07:37, 16.64s/it]
 40%|███▉      | 15009/37963 [64:20:16<101:41:07, 15.95s/it]
 40%|███▉      | 15010/37963 [64:20:30<98:44:12, 15.49s/it] 
                                                           
{'loss': '0.1511', 'grad_norm': '5.299', 'learning_rate': '1.378e-05', 'epoch': '0.3954'}

 40%|███▉      | 15010/37963 [64:20:30<98:44:12, 15.49s/it]
 40%|███▉      | 15011/37963 [64:20:44<96:38:06, 15.16s/it]
 40%|███▉      | 15012/37963 [64:20:59<95:14:28, 14.94s/it]
 40%|███▉      | 15013/37963 [64:21:20<106:38:38, 16.73s/it]
 40%|███▉      | 15014/37963 [64:21:34<102:05:07, 16.01s/it]
 40%|███▉      | 15015/37963 [64:21:49<99:15:59, 15.57s/it] 
 40%|███▉      | 15016/37963 [64:22:03<96:53:23, 15.20s/it]
 40%|███▉      | 15017/37963 [64:22:17<94:35:58, 14.84s/it]
 40%|███▉      | 15018/37963 [64:22:31<93:40:47, 14.70s/it]
 40%|███▉      | 15019/37963 [64:22:52<105:28:36, 16.55s/it]
 40%|███▉      | 15020/37963 [64:23:14<114:56:59, 18.04s/it]
                                                            
{'loss': '0.1635', 'grad_norm': '1.974', 'learning_rate': '1.377e-05', 'epoch': '0.3956'}

 40%|███▉      | 15020/37963 [64:23:14<114:56:59, 18.04s/it]
 40%|███▉      | 15021/37963 [64:23:28<107:04:28, 16.80s/it]
 40%|███▉      | 15022/37963 [64:23:42<102:54:10, 16.15s/it]
 40%|███▉      | 15023/37963 [64:23:57<99:34:07, 15.63s/it] 
 40%|███▉      | 15024/37963 [64:24:11<97:08:33, 15.25s/it]
 40%|███▉      | 15025/37963 [64:24:25<95:24:28, 14.97s/it]
 40%|███▉      | 15026/37963 [64:24:40<94:14:27, 14.79s/it]
 40%|███▉      | 15027/37963 [64:24:54<92:29:34, 14.52s/it]
 40%|███▉      | 15028/37963 [64:25:08<92:11:11, 14.47s/it]
 40%|███▉      | 15029/37963 [64:25:22<91:25:31, 14.35s/it]
 40%|███▉      | 15030/37963 [64:25:36<91:36:08, 14.38s/it]
                                                           
{'loss': '0.1639', 'grad_norm': '1.666', 'learning_rate': '1.376e-05', 'epoch': '0.3959'}

 40%|███▉      | 15030/37963 [64:25:36<91:36:08, 14.38s/it]
 40%|███▉      | 15031/37963 [64:25:58<104:32:08, 16.41s/it]
 40%|███▉      | 15032/37963 [64:26:18<112:55:16, 17.73s/it]
 40%|███▉      | 15033/37963 [64:26:33<106:13:09, 16.68s/it]
 40%|███▉      | 15034/37963 [64:26:47<101:49:01, 15.99s/it]
 40%|███▉      | 15035/37963 [64:27:08<111:13:23, 17.46s/it]
 40%|███▉      | 15036/37963 [64:27:22<105:20:44, 16.54s/it]
 40%|███▉      | 15037/37963 [64:27:36<100:14:22, 15.74s/it]
 40%|███▉      | 15038/37963 [64:27:57<109:38:37, 17.22s/it]
 40%|███▉      | 15039/37963 [64:28:11<104:09:18, 16.36s/it]
 40%|███▉      | 15040/37963 [64:28:26<100:14:03, 15.74s/it]
                                                            
{'loss': '0.155', 'grad_norm': '5.638', 'learning_rate': '1.375e-05', 'epoch': '0.3962'}

 40%|███▉      | 15040/37963 [64:28:26<100:14:03, 15.74s/it]
 40%|███▉      | 15041/37963 [64:28:40<97:02:46, 15.24s/it] 
 40%|███▉      | 15042/37963 [64:28:54<95:17:56, 14.97s/it]
 40%|███▉      | 15043/37963 [64:29:08<94:06:38, 14.78s/it]
 40%|███▉      | 15044/37963 [64:29:29<106:10:32, 16.68s/it]
 40%|███▉      | 15045/37963 [64:29:44<101:44:01, 15.98s/it]
 40%|███▉      | 15046/37963 [64:29:58<98:15:19, 15.43s/it] 
 40%|███▉      | 15047/37963 [64:30:12<96:03:17, 15.09s/it]
 40%|███▉      | 15048/37963 [64:30:27<94:39:09, 14.87s/it]
 40%|███▉      | 15049/37963 [64:30:41<93:40:14, 14.72s/it]
 40%|███▉      | 15050/37963 [64:30:55<92:51:53, 14.59s/it]
                                                           
{'loss': '0.1529', 'grad_norm': '0.9615', 'learning_rate': '1.375e-05', 'epoch': '0.3964'}

 40%|███▉      | 15050/37963 [64:30:55<92:51:53, 14.59s/it]
 40%|███▉      | 15051/37963 [64:31:10<92:30:14, 14.53s/it]
 40%|███▉      | 15052/37963 [64:31:24<92:07:56, 14.48s/it]
 40%|███▉      | 15053/37963 [64:31:38<92:00:30, 14.46s/it]
 40%|███▉      | 15054/37963 [64:31:53<91:49:08, 14.43s/it]
 40%|███▉      | 15055/37963 [64:32:07<91:17:51, 14.35s/it]
 40%|███▉      | 15056/37963 [64:32:21<90:47:07, 14.27s/it]
 40%|███▉      | 15057/37963 [64:32:35<90:56:24, 14.29s/it]
 40%|███▉      | 15058/37963 [64:32:50<91:02:34, 14.31s/it]
 40%|███▉      | 15059/37963 [64:33:04<91:08:38, 14.33s/it]
 40%|███▉      | 15060/37963 [64:33:18<90:47:21, 14.27s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '0.8604', 'learning_rate': '1.374e-05', 'epoch': '0.3967'}

 40%|███▉      | 15060/37963 [64:33:18<90:47:21, 14.27s/it]
 40%|███▉      | 15061/37963 [64:33:32<90:50:23, 14.28s/it]
 40%|███▉      | 15062/37963 [64:33:47<91:01:13, 14.31s/it]
 40%|███▉      | 15063/37963 [64:34:07<102:32:57, 16.12s/it]
 40%|███▉      | 15064/37963 [64:34:22<99:07:06, 15.58s/it] 
 40%|███▉      | 15065/37963 [64:34:35<96:04:20, 15.10s/it]
 40%|███▉      | 15066/37963 [64:34:50<94:41:50, 14.89s/it]
 40%|███▉      | 15067/37963 [64:35:10<105:16:35, 16.55s/it]
 40%|███▉      | 15068/37963 [64:35:25<101:30:58, 15.96s/it]
 40%|███▉      | 15069/37963 [64:35:46<110:59:36, 17.45s/it]
 40%|███▉      | 15070/37963 [64:36:00<103:57:41, 16.35s/it]
                                                            
{'loss': '0.1411', 'grad_norm': '2.158', 'learning_rate': '1.373e-05', 'epoch': '0.397'}

 40%|███▉      | 15070/37963 [64:36:00<103:57:41, 16.35s/it]
 40%|███▉      | 15071/37963 [64:36:14<99:24:53, 15.63s/it] 
 40%|███▉      | 15072/37963 [64:36:28<96:59:52, 15.25s/it]
 40%|███▉      | 15073/37963 [64:36:42<95:10:39, 14.97s/it]
 40%|███▉      | 15074/37963 [64:36:56<93:36:10, 14.72s/it]
 40%|███▉      | 15075/37963 [64:37:10<91:57:53, 14.46s/it]
 40%|███▉      | 15076/37963 [64:37:25<91:43:43, 14.43s/it]
 40%|███▉      | 15077/37963 [64:37:39<91:12:02, 14.35s/it]
 40%|███▉      | 15078/37963 [64:37:59<102:49:01, 16.17s/it]
 40%|███▉      | 15079/37963 [64:38:14<99:16:56, 15.62s/it] 
 40%|███▉      | 15080/37963 [64:38:34<108:52:04, 17.13s/it]
                                                            
{'loss': '0.1535', 'grad_norm': '4.316', 'learning_rate': '1.372e-05', 'epoch': '0.3972'}

 40%|███▉      | 15080/37963 [64:38:34<108:52:04, 17.13s/it]
 40%|███▉      | 15081/37963 [64:38:48<103:25:44, 16.27s/it]
 40%|███▉      | 15082/37963 [64:39:03<99:48:02, 15.70s/it] 
 40%|███▉      | 15083/37963 [64:39:17<96:52:52, 15.24s/it]
 40%|███▉      | 15084/37963 [64:39:38<107:42:57, 16.95s/it]
 40%|███▉      | 15085/37963 [64:39:52<102:40:10, 16.16s/it]
 40%|███▉      | 15086/37963 [64:40:06<97:57:17, 15.41s/it] 
 40%|███▉      | 15087/37963 [64:40:27<108:08:15, 17.02s/it]
 40%|███▉      | 15088/37963 [64:40:41<103:06:25, 16.23s/it]
 40%|███▉      | 15089/37963 [64:40:55<99:31:17, 15.66s/it] 
 40%|███▉      | 15090/37963 [64:41:10<96:54:06, 15.25s/it]
                                                           
{'loss': '0.1467', 'grad_norm': '1.087', 'learning_rate': '1.372e-05', 'epoch': '0.3975'}

 40%|███▉      | 15090/37963 [64:41:10<96:54:06, 15.25s/it]
 40%|███▉      | 15091/37963 [64:41:24<94:25:11, 14.86s/it]
 40%|███▉      | 15092/37963 [64:41:44<104:58:20, 16.52s/it]
 40%|███▉      | 15093/37963 [64:41:58<100:44:09, 15.86s/it]
 40%|███▉      | 15094/37963 [64:42:12<96:55:29, 15.26s/it] 
 40%|███▉      | 15095/37963 [64:42:27<95:09:16, 14.98s/it]
 40%|███▉      | 15096/37963 [64:42:41<94:12:44, 14.83s/it]
 40%|███▉      | 15097/37963 [64:42:55<93:17:17, 14.69s/it]
 40%|███▉      | 15098/37963 [64:43:10<92:32:53, 14.57s/it]
 40%|███▉      | 15099/37963 [64:43:24<91:38:03, 14.43s/it]
 40%|███▉      | 15100/37963 [64:43:38<91:30:25, 14.41s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '3.482', 'learning_rate': '1.371e-05', 'epoch': '0.3978'}

 40%|███▉      | 15100/37963 [64:43:38<91:30:25, 14.41s/it]
 40%|███▉      | 15101/37963 [64:43:53<91:41:49, 14.44s/it]
 40%|███▉      | 15102/37963 [64:44:07<90:46:40, 14.30s/it]
 40%|███▉      | 15103/37963 [64:44:21<90:48:17, 14.30s/it]
 40%|███▉      | 15104/37963 [64:44:35<90:30:30, 14.25s/it]
 40%|███▉      | 15105/37963 [64:44:49<90:44:35, 14.29s/it]
 40%|███▉      | 15106/37963 [64:45:04<91:10:18, 14.36s/it]
 40%|███▉      | 15107/37963 [64:45:18<91:30:34, 14.41s/it]
 40%|███▉      | 15108/37963 [64:45:33<91:06:48, 14.35s/it]
 40%|███▉      | 15109/37963 [64:45:47<91:10:24, 14.36s/it]
 40%|███▉      | 15110/37963 [64:46:08<104:02:31, 16.39s/it]
                                                            
{'loss': '0.1605', 'grad_norm': '2.173', 'learning_rate': '1.37e-05', 'epoch': '0.398'}

 40%|███▉      | 15110/37963 [64:46:08<104:02:31, 16.39s/it]
 40%|███▉      | 15111/37963 [64:46:23<100:20:06, 15.81s/it]
 40%|███▉      | 15112/37963 [64:46:37<97:34:19, 15.37s/it] 
 40%|███▉      | 15113/37963 [64:46:51<95:35:01, 15.06s/it]
 40%|███▉      | 15114/37963 [64:47:06<94:16:14, 14.85s/it]
 40%|███▉      | 15115/37963 [64:47:20<93:14:53, 14.69s/it]
 40%|███▉      | 15116/37963 [64:47:34<92:39:55, 14.60s/it]
 40%|███▉      | 15117/37963 [64:48:02<117:49:57, 18.57s/it]
 40%|███▉      | 15118/37963 [64:48:17<109:42:54, 17.29s/it]
 40%|███▉      | 15119/37963 [64:48:31<104:02:44, 16.40s/it]
 40%|███▉      | 15120/37963 [64:48:45<100:10:18, 15.79s/it]
                                                            
{'loss': '0.1618', 'grad_norm': '1.615', 'learning_rate': '1.369e-05', 'epoch': '0.3983'}

 40%|███▉      | 15120/37963 [64:48:45<100:10:18, 15.79s/it]
 40%|███▉      | 15121/37963 [64:49:00<97:28:08, 15.36s/it] 
 40%|███▉      | 15122/37963 [64:49:14<95:28:53, 15.05s/it]
 40%|███▉      | 15123/37963 [64:49:28<94:24:54, 14.88s/it]
 40%|███▉      | 15124/37963 [64:49:43<93:05:40, 14.67s/it]
 40%|███▉      | 15125/37963 [64:50:04<105:43:18, 16.67s/it]
 40%|███▉      | 15126/37963 [64:50:18<101:14:40, 15.96s/it]
 40%|███▉      | 15127/37963 [64:50:33<98:06:48, 15.47s/it] 
 40%|███▉      | 15128/37963 [64:50:53<108:26:35, 17.10s/it]
 40%|███▉      | 15129/37963 [64:51:08<103:09:23, 16.26s/it]
 40%|███▉      | 15130/37963 [64:51:22<99:00:16, 15.61s/it] 
                                                           
{'loss': '0.1411', 'grad_norm': '1.575', 'learning_rate': '1.368e-05', 'epoch': '0.3985'}

 40%|███▉      | 15130/37963 [64:51:22<99:00:16, 15.61s/it]
 40%|███▉      | 15131/37963 [64:51:42<108:35:06, 17.12s/it]
 40%|███▉      | 15132/37963 [64:51:57<103:18:20, 16.29s/it]
 40%|███▉      | 15133/37963 [64:52:11<99:16:00, 15.65s/it] 
 40%|███▉      | 15134/37963 [64:52:26<97:07:44, 15.32s/it]
 40%|███▉      | 15135/37963 [64:52:40<95:03:18, 14.99s/it]
 40%|███▉      | 15136/37963 [64:53:00<105:32:02, 16.64s/it]
 40%|███▉      | 15137/37963 [64:53:15<101:27:54, 16.00s/it]
 40%|███▉      | 15138/37963 [64:53:29<98:21:02, 15.51s/it] 
 40%|███▉      | 15139/37963 [64:53:44<96:12:13, 15.17s/it]
 40%|███▉      | 15140/37963 [64:53:58<94:35:09, 14.92s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '2.88', 'learning_rate': '1.368e-05', 'epoch': '0.3988'}

 40%|███▉      | 15140/37963 [64:53:58<94:35:09, 14.92s/it]
 40%|███▉      | 15141/37963 [64:54:12<93:21:29, 14.73s/it]
 40%|███▉      | 15142/37963 [64:54:33<105:27:41, 16.64s/it]
 40%|███▉      | 15143/37963 [64:54:47<100:12:02, 15.81s/it]
 40%|███▉      | 15144/37963 [64:55:01<97:20:37, 15.36s/it] 
 40%|███▉      | 15145/37963 [64:55:15<94:52:51, 14.97s/it]
 40%|███▉      | 15146/37963 [64:55:30<93:47:34, 14.80s/it]
 40%|███▉      | 15147/37963 [64:55:44<92:25:19, 14.58s/it]
 40%|███▉      | 15148/37963 [64:55:58<91:30:35, 14.44s/it]
 40%|███▉      | 15149/37963 [64:56:12<91:17:43, 14.41s/it]
 40%|███▉      | 15150/37963 [64:56:27<91:09:43, 14.39s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '1.233', 'learning_rate': '1.367e-05', 'epoch': '0.3991'}

 40%|███▉      | 15150/37963 [64:56:27<91:09:43, 14.39s/it]
 40%|███▉      | 15151/37963 [64:56:41<91:03:29, 14.37s/it]
 40%|███▉      | 15152/37963 [64:56:55<90:40:16, 14.31s/it]
 40%|███▉      | 15153/37963 [64:57:10<90:46:23, 14.33s/it]
 40%|███▉      | 15154/37963 [64:57:24<90:59:42, 14.36s/it]
 40%|███▉      | 15155/37963 [64:57:38<90:58:36, 14.36s/it]
 40%|███▉      | 15156/37963 [64:57:53<91:16:18, 14.41s/it]
 40%|███▉      | 15157/37963 [64:58:06<89:13:30, 14.08s/it]
 40%|███▉      | 15158/37963 [64:58:21<89:43:43, 14.16s/it]
 40%|███▉      | 15159/37963 [64:58:41<102:30:57, 16.18s/it]
 40%|███▉      | 15160/37963 [64:58:56<98:57:50, 15.62s/it] 
                                                           
{'loss': '0.1606', 'grad_norm': '3.542', 'learning_rate': '1.366e-05', 'epoch': '0.3993'}

 40%|███▉      | 15160/37963 [64:58:56<98:57:50, 15.62s/it]
 40%|███▉      | 15161/37963 [64:59:09<95:11:34, 15.03s/it]
 40%|███▉      | 15162/37963 [64:59:24<94:00:32, 14.84s/it]
 40%|███▉      | 15163/37963 [64:59:38<93:01:05, 14.69s/it]
 40%|███▉      | 15164/37963 [64:59:52<91:06:39, 14.39s/it]
 40%|███▉      | 15165/37963 [65:00:06<90:54:39, 14.36s/it]
 40%|███▉      | 15166/37963 [65:00:27<102:24:48, 16.17s/it]
 40%|███▉      | 15167/37963 [65:00:47<111:23:17, 17.59s/it]
 40%|███▉      | 15168/37963 [65:01:02<104:58:18, 16.58s/it]
 40%|███▉      | 15169/37963 [65:01:16<100:16:58, 15.84s/it]
 40%|███▉      | 15170/37963 [65:01:30<97:36:12, 15.42s/it] 
                                                           
{'loss': '0.1489', 'grad_norm': '4.052', 'learning_rate': '1.365e-05', 'epoch': '0.3996'}

 40%|███▉      | 15170/37963 [65:01:30<97:36:12, 15.42s/it]
 40%|███▉      | 15171/37963 [65:01:45<95:40:56, 15.11s/it]
 40%|███▉      | 15172/37963 [65:01:59<93:37:19, 14.79s/it]
 40%|███▉      | 15173/37963 [65:02:13<92:37:54, 14.63s/it]
 40%|███▉      | 15174/37963 [65:02:27<92:04:07, 14.54s/it]
 40%|███▉      | 15175/37963 [65:02:49<104:55:20, 16.58s/it]
 40%|███▉      | 15176/37963 [65:03:03<101:01:05, 15.96s/it]
 40%|███▉      | 15177/37963 [65:03:24<110:26:03, 17.45s/it]
 40%|███▉      | 15178/37963 [65:03:38<104:34:41, 16.52s/it]
 40%|███▉      | 15179/37963 [65:03:52<99:23:48, 15.71s/it] 
 40%|███▉      | 15180/37963 [65:04:13<109:15:17, 17.26s/it]
                                                            
{'loss': '0.1433', 'grad_norm': '2.043', 'learning_rate': '1.364e-05', 'epoch': '0.3999'}

 40%|███▉      | 15180/37963 [65:04:13<109:15:17, 17.26s/it]
 40%|███▉      | 15181/37963 [65:04:27<103:48:17, 16.40s/it]
 40%|███▉      | 15182/37963 [65:04:41<99:17:48, 15.69s/it] 
 40%|███▉      | 15183/37963 [65:04:56<96:44:09, 15.29s/it]
 40%|███▉      | 15184/37963 [65:05:10<95:00:30, 15.02s/it]
 40%|███▉      | 15185/37963 [65:05:25<93:52:10, 14.84s/it]
 40%|████      | 15186/37963 [65:05:39<92:54:14, 14.68s/it]
 40%|████      | 15187/37963 [65:06:00<104:31:57, 16.52s/it]
 40%|████      | 15188/37963 [65:06:14<100:35:38, 15.90s/it]
 40%|████      | 15189/37963 [65:06:29<97:38:04, 15.43s/it] 
 40%|████      | 15190/37963 [65:06:43<95:08:03, 15.04s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '1.579', 'learning_rate': '1.364e-05', 'epoch': '0.4001'}

 40%|████      | 15190/37963 [65:06:43<95:08:03, 15.04s/it]
 40%|████      | 15191/37963 [65:07:03<106:04:15, 16.77s/it]
 40%|████      | 15192/37963 [65:07:18<101:26:50, 16.04s/it]
 40%|████      | 15193/37963 [65:07:32<97:07:56, 15.36s/it] 
 40%|████      | 15194/37963 [65:07:46<95:11:53, 15.05s/it]
 40%|████      | 15195/37963 [65:08:00<93:48:52, 14.83s/it]
 40%|████      | 15196/37963 [65:08:15<93:04:21, 14.72s/it]
 40%|████      | 15197/37963 [65:08:29<91:39:55, 14.50s/it]
 40%|████      | 15198/37963 [65:08:43<91:23:04, 14.45s/it]
 40%|████      | 15199/37963 [65:08:57<91:09:43, 14.42s/it]
 40%|████      | 15200/37963 [65:09:12<91:07:51, 14.41s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '4.192', 'learning_rate': '1.363e-05', 'epoch': '0.4004'}

 40%|████      | 15200/37963 [65:09:12<91:07:51, 14.41s/it]
 40%|████      | 15201/37963 [65:09:26<91:18:11, 14.44s/it]
 40%|████      | 15202/37963 [65:09:41<91:05:51, 14.41s/it]
 40%|████      | 15203/37963 [65:09:55<90:46:14, 14.36s/it]
 40%|████      | 15204/37963 [65:10:09<89:46:33, 14.20s/it]
 40%|████      | 15205/37963 [65:10:23<90:05:08, 14.25s/it]
 40%|████      | 15206/37963 [65:10:37<90:16:10, 14.28s/it]
 40%|████      | 15207/37963 [65:10:52<90:22:32, 14.30s/it]
 40%|████      | 15208/37963 [65:11:06<90:33:31, 14.33s/it]
 40%|████      | 15209/37963 [65:11:27<102:22:52, 16.20s/it]
 40%|████      | 15210/37963 [65:11:41<98:43:45, 15.62s/it] 
                                                           
{'loss': '0.1521', 'grad_norm': '1.838', 'learning_rate': '1.362e-05', 'epoch': '0.4007'}

 40%|████      | 15210/37963 [65:11:41<98:43:45, 15.62s/it]
 40%|████      | 15211/37963 [65:11:55<95:58:59, 15.19s/it]
 40%|████      | 15212/37963 [65:12:09<94:19:05, 14.92s/it]
 40%|████      | 15213/37963 [65:12:24<92:51:27, 14.69s/it]
 40%|████      | 15214/37963 [65:12:37<90:59:23, 14.40s/it]
 40%|████      | 15215/37963 [65:12:52<90:54:47, 14.39s/it]
 40%|████      | 15216/37963 [65:13:13<103:43:58, 16.42s/it]
 40%|████      | 15217/37963 [65:13:34<113:32:50, 17.97s/it]
 40%|████      | 15218/37963 [65:13:49<106:51:00, 16.91s/it]
 40%|████      | 15219/37963 [65:14:03<100:55:42, 15.98s/it]
 40%|████      | 15220/37963 [65:14:17<97:54:53, 15.50s/it] 
                                                           
{'loss': '0.144', 'grad_norm': '3.578', 'learning_rate': '1.361e-05', 'epoch': '0.4009'}

 40%|████      | 15220/37963 [65:14:17<97:54:53, 15.50s/it]
 40%|████      | 15221/37963 [65:14:31<95:47:05, 15.16s/it]
 40%|████      | 15222/37963 [65:14:46<94:06:26, 14.90s/it]
 40%|████      | 15223/37963 [65:15:07<105:18:26, 16.67s/it]
 40%|████      | 15224/37963 [65:15:20<99:57:32, 15.83s/it] 
 40%|████      | 15225/37963 [65:15:41<109:34:13, 17.35s/it]
 40%|████      | 15226/37963 [65:15:56<103:50:50, 16.44s/it]
 40%|████      | 15227/37963 [65:16:10<100:01:40, 15.84s/it]
 40%|████      | 15228/37963 [65:16:31<109:37:22, 17.36s/it]
 40%|████      | 15229/37963 [65:16:45<103:42:58, 16.42s/it]
 40%|████      | 15230/37963 [65:17:00<99:55:19, 15.82s/it] 
                                                           
{'loss': '0.155', 'grad_norm': '2.437', 'learning_rate': '1.36e-05', 'epoch': '0.4012'}

 40%|████      | 15230/37963 [65:17:00<99:55:19, 15.82s/it]
 40%|████      | 15231/37963 [65:17:14<97:05:30, 15.38s/it]
 40%|████      | 15232/37963 [65:17:28<95:17:15, 15.09s/it]
 40%|████      | 15233/37963 [65:17:42<93:17:46, 14.78s/it]
 40%|████      | 15234/37963 [65:18:03<104:35:50, 16.57s/it]
 40%|████      | 15235/37963 [65:18:18<100:26:56, 15.91s/it]
 40%|████      | 15236/37963 [65:18:32<97:20:23, 15.42s/it] 
 40%|████      | 15237/37963 [65:18:46<95:24:12, 15.11s/it]
 40%|████      | 15238/37963 [65:19:01<94:01:02, 14.89s/it]
 40%|████      | 15239/37963 [65:19:21<104:06:35, 16.49s/it]
 40%|████      | 15240/37963 [65:19:35<100:07:58, 15.86s/it]
                                                            
{'loss': '0.16', 'grad_norm': '2.146', 'learning_rate': '1.36e-05', 'epoch': '0.4014'}

 40%|████      | 15240/37963 [65:19:35<100:07:58, 15.86s/it]
 40%|████      | 15241/37963 [65:19:50<97:12:43, 15.40s/it] 
 40%|████      | 15242/37963 [65:20:04<95:11:27, 15.08s/it]
 40%|████      | 15243/37963 [65:20:18<93:45:02, 14.85s/it]
 40%|████      | 15244/37963 [65:20:32<92:22:07, 14.64s/it]
 40%|████      | 15245/37963 [65:20:46<90:26:24, 14.33s/it]
 40%|████      | 15246/37963 [65:21:00<90:34:30, 14.35s/it]
 40%|████      | 15247/37963 [65:21:15<90:54:19, 14.41s/it]
 40%|████      | 15248/37963 [65:21:29<91:03:10, 14.43s/it]
 40%|████      | 15249/37963 [65:21:44<91:05:06, 14.44s/it]
 40%|████      | 15250/37963 [65:21:58<90:53:34, 14.41s/it]
                                                           
{'loss': '0.1453', 'grad_norm': '1.499', 'learning_rate': '1.359e-05', 'epoch': '0.4017'}

 40%|████      | 15250/37963 [65:21:58<90:53:34, 14.41s/it]
 40%|████      | 15251/37963 [65:22:12<90:35:38, 14.36s/it]
 40%|████      | 15252/37963 [65:22:27<90:35:07, 14.36s/it]
 40%|████      | 15253/37963 [65:22:41<90:41:12, 14.38s/it]
 40%|████      | 15254/37963 [65:22:55<90:30:01, 14.35s/it]
 40%|████      | 15255/37963 [65:23:10<90:43:22, 14.38s/it]
 40%|████      | 15256/37963 [65:23:24<90:31:10, 14.35s/it]
 40%|████      | 15257/37963 [65:23:39<90:42:47, 14.38s/it]
 40%|████      | 15258/37963 [65:23:59<102:28:54, 16.25s/it]
 40%|████      | 15259/37963 [65:24:14<98:42:47, 15.65s/it] 
 40%|████      | 15260/37963 [65:24:27<95:15:11, 15.10s/it]
                                                           
{'loss': '0.1469', 'grad_norm': '1.801', 'learning_rate': '1.358e-05', 'epoch': '0.402'}

 40%|████      | 15260/37963 [65:24:27<95:15:11, 15.10s/it]
 40%|████      | 15261/37963 [65:24:42<93:49:06, 14.88s/it]
 40%|████      | 15262/37963 [65:24:56<92:45:41, 14.71s/it]
 40%|████      | 15263/37963 [65:25:10<92:12:16, 14.62s/it]
 40%|████      | 15264/37963 [65:25:25<91:44:18, 14.55s/it]
 40%|████      | 15265/37963 [65:25:53<116:51:29, 18.53s/it]
 40%|████      | 15266/37963 [65:26:07<109:04:44, 17.30s/it]
 40%|████      | 15267/37963 [65:26:21<103:39:52, 16.44s/it]
 40%|████      | 15268/37963 [65:26:36<99:04:52, 15.72s/it] 
 40%|████      | 15269/37963 [65:26:50<95:56:24, 15.22s/it]
 40%|████      | 15270/37963 [65:27:04<94:49:07, 15.04s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '3.564', 'learning_rate': '1.357e-05', 'epoch': '0.4022'}

 40%|████      | 15270/37963 [65:27:04<94:49:07, 15.04s/it]
 40%|████      | 15271/37963 [65:27:25<106:15:05, 16.86s/it]
 40%|████      | 15272/37963 [65:27:40<101:37:40, 16.12s/it]
 40%|████      | 15273/37963 [65:28:00<109:37:14, 17.39s/it]
 40%|████      | 15274/37963 [65:28:14<103:54:04, 16.49s/it]
 40%|████      | 15275/37963 [65:28:29<99:33:23, 15.80s/it] 
 40%|████      | 15276/37963 [65:28:43<97:01:24, 15.40s/it]
 40%|████      | 15277/37963 [65:29:04<107:15:27, 17.02s/it]
 40%|████      | 15278/37963 [65:29:18<101:50:48, 16.16s/it]
 40%|████      | 15279/37963 [65:29:33<98:46:21, 15.68s/it] 
 40%|████      | 15280/37963 [65:29:47<96:18:25, 15.28s/it]
                                                           
{'loss': '0.1541', 'grad_norm': '2.46', 'learning_rate': '1.356e-05', 'epoch': '0.4025'}

 40%|████      | 15280/37963 [65:29:47<96:18:25, 15.28s/it]
 40%|████      | 15281/37963 [65:30:08<106:46:13, 16.95s/it]
 40%|████      | 15282/37963 [65:30:22<101:58:06, 16.18s/it]
 40%|████      | 15283/37963 [65:30:37<98:29:37, 15.63s/it] 
 40%|████      | 15284/37963 [65:30:51<95:59:58, 15.24s/it]
 40%|████      | 15285/37963 [65:31:05<94:00:55, 14.92s/it]
 40%|████      | 15286/37963 [65:31:19<92:56:37, 14.75s/it]
 40%|████      | 15287/37963 [65:31:34<92:10:20, 14.63s/it]
 40%|████      | 15288/37963 [65:31:48<91:39:21, 14.55s/it]
 40%|████      | 15289/37963 [65:32:09<104:13:10, 16.55s/it]
 40%|████      | 15290/37963 [65:32:24<100:11:25, 15.91s/it]
                                                            
{'loss': '0.147', 'grad_norm': '2.188', 'learning_rate': '1.356e-05', 'epoch': '0.4028'}

 40%|████      | 15290/37963 [65:32:24<100:11:25, 15.91s/it]
 40%|████      | 15291/37963 [65:32:38<97:21:09, 15.46s/it] 
 40%|████      | 15292/37963 [65:32:53<95:17:14, 15.13s/it]
 40%|████      | 15293/37963 [65:33:07<93:32:47, 14.86s/it]
 40%|████      | 15294/37963 [65:33:21<92:38:19, 14.71s/it]
 40%|████      | 15295/37963 [65:33:36<92:02:58, 14.62s/it]
 40%|████      | 15296/37963 [65:33:50<91:08:02, 14.47s/it]
 40%|████      | 15297/37963 [65:34:03<89:47:45, 14.26s/it]
 40%|████      | 15298/37963 [65:34:18<90:28:32, 14.37s/it]
 40%|████      | 15299/37963 [65:34:32<89:34:02, 14.23s/it]
 40%|████      | 15300/37963 [65:34:46<89:08:10, 14.16s/it]
                                                           
{'loss': '0.1349', 'grad_norm': '4.843', 'learning_rate': '1.355e-05', 'epoch': '0.403'}

 40%|████      | 15300/37963 [65:34:46<89:08:10, 14.16s/it]
 40%|████      | 15301/37963 [65:35:00<89:05:39, 14.15s/it]
 40%|████      | 15302/37963 [65:35:14<89:32:21, 14.22s/it]
 40%|████      | 15303/37963 [65:35:29<89:57:23, 14.29s/it]
 40%|████      | 15304/37963 [65:35:43<90:08:46, 14.32s/it]
 40%|████      | 15305/37963 [65:35:57<89:31:40, 14.22s/it]
 40%|████      | 15306/37963 [65:36:12<89:42:12, 14.25s/it]
 40%|████      | 15307/37963 [65:36:32<102:09:19, 16.23s/it]
 40%|████      | 15308/37963 [65:36:47<98:35:05, 15.67s/it] 
 40%|████      | 15309/37963 [65:37:01<96:07:05, 15.27s/it]
 40%|████      | 15310/37963 [65:37:15<93:05:48, 14.79s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '1.57', 'learning_rate': '1.354e-05', 'epoch': '0.4033'}

 40%|████      | 15310/37963 [65:37:15<93:05:48, 14.79s/it]
 40%|████      | 15311/37963 [65:37:29<92:03:19, 14.63s/it]
 40%|████      | 15312/37963 [65:37:43<91:37:04, 14.56s/it]
 40%|████      | 15313/37963 [65:37:58<91:13:09, 14.50s/it]
 40%|████      | 15314/37963 [65:38:26<116:24:11, 18.50s/it]
 40%|████      | 15315/37963 [65:38:40<108:49:39, 17.30s/it]
 40%|████      | 15316/37963 [65:38:55<103:15:08, 16.41s/it]
 40%|████      | 15317/37963 [65:39:09<98:42:04, 15.69s/it] 
 40%|████      | 15318/37963 [65:39:30<109:02:22, 17.33s/it]
 40%|████      | 15319/37963 [65:39:44<102:41:03, 16.33s/it]
 40%|████      | 15320/37963 [65:39:58<98:51:20, 15.72s/it] 
                                                           
{'loss': '0.1551', 'grad_norm': '0.9825', 'learning_rate': '1.353e-05', 'epoch': '0.4036'}

 40%|████      | 15320/37963 [65:39:58<98:51:20, 15.72s/it]
 40%|████      | 15321/37963 [65:40:12<96:09:26, 15.29s/it]
 40%|████      | 15322/37963 [65:40:33<105:31:21, 16.78s/it]
 40%|████      | 15323/37963 [65:40:47<100:23:48, 15.96s/it]
 40%|████      | 15324/37963 [65:41:01<97:22:29, 15.48s/it] 
 40%|████      | 15325/37963 [65:41:15<95:12:30, 15.14s/it]
 40%|████      | 15326/37963 [65:41:36<106:00:04, 16.86s/it]
 40%|████      | 15327/37963 [65:41:50<101:13:00, 16.10s/it]
 40%|████      | 15328/37963 [65:42:05<97:56:17, 15.58s/it] 
 40%|████      | 15329/37963 [65:42:19<95:37:05, 15.21s/it]
 40%|████      | 15330/37963 [65:42:33<93:48:49, 14.92s/it]
                                                           
{'loss': '0.1557', 'grad_norm': '2.507', 'learning_rate': '1.352e-05', 'epoch': '0.4038'}

 40%|████      | 15330/37963 [65:42:33<93:48:49, 14.92s/it]
 40%|████      | 15331/37963 [65:42:54<104:06:44, 16.56s/it]
 40%|████      | 15332/37963 [65:43:08<100:01:58, 15.91s/it]
 40%|████      | 15333/37963 [65:43:23<97:05:11, 15.44s/it] 
 40%|████      | 15334/37963 [65:43:37<94:58:24, 15.11s/it]
 40%|████      | 15335/37963 [65:43:51<93:12:15, 14.83s/it]
 40%|████      | 15336/37963 [65:44:05<92:15:38, 14.68s/it]
 40%|████      | 15337/37963 [65:44:27<105:05:02, 16.72s/it]
 40%|████      | 15338/37963 [65:44:41<99:59:52, 15.91s/it] 
 40%|████      | 15339/37963 [65:44:55<96:51:08, 15.41s/it]
 40%|████      | 15340/37963 [65:45:09<94:08:21, 14.98s/it]
                                                           
{'loss': '0.156', 'grad_norm': '3.619', 'learning_rate': '1.352e-05', 'epoch': '0.4041'}

 40%|████      | 15340/37963 [65:45:09<94:08:21, 14.98s/it]
 40%|████      | 15341/37963 [65:45:24<93:01:25, 14.80s/it]
 40%|████      | 15342/37963 [65:45:38<92:35:29, 14.74s/it]
 40%|████      | 15343/37963 [65:45:52<91:29:43, 14.56s/it]
 40%|████      | 15344/37963 [65:46:07<91:05:31, 14.50s/it]
 40%|████      | 15345/37963 [65:46:21<90:44:15, 14.44s/it]
 40%|████      | 15346/37963 [65:46:35<90:46:23, 14.45s/it]
 40%|████      | 15347/37963 [65:46:50<90:36:45, 14.42s/it]
 40%|████      | 15348/37963 [65:47:04<90:23:25, 14.39s/it]
 40%|████      | 15349/37963 [65:47:18<90:19:33, 14.38s/it]
 40%|████      | 15350/37963 [65:47:33<90:23:39, 14.39s/it]
                                                           
{'loss': '0.1564', 'grad_norm': '1.292', 'learning_rate': '1.351e-05', 'epoch': '0.4043'}

 40%|████      | 15350/37963 [65:47:33<90:23:39, 14.39s/it]
 40%|████      | 15351/37963 [65:47:47<90:27:51, 14.40s/it]
 40%|████      | 15352/37963 [65:48:02<90:28:26, 14.40s/it]
 40%|████      | 15353/37963 [65:48:16<90:04:05, 14.34s/it]
 40%|████      | 15354/37963 [65:48:37<102:06:24, 16.26s/it]
 40%|████      | 15355/37963 [65:48:51<98:14:40, 15.64s/it] 
 40%|████      | 15356/37963 [65:49:05<95:44:02, 15.24s/it]
 40%|████      | 15357/37963 [65:49:19<94:05:03, 14.98s/it]
 40%|████      | 15358/37963 [65:49:33<92:13:15, 14.69s/it]
 40%|████      | 15359/37963 [65:49:48<91:45:36, 14.61s/it]
 40%|████      | 15360/37963 [65:50:02<90:09:20, 14.36s/it]
                                                           
{'loss': '0.1492', 'grad_norm': '1.432', 'learning_rate': '1.35e-05', 'epoch': '0.4046'}

 40%|████      | 15360/37963 [65:50:02<90:09:20, 14.36s/it]
 40%|████      | 15361/37963 [65:50:23<102:44:21, 16.36s/it]
 40%|████      | 15362/37963 [65:50:37<98:52:59, 15.75s/it] 
 40%|████      | 15363/37963 [65:50:51<95:21:07, 15.19s/it]
 40%|████      | 15364/37963 [65:51:12<106:38:07, 16.99s/it]
 40%|████      | 15365/37963 [65:51:26<101:41:50, 16.20s/it]
 40%|████      | 15366/37963 [65:51:41<98:08:12, 15.63s/it] 
 40%|████      | 15367/37963 [65:52:02<108:23:33, 17.27s/it]
 40%|████      | 15368/37963 [65:52:16<103:07:59, 16.43s/it]
 40%|████      | 15369/37963 [65:52:31<99:16:36, 15.82s/it] 
 40%|████      | 15370/37963 [65:52:45<96:30:15, 15.38s/it]
                                                           
{'loss': '0.1662', 'grad_norm': '4.155', 'learning_rate': '1.349e-05', 'epoch': '0.4049'}

 40%|████      | 15370/37963 [65:52:45<96:30:15, 15.38s/it]
 40%|████      | 15371/37963 [65:53:06<106:33:58, 16.98s/it]
 40%|████      | 15372/37963 [65:53:20<101:43:48, 16.21s/it]
 40%|████      | 15373/37963 [65:53:35<98:07:28, 15.64s/it] 
 40%|████      | 15374/37963 [65:53:49<95:35:16, 15.23s/it]
 40%|████      | 15375/37963 [65:54:09<105:41:25, 16.84s/it]
 41%|████      | 15376/37963 [65:54:24<100:31:05, 16.02s/it]
 41%|████      | 15377/37963 [65:54:38<97:24:02, 15.52s/it] 
 41%|████      | 15378/37963 [65:54:52<95:09:47, 15.17s/it]
 41%|████      | 15379/37963 [65:55:06<92:11:59, 14.70s/it]
 41%|████      | 15380/37963 [65:55:20<91:22:16, 14.57s/it]
                                                           
{'loss': '0.1396', 'grad_norm': '1.536', 'learning_rate': '1.348e-05', 'epoch': '0.4051'}

 41%|████      | 15380/37963 [65:55:20<91:22:16, 14.57s/it]
 41%|████      | 15381/37963 [65:55:40<102:02:31, 16.27s/it]
 41%|████      | 15382/37963 [65:55:54<98:07:21, 15.64s/it] 
 41%|████      | 15383/37963 [65:56:09<95:24:50, 15.21s/it]
 41%|████      | 15384/37963 [65:56:23<93:11:32, 14.86s/it]
 41%|████      | 15385/37963 [65:56:37<92:25:51, 14.74s/it]
 41%|████      | 15386/37963 [65:56:52<92:06:47, 14.69s/it]
 41%|████      | 15387/37963 [65:57:13<104:10:14, 16.61s/it]
 41%|████      | 15388/37963 [65:57:27<99:34:47, 15.88s/it] 
 41%|████      | 15389/37963 [65:57:41<95:07:45, 15.17s/it]
 41%|████      | 15390/37963 [65:57:55<93:43:03, 14.95s/it]
                                                           
{'loss': '0.1453', 'grad_norm': '4.796', 'learning_rate': '1.348e-05', 'epoch': '0.4054'}

 41%|████      | 15390/37963 [65:57:55<93:43:03, 14.95s/it]
 41%|████      | 15391/37963 [65:58:09<92:43:12, 14.79s/it]
 41%|████      | 15392/37963 [65:58:24<91:45:32, 14.64s/it]
 41%|████      | 15393/37963 [65:58:38<91:19:22, 14.57s/it]
 41%|████      | 15394/37963 [65:58:52<90:44:51, 14.48s/it]
 41%|████      | 15395/37963 [65:59:07<90:29:37, 14.44s/it]
 41%|████      | 15396/37963 [65:59:21<90:22:57, 14.42s/it]
 41%|████      | 15397/37963 [65:59:35<89:54:45, 14.34s/it]
 41%|████      | 15398/37963 [65:59:49<88:59:48, 14.20s/it]
 41%|████      | 15399/37963 [66:00:03<89:23:01, 14.26s/it]
 41%|████      | 15400/37963 [66:00:18<89:47:27, 14.33s/it]
                                                           
{'loss': '0.1432', 'grad_norm': '0.8311', 'learning_rate': '1.347e-05', 'epoch': '0.4057'}

 41%|████      | 15400/37963 [66:00:18<89:47:27, 14.33s/it]
 41%|████      | 15401/37963 [66:00:39<102:07:55, 16.30s/it]
 41%|████      | 15402/37963 [66:00:53<98:28:52, 15.71s/it] 
 41%|████      | 15403/37963 [66:01:08<95:56:17, 15.31s/it]
 41%|████      | 15404/37963 [66:01:22<94:13:06, 15.04s/it]
 41%|████      | 15405/37963 [66:01:36<92:57:16, 14.83s/it]
 41%|████      | 15406/37963 [66:01:51<91:57:32, 14.68s/it]
 41%|████      | 15407/37963 [66:02:05<90:52:47, 14.50s/it]
 41%|████      | 15408/37963 [66:02:19<90:58:18, 14.52s/it]
 41%|████      | 15409/37963 [66:02:39<101:18:38, 16.17s/it]
 41%|████      | 15410/37963 [66:02:54<97:58:41, 15.64s/it] 
                                                           
{'loss': '0.1596', 'grad_norm': '1.902', 'learning_rate': '1.346e-05', 'epoch': '0.4059'}

 41%|████      | 15410/37963 [66:02:54<97:58:41, 15.64s/it]
 41%|████      | 15411/37963 [66:03:08<95:36:39, 15.26s/it]
 41%|████      | 15412/37963 [66:03:29<106:32:11, 17.01s/it]
 41%|████      | 15413/37963 [66:03:44<101:40:14, 16.23s/it]
 41%|████      | 15414/37963 [66:03:58<98:02:54, 15.65s/it] 
 41%|████      | 15415/37963 [66:04:19<108:26:00, 17.31s/it]
 41%|████      | 15416/37963 [66:04:33<102:06:15, 16.30s/it]
 41%|████      | 15417/37963 [66:04:47<98:23:25, 15.71s/it] 
 41%|████      | 15418/37963 [66:05:02<95:45:55, 15.29s/it]
 41%|████      | 15419/37963 [66:05:22<105:46:12, 16.89s/it]
 41%|████      | 15420/37963 [66:05:37<101:02:05, 16.13s/it]
                                                            
{'loss': '0.1522', 'grad_norm': '2.49', 'learning_rate': '1.345e-05', 'epoch': '0.4062'}

 41%|████      | 15420/37963 [66:05:37<101:02:05, 16.13s/it]
 41%|████      | 15421/37963 [66:05:51<97:56:06, 15.64s/it] 
 41%|████      | 15422/37963 [66:06:11<106:30:36, 17.01s/it]
 41%|████      | 15423/37963 [66:06:25<100:44:27, 16.09s/it]
 41%|████      | 15424/37963 [66:06:40<97:16:58, 15.54s/it] 
 41%|████      | 15425/37963 [66:06:54<95:02:20, 15.18s/it]
 41%|████      | 15426/37963 [66:07:08<93:33:14, 14.94s/it]
 41%|████      | 15427/37963 [66:07:23<92:34:37, 14.79s/it]
 41%|████      | 15428/37963 [66:07:37<91:37:29, 14.64s/it]
 41%|████      | 15429/37963 [66:07:51<91:01:50, 14.54s/it]
 41%|████      | 15430/37963 [66:08:13<104:12:06, 16.65s/it]
                                                            
{'loss': '0.1597', 'grad_norm': '2.976', 'learning_rate': '1.344e-05', 'epoch': '0.4064'}

 41%|████      | 15430/37963 [66:08:13<104:12:06, 16.65s/it]
 41%|████      | 15431/37963 [66:08:27<99:59:31, 15.98s/it] 
 41%|████      | 15432/37963 [66:08:42<97:05:39, 15.51s/it]
 41%|████      | 15433/37963 [66:08:56<94:49:51, 15.15s/it]
 41%|████      | 15434/37963 [66:09:10<92:36:17, 14.80s/it]
 41%|████      | 15435/37963 [66:09:31<104:14:56, 16.66s/it]
 41%|████      | 15436/37963 [66:09:45<99:20:03, 15.87s/it] 
 41%|████      | 15437/37963 [66:10:00<96:51:19, 15.48s/it]
 41%|████      | 15438/37963 [66:10:14<94:50:16, 15.16s/it]
 41%|████      | 15439/37963 [66:10:28<93:16:52, 14.91s/it]
 41%|████      | 15440/37963 [66:10:42<91:37:43, 14.65s/it]
                                                           
{'loss': '0.1513', 'grad_norm': '2.825', 'learning_rate': '1.344e-05', 'epoch': '0.4067'}

 41%|████      | 15440/37963 [66:10:42<91:37:43, 14.65s/it]
 41%|████      | 15441/37963 [66:10:57<91:04:42, 14.56s/it]
 41%|████      | 15442/37963 [66:11:10<89:23:57, 14.29s/it]
 41%|████      | 15443/37963 [66:11:25<89:23:30, 14.29s/it]
 41%|████      | 15444/37963 [66:11:39<89:20:27, 14.28s/it]
 41%|████      | 15445/37963 [66:11:53<89:26:25, 14.30s/it]
 41%|████      | 15446/37963 [66:12:08<89:35:44, 14.32s/it]
 41%|████      | 15447/37963 [66:12:22<89:33:36, 14.32s/it]
 41%|████      | 15448/37963 [66:12:36<89:45:51, 14.35s/it]
 41%|████      | 15449/37963 [66:12:57<101:47:19, 16.28s/it]
 41%|████      | 15450/37963 [66:13:12<98:07:59, 15.69s/it] 
                                                           
{'loss': '0.1639', 'grad_norm': '2.823', 'learning_rate': '1.343e-05', 'epoch': '0.407'}

 41%|████      | 15450/37963 [66:13:12<98:07:59, 15.69s/it]
 41%|████      | 15451/37963 [66:13:26<95:45:01, 15.31s/it]
 41%|████      | 15452/37963 [66:13:40<93:54:49, 15.02s/it]
 41%|████      | 15453/37963 [66:13:55<92:39:48, 14.82s/it]
 41%|████      | 15454/37963 [66:14:08<90:42:58, 14.51s/it]
 41%|████      | 15455/37963 [66:14:23<90:28:22, 14.47s/it]
 41%|████      | 15456/37963 [66:14:37<89:31:31, 14.32s/it]
 41%|████      | 15457/37963 [66:14:51<89:21:58, 14.29s/it]
 41%|████      | 15458/37963 [66:15:05<89:09:18, 14.26s/it]
 41%|████      | 15459/37963 [66:15:26<101:41:07, 16.27s/it]
 41%|████      | 15460/37963 [66:15:40<97:56:36, 15.67s/it] 
                                                           
{'loss': '0.154', 'grad_norm': '5.191', 'learning_rate': '1.342e-05', 'epoch': '0.4072'}

 41%|████      | 15460/37963 [66:15:40<97:56:36, 15.67s/it]
 41%|████      | 15461/37963 [66:15:55<95:22:43, 15.26s/it]
 41%|████      | 15462/37963 [66:16:09<93:33:05, 14.97s/it]
 41%|████      | 15463/37963 [66:16:37<118:00:08, 18.88s/it]
 41%|████      | 15464/37963 [66:16:51<109:29:58, 17.52s/it]
 41%|████      | 15465/37963 [66:17:06<103:31:49, 16.57s/it]
 41%|████      | 15466/37963 [66:17:20<99:18:42, 15.89s/it] 
 41%|████      | 15467/37963 [66:17:34<96:33:19, 15.45s/it]
 41%|████      | 15468/37963 [66:17:55<106:45:09, 17.08s/it]
 41%|████      | 15469/37963 [66:18:10<101:32:05, 16.25s/it]
 41%|████      | 15470/37963 [66:18:30<109:25:02, 17.51s/it]
                                                            
{'loss': '0.1325', 'grad_norm': '1.434', 'learning_rate': '1.341e-05', 'epoch': '0.4075'}

 41%|████      | 15470/37963 [66:18:30<109:25:02, 17.51s/it]
 41%|████      | 15471/37963 [66:18:44<102:48:26, 16.46s/it]
 41%|████      | 15472/37963 [66:18:58<98:11:12, 15.72s/it] 
 41%|████      | 15473/37963 [66:19:12<94:44:35, 15.17s/it]
 41%|████      | 15474/37963 [66:19:25<91:35:48, 14.66s/it]
 41%|████      | 15475/37963 [66:19:40<90:56:17, 14.56s/it]
 41%|████      | 15476/37963 [66:19:54<90:34:52, 14.50s/it]
 41%|████      | 15477/37963 [66:20:08<89:31:49, 14.33s/it]
 41%|████      | 15478/37963 [66:20:22<89:31:13, 14.33s/it]
 41%|████      | 15479/37963 [66:20:37<89:40:54, 14.36s/it]
 41%|████      | 15480/37963 [66:20:51<89:13:27, 14.29s/it]
                                                           
{'loss': '0.1439', 'grad_norm': '1.263', 'learning_rate': '1.34e-05', 'epoch': '0.4078'}

 41%|████      | 15480/37963 [66:20:51<89:13:27, 14.29s/it]
 41%|████      | 15481/37963 [66:21:11<100:34:12, 16.10s/it]
 41%|████      | 15482/37963 [66:21:25<96:56:26, 15.52s/it] 
 41%|████      | 15483/37963 [66:21:40<94:44:15, 15.17s/it]
 41%|████      | 15484/37963 [66:22:00<104:42:46, 16.77s/it]
 41%|████      | 15485/37963 [66:22:14<99:09:47, 15.88s/it] 
 41%|████      | 15486/37963 [66:22:28<95:56:28, 15.37s/it]
 41%|████      | 15487/37963 [66:22:43<93:56:39, 15.05s/it]
 41%|████      | 15488/37963 [66:22:57<92:45:49, 14.86s/it]
 41%|████      | 15489/37963 [66:23:11<92:00:05, 14.74s/it]
 41%|████      | 15490/37963 [66:23:26<91:19:16, 14.63s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '2.786', 'learning_rate': '1.34e-05', 'epoch': '0.408'}

 41%|████      | 15490/37963 [66:23:26<91:19:16, 14.63s/it]
 41%|████      | 15491/37963 [66:23:40<90:40:54, 14.53s/it]
 41%|████      | 15492/37963 [66:23:54<90:17:08, 14.46s/it]
 41%|████      | 15493/37963 [66:24:09<90:06:25, 14.44s/it]
 41%|████      | 15494/37963 [66:24:23<90:27:32, 14.49s/it]
 41%|████      | 15495/37963 [66:24:38<90:10:58, 14.45s/it]
 41%|████      | 15496/37963 [66:24:52<90:02:13, 14.43s/it]
 41%|████      | 15497/37963 [66:25:07<90:07:12, 14.44s/it]
 41%|████      | 15498/37963 [66:25:28<102:30:22, 16.43s/it]
 41%|████      | 15499/37963 [66:25:42<99:01:56, 15.87s/it] 
 41%|████      | 15500/37963 [66:25:57<96:20:01, 15.44s/it]
                                                           
{'loss': '0.1576', 'grad_norm': '3.831', 'learning_rate': '1.339e-05', 'epoch': '0.4083'}

 41%|████      | 15500/37963 [66:25:57<96:20:01, 15.44s/it]
 41%|████      | 15501/37963 [66:26:11<94:14:12, 15.10s/it]
 41%|████      | 15502/37963 [66:26:25<92:46:17, 14.87s/it]
 41%|████      | 15503/37963 [66:26:39<90:48:27, 14.56s/it]
 41%|████      | 15504/37963 [66:26:54<90:29:53, 14.51s/it]
 41%|████      | 15505/37963 [66:27:08<89:44:07, 14.38s/it]
 41%|████      | 15506/37963 [66:27:22<89:38:23, 14.37s/it]
 41%|████      | 15507/37963 [66:27:36<89:47:01, 14.39s/it]
 41%|████      | 15508/37963 [66:27:51<89:47:48, 14.40s/it]
 41%|████      | 15509/37963 [66:28:12<101:53:51, 16.34s/it]
 41%|████      | 15510/37963 [66:28:26<98:12:45, 15.75s/it] 
                                                           
{'loss': '0.1401', 'grad_norm': '1.351', 'learning_rate': '1.338e-05', 'epoch': '0.4086'}

 41%|████      | 15510/37963 [66:28:26<98:12:45, 15.75s/it]
 41%|████      | 15511/37963 [66:28:40<95:33:30, 15.32s/it]
 41%|████      | 15512/37963 [66:29:09<119:47:23, 19.21s/it]
 41%|████      | 15513/37963 [66:29:23<110:03:35, 17.65s/it]
 41%|████      | 15514/37963 [66:29:44<116:13:24, 18.64s/it]
 41%|████      | 15515/37963 [66:29:58<108:16:27, 17.36s/it]
 41%|████      | 15516/37963 [66:30:12<101:15:50, 16.24s/it]
 41%|████      | 15517/37963 [66:30:26<97:41:46, 15.67s/it] 
 41%|████      | 15518/37963 [66:30:40<95:09:35, 15.26s/it]
 41%|████      | 15519/37963 [66:31:01<105:44:19, 16.96s/it]
 41%|████      | 15520/37963 [66:31:15<99:34:55, 15.97s/it] 
                                                           
{'loss': '0.1526', 'grad_norm': '3.389', 'learning_rate': '1.337e-05', 'epoch': '0.4088'}

 41%|████      | 15520/37963 [66:31:15<99:34:55, 15.97s/it]
 41%|████      | 15521/37963 [66:31:29<96:26:42, 15.47s/it]
 41%|████      | 15522/37963 [66:31:44<94:37:58, 15.18s/it]
 41%|████      | 15523/37963 [66:31:58<92:47:23, 14.89s/it]
 41%|████      | 15524/37963 [66:32:13<92:15:53, 14.80s/it]
 41%|████      | 15525/37963 [66:32:27<91:22:07, 14.66s/it]
 41%|████      | 15526/37963 [66:32:41<90:38:46, 14.54s/it]
 41%|████      | 15527/37963 [66:32:55<90:10:20, 14.47s/it]
 41%|████      | 15528/37963 [66:33:10<89:57:28, 14.43s/it]
 41%|████      | 15529/37963 [66:33:24<88:59:45, 14.28s/it]
 41%|████      | 15530/37963 [66:33:45<101:22:30, 16.27s/it]
                                                            
{'loss': '0.1517', 'grad_norm': '2.593', 'learning_rate': '1.336e-05', 'epoch': '0.4091'}

 41%|████      | 15530/37963 [66:33:45<101:22:30, 16.27s/it]
 41%|████      | 15531/37963 [66:33:59<97:57:19, 15.72s/it] 
 41%|████      | 15532/37963 [66:34:20<107:42:25, 17.29s/it]
 41%|████      | 15533/37963 [66:34:34<101:31:28, 16.29s/it]
 41%|████      | 15534/37963 [66:34:48<97:50:03, 15.70s/it] 
 41%|████      | 15535/37963 [66:35:03<95:32:37, 15.34s/it]
 41%|████      | 15536/37963 [66:35:17<93:41:30, 15.04s/it]
 41%|████      | 15537/37963 [66:35:31<92:07:48, 14.79s/it]
 41%|████      | 15538/37963 [66:35:46<91:16:41, 14.65s/it]
 41%|████      | 15539/37963 [66:36:00<90:33:20, 14.54s/it]
 41%|████      | 15540/37963 [66:36:14<90:25:24, 14.52s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '1.94', 'learning_rate': '1.336e-05', 'epoch': '0.4093'}

 41%|████      | 15540/37963 [66:36:14<90:25:24, 14.52s/it]
 41%|████      | 15541/37963 [66:36:29<89:48:18, 14.42s/it]
 41%|████      | 15542/37963 [66:36:43<89:37:51, 14.39s/it]
 41%|████      | 15543/37963 [66:36:57<88:52:34, 14.27s/it]
 41%|████      | 15544/37963 [66:37:11<89:05:49, 14.31s/it]
 41%|████      | 15545/37963 [66:37:26<89:31:47, 14.38s/it]
 41%|████      | 15546/37963 [66:37:46<101:12:26, 16.25s/it]
 41%|████      | 15547/37963 [66:38:01<97:17:57, 15.63s/it] 
 41%|████      | 15548/37963 [66:38:14<93:50:12, 15.07s/it]
 41%|████      | 15549/37963 [66:38:28<90:46:36, 14.58s/it]
 41%|████      | 15550/37963 [66:38:42<90:17:54, 14.50s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '1.23', 'learning_rate': '1.335e-05', 'epoch': '0.4096'}

 41%|████      | 15550/37963 [66:38:42<90:17:54, 14.50s/it]
 41%|████      | 15551/37963 [66:38:57<90:01:49, 14.46s/it]
 41%|████      | 15552/37963 [66:39:11<90:08:36, 14.48s/it]
 41%|████      | 15553/37963 [66:39:25<89:55:55, 14.45s/it]
 41%|████      | 15554/37963 [66:39:40<89:53:40, 14.44s/it]
 41%|████      | 15555/37963 [66:39:54<89:35:12, 14.39s/it]
 41%|████      | 15556/37963 [66:40:09<89:35:25, 14.39s/it]
 41%|████      | 15557/37963 [66:40:22<88:45:43, 14.26s/it]
 41%|████      | 15558/37963 [66:40:43<101:03:21, 16.24s/it]
 41%|████      | 15559/37963 [66:40:58<97:20:30, 15.64s/it] 
 41%|████      | 15560/37963 [66:41:12<95:12:52, 15.30s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '1.936', 'learning_rate': '1.334e-05', 'epoch': '0.4099'}

 41%|████      | 15560/37963 [66:41:12<95:12:52, 15.30s/it]
 41%|████      | 15561/37963 [66:41:33<105:38:04, 16.98s/it]
 41%|████      | 15562/37963 [66:41:54<113:47:19, 18.29s/it]
 41%|████      | 15563/37963 [66:42:15<118:32:37, 19.05s/it]
 41%|████      | 15564/37963 [66:42:29<109:36:38, 17.62s/it]
 41%|████      | 15565/37963 [66:42:44<103:13:46, 16.59s/it]
 41%|████      | 15566/37963 [66:43:04<111:15:55, 17.88s/it]
 41%|████      | 15567/37963 [66:43:18<103:58:30, 16.71s/it]
 41%|████      | 15568/37963 [66:43:33<99:32:27, 16.00s/it] 
 41%|████      | 15569/37963 [66:43:47<95:51:08, 15.41s/it]
 41%|████      | 15570/37963 [66:44:01<94:07:34, 15.13s/it]
                                                           
{'loss': '0.1471', 'grad_norm': '1.108', 'learning_rate': '1.333e-05', 'epoch': '0.4101'}

 41%|████      | 15570/37963 [66:44:01<94:07:34, 15.13s/it]
 41%|████      | 15571/37963 [66:44:16<92:42:57, 14.91s/it]
 41%|████      | 15572/37963 [66:44:30<91:45:35, 14.75s/it]
 41%|████      | 15573/37963 [66:44:44<91:02:11, 14.64s/it]
 41%|████      | 15574/37963 [66:44:59<90:31:31, 14.56s/it]
 41%|████      | 15575/37963 [66:45:13<90:18:09, 14.52s/it]
 41%|████      | 15576/37963 [66:45:27<89:41:58, 14.42s/it]
 41%|████      | 15577/37963 [66:45:42<89:19:28, 14.36s/it]
 41%|████      | 15578/37963 [66:45:56<89:33:18, 14.40s/it]
 41%|████      | 15579/37963 [66:46:11<89:25:02, 14.38s/it]
 41%|████      | 15580/37963 [66:46:38<113:53:25, 18.32s/it]
                                                            
{'loss': '0.1527', 'grad_norm': '0.9518', 'learning_rate': '1.332e-05', 'epoch': '0.4104'}

 41%|████      | 15580/37963 [66:46:38<113:53:25, 18.32s/it]
 41%|████      | 15581/37963 [66:46:52<106:03:09, 17.06s/it]
 41%|████      | 15582/37963 [66:47:07<101:02:19, 16.25s/it]
 41%|████      | 15583/37963 [66:47:21<97:39:59, 15.71s/it] 
 41%|████      | 15584/37963 [66:47:35<94:14:02, 15.16s/it]
 41%|████      | 15585/37963 [66:47:49<92:49:18, 14.93s/it]
 41%|████      | 15586/37963 [66:48:04<91:47:11, 14.77s/it]
 41%|████      | 15587/37963 [66:48:17<90:00:26, 14.48s/it]
 41%|████      | 15588/37963 [66:48:32<89:40:30, 14.43s/it]
 41%|████      | 15589/37963 [66:48:46<89:40:02, 14.43s/it]
 41%|████      | 15590/37963 [66:49:01<89:30:37, 14.40s/it]
                                                           
{'loss': '0.1403', 'grad_norm': '4.562', 'learning_rate': '1.332e-05', 'epoch': '0.4107'}

 41%|████      | 15590/37963 [66:49:01<89:30:37, 14.40s/it]
 41%|████      | 15591/37963 [66:49:15<89:48:17, 14.45s/it]
 41%|████      | 15592/37963 [66:49:29<88:54:41, 14.31s/it]
 41%|████      | 15593/37963 [66:49:43<88:35:26, 14.26s/it]
 41%|████      | 15594/37963 [66:49:58<88:43:34, 14.28s/it]
 41%|████      | 15595/37963 [66:50:18<100:23:35, 16.16s/it]
 41%|████      | 15596/37963 [66:50:32<95:58:46, 15.45s/it] 
 41%|████      | 15597/37963 [66:50:46<94:00:40, 15.13s/it]
 41%|████      | 15598/37963 [66:51:01<92:28:23, 14.89s/it]
 41%|████      | 15599/37963 [66:51:15<91:32:19, 14.74s/it]
 41%|████      | 15600/37963 [66:51:29<90:41:44, 14.60s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '1.526', 'learning_rate': '1.331e-05', 'epoch': '0.4109'}

 41%|████      | 15600/37963 [66:51:29<90:41:44, 14.60s/it]
 41%|████      | 15601/37963 [66:51:44<90:08:15, 14.51s/it]
 41%|████      | 15602/37963 [66:51:58<89:34:49, 14.42s/it]
 41%|████      | 15603/37963 [66:52:12<89:28:58, 14.41s/it]
 41%|████      | 15604/37963 [66:52:26<89:25:16, 14.40s/it]
 41%|████      | 15605/37963 [66:52:41<90:04:47, 14.50s/it]
 41%|████      | 15606/37963 [66:52:56<89:54:50, 14.48s/it]
 41%|████      | 15607/37963 [66:53:09<88:37:26, 14.27s/it]
 41%|████      | 15608/37963 [66:53:30<100:09:22, 16.13s/it]
 41%|████      | 15609/37963 [66:53:44<95:26:22, 15.37s/it] 
 41%|████      | 15610/37963 [66:53:58<93:29:19, 15.06s/it]
                                                           
{'loss': '0.162', 'grad_norm': '2.518', 'learning_rate': '1.33e-05', 'epoch': '0.4112'}

 41%|████      | 15610/37963 [66:53:58<93:29:19, 15.06s/it]
 41%|████      | 15611/37963 [66:54:19<105:24:02, 16.98s/it]
 41%|████      | 15612/37963 [66:54:41<113:33:19, 18.29s/it]
 41%|████      | 15613/37963 [66:54:55<106:13:39, 17.11s/it]
 41%|████      | 15614/37963 [66:55:09<101:06:20, 16.29s/it]
 41%|████      | 15615/37963 [66:55:30<109:59:12, 17.72s/it]
 41%|████      | 15616/37963 [66:55:45<103:42:34, 16.71s/it]
 41%|████      | 15617/37963 [66:55:59<99:25:39, 16.02s/it] 
 41%|████      | 15618/37963 [66:56:14<96:18:26, 15.52s/it]
 41%|████      | 15619/37963 [66:56:28<94:01:48, 15.15s/it]
 41%|████      | 15620/37963 [66:56:42<92:40:44, 14.93s/it]
                                                           
{'loss': '0.1507', 'grad_norm': '1.602', 'learning_rate': '1.329e-05', 'epoch': '0.4115'}

 41%|████      | 15620/37963 [66:56:42<92:40:44, 14.93s/it]
 41%|████      | 15621/37963 [66:56:57<91:33:31, 14.75s/it]
 41%|████      | 15622/37963 [66:57:11<90:10:26, 14.53s/it]
 41%|████      | 15623/37963 [66:57:25<89:51:33, 14.48s/it]
 41%|████      | 15624/37963 [66:57:39<89:32:53, 14.43s/it]
 41%|████      | 15625/37963 [66:57:54<89:34:49, 14.44s/it]
 41%|████      | 15626/37963 [66:58:07<88:13:19, 14.22s/it]
 41%|████      | 15627/37963 [66:58:22<88:25:20, 14.25s/it]
 41%|████      | 15628/37963 [66:58:49<112:46:13, 18.18s/it]
 41%|████      | 15629/37963 [66:59:04<105:49:45, 17.06s/it]
 41%|████      | 15630/37963 [66:59:18<100:52:38, 16.26s/it]
                                                            
{'loss': '0.1457', 'grad_norm': '1.105', 'learning_rate': '1.328e-05', 'epoch': '0.4117'}

 41%|████      | 15630/37963 [66:59:18<100:52:38, 16.26s/it]
 41%|████      | 15631/37963 [66:59:32<97:20:18, 15.69s/it] 
 41%|████      | 15632/37963 [66:59:47<94:52:17, 15.29s/it]
 41%|████      | 15633/37963 [67:00:00<91:48:40, 14.80s/it]
 41%|████      | 15634/37963 [67:00:14<90:09:23, 14.54s/it]
 41%|████      | 15635/37963 [67:00:29<89:46:36, 14.47s/it]
 41%|████      | 15636/37963 [67:00:43<89:33:01, 14.44s/it]
 41%|████      | 15637/37963 [67:00:57<89:14:10, 14.39s/it]
 41%|████      | 15638/37963 [67:01:12<89:12:30, 14.39s/it]
 41%|████      | 15639/37963 [67:01:26<88:42:06, 14.30s/it]
 41%|████      | 15640/37963 [67:01:40<88:56:26, 14.34s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '1.252', 'learning_rate': '1.328e-05', 'epoch': '0.412'}

 41%|████      | 15640/37963 [67:01:40<88:56:26, 14.34s/it]
 41%|████      | 15641/37963 [67:01:55<89:50:02, 14.49s/it]
 41%|████      | 15642/37963 [67:02:09<89:33:08, 14.44s/it]
 41%|████      | 15643/37963 [67:02:24<89:22:07, 14.41s/it]
 41%|████      | 15644/37963 [67:02:44<100:14:49, 16.17s/it]
 41%|████      | 15645/37963 [67:02:58<96:20:34, 15.54s/it] 
 41%|████      | 15646/37963 [67:03:12<94:09:37, 15.19s/it]
 41%|████      | 15647/37963 [67:03:27<92:34:53, 14.94s/it]
 41%|████      | 15648/37963 [67:03:41<91:43:49, 14.80s/it]
 41%|████      | 15649/37963 [67:03:55<90:32:04, 14.61s/it]
 41%|████      | 15650/37963 [67:04:10<90:18:18, 14.57s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '3.666', 'learning_rate': '1.327e-05', 'epoch': '0.4122'}

 41%|████      | 15650/37963 [67:04:10<90:18:18, 14.57s/it]
 41%|████      | 15651/37963 [67:04:24<89:50:39, 14.50s/it]
 41%|████      | 15652/37963 [67:04:38<89:33:52, 14.45s/it]
 41%|████      | 15653/37963 [67:04:53<89:18:14, 14.41s/it]
 41%|████      | 15654/37963 [67:05:07<89:17:13, 14.41s/it]
 41%|████      | 15655/37963 [67:05:28<100:45:22, 16.26s/it]
 41%|████      | 15656/37963 [67:05:42<97:12:33, 15.69s/it] 
 41%|████      | 15657/37963 [67:05:56<94:43:34, 15.29s/it]
 41%|████      | 15658/37963 [67:06:18<105:52:34, 17.09s/it]
 41%|████      | 15659/37963 [67:06:38<112:14:55, 18.12s/it]
 41%|████▏     | 15660/37963 [67:06:59<117:15:44, 18.93s/it]
                                                            
{'loss': '0.1599', 'grad_norm': '1.117', 'learning_rate': '1.326e-05', 'epoch': '0.4125'}

 41%|████▏     | 15660/37963 [67:06:59<117:15:44, 18.93s/it]
 41%|████▏     | 15661/37963 [67:07:13<108:45:24, 17.56s/it]
 41%|████▏     | 15662/37963 [67:07:28<102:57:11, 16.62s/it]
 41%|████▏     | 15663/37963 [67:07:42<98:50:54, 15.96s/it] 
 41%|████▏     | 15664/37963 [67:07:57<95:45:11, 15.46s/it]
 41%|████▏     | 15665/37963 [67:08:18<106:15:05, 17.15s/it]
 41%|████▏     | 15666/37963 [67:08:32<101:06:38, 16.32s/it]
 41%|████▏     | 15667/37963 [67:08:47<97:30:00, 15.74s/it] 
 41%|████▏     | 15668/37963 [67:09:01<94:51:15, 15.32s/it]
 41%|████▏     | 15669/37963 [67:09:15<92:43:12, 14.97s/it]
 41%|████▏     | 15670/37963 [67:09:29<91:47:15, 14.82s/it]
                                                           
{'loss': '0.1461', 'grad_norm': '3.631', 'learning_rate': '1.325e-05', 'epoch': '0.4128'}

 41%|████▏     | 15670/37963 [67:09:29<91:47:15, 14.82s/it]
 41%|████▏     | 15671/37963 [67:09:44<90:52:35, 14.68s/it]
 41%|████▏     | 15672/37963 [67:09:58<90:24:38, 14.60s/it]
 41%|████▏     | 15673/37963 [67:10:13<89:56:05, 14.53s/it]
 41%|████▏     | 15674/37963 [67:10:27<89:42:13, 14.49s/it]
 41%|████▏     | 15675/37963 [67:10:41<89:34:00, 14.47s/it]
 41%|████▏     | 15676/37963 [67:11:03<102:06:35, 16.49s/it]
 41%|████▏     | 15677/37963 [67:11:23<110:04:33, 17.78s/it]
 41%|████▏     | 15678/37963 [67:11:37<103:06:00, 16.66s/it]
 41%|████▏     | 15679/37963 [67:11:52<99:03:51, 16.00s/it] 
 41%|████▏     | 15680/37963 [67:12:06<95:39:59, 15.46s/it]
                                                           
{'loss': '0.1502', 'grad_norm': '1.798', 'learning_rate': '1.324e-05', 'epoch': '0.413'}

 41%|████▏     | 15680/37963 [67:12:06<95:39:59, 15.46s/it]
 41%|████▏     | 15681/37963 [67:12:20<93:37:26, 15.13s/it]
 41%|████▏     | 15682/37963 [67:12:35<92:11:55, 14.90s/it]
 41%|████▏     | 15683/37963 [67:12:48<89:37:58, 14.48s/it]
 41%|████▏     | 15684/37963 [67:13:03<89:23:34, 14.44s/it]
 41%|████▏     | 15685/37963 [67:13:17<88:51:58, 14.36s/it]
 41%|████▏     | 15686/37963 [67:13:31<88:12:27, 14.25s/it]
 41%|████▏     | 15687/37963 [67:13:45<88:46:51, 14.35s/it]
 41%|████▏     | 15688/37963 [67:14:00<88:50:22, 14.36s/it]
 41%|████▏     | 15689/37963 [67:14:14<88:45:46, 14.35s/it]
 41%|████▏     | 15690/37963 [67:14:28<88:47:08, 14.35s/it]
                                                           
{'loss': '0.1483', 'grad_norm': '1.775', 'learning_rate': '1.324e-05', 'epoch': '0.4133'}

 41%|████▏     | 15690/37963 [67:14:28<88:47:08, 14.35s/it]
 41%|████▏     | 15691/37963 [67:14:49<99:50:41, 16.14s/it]
 41%|████▏     | 15692/37963 [67:15:03<96:42:55, 15.63s/it]
 41%|████▏     | 15693/37963 [67:15:18<94:11:11, 15.23s/it]
 41%|████▏     | 15694/37963 [67:15:32<92:08:14, 14.89s/it]
 41%|████▏     | 15695/37963 [67:15:46<91:09:44, 14.74s/it]
 41%|████▏     | 15696/37963 [67:16:00<89:55:22, 14.54s/it]
 41%|████▏     | 15697/37963 [67:16:14<88:27:36, 14.30s/it]
 41%|████▏     | 15698/37963 [67:16:28<88:36:28, 14.33s/it]
 41%|████▏     | 15699/37963 [67:16:42<87:49:16, 14.20s/it]
 41%|████▏     | 15700/37963 [67:16:56<88:04:41, 14.24s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '5.392', 'learning_rate': '1.323e-05', 'epoch': '0.4136'}

 41%|████▏     | 15700/37963 [67:16:56<88:04:41, 14.24s/it]
 41%|████▏     | 15701/37963 [67:17:11<88:24:11, 14.30s/it]
 41%|████▏     | 15702/37963 [67:17:32<101:14:31, 16.37s/it]
 41%|████▏     | 15703/37963 [67:17:46<96:27:44, 15.60s/it] 
 41%|████▏     | 15704/37963 [67:18:07<106:07:21, 17.16s/it]
 41%|████▏     | 15705/37963 [67:18:21<100:54:08, 16.32s/it]
 41%|████▏     | 15706/37963 [67:18:35<97:11:04, 15.72s/it] 
 41%|████▏     | 15707/37963 [67:18:50<94:45:52, 15.33s/it]
 41%|████▏     | 15708/37963 [67:19:11<105:30:55, 17.07s/it]
 41%|████▏     | 15709/37963 [67:19:25<100:27:34, 16.25s/it]
 41%|████▏     | 15710/37963 [67:19:46<108:47:43, 17.60s/it]
                                                            
{'loss': '0.1508', 'grad_norm': '4.565', 'learning_rate': '1.322e-05', 'epoch': '0.4138'}

 41%|████▏     | 15710/37963 [67:19:46<108:47:43, 17.60s/it]
 41%|████▏     | 15711/37963 [67:20:00<102:48:35, 16.63s/it]
 41%|████▏     | 15712/37963 [67:20:21<109:34:46, 17.73s/it]
 41%|████▏     | 15713/37963 [67:20:35<102:41:21, 16.61s/it]
 41%|████▏     | 15714/37963 [67:20:49<98:31:45, 15.94s/it] 
 41%|████▏     | 15715/37963 [67:21:03<95:27:18, 15.45s/it]
 41%|████▏     | 15716/37963 [67:21:18<93:22:16, 15.11s/it]
 41%|████▏     | 15717/37963 [67:21:32<91:40:33, 14.84s/it]
 41%|████▏     | 15718/37963 [67:21:46<90:29:31, 14.64s/it]
 41%|████▏     | 15719/37963 [67:22:00<89:53:53, 14.55s/it]
 41%|████▏     | 15720/37963 [67:22:15<89:39:05, 14.51s/it]
                                                           
{'loss': '0.1587', 'grad_norm': '1.886', 'learning_rate': '1.321e-05', 'epoch': '0.4141'}

 41%|████▏     | 15720/37963 [67:22:15<89:39:05, 14.51s/it]
 41%|████▏     | 15721/37963 [67:22:29<89:15:52, 14.45s/it]
 41%|████▏     | 15722/37963 [67:22:44<89:08:46, 14.43s/it]
 41%|████▏     | 15723/37963 [67:22:58<88:55:56, 14.40s/it]
 41%|████▏     | 15724/37963 [67:23:12<88:54:37, 14.39s/it]
 41%|████▏     | 15725/37963 [67:23:33<100:16:19, 16.23s/it]
 41%|████▏     | 15726/37963 [67:23:47<97:03:27, 15.71s/it] 
 41%|████▏     | 15727/37963 [67:24:08<106:39:12, 17.27s/it]
 41%|████▏     | 15728/37963 [67:24:23<101:18:49, 16.40s/it]
 41%|████▏     | 15729/37963 [67:24:37<98:08:46, 15.89s/it] 
 41%|████▏     | 15730/37963 [67:24:52<95:13:03, 15.42s/it]
                                                           
{'loss': '0.1595', 'grad_norm': '2.56', 'learning_rate': '1.32e-05', 'epoch': '0.4144'}

 41%|████▏     | 15730/37963 [67:24:52<95:13:03, 15.42s/it]
 41%|████▏     | 15731/37963 [67:25:05<92:20:29, 14.95s/it]
 41%|████▏     | 15732/37963 [67:25:20<91:21:41, 14.79s/it]
 41%|████▏     | 15733/37963 [67:25:34<90:40:39, 14.68s/it]
 41%|████▏     | 15734/37963 [67:25:49<89:59:16, 14.57s/it]
 41%|████▏     | 15735/37963 [67:26:03<89:31:27, 14.50s/it]
 41%|████▏     | 15736/37963 [67:26:17<89:18:12, 14.46s/it]
 41%|████▏     | 15737/37963 [67:26:32<89:04:03, 14.43s/it]
 41%|████▏     | 15738/37963 [67:26:46<88:20:45, 14.31s/it]
 41%|████▏     | 15739/37963 [67:27:06<100:24:57, 16.27s/it]
 41%|████▏     | 15740/37963 [67:27:21<96:46:04, 15.68s/it] 
                                                           
{'loss': '0.1493', 'grad_norm': '4.098', 'learning_rate': '1.32e-05', 'epoch': '0.4146'}

 41%|████▏     | 15740/37963 [67:27:21<96:46:04, 15.68s/it]
 41%|████▏     | 15741/37963 [67:27:35<94:05:42, 15.24s/it]
 41%|████▏     | 15742/37963 [67:27:49<92:21:39, 14.96s/it]
 41%|████▏     | 15743/37963 [67:28:04<91:05:55, 14.76s/it]
 41%|████▏     | 15744/37963 [67:28:18<90:29:02, 14.66s/it]
 41%|████▏     | 15745/37963 [67:28:33<90:16:32, 14.63s/it]
 41%|████▏     | 15746/37963 [67:28:47<89:20:06, 14.48s/it]
 41%|████▏     | 15747/37963 [67:29:01<89:15:55, 14.47s/it]
 41%|████▏     | 15748/37963 [67:29:22<101:34:03, 16.46s/it]
 41%|████▏     | 15749/37963 [67:29:36<96:36:30, 15.66s/it] 
 41%|████▏     | 15750/37963 [67:29:51<94:28:55, 15.31s/it]
                                                           
{'loss': '0.1533', 'grad_norm': '2.951', 'learning_rate': '1.319e-05', 'epoch': '0.4149'}

 41%|████▏     | 15750/37963 [67:29:51<94:28:55, 15.31s/it]
 41%|████▏     | 15751/37963 [67:30:05<93:03:33, 15.08s/it]
 41%|████▏     | 15752/37963 [67:30:19<91:43:13, 14.87s/it]
 41%|████▏     | 15753/37963 [67:30:40<101:59:10, 16.53s/it]
 41%|████▏     | 15754/37963 [67:30:54<97:58:56, 15.88s/it] 
 42%|████▏     | 15755/37963 [67:31:08<94:04:52, 15.25s/it]
 42%|████▏     | 15756/37963 [67:31:29<105:13:13, 17.06s/it]
 42%|████▏     | 15757/37963 [67:31:43<99:54:37, 16.20s/it] 
 42%|████▏     | 15758/37963 [67:32:11<120:07:39, 19.48s/it]
 42%|████▏     | 15759/37963 [67:32:25<109:57:33, 17.83s/it]
 42%|████▏     | 15760/37963 [67:32:39<102:43:32, 16.66s/it]
                                                            
{'loss': '0.1567', 'grad_norm': '2.237', 'learning_rate': '1.318e-05', 'epoch': '0.4151'}

 42%|████▏     | 15760/37963 [67:32:39<102:43:32, 16.66s/it]
 42%|████▏     | 15761/37963 [67:32:52<97:40:06, 15.84s/it] 
 42%|████▏     | 15762/37963 [67:33:07<94:55:05, 15.39s/it]
 42%|████▏     | 15763/37963 [67:33:21<92:24:10, 14.98s/it]
 42%|████▏     | 15764/37963 [67:33:35<90:45:17, 14.72s/it]
 42%|████▏     | 15765/37963 [67:33:49<90:19:36, 14.65s/it]
 42%|████▏     | 15766/37963 [67:34:04<89:21:03, 14.49s/it]
 42%|████▏     | 15767/37963 [67:34:18<88:40:37, 14.38s/it]
 42%|████▏     | 15768/37963 [67:34:32<88:35:14, 14.37s/it]
 42%|████▏     | 15769/37963 [67:34:46<88:30:44, 14.36s/it]
 42%|████▏     | 15770/37963 [67:35:01<88:34:08, 14.37s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '2.47', 'learning_rate': '1.317e-05', 'epoch': '0.4154'}

 42%|████▏     | 15770/37963 [67:35:01<88:34:08, 14.37s/it]
 42%|████▏     | 15771/37963 [67:35:15<88:53:28, 14.42s/it]
 42%|████▏     | 15772/37963 [67:35:30<88:47:57, 14.41s/it]
 42%|████▏     | 15773/37963 [67:35:51<101:23:19, 16.45s/it]
 42%|████▏     | 15774/37963 [67:36:05<97:38:33, 15.84s/it] 
 42%|████▏     | 15775/37963 [67:36:19<94:30:31, 15.33s/it]
 42%|████▏     | 15776/37963 [67:36:40<103:43:05, 16.83s/it]
 42%|████▏     | 15777/37963 [67:36:54<99:02:56, 16.07s/it] 
 42%|████▏     | 15778/37963 [67:37:08<94:51:47, 15.39s/it]
 42%|████▏     | 15779/37963 [67:37:22<92:49:51, 15.06s/it]
 42%|████▏     | 15780/37963 [67:37:37<91:49:23, 14.90s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '1.667', 'learning_rate': '1.316e-05', 'epoch': '0.4157'}

 42%|████▏     | 15780/37963 [67:37:37<91:49:23, 14.90s/it]
 42%|████▏     | 15781/37963 [67:37:51<90:34:44, 14.70s/it]
 42%|████▏     | 15782/37963 [67:38:05<89:58:28, 14.60s/it]
 42%|████▏     | 15783/37963 [67:38:20<89:24:11, 14.51s/it]
 42%|████▏     | 15784/37963 [67:38:34<88:43:50, 14.40s/it]
 42%|████▏     | 15785/37963 [67:38:48<88:37:00, 14.38s/it]
 42%|████▏     | 15786/37963 [67:39:02<88:32:48, 14.37s/it]
 42%|████▏     | 15787/37963 [67:39:17<88:37:50, 14.39s/it]
 42%|████▏     | 15788/37963 [67:39:38<100:23:18, 16.30s/it]
 42%|████▏     | 15789/37963 [67:39:52<96:52:27, 15.73s/it] 
 42%|████▏     | 15790/37963 [67:40:06<93:35:12, 15.19s/it]
                                                           
{'loss': '0.1632', 'grad_norm': '1.892', 'learning_rate': '1.315e-05', 'epoch': '0.4159'}

 42%|████▏     | 15790/37963 [67:40:06<93:35:12, 15.19s/it]
 42%|████▏     | 15791/37963 [67:40:20<92:02:25, 14.94s/it]
 42%|████▏     | 15792/37963 [67:40:35<90:38:18, 14.72s/it]
 42%|████▏     | 15793/37963 [67:40:49<89:55:52, 14.60s/it]
 42%|████▏     | 15794/37963 [67:41:03<89:40:35, 14.56s/it]
 42%|████▏     | 15795/37963 [67:41:17<88:44:23, 14.41s/it]
 42%|████▏     | 15796/37963 [67:41:32<88:14:13, 14.33s/it]
 42%|████▏     | 15797/37963 [67:41:52<100:15:22, 16.28s/it]
 42%|████▏     | 15798/37963 [67:42:07<96:29:49, 15.67s/it] 
 42%|████▏     | 15799/37963 [67:42:20<93:08:55, 15.13s/it]
 42%|████▏     | 15800/37963 [67:42:35<91:44:53, 14.90s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '1.153', 'learning_rate': '1.315e-05', 'epoch': '0.4162'}

 42%|████▏     | 15800/37963 [67:42:35<91:44:53, 14.90s/it]
 42%|████▏     | 15801/37963 [67:42:56<102:50:35, 16.71s/it]
 42%|████▏     | 15802/37963 [67:43:10<98:31:34, 16.01s/it] 
 42%|████▏     | 15803/37963 [67:43:25<95:34:43, 15.53s/it]
 42%|████▏     | 15804/37963 [67:43:39<92:45:37, 15.07s/it]
 42%|████▏     | 15805/37963 [67:43:59<103:25:39, 16.80s/it]
 42%|████▏     | 15806/37963 [67:44:20<111:03:03, 18.04s/it]
 42%|████▏     | 15807/37963 [67:44:35<104:24:35, 16.96s/it]
 42%|████▏     | 15808/37963 [67:44:55<110:48:19, 18.00s/it]
 42%|████▏     | 15809/37963 [67:45:10<104:14:32, 16.94s/it]
 42%|████▏     | 15810/37963 [67:45:24<99:37:05, 16.19s/it] 
                                                           
{'loss': '0.1466', 'grad_norm': '1.477', 'learning_rate': '1.314e-05', 'epoch': '0.4165'}

 42%|████▏     | 15810/37963 [67:45:24<99:37:05, 16.19s/it]
 42%|████▏     | 15811/37963 [67:45:38<96:15:12, 15.64s/it]
 42%|████▏     | 15812/37963 [67:45:53<93:55:02, 15.26s/it]
 42%|████▏     | 15813/37963 [67:46:07<91:55:21, 14.94s/it]
 42%|████▏     | 15814/37963 [67:46:21<90:50:48, 14.77s/it]
 42%|████▏     | 15815/37963 [67:46:36<89:45:20, 14.59s/it]
 42%|████▏     | 15816/37963 [67:46:50<88:45:54, 14.43s/it]
 42%|████▏     | 15817/37963 [67:47:04<88:31:01, 14.39s/it]
 42%|████▏     | 15818/37963 [67:47:18<88:24:56, 14.37s/it]
 42%|████▏     | 15819/37963 [67:47:33<88:22:45, 14.37s/it]
 42%|████▏     | 15820/37963 [67:47:47<87:50:09, 14.28s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '5.544', 'learning_rate': '1.313e-05', 'epoch': '0.4167'}

 42%|████▏     | 15820/37963 [67:47:47<87:50:09, 14.28s/it]
 42%|████▏     | 15821/37963 [67:48:01<88:09:08, 14.33s/it]
 42%|████▏     | 15822/37963 [67:48:23<101:12:06, 16.45s/it]
 42%|████▏     | 15823/37963 [67:48:37<97:21:48, 15.83s/it] 
 42%|████▏     | 15824/37963 [67:48:51<94:34:04, 15.38s/it]
 42%|████▏     | 15825/37963 [67:49:12<104:22:34, 16.97s/it]
 42%|████▏     | 15826/37963 [67:49:25<98:00:40, 15.94s/it] 
 42%|████▏     | 15827/37963 [67:49:40<95:09:36, 15.48s/it]
 42%|████▏     | 15828/37963 [67:49:54<93:01:25, 15.13s/it]
 42%|████▏     | 15829/37963 [67:50:08<91:18:05, 14.85s/it]
 42%|████▏     | 15830/37963 [67:50:23<90:05:08, 14.65s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '1.39', 'learning_rate': '1.312e-05', 'epoch': '0.417'}

 42%|████▏     | 15830/37963 [67:50:23<90:05:08, 14.65s/it]
 42%|████▏     | 15831/37963 [67:50:37<89:32:45, 14.57s/it]
 42%|████▏     | 15832/37963 [67:50:51<88:55:20, 14.46s/it]
 42%|████▏     | 15833/37963 [67:51:05<87:18:55, 14.20s/it]
 42%|████▏     | 15834/37963 [67:51:19<86:48:23, 14.12s/it]
 42%|████▏     | 15835/37963 [67:51:33<86:41:39, 14.10s/it]
 42%|████▏     | 15836/37963 [67:51:47<87:04:06, 14.17s/it]
 42%|████▏     | 15837/37963 [67:52:01<87:32:08, 14.24s/it]
 42%|████▏     | 15838/37963 [67:52:23<100:08:58, 16.30s/it]
 42%|████▏     | 15839/37963 [67:52:37<96:42:30, 15.74s/it] 
 42%|████▏     | 15840/37963 [67:52:51<93:05:36, 15.15s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '1.514', 'learning_rate': '1.311e-05', 'epoch': '0.4172'}

 42%|████▏     | 15840/37963 [67:52:51<93:05:36, 15.15s/it]
 42%|████▏     | 15841/37963 [67:53:05<91:04:05, 14.82s/it]
 42%|████▏     | 15842/37963 [67:53:19<90:15:06, 14.69s/it]
 42%|████▏     | 15843/37963 [67:53:34<89:38:09, 14.59s/it]
 42%|████▏     | 15844/37963 [67:53:48<89:09:48, 14.51s/it]
 42%|████▏     | 15845/37963 [67:54:09<100:45:57, 16.40s/it]
 42%|████▏     | 15846/37963 [67:54:23<97:03:32, 15.80s/it] 
 42%|████▏     | 15847/37963 [67:54:37<93:43:45, 15.26s/it]
 42%|████▏     | 15848/37963 [67:54:51<92:05:28, 14.99s/it]
 42%|████▏     | 15849/37963 [67:55:05<89:07:29, 14.51s/it]
 42%|████▏     | 15850/37963 [67:55:25<100:02:50, 16.29s/it]
                                                            
{'loss': '0.1358', 'grad_norm': '2.348', 'learning_rate': '1.311e-05', 'epoch': '0.4175'}

 42%|████▏     | 15850/37963 [67:55:25<100:02:50, 16.29s/it]
 42%|████▏     | 15851/37963 [67:55:39<96:12:28, 15.66s/it] 
 42%|████▏     | 15852/37963 [67:56:00<105:13:51, 17.13s/it]
 42%|████▏     | 15853/37963 [67:56:14<100:10:53, 16.31s/it]
 42%|████▏     | 15854/37963 [67:56:29<96:12:23, 15.67s/it] 
 42%|████▏     | 15855/37963 [67:56:51<107:43:28, 17.54s/it]
 42%|████▏     | 15856/37963 [67:57:05<101:50:09, 16.58s/it]
 42%|████▏     | 15857/37963 [67:57:26<109:35:55, 17.85s/it]
 42%|████▏     | 15858/37963 [67:57:40<103:08:31, 16.80s/it]
 42%|████▏     | 15859/37963 [67:57:54<98:36:02, 16.06s/it] 
 42%|████▏     | 15860/37963 [67:58:09<95:54:51, 15.62s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '1.568', 'learning_rate': '1.31e-05', 'epoch': '0.4178'}

 42%|████▏     | 15860/37963 [67:58:09<95:54:51, 15.62s/it]
 42%|████▏     | 15861/37963 [67:58:23<93:01:04, 15.15s/it]
 42%|████▏     | 15862/37963 [67:58:37<91:24:09, 14.89s/it]
 42%|████▏     | 15863/37963 [67:58:52<90:21:06, 14.72s/it]
 42%|████▏     | 15864/37963 [67:59:06<89:44:58, 14.62s/it]
 42%|████▏     | 15865/37963 [67:59:20<88:10:32, 14.36s/it]
 42%|████▏     | 15866/37963 [67:59:34<88:15:11, 14.38s/it]
 42%|████▏     | 15867/37963 [67:59:49<88:17:56, 14.39s/it]
 42%|████▏     | 15868/37963 [68:00:02<86:46:28, 14.14s/it]
 42%|████▏     | 15869/37963 [68:00:16<87:11:36, 14.21s/it]
 42%|████▏     | 15870/37963 [68:00:31<86:59:16, 14.17s/it]
                                                           
{'loss': '0.1486', 'grad_norm': '5.558', 'learning_rate': '1.309e-05', 'epoch': '0.418'}

 42%|████▏     | 15870/37963 [68:00:31<86:59:16, 14.17s/it]
 42%|████▏     | 15871/37963 [68:00:51<99:13:34, 16.17s/it]
 42%|████▏     | 15872/37963 [68:01:06<95:58:39, 15.64s/it]
 42%|████▏     | 15873/37963 [68:01:20<93:35:15, 15.25s/it]
 42%|████▏     | 15874/37963 [68:01:34<91:49:32, 14.97s/it]
 42%|████▏     | 15875/37963 [68:01:55<102:08:09, 16.65s/it]
 42%|████▏     | 15876/37963 [68:02:09<97:46:13, 15.94s/it] 
 42%|████▏     | 15877/37963 [68:02:24<94:45:56, 15.45s/it]
 42%|████▏     | 15878/37963 [68:02:38<92:51:47, 15.14s/it]
 42%|████▏     | 15879/37963 [68:02:52<91:33:59, 14.93s/it]
 42%|████▏     | 15880/37963 [68:03:07<90:43:33, 14.79s/it]
                                                           
{'loss': '0.1524', 'grad_norm': '1.772', 'learning_rate': '1.308e-05', 'epoch': '0.4183'}

 42%|████▏     | 15880/37963 [68:03:07<90:43:33, 14.79s/it]
 42%|████▏     | 15881/37963 [68:03:21<90:04:21, 14.68s/it]
 42%|████▏     | 15882/37963 [68:03:36<89:20:43, 14.57s/it]
 42%|████▏     | 15883/37963 [68:03:50<89:00:07, 14.51s/it]
 42%|████▏     | 15884/37963 [68:04:04<88:45:10, 14.47s/it]
 42%|████▏     | 15885/37963 [68:04:18<87:24:50, 14.25s/it]
 42%|████▏     | 15886/37963 [68:04:33<87:45:41, 14.31s/it]
 42%|████▏     | 15887/37963 [68:04:53<98:34:03, 16.07s/it]
 42%|████▏     | 15888/37963 [68:05:07<95:26:50, 15.57s/it]
 42%|████▏     | 15889/37963 [68:05:22<93:17:16, 15.21s/it]
 42%|████▏     | 15890/37963 [68:05:36<91:57:44, 15.00s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '1.523', 'learning_rate': '1.307e-05', 'epoch': '0.4186'}

 42%|████▏     | 15890/37963 [68:05:36<91:57:44, 15.00s/it]
 42%|████▏     | 15891/37963 [68:05:50<90:42:21, 14.79s/it]
 42%|████▏     | 15892/37963 [68:06:11<101:54:41, 16.62s/it]
 42%|████▏     | 15893/37963 [68:06:26<97:57:46, 15.98s/it] 
 42%|████▏     | 15894/37963 [68:06:40<94:55:19, 15.48s/it]
 42%|████▏     | 15895/37963 [68:06:54<92:46:22, 15.13s/it]
 42%|████▏     | 15896/37963 [68:07:08<90:19:07, 14.73s/it]
 42%|████▏     | 15897/37963 [68:07:22<89:12:07, 14.55s/it]
 42%|████▏     | 15898/37963 [68:07:43<100:05:30, 16.33s/it]
 42%|████▏     | 15899/37963 [68:07:57<95:19:50, 15.55s/it] 
 42%|████▏     | 15900/37963 [68:08:17<104:12:05, 17.00s/it]
                                                            
{'loss': '0.1638', 'grad_norm': '4.544', 'learning_rate': '1.307e-05', 'epoch': '0.4188'}

 42%|████▏     | 15900/37963 [68:08:17<104:12:05, 17.00s/it]
 42%|████▏     | 15901/37963 [68:08:31<99:19:30, 16.21s/it] 
 42%|████▏     | 15902/37963 [68:08:46<95:54:13, 15.65s/it]
 42%|████▏     | 15903/37963 [68:09:07<106:00:19, 17.30s/it]
 42%|████▏     | 15904/37963 [68:09:21<100:43:29, 16.44s/it]
 42%|████▏     | 15905/37963 [68:09:35<95:16:21, 15.55s/it] 
 42%|████▏     | 15906/37963 [68:09:55<103:44:05, 16.93s/it]
 42%|████▏     | 15907/37963 [68:10:09<98:41:00, 16.11s/it] 
 42%|████▏     | 15908/37963 [68:10:23<95:35:54, 15.60s/it]
 42%|████▏     | 15909/37963 [68:10:38<93:18:34, 15.23s/it]
 42%|████▏     | 15910/37963 [68:10:52<91:38:53, 14.96s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '1.151', 'learning_rate': '1.306e-05', 'epoch': '0.4191'}

 42%|████▏     | 15910/37963 [68:10:52<91:38:53, 14.96s/it]
 42%|████▏     | 15911/37963 [68:11:06<89:57:55, 14.69s/it]
 42%|████▏     | 15912/37963 [68:11:21<89:18:43, 14.58s/it]
 42%|████▏     | 15913/37963 [68:11:35<88:47:58, 14.50s/it]
 42%|████▏     | 15914/37963 [68:11:49<87:33:33, 14.30s/it]
 42%|████▏     | 15915/37963 [68:12:03<87:35:20, 14.30s/it]
 42%|████▏     | 15916/37963 [68:12:17<87:54:12, 14.35s/it]
 42%|████▏     | 15917/37963 [68:12:32<87:30:06, 14.29s/it]
 42%|████▏     | 15918/37963 [68:12:46<87:37:30, 14.31s/it]
 42%|████▏     | 15919/37963 [68:13:06<98:55:47, 16.16s/it]
 42%|████▏     | 15920/37963 [68:13:20<94:46:55, 15.48s/it]
                                                           
{'loss': '0.1488', 'grad_norm': '1.712', 'learning_rate': '1.305e-05', 'epoch': '0.4194'}

 42%|████▏     | 15920/37963 [68:13:20<94:46:55, 15.48s/it]
 42%|████▏     | 15921/37963 [68:13:35<92:46:25, 15.15s/it]
 42%|████▏     | 15922/37963 [68:13:49<91:20:16, 14.92s/it]
 42%|████▏     | 15923/37963 [68:14:10<102:00:58, 16.66s/it]
 42%|████▏     | 15924/37963 [68:14:24<96:48:03, 15.81s/it] 
 42%|████▏     | 15925/37963 [68:14:38<94:09:28, 15.38s/it]
 42%|████▏     | 15926/37963 [68:14:52<92:09:17, 15.05s/it]
 42%|████▏     | 15927/37963 [68:15:07<90:48:56, 14.84s/it]
 42%|████▏     | 15928/37963 [68:15:20<89:01:07, 14.54s/it]
 42%|████▏     | 15929/37963 [68:15:35<88:41:21, 14.49s/it]
 42%|████▏     | 15930/37963 [68:15:49<88:31:48, 14.47s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '1.867', 'learning_rate': '1.304e-05', 'epoch': '0.4196'}

 42%|████▏     | 15930/37963 [68:15:49<88:31:48, 14.47s/it]
 42%|████▏     | 15931/37963 [68:16:04<88:19:27, 14.43s/it]
 42%|████▏     | 15932/37963 [68:16:18<88:07:13, 14.40s/it]
 42%|████▏     | 15933/37963 [68:16:32<87:57:00, 14.37s/it]
 42%|████▏     | 15934/37963 [68:16:47<88:04:37, 14.39s/it]
 42%|████▏     | 15935/37963 [68:17:01<88:21:17, 14.44s/it]
 42%|████▏     | 15936/37963 [68:17:22<100:08:53, 16.37s/it]
 42%|████▏     | 15937/37963 [68:17:36<96:20:18, 15.75s/it] 
 42%|████▏     | 15938/37963 [68:17:51<93:57:38, 15.36s/it]
 42%|████▏     | 15939/37963 [68:18:05<91:28:16, 14.95s/it]
 42%|████▏     | 15940/37963 [68:18:19<90:00:03, 14.71s/it]
                                                           
{'loss': '0.148', 'grad_norm': '1.992', 'learning_rate': '1.303e-05', 'epoch': '0.4199'}

 42%|████▏     | 15940/37963 [68:18:19<90:00:03, 14.71s/it]
 42%|████▏     | 15941/37963 [68:18:33<88:59:51, 14.55s/it]
 42%|████▏     | 15942/37963 [68:18:54<101:00:40, 16.51s/it]
 42%|████▏     | 15943/37963 [68:19:08<96:07:30, 15.72s/it] 
 42%|████▏     | 15944/37963 [68:19:22<93:29:46, 15.29s/it]
 42%|████▏     | 15945/37963 [68:19:42<102:15:27, 16.72s/it]
 42%|████▏     | 15946/37963 [68:20:03<108:34:52, 17.75s/it]
 42%|████▏     | 15947/37963 [68:20:17<102:15:10, 16.72s/it]
 42%|████▏     | 15948/37963 [68:20:31<97:11:50, 15.89s/it] 
 42%|████▏     | 15949/37963 [68:20:45<93:25:42, 15.28s/it]
 42%|████▏     | 15950/37963 [68:20:58<89:51:09, 14.69s/it]
                                                           
{'loss': '0.1451', 'grad_norm': '1.801', 'learning_rate': '1.302e-05', 'epoch': '0.4201'}

 42%|████▏     | 15950/37963 [68:20:58<89:51:09, 14.69s/it]
 42%|████▏     | 15951/37963 [68:21:12<89:06:49, 14.57s/it]
 42%|████▏     | 15952/37963 [68:21:33<101:02:24, 16.53s/it]
 42%|████▏     | 15953/37963 [68:21:47<95:29:45, 15.62s/it] 
 42%|████▏     | 15954/37963 [68:22:08<105:12:43, 17.21s/it]
 42%|████▏     | 15955/37963 [68:22:22<99:35:27, 16.29s/it] 
 42%|████▏     | 15956/37963 [68:22:36<96:05:20, 15.72s/it]
 42%|████▏     | 15957/37963 [68:22:51<93:34:22, 15.31s/it]
 42%|████▏     | 15958/37963 [68:23:05<91:32:08, 14.98s/it]
 42%|████▏     | 15959/37963 [68:23:19<90:36:48, 14.82s/it]
 42%|████▏     | 15960/37963 [68:23:34<89:44:06, 14.68s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '1.32', 'learning_rate': '1.302e-05', 'epoch': '0.4204'}

 42%|████▏     | 15960/37963 [68:23:34<89:44:06, 14.68s/it]
 42%|████▏     | 15961/37963 [68:23:48<89:05:20, 14.58s/it]
 42%|████▏     | 15962/37963 [68:24:03<88:45:52, 14.52s/it]
 42%|████▏     | 15963/37963 [68:24:17<88:34:13, 14.49s/it]
 42%|████▏     | 15964/37963 [68:24:31<88:15:36, 14.44s/it]
 42%|████▏     | 15965/37963 [68:24:46<88:08:24, 14.42s/it]
 42%|████▏     | 15966/37963 [68:25:00<87:39:03, 14.34s/it]
 42%|████▏     | 15967/37963 [68:25:14<87:39:23, 14.35s/it]
 42%|████▏     | 15968/37963 [68:25:35<99:54:32, 16.35s/it]
 42%|████▏     | 15969/37963 [68:25:50<96:17:22, 15.76s/it]
 42%|████▏     | 15970/37963 [68:26:04<93:45:53, 15.35s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '1.767', 'learning_rate': '1.301e-05', 'epoch': '0.4207'}

 42%|████▏     | 15970/37963 [68:26:04<93:45:53, 15.35s/it]
 42%|████▏     | 15971/37963 [68:26:18<91:53:49, 15.04s/it]
 42%|████▏     | 15972/37963 [68:26:39<102:16:20, 16.74s/it]
 42%|████▏     | 15973/37963 [68:26:53<98:06:20, 16.06s/it] 
 42%|████▏     | 15974/37963 [68:27:08<95:11:10, 15.58s/it]
 42%|████▏     | 15975/37963 [68:27:22<93:01:21, 15.23s/it]
 42%|████▏     | 15976/37963 [68:27:37<91:27:45, 14.98s/it]
 42%|████▏     | 15977/37963 [68:27:51<90:12:09, 14.77s/it]
 42%|████▏     | 15978/37963 [68:28:05<88:13:30, 14.45s/it]
 42%|████▏     | 15979/37963 [68:28:19<87:24:05, 14.31s/it]
 42%|████▏     | 15980/37963 [68:28:33<87:24:53, 14.32s/it]
                                                           
{'loss': '0.158', 'grad_norm': '3.241', 'learning_rate': '1.3e-05', 'epoch': '0.4209'}

 42%|████▏     | 15980/37963 [68:28:33<87:24:53, 14.32s/it]
 42%|████▏     | 15981/37963 [68:28:54<99:08:46, 16.24s/it]
 42%|████▏     | 15982/37963 [68:29:08<95:42:05, 15.67s/it]
 42%|████▏     | 15983/37963 [68:29:22<93:13:38, 15.27s/it]
 42%|████▏     | 15984/37963 [68:29:37<91:30:39, 14.99s/it]
 42%|████▏     | 15985/37963 [68:29:51<90:20:34, 14.80s/it]
 42%|████▏     | 15986/37963 [68:30:06<89:40:51, 14.69s/it]
 42%|████▏     | 15987/37963 [68:30:20<88:30:20, 14.50s/it]
 42%|████▏     | 15988/37963 [68:30:33<86:38:13, 14.19s/it]
 42%|████▏     | 15989/37963 [68:30:54<98:47:26, 16.18s/it]
 42%|████▏     | 15990/37963 [68:31:08<94:34:14, 15.49s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '2.713', 'learning_rate': '1.299e-05', 'epoch': '0.4212'}

 42%|████▏     | 15990/37963 [68:31:08<94:34:14, 15.49s/it]
 42%|████▏     | 15991/37963 [68:31:22<92:32:57, 15.16s/it]
 42%|████▏     | 15992/37963 [68:31:37<91:05:38, 14.93s/it]
 42%|████▏     | 15993/37963 [68:31:58<102:27:32, 16.79s/it]
 42%|████▏     | 15994/37963 [68:32:12<97:54:57, 16.05s/it] 
 42%|████▏     | 15995/37963 [68:32:26<94:59:53, 15.57s/it]
 42%|████▏     | 15996/37963 [68:32:47<104:32:40, 17.13s/it]
 42%|████▏     | 15997/37963 [68:33:01<98:51:13, 16.20s/it] 
 42%|████▏     | 15998/37963 [68:33:15<94:33:36, 15.50s/it]
 42%|████▏     | 15999/37963 [68:33:30<92:46:22, 15.21s/it]
 42%|████▏     | 16000/37963 [68:33:50<102:56:35, 16.87s/it]
                                                            
{'loss': '0.1497', 'grad_norm': '1.589', 'learning_rate': '1.298e-05', 'epoch': '0.4215'}

 42%|████▏     | 16000/37963 [68:33:50<102:56:35, 16.87s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.44s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.44s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 42%|████▏     | 16001/37963 [68:35:36<264:48:48, 43.41s/it]
 42%|████▏     | 16002/37963 [68:35:50<211:42:51, 34.71s/it]
 42%|████▏     | 16003/37963 [68:36:11<186:08:53, 30.52s/it]
 42%|████▏     | 16004/37963 [68:36:25<156:02:44, 25.58s/it]
 42%|████▏     | 16005/37963 [68:36:40<135:55:14, 22.28s/it]
 42%|████▏     | 16006/37963 [68:36:54<121:11:31, 19.87s/it]
 42%|████▏     | 16007/37963 [68:37:08<110:59:08, 18.20s/it]
 42%|████▏     | 16008/37963 [68:37:22<103:57:18, 17.05s/it]
 42%|████▏     | 16009/37963 [68:37:37<99:00:19, 16.23s/it] 
 42%|████▏     | 16010/37963 [68:37:50<93:44:45, 15.37s/it]
                                                           
{'loss': '0.15', 'grad_norm': '1.732', 'learning_rate': '1.298e-05', 'epoch': '0.4217'}

 42%|████▏     | 16010/37963 [68:37:50<93:44:45, 15.37s/it]
 42%|████▏     | 16011/37963 [68:38:05<91:53:00, 15.07s/it]
 42%|████▏     | 16012/37963 [68:38:19<90:28:49, 14.84s/it]
 42%|████▏     | 16013/37963 [68:38:33<89:34:59, 14.69s/it]
 42%|████▏     | 16014/37963 [68:38:47<88:38:11, 14.54s/it]
 42%|████▏     | 16015/37963 [68:39:02<87:58:59, 14.43s/it]
 42%|████▏     | 16016/37963 [68:39:16<87:51:42, 14.41s/it]
 42%|████▏     | 16017/37963 [68:39:30<87:35:26, 14.37s/it]
 42%|████▏     | 16018/37963 [68:39:51<99:39:06, 16.35s/it]
 42%|████▏     | 16019/37963 [68:40:05<95:37:14, 15.69s/it]
 42%|████▏     | 16020/37963 [68:40:19<91:57:43, 15.09s/it]
                                                           
{'loss': '0.136', 'grad_norm': '4.042', 'learning_rate': '1.297e-05', 'epoch': '0.422'}

 42%|████▏     | 16020/37963 [68:40:19<91:57:43, 15.09s/it]
 42%|████▏     | 16021/37963 [68:40:39<100:59:40, 16.57s/it]
 42%|████▏     | 16022/37963 [68:40:53<96:57:37, 15.91s/it] 
 42%|████▏     | 16023/37963 [68:41:08<94:04:59, 15.44s/it]
 42%|████▏     | 16024/37963 [68:41:22<92:03:34, 15.11s/it]
 42%|████▏     | 16025/37963 [68:41:36<89:26:32, 14.68s/it]
 42%|████▏     | 16026/37963 [68:41:50<88:46:36, 14.57s/it]
 42%|████▏     | 16027/37963 [68:42:04<88:24:21, 14.51s/it]
 42%|████▏     | 16028/37963 [68:42:19<88:03:35, 14.45s/it]
 42%|████▏     | 16029/37963 [68:42:39<99:18:13, 16.30s/it]
 42%|████▏     | 16030/37963 [68:42:54<95:48:31, 15.73s/it]
                                                           
{'loss': '0.135', 'grad_norm': '2.215', 'learning_rate': '1.296e-05', 'epoch': '0.4223'}

 42%|████▏     | 16030/37963 [68:42:54<95:48:31, 15.73s/it]
 42%|████▏     | 16031/37963 [68:43:08<93:21:36, 15.32s/it]
 42%|████▏     | 16032/37963 [68:43:22<91:30:06, 15.02s/it]
 42%|████▏     | 16033/37963 [68:43:37<89:58:00, 14.77s/it]
 42%|████▏     | 16034/37963 [68:43:51<89:15:23, 14.65s/it]
 42%|████▏     | 16035/37963 [68:44:05<88:49:14, 14.58s/it]
 42%|████▏     | 16036/37963 [68:44:20<88:15:27, 14.49s/it]
 42%|████▏     | 16037/37963 [68:44:34<87:51:22, 14.42s/it]
 42%|████▏     | 16038/37963 [68:44:55<99:36:46, 16.36s/it]
 42%|████▏     | 16039/37963 [68:45:09<95:59:27, 15.76s/it]
 42%|████▏     | 16040/37963 [68:45:24<93:41:54, 15.39s/it]
                                                           
{'loss': '0.1443', 'grad_norm': '2.843', 'learning_rate': '1.295e-05', 'epoch': '0.4225'}

 42%|████▏     | 16040/37963 [68:45:24<93:41:54, 15.39s/it]
 42%|████▏     | 16041/37963 [68:45:38<91:57:10, 15.10s/it]
 42%|████▏     | 16042/37963 [68:45:53<90:39:40, 14.89s/it]
 42%|████▏     | 16043/37963 [68:46:14<102:25:22, 16.82s/it]
 42%|████▏     | 16044/37963 [68:46:35<109:40:49, 18.01s/it]
 42%|████▏     | 16045/37963 [68:46:49<102:59:40, 16.92s/it]
 42%|████▏     | 16046/37963 [68:47:10<111:00:02, 18.23s/it]
 42%|████▏     | 16047/37963 [68:47:25<103:58:35, 17.08s/it]
 42%|████▏     | 16048/37963 [68:47:45<109:51:54, 18.05s/it]
 42%|████▏     | 16049/37963 [68:47:59<103:07:19, 16.94s/it]
 42%|████▏     | 16050/37963 [68:48:14<98:15:08, 16.14s/it] 
                                                           
{'loss': '0.1598', 'grad_norm': '1.48', 'learning_rate': '1.294e-05', 'epoch': '0.4228'}

 42%|████▏     | 16050/37963 [68:48:14<98:15:08, 16.14s/it]
 42%|████▏     | 16051/37963 [68:48:28<94:37:24, 15.55s/it]
 42%|████▏     | 16052/37963 [68:48:42<92:06:23, 15.13s/it]
 42%|████▏     | 16053/37963 [68:48:56<90:31:15, 14.87s/it]
 42%|████▏     | 16054/37963 [68:49:11<89:40:39, 14.74s/it]
 42%|████▏     | 16055/37963 [68:49:25<88:58:59, 14.62s/it]
 42%|████▏     | 16056/37963 [68:49:39<88:18:31, 14.51s/it]
 42%|████▏     | 16057/37963 [68:49:54<87:52:52, 14.44s/it]
 42%|████▏     | 16058/37963 [68:50:07<86:26:06, 14.21s/it]
 42%|████▏     | 16059/37963 [68:50:22<86:39:37, 14.24s/it]
 42%|████▏     | 16060/37963 [68:50:35<86:09:52, 14.16s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '0.9206', 'learning_rate': '1.294e-05', 'epoch': '0.423'}

 42%|████▏     | 16060/37963 [68:50:35<86:09:52, 14.16s/it]
 42%|████▏     | 16061/37963 [68:50:50<86:06:24, 14.15s/it]
 42%|████▏     | 16062/37963 [68:51:04<86:30:39, 14.22s/it]
 42%|████▏     | 16063/37963 [68:51:18<86:58:47, 14.30s/it]
 42%|████▏     | 16064/37963 [68:51:33<87:06:11, 14.32s/it]
 42%|████▏     | 16065/37963 [68:51:47<87:06:37, 14.32s/it]
 42%|████▏     | 16066/37963 [68:52:01<86:45:08, 14.26s/it]
 42%|████▏     | 16067/37963 [68:52:16<86:52:13, 14.28s/it]
 42%|████▏     | 16068/37963 [68:52:37<99:39:20, 16.39s/it]
 42%|████▏     | 16069/37963 [68:52:57<107:15:08, 17.64s/it]
 42%|████▏     | 16070/37963 [68:53:12<101:14:24, 16.65s/it]
                                                            
{'loss': '0.1442', 'grad_norm': '3.477', 'learning_rate': '1.293e-05', 'epoch': '0.4233'}

 42%|████▏     | 16070/37963 [68:53:12<101:14:24, 16.65s/it]
 42%|████▏     | 16071/37963 [68:53:26<97:11:47, 15.98s/it] 
 42%|████▏     | 16072/37963 [68:53:41<94:06:44, 15.48s/it]
 42%|████▏     | 16073/37963 [68:53:54<91:11:44, 15.00s/it]
 42%|████▏     | 16074/37963 [68:54:09<89:53:42, 14.78s/it]
 42%|████▏     | 16075/37963 [68:54:23<89:01:28, 14.64s/it]
 42%|████▏     | 16076/37963 [68:54:37<88:35:41, 14.57s/it]
 42%|████▏     | 16077/37963 [68:54:52<88:04:46, 14.49s/it]
 42%|████▏     | 16078/37963 [68:55:12<99:29:04, 16.36s/it]
 42%|████▏     | 16079/37963 [68:55:27<95:46:58, 15.76s/it]
 42%|████▏     | 16080/37963 [68:55:41<92:58:18, 15.29s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '1.847', 'learning_rate': '1.292e-05', 'epoch': '0.4236'}

 42%|████▏     | 16080/37963 [68:55:41<92:58:18, 15.29s/it]
 42%|████▏     | 16081/37963 [68:55:55<90:17:51, 14.86s/it]
 42%|████▏     | 16082/37963 [68:56:09<89:19:08, 14.70s/it]
 42%|████▏     | 16083/37963 [68:56:23<88:26:17, 14.55s/it]
 42%|████▏     | 16084/37963 [68:56:38<88:02:20, 14.49s/it]
 42%|████▏     | 16085/37963 [68:56:52<87:45:44, 14.44s/it]
 42%|████▏     | 16086/37963 [68:57:06<87:32:04, 14.40s/it]
 42%|████▏     | 16087/37963 [68:57:21<87:20:45, 14.37s/it]
 42%|████▏     | 16088/37963 [68:57:41<98:28:04, 16.20s/it]
 42%|████▏     | 16089/37963 [68:57:55<95:00:37, 15.64s/it]
 42%|████▏     | 16090/37963 [68:58:09<92:03:47, 15.15s/it]
                                                           
{'loss': '0.163', 'grad_norm': '2.011', 'learning_rate': '1.291e-05', 'epoch': '0.4238'}

 42%|████▏     | 16090/37963 [68:58:09<92:03:47, 15.15s/it]
 42%|████▏     | 16091/37963 [68:58:31<102:52:58, 16.93s/it]
 42%|████▏     | 16092/37963 [68:58:45<98:08:09, 16.15s/it] 
 42%|████▏     | 16093/37963 [68:58:59<94:50:48, 15.61s/it]
 42%|████▏     | 16094/37963 [68:59:26<115:02:20, 18.94s/it]
 42%|████▏     | 16095/37963 [68:59:40<106:44:44, 17.57s/it]
 42%|████▏     | 16096/37963 [68:59:55<101:00:15, 16.63s/it]
 42%|████▏     | 16097/37963 [69:00:09<96:54:02, 15.95s/it] 
 42%|████▏     | 16098/37963 [69:00:24<93:59:28, 15.48s/it]
 42%|████▏     | 16099/37963 [69:00:45<104:05:18, 17.14s/it]
 42%|████▏     | 16100/37963 [69:00:59<99:05:10, 16.32s/it] 
                                                           
{'loss': '0.1483', 'grad_norm': '1.293', 'learning_rate': '1.29e-05', 'epoch': '0.4241'}

 42%|████▏     | 16100/37963 [69:00:59<99:05:10, 16.32s/it]
 42%|████▏     | 16101/37963 [69:01:12<94:00:17, 15.48s/it]
 42%|████▏     | 16102/37963 [69:01:27<91:57:36, 15.14s/it]
 42%|████▏     | 16103/37963 [69:01:41<90:33:31, 14.91s/it]
 42%|████▏     | 16104/37963 [69:01:55<89:25:41, 14.73s/it]
 42%|████▏     | 16105/37963 [69:02:10<88:49:56, 14.63s/it]
 42%|████▏     | 16106/37963 [69:02:24<88:10:40, 14.52s/it]
 42%|████▏     | 16107/37963 [69:02:38<87:49:54, 14.47s/it]
 42%|████▏     | 16108/37963 [69:02:52<85:59:57, 14.17s/it]
 42%|████▏     | 16109/37963 [69:03:07<86:46:15, 14.29s/it]
 42%|████▏     | 16110/37963 [69:03:20<86:02:28, 14.17s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '1.041', 'learning_rate': '1.289e-05', 'epoch': '0.4244'}

 42%|████▏     | 16110/37963 [69:03:20<86:02:28, 14.17s/it]
 42%|████▏     | 16111/37963 [69:03:35<86:22:22, 14.23s/it]
 42%|████▏     | 16112/37963 [69:03:49<86:43:11, 14.29s/it]
 42%|████▏     | 16113/37963 [69:04:03<86:32:58, 14.26s/it]
 42%|████▏     | 16114/37963 [69:04:18<86:54:12, 14.32s/it]
 42%|████▏     | 16115/37963 [69:04:32<86:51:49, 14.31s/it]
 42%|████▏     | 16116/37963 [69:04:47<86:53:57, 14.32s/it]
 42%|████▏     | 16117/37963 [69:05:01<87:06:07, 14.35s/it]
 42%|████▏     | 16118/37963 [69:05:29<111:58:12, 18.45s/it]
 42%|████▏     | 16119/37963 [69:05:43<104:32:31, 17.23s/it]
 42%|████▏     | 16120/37963 [69:05:58<99:16:47, 16.36s/it] 
                                                           
{'loss': '0.155', 'grad_norm': '1.357', 'learning_rate': '1.289e-05', 'epoch': '0.4246'}

 42%|████▏     | 16120/37963 [69:05:58<99:16:47, 16.36s/it]
 42%|████▏     | 16121/37963 [69:06:12<95:43:54, 15.78s/it]
 42%|████▏     | 16122/37963 [69:06:26<93:05:12, 15.34s/it]
 42%|████▏     | 16123/37963 [69:06:41<91:26:23, 15.07s/it]
 42%|████▏     | 16124/37963 [69:07:01<100:22:34, 16.55s/it]
 42%|████▏     | 16125/37963 [69:07:15<95:48:54, 15.80s/it] 
 42%|████▏     | 16126/37963 [69:07:29<92:00:39, 15.17s/it]
 42%|████▏     | 16127/37963 [69:07:43<90:34:23, 14.93s/it]
 42%|████▏     | 16128/37963 [69:07:57<89:28:20, 14.75s/it]
 42%|████▏     | 16129/37963 [69:08:12<88:41:46, 14.62s/it]
 42%|████▏     | 16130/37963 [69:08:26<87:28:07, 14.42s/it]
                                                           
{'loss': '0.1599', 'grad_norm': '2.389', 'learning_rate': '1.288e-05', 'epoch': '0.4249'}

 42%|████▏     | 16130/37963 [69:08:26<87:28:07, 14.42s/it]
 42%|████▏     | 16131/37963 [69:08:40<87:00:26, 14.35s/it]
 42%|████▏     | 16132/37963 [69:08:54<86:27:24, 14.26s/it]
 42%|████▏     | 16133/37963 [69:09:08<86:37:33, 14.29s/it]
 42%|████▏     | 16134/37963 [69:09:29<98:39:20, 16.27s/it]
 43%|████▎     | 16135/37963 [69:09:43<95:05:24, 15.68s/it]
 43%|████▎     | 16136/37963 [69:09:58<92:29:26, 15.25s/it]
 43%|████▎     | 16137/37963 [69:10:12<90:36:11, 14.94s/it]
 43%|████▎     | 16138/37963 [69:10:26<89:27:14, 14.76s/it]
 43%|████▎     | 16139/37963 [69:10:41<89:08:37, 14.70s/it]
 43%|████▎     | 16140/37963 [69:10:55<88:02:10, 14.52s/it]
                                                           
{'loss': '0.1587', 'grad_norm': '2.754', 'learning_rate': '1.287e-05', 'epoch': '0.4252'}

 43%|████▎     | 16140/37963 [69:10:55<88:02:10, 14.52s/it]
 43%|████▎     | 16141/37963 [69:11:09<87:37:21, 14.46s/it]
 43%|████▎     | 16142/37963 [69:11:37<112:41:12, 18.59s/it]
 43%|████▎     | 16143/37963 [69:11:52<104:55:56, 17.31s/it]
 43%|████▎     | 16144/37963 [69:12:13<111:45:14, 18.44s/it]
 43%|████▎     | 16145/37963 [69:12:27<103:26:59, 17.07s/it]
 43%|████▎     | 16146/37963 [69:12:41<98:28:21, 16.25s/it] 
 43%|████▎     | 16147/37963 [69:13:02<106:14:17, 17.53s/it]
 43%|████▎     | 16148/37963 [69:13:16<100:35:48, 16.60s/it]
 43%|████▎     | 16149/37963 [69:13:30<96:34:49, 15.94s/it] 
 43%|████▎     | 16150/37963 [69:13:45<93:39:56, 15.46s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '3.789', 'learning_rate': '1.286e-05', 'epoch': '0.4254'}

 43%|████▎     | 16150/37963 [69:13:45<93:39:56, 15.46s/it]
 43%|████▎     | 16151/37963 [69:13:59<91:50:50, 15.16s/it]
 43%|████▎     | 16152/37963 [69:14:13<90:09:07, 14.88s/it]
 43%|████▎     | 16153/37963 [69:14:28<89:09:51, 14.72s/it]
 43%|████▎     | 16154/37963 [69:14:42<88:21:00, 14.58s/it]
 43%|████▎     | 16155/37963 [69:14:57<88:19:51, 14.58s/it]
 43%|████▎     | 16156/37963 [69:15:11<87:54:10, 14.51s/it]
 43%|████▎     | 16157/37963 [69:15:25<87:38:05, 14.47s/it]
 43%|████▎     | 16158/37963 [69:15:40<87:26:40, 14.44s/it]
 43%|████▎     | 16159/37963 [69:15:54<87:17:25, 14.41s/it]
 43%|████▎     | 16160/37963 [69:16:08<87:12:51, 14.40s/it]
                                                           
{'loss': '0.1691', 'grad_norm': '1.695', 'learning_rate': '1.285e-05', 'epoch': '0.4257'}

 43%|████▎     | 16160/37963 [69:16:08<87:12:51, 14.40s/it]
 43%|████▎     | 16161/37963 [69:16:23<86:49:42, 14.34s/it]
 43%|████▎     | 16162/37963 [69:16:37<86:12:00, 14.23s/it]
 43%|████▎     | 16163/37963 [69:16:51<85:45:07, 14.16s/it]
 43%|████▎     | 16164/37963 [69:17:05<86:07:15, 14.22s/it]
 43%|████▎     | 16165/37963 [69:17:19<86:42:37, 14.32s/it]
 43%|████▎     | 16166/37963 [69:17:40<98:07:58, 16.21s/it]
 43%|████▎     | 16167/37963 [69:17:54<94:08:32, 15.55s/it]
 43%|████▎     | 16168/37963 [69:18:15<104:42:43, 17.30s/it]
 43%|████▎     | 16169/37963 [69:18:30<99:32:25, 16.44s/it] 
 43%|████▎     | 16170/37963 [69:18:44<95:45:18, 15.82s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '1.327', 'learning_rate': '1.285e-05', 'epoch': '0.4259'}

 43%|████▎     | 16170/37963 [69:18:44<95:45:18, 15.82s/it]
 43%|████▎     | 16171/37963 [69:18:59<93:23:20, 15.43s/it]
 43%|████▎     | 16172/37963 [69:19:19<101:32:32, 16.78s/it]
 43%|████▎     | 16173/37963 [69:19:33<97:08:08, 16.05s/it] 
 43%|████▎     | 16174/37963 [69:19:47<93:42:18, 15.48s/it]
 43%|████▎     | 16175/37963 [69:20:01<91:30:17, 15.12s/it]
 43%|████▎     | 16176/37963 [69:20:16<90:04:52, 14.88s/it]
 43%|████▎     | 16177/37963 [69:20:30<89:01:58, 14.71s/it]
 43%|████▎     | 16178/37963 [69:20:44<88:20:47, 14.60s/it]
 43%|████▎     | 16179/37963 [69:20:59<87:50:13, 14.52s/it]
 43%|████▎     | 16180/37963 [69:21:13<86:55:57, 14.37s/it]
                                                           
{'loss': '0.1401', 'grad_norm': '0.7792', 'learning_rate': '1.284e-05', 'epoch': '0.4262'}

 43%|████▎     | 16180/37963 [69:21:13<86:55:57, 14.37s/it]
 43%|████▎     | 16181/37963 [69:21:27<86:53:03, 14.36s/it]
 43%|████▎     | 16182/37963 [69:21:42<86:54:00, 14.36s/it]
 43%|████▎     | 16183/37963 [69:22:03<99:21:26, 16.42s/it]
 43%|████▎     | 16184/37963 [69:22:17<95:33:09, 15.79s/it]
 43%|████▎     | 16185/37963 [69:22:32<93:07:49, 15.39s/it]
 43%|████▎     | 16186/37963 [69:22:46<91:19:01, 15.10s/it]
 43%|████▎     | 16187/37963 [69:23:00<90:09:16, 14.90s/it]
 43%|████▎     | 16188/37963 [69:23:15<89:09:48, 14.74s/it]
 43%|████▎     | 16189/37963 [69:23:29<87:32:07, 14.47s/it]
 43%|████▎     | 16190/37963 [69:23:50<100:17:33, 16.58s/it]
                                                            
{'loss': '0.1531', 'grad_norm': '1.682', 'learning_rate': '1.283e-05', 'epoch': '0.4265'}

 43%|████▎     | 16190/37963 [69:23:50<100:17:33, 16.58s/it]
 43%|████▎     | 16191/37963 [69:24:11<108:20:35, 17.91s/it]
 43%|████▎     | 16192/37963 [69:24:25<101:42:53, 16.82s/it]
 43%|████▎     | 16193/37963 [69:24:40<97:17:45, 16.09s/it] 
 43%|████▎     | 16194/37963 [69:25:01<105:42:42, 17.48s/it]
 43%|████▎     | 16195/37963 [69:25:22<112:11:26, 18.55s/it]
 43%|████▎     | 16196/37963 [69:25:36<104:32:01, 17.29s/it]
 43%|████▎     | 16197/37963 [69:25:50<99:10:57, 16.40s/it] 
 43%|████▎     | 16198/37963 [69:26:05<95:21:11, 15.77s/it]
 43%|████▎     | 16199/37963 [69:26:19<92:22:13, 15.28s/it]
 43%|████▎     | 16200/37963 [69:26:32<89:24:45, 14.79s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '1.673', 'learning_rate': '1.282e-05', 'epoch': '0.4267'}

 43%|████▎     | 16200/37963 [69:26:32<89:24:45, 14.79s/it]
 43%|████▎     | 16201/37963 [69:26:47<88:43:24, 14.68s/it]
 43%|████▎     | 16202/37963 [69:27:01<88:22:01, 14.62s/it]
 43%|████▎     | 16203/37963 [69:27:15<87:37:21, 14.50s/it]
 43%|████▎     | 16204/37963 [69:27:29<85:49:30, 14.20s/it]
 43%|████▎     | 16205/37963 [69:27:43<86:02:38, 14.24s/it]
 43%|████▎     | 16206/37963 [69:27:57<85:46:36, 14.19s/it]
 43%|████▎     | 16207/37963 [69:28:12<86:03:20, 14.24s/it]
 43%|████▎     | 16208/37963 [69:28:25<85:12:20, 14.10s/it]
 43%|████▎     | 16209/37963 [69:28:40<85:49:47, 14.20s/it]
 43%|████▎     | 16210/37963 [69:28:54<86:16:51, 14.28s/it]
                                                           
{'loss': '0.1541', 'grad_norm': '4.124', 'learning_rate': '1.281e-05', 'epoch': '0.427'}

 43%|████▎     | 16210/37963 [69:28:54<86:16:51, 14.28s/it]
 43%|████▎     | 16211/37963 [69:29:09<86:37:50, 14.34s/it]
 43%|████▎     | 16212/37963 [69:29:23<87:12:19, 14.43s/it]
 43%|████▎     | 16213/37963 [69:29:38<86:53:59, 14.38s/it]
 43%|████▎     | 16214/37963 [69:29:59<98:51:36, 16.36s/it]
 43%|████▎     | 16215/37963 [69:30:13<94:54:42, 15.71s/it]
 43%|████▎     | 16216/37963 [69:30:34<104:50:15, 17.35s/it]
 43%|████▎     | 16217/37963 [69:30:48<99:24:33, 16.46s/it] 
 43%|████▎     | 16218/37963 [69:31:03<95:05:04, 15.74s/it]
 43%|████▎     | 16219/37963 [69:31:17<92:38:43, 15.34s/it]
 43%|████▎     | 16220/37963 [69:31:31<90:52:03, 15.05s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '2.713', 'learning_rate': '1.28e-05', 'epoch': '0.4273'}

 43%|████▎     | 16220/37963 [69:31:31<90:52:03, 15.05s/it]
 43%|████▎     | 16221/37963 [69:31:46<89:36:13, 14.84s/it]
 43%|████▎     | 16222/37963 [69:32:06<100:15:39, 16.60s/it]
 43%|████▎     | 16223/37963 [69:32:20<94:54:07, 15.72s/it] 
 43%|████▎     | 16224/37963 [69:32:34<91:52:56, 15.22s/it]
 43%|████▎     | 16225/37963 [69:32:48<90:16:04, 14.95s/it]
 43%|████▎     | 16226/37963 [69:33:02<88:38:00, 14.68s/it]
 43%|████▎     | 16227/37963 [69:33:17<88:03:54, 14.59s/it]
 43%|████▎     | 16228/37963 [69:33:31<87:36:25, 14.51s/it]
 43%|████▎     | 16229/37963 [69:33:45<87:16:20, 14.46s/it]
 43%|████▎     | 16230/37963 [69:34:00<87:15:53, 14.46s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '2.548', 'learning_rate': '1.28e-05', 'epoch': '0.4275'}

 43%|████▎     | 16230/37963 [69:34:00<87:15:53, 14.46s/it]
 43%|████▎     | 16231/37963 [69:34:14<87:05:17, 14.43s/it]
 43%|████▎     | 16232/37963 [69:34:29<87:03:54, 14.42s/it]
 43%|████▎     | 16233/37963 [69:34:43<87:03:09, 14.42s/it]
 43%|████▎     | 16234/37963 [69:35:04<98:28:54, 16.32s/it]
 43%|████▎     | 16235/37963 [69:35:18<95:00:54, 15.74s/it]
 43%|████▎     | 16236/37963 [69:35:33<92:28:36, 15.32s/it]
 43%|████▎     | 16237/37963 [69:35:47<90:32:24, 15.00s/it]
 43%|████▎     | 16238/37963 [69:36:01<89:22:40, 14.81s/it]
 43%|████▎     | 16239/37963 [69:36:23<101:11:05, 16.77s/it]
 43%|████▎     | 16240/37963 [69:36:37<96:45:46, 16.04s/it] 
                                                           
{'loss': '0.1585', 'grad_norm': '3.767', 'learning_rate': '1.279e-05', 'epoch': '0.4278'}

 43%|████▎     | 16240/37963 [69:36:37<96:45:46, 16.04s/it]
 43%|████▎     | 16241/37963 [69:36:59<107:10:07, 17.76s/it]
 43%|████▎     | 16242/37963 [69:37:19<112:35:52, 18.66s/it]
 43%|████▎     | 16243/37963 [69:37:33<104:08:38, 17.26s/it]
 43%|████▎     | 16244/37963 [69:37:54<110:29:08, 18.31s/it]
 43%|████▎     | 16245/37963 [69:38:08<103:09:37, 17.10s/it]
 43%|████▎     | 16246/37963 [69:38:23<98:25:39, 16.32s/it] 
 43%|████▎     | 16247/37963 [69:38:37<94:48:44, 15.72s/it]
 43%|████▎     | 16248/37963 [69:38:52<92:44:50, 15.38s/it]
 43%|████▎     | 16249/37963 [69:39:06<90:29:51, 15.00s/it]
 43%|████▎     | 16250/37963 [69:39:20<89:10:04, 14.78s/it]
                                                           
{'loss': '0.1487', 'grad_norm': '1.204', 'learning_rate': '1.278e-05', 'epoch': '0.428'}

 43%|████▎     | 16250/37963 [69:39:20<89:10:04, 14.78s/it]
 43%|████▎     | 16251/37963 [69:39:34<86:35:29, 14.36s/it]
 43%|████▎     | 16252/37963 [69:39:48<86:15:49, 14.30s/it]
 43%|████▎     | 16253/37963 [69:40:02<85:21:04, 14.15s/it]
 43%|████▎     | 16254/37963 [69:40:16<85:50:48, 14.24s/it]
 43%|████▎     | 16255/37963 [69:40:30<85:39:02, 14.20s/it]
 43%|████▎     | 16256/37963 [69:40:45<85:57:37, 14.26s/it]
 43%|████▎     | 16257/37963 [69:40:59<86:10:27, 14.29s/it]
 43%|████▎     | 16258/37963 [69:41:13<86:36:44, 14.37s/it]
 43%|████▎     | 16259/37963 [69:41:28<86:44:41, 14.39s/it]
 43%|████▎     | 16260/37963 [69:41:42<85:31:21, 14.19s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '2.539', 'learning_rate': '1.277e-05', 'epoch': '0.4283'}

 43%|████▎     | 16260/37963 [69:41:42<85:31:21, 14.19s/it]
 43%|████▎     | 16261/37963 [69:41:56<85:29:46, 14.18s/it]
 43%|████▎     | 16262/37963 [69:42:10<85:29:40, 14.18s/it]
 43%|████▎     | 16263/37963 [69:42:31<98:24:25, 16.33s/it]
 43%|████▎     | 16264/37963 [69:42:45<93:54:38, 15.58s/it]
 43%|████▎     | 16265/37963 [69:43:06<103:51:16, 17.23s/it]
 43%|████▎     | 16266/37963 [69:43:21<98:33:45, 16.35s/it] 
 43%|████▎     | 16267/37963 [69:43:35<94:56:36, 15.75s/it]
 43%|████▎     | 16268/37963 [69:43:49<92:16:24, 15.31s/it]
 43%|████▎     | 16269/37963 [69:44:03<89:31:05, 14.86s/it]
 43%|████▎     | 16270/37963 [69:44:23<99:43:39, 16.55s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '5.651', 'learning_rate': '1.276e-05', 'epoch': '0.4286'}

 43%|████▎     | 16270/37963 [69:44:23<99:43:39, 16.55s/it]
 43%|████▎     | 16271/37963 [69:44:38<95:28:25, 15.84s/it]
 43%|████▎     | 16272/37963 [69:44:52<92:44:51, 15.39s/it]
 43%|████▎     | 16273/37963 [69:45:06<90:15:07, 14.98s/it]
 43%|████▎     | 16274/37963 [69:45:20<89:08:04, 14.79s/it]
 43%|████▎     | 16275/37963 [69:45:35<88:19:05, 14.66s/it]
 43%|████▎     | 16276/37963 [69:45:49<86:47:14, 14.41s/it]
 43%|████▎     | 16277/37963 [69:46:03<86:42:10, 14.39s/it]
 43%|████▎     | 16278/37963 [69:46:17<85:33:18, 14.20s/it]
 43%|████▎     | 16279/37963 [69:46:30<84:47:32, 14.08s/it]
 43%|████▎     | 16280/37963 [69:46:45<85:13:56, 14.15s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '1.07', 'learning_rate': '1.276e-05', 'epoch': '0.4288'}

 43%|████▎     | 16280/37963 [69:46:45<85:13:56, 14.15s/it]
 43%|████▎     | 16281/37963 [69:47:06<97:20:38, 16.16s/it]
 43%|████▎     | 16282/37963 [69:47:20<94:09:24, 15.63s/it]
 43%|████▎     | 16283/37963 [69:47:34<91:30:56, 15.20s/it]
 43%|████▎     | 16284/37963 [69:47:48<89:40:39, 14.89s/it]
 43%|████▎     | 16285/37963 [69:48:03<88:42:52, 14.73s/it]
 43%|████▎     | 16286/37963 [69:48:17<88:04:18, 14.63s/it]
 43%|████▎     | 16287/37963 [69:48:45<112:03:05, 18.61s/it]
 43%|████▎     | 16288/37963 [69:48:59<104:25:45, 17.34s/it]
 43%|████▎     | 16289/37963 [69:49:14<99:01:09, 16.45s/it] 
 43%|████▎     | 16290/37963 [69:49:28<94:30:29, 15.70s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '2.584', 'learning_rate': '1.275e-05', 'epoch': '0.4291'}

 43%|████▎     | 16290/37963 [69:49:28<94:30:29, 15.70s/it]
 43%|████▎     | 16291/37963 [69:49:41<90:34:13, 15.04s/it]
 43%|████▎     | 16292/37963 [69:49:56<89:17:05, 14.83s/it]
 43%|████▎     | 16293/37963 [69:50:23<111:28:33, 18.52s/it]
 43%|████▎     | 16294/37963 [69:50:36<102:23:31, 17.01s/it]
 43%|████▎     | 16295/37963 [69:50:51<97:41:29, 16.23s/it] 
 43%|████▎     | 16296/37963 [69:51:05<94:14:29, 15.66s/it]
 43%|████▎     | 16297/37963 [69:51:19<91:34:21, 15.22s/it]
 43%|████▎     | 16298/37963 [69:51:34<90:07:32, 14.98s/it]
 43%|████▎     | 16299/37963 [69:51:48<88:40:44, 14.74s/it]
 43%|████▎     | 16300/37963 [69:52:02<87:56:22, 14.61s/it]
                                                           
{'loss': '0.1455', 'grad_norm': '1.77', 'learning_rate': '1.274e-05', 'epoch': '0.4294'}

 43%|████▎     | 16300/37963 [69:52:02<87:56:22, 14.61s/it]
 43%|████▎     | 16301/37963 [69:52:16<87:00:46, 14.46s/it]
 43%|████▎     | 16302/37963 [69:52:31<86:55:50, 14.45s/it]
 43%|████▎     | 16303/37963 [69:52:45<86:56:20, 14.45s/it]
 43%|████▎     | 16304/37963 [69:52:59<85:45:01, 14.25s/it]
 43%|████▎     | 16305/37963 [69:53:13<86:09:57, 14.32s/it]
 43%|████▎     | 16306/37963 [69:53:27<85:41:33, 14.24s/it]
 43%|████▎     | 16307/37963 [69:53:42<85:56:58, 14.29s/it]
 43%|████▎     | 16308/37963 [69:53:56<85:54:58, 14.28s/it]
 43%|████▎     | 16309/37963 [69:54:10<86:08:36, 14.32s/it]
 43%|████▎     | 16310/37963 [69:54:25<85:58:52, 14.30s/it]
                                                           
{'loss': '0.1399', 'grad_norm': '4.327', 'learning_rate': '1.273e-05', 'epoch': '0.4296'}

 43%|████▎     | 16310/37963 [69:54:25<85:58:52, 14.30s/it]
 43%|████▎     | 16311/37963 [69:54:39<85:29:50, 14.22s/it]
 43%|████▎     | 16312/37963 [69:55:00<97:30:53, 16.21s/it]
 43%|████▎     | 16313/37963 [69:55:14<93:44:19, 15.59s/it]
 43%|████▎     | 16314/37963 [69:55:28<90:59:33, 15.13s/it]
 43%|████▎     | 16315/37963 [69:55:49<101:48:15, 16.93s/it]
 43%|████▎     | 16316/37963 [69:56:03<96:52:38, 16.11s/it] 
 43%|████▎     | 16317/37963 [69:56:17<93:49:06, 15.60s/it]
 43%|████▎     | 16318/37963 [69:56:38<103:19:15, 17.18s/it]
 43%|████▎     | 16319/37963 [69:56:53<98:26:31, 16.37s/it] 
 43%|████▎     | 16320/37963 [69:57:07<94:53:23, 15.78s/it]
                                                           
{'loss': '0.1546', 'grad_norm': '4.787', 'learning_rate': '1.272e-05', 'epoch': '0.4299'}

 43%|████▎     | 16320/37963 [69:57:07<94:53:23, 15.78s/it]
 43%|████▎     | 16321/37963 [69:57:22<92:21:04, 15.36s/it]
 43%|████▎     | 16322/37963 [69:57:36<90:06:41, 14.99s/it]
 43%|████▎     | 16323/37963 [69:57:50<88:54:40, 14.79s/it]
 43%|████▎     | 16324/37963 [69:58:04<88:03:54, 14.65s/it]
 43%|████▎     | 16325/37963 [69:58:18<86:22:22, 14.37s/it]
 43%|████▎     | 16326/37963 [69:58:33<86:23:32, 14.37s/it]
 43%|████▎     | 16327/37963 [69:58:47<86:25:47, 14.38s/it]
 43%|████▎     | 16328/37963 [69:59:01<85:59:39, 14.31s/it]
 43%|████▎     | 16329/37963 [69:59:15<86:04:35, 14.32s/it]
 43%|████▎     | 16330/37963 [69:59:36<96:34:25, 16.07s/it]
                                                           
{'loss': '0.1436', 'grad_norm': '1.681', 'learning_rate': '1.271e-05', 'epoch': '0.4302'}

 43%|████▎     | 16330/37963 [69:59:36<96:34:25, 16.07s/it]
 43%|████▎     | 16331/37963 [69:59:50<93:51:05, 15.62s/it]
 43%|████▎     | 16332/37963 [70:00:05<91:39:12, 15.25s/it]
 43%|████▎     | 16333/37963 [70:00:19<90:00:35, 14.98s/it]
 43%|████▎     | 16334/37963 [70:00:33<88:51:47, 14.79s/it]
 43%|████▎     | 16335/37963 [70:00:48<88:21:28, 14.71s/it]
 43%|████▎     | 16336/37963 [70:01:10<101:11:12, 16.84s/it]
 43%|████▎     | 16337/37963 [70:01:24<96:48:58, 16.12s/it] 
 43%|████▎     | 16338/37963 [70:01:44<104:36:52, 17.42s/it]
 43%|████▎     | 16339/37963 [70:01:59<98:55:16, 16.47s/it] 
 43%|████▎     | 16340/37963 [70:02:13<94:59:56, 15.82s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '2.961', 'learning_rate': '1.271e-05', 'epoch': '0.4304'}

 43%|████▎     | 16340/37963 [70:02:13<94:59:56, 15.82s/it]
 43%|████▎     | 16341/37963 [70:02:27<91:40:59, 15.26s/it]
 43%|████▎     | 16342/37963 [70:02:41<90:02:25, 14.99s/it]
 43%|████▎     | 16343/37963 [70:03:02<100:06:24, 16.67s/it]
 43%|████▎     | 16344/37963 [70:03:23<107:21:30, 17.88s/it]
 43%|████▎     | 16345/37963 [70:03:37<100:20:58, 16.71s/it]
 43%|████▎     | 16346/37963 [70:03:51<95:26:08, 15.89s/it] 
 43%|████▎     | 16347/37963 [70:04:05<92:09:58, 15.35s/it]
 43%|████▎     | 16348/37963 [70:04:19<89:54:21, 14.97s/it]
 43%|████▎     | 16349/37963 [70:04:33<88:51:01, 14.80s/it]
 43%|████▎     | 16350/37963 [70:04:47<88:03:28, 14.67s/it]
                                                           
{'loss': '0.1576', 'grad_norm': '4.762', 'learning_rate': '1.27e-05', 'epoch': '0.4307'}

 43%|████▎     | 16350/37963 [70:04:47<88:03:28, 14.67s/it]
 43%|████▎     | 16351/37963 [70:05:02<86:55:17, 14.48s/it]
 43%|████▎     | 16352/37963 [70:05:16<86:43:13, 14.45s/it]
 43%|████▎     | 16353/37963 [70:05:30<86:37:26, 14.43s/it]
 43%|████▎     | 16354/37963 [70:05:44<86:06:05, 14.34s/it]
 43%|████▎     | 16355/37963 [70:05:59<86:12:29, 14.36s/it]
 43%|████▎     | 16356/37963 [70:06:13<86:00:37, 14.33s/it]
 43%|████▎     | 16357/37963 [70:06:28<86:09:29, 14.36s/it]
 43%|████▎     | 16358/37963 [70:06:42<86:17:35, 14.38s/it]
 43%|████▎     | 16359/37963 [70:06:56<86:16:31, 14.38s/it]
 43%|████▎     | 16360/37963 [70:07:17<97:37:24, 16.27s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '1.633', 'learning_rate': '1.269e-05', 'epoch': '0.4309'}

 43%|████▎     | 16360/37963 [70:07:17<97:37:24, 16.27s/it]
 43%|████▎     | 16361/37963 [70:07:31<94:18:05, 15.72s/it]
 43%|████▎     | 16362/37963 [70:07:45<90:53:07, 15.15s/it]
 43%|████▎     | 16363/37963 [70:08:06<101:22:38, 16.90s/it]
 43%|████▎     | 16364/37963 [70:08:21<96:51:22, 16.14s/it] 
 43%|████▎     | 16365/37963 [70:08:34<92:46:30, 15.46s/it]
 43%|████▎     | 16366/37963 [70:08:55<102:15:01, 17.04s/it]
 43%|████▎     | 16367/37963 [70:09:09<97:14:27, 16.21s/it] 
 43%|████▎     | 16368/37963 [70:09:24<94:16:46, 15.72s/it]
 43%|████▎     | 16369/37963 [70:09:38<91:08:05, 15.19s/it]
 43%|████▎     | 16370/37963 [70:09:52<89:43:40, 14.96s/it]
                                                           
{'loss': '0.1486', 'grad_norm': '2.732', 'learning_rate': '1.268e-05', 'epoch': '0.4312'}

 43%|████▎     | 16370/37963 [70:09:52<89:43:40, 14.96s/it]
 43%|████▎     | 16371/37963 [70:10:07<88:46:44, 14.80s/it]
 43%|████▎     | 16372/37963 [70:10:21<87:46:59, 14.64s/it]
 43%|████▎     | 16373/37963 [70:10:36<87:33:14, 14.60s/it]
 43%|████▎     | 16374/37963 [70:10:50<87:12:38, 14.54s/it]
 43%|████▎     | 16375/37963 [70:11:04<86:49:58, 14.48s/it]
 43%|████▎     | 16376/37963 [70:11:19<86:40:32, 14.45s/it]
 43%|████▎     | 16377/37963 [70:11:33<86:26:12, 14.42s/it]
 43%|████▎     | 16378/37963 [70:11:54<98:21:25, 16.40s/it]
 43%|████▎     | 16379/37963 [70:12:08<94:23:06, 15.74s/it]
 43%|████▎     | 16380/37963 [70:12:23<91:51:50, 15.32s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '2.519', 'learning_rate': '1.267e-05', 'epoch': '0.4315'}

 43%|████▎     | 16380/37963 [70:12:23<91:51:50, 15.32s/it]
 43%|████▎     | 16381/37963 [70:12:36<88:44:03, 14.80s/it]
 43%|████▎     | 16382/37963 [70:12:51<87:49:07, 14.65s/it]
 43%|████▎     | 16383/37963 [70:13:12<99:45:31, 16.64s/it]
 43%|████▎     | 16384/37963 [70:13:26<95:38:07, 15.95s/it]
 43%|████▎     | 16385/37963 [70:13:40<92:35:27, 15.45s/it]
 43%|████▎     | 16386/37963 [70:13:55<90:24:58, 15.09s/it]
 43%|████▎     | 16387/37963 [70:14:16<101:07:12, 16.87s/it]
 43%|████▎     | 16388/37963 [70:14:30<95:39:24, 15.96s/it] 
 43%|████▎     | 16389/37963 [70:14:44<92:43:49, 15.47s/it]
 43%|████▎     | 16390/37963 [70:14:58<90:46:21, 15.15s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '1.108', 'learning_rate': '1.267e-05', 'epoch': '0.4317'}

 43%|████▎     | 16390/37963 [70:14:58<90:46:21, 15.15s/it]
 43%|████▎     | 16391/37963 [70:15:19<100:57:57, 16.85s/it]
 43%|████▎     | 16392/37963 [70:15:34<96:33:57, 16.12s/it] 
 43%|████▎     | 16393/37963 [70:15:54<105:10:46, 17.55s/it]
 43%|████▎     | 16394/37963 [70:16:09<98:56:43, 16.51s/it] 
 43%|████▎     | 16395/37963 [70:16:23<94:59:09, 15.85s/it]
 43%|████▎     | 16396/37963 [70:16:37<92:23:53, 15.42s/it]
 43%|████▎     | 16397/37963 [70:16:51<90:12:09, 15.06s/it]
 43%|████▎     | 16398/37963 [70:17:05<88:20:36, 14.75s/it]
 43%|████▎     | 16399/37963 [70:17:20<87:29:45, 14.61s/it]
 43%|████▎     | 16400/37963 [70:17:34<86:58:49, 14.52s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '3.546', 'learning_rate': '1.266e-05', 'epoch': '0.432'}

 43%|████▎     | 16400/37963 [70:17:34<86:58:49, 14.52s/it]
 43%|████▎     | 16401/37963 [70:17:48<86:40:50, 14.47s/it]
 43%|████▎     | 16402/37963 [70:18:02<85:45:25, 14.32s/it]
 43%|████▎     | 16403/37963 [70:18:17<85:37:26, 14.30s/it]
 43%|████▎     | 16404/37963 [70:18:31<85:41:40, 14.31s/it]
 43%|████▎     | 16405/37963 [70:18:45<85:45:16, 14.32s/it]
 43%|████▎     | 16406/37963 [70:18:59<84:01:12, 14.03s/it]
 43%|████▎     | 16407/37963 [70:19:13<84:28:07, 14.11s/it]
 43%|████▎     | 16408/37963 [70:19:34<96:49:59, 16.17s/it]
 43%|████▎     | 16409/37963 [70:19:48<93:10:54, 15.56s/it]
 43%|████▎     | 16410/37963 [70:20:02<90:15:31, 15.08s/it]
                                                           
{'loss': '0.1358', 'grad_norm': '1.831', 'learning_rate': '1.265e-05', 'epoch': '0.4323'}

 43%|████▎     | 16410/37963 [70:20:02<90:15:31, 15.08s/it]
 43%|████▎     | 16411/37963 [70:20:16<88:18:12, 14.75s/it]
 43%|████▎     | 16412/37963 [70:20:30<87:37:18, 14.64s/it]
 43%|████▎     | 16413/37963 [70:20:52<99:17:50, 16.59s/it]
 43%|████▎     | 16414/37963 [70:21:05<94:14:51, 15.75s/it]
 43%|████▎     | 16415/37963 [70:21:26<102:39:04, 17.15s/it]
 43%|████▎     | 16416/37963 [70:21:40<97:11:36, 16.24s/it] 
 43%|████▎     | 16417/37963 [70:21:55<94:25:13, 15.78s/it]
 43%|████▎     | 16418/37963 [70:22:09<91:53:30, 15.35s/it]
 43%|████▎     | 16419/37963 [70:22:23<90:02:13, 15.05s/it]
 43%|████▎     | 16420/37963 [70:22:38<88:42:18, 14.82s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '2.303', 'learning_rate': '1.264e-05', 'epoch': '0.4325'}

 43%|████▎     | 16420/37963 [70:22:38<88:42:18, 14.82s/it]
 43%|████▎     | 16421/37963 [70:22:52<87:57:27, 14.70s/it]
 43%|████▎     | 16422/37963 [70:23:06<87:16:04, 14.58s/it]
 43%|████▎     | 16423/37963 [70:23:21<87:01:20, 14.54s/it]
 43%|████▎     | 16424/37963 [70:23:35<86:41:02, 14.49s/it]
 43%|████▎     | 16425/37963 [70:23:50<86:31:09, 14.46s/it]
 43%|████▎     | 16426/37963 [70:24:04<86:18:25, 14.43s/it]
 43%|████▎     | 16427/37963 [70:24:18<86:00:30, 14.38s/it]
 43%|████▎     | 16428/37963 [70:24:38<96:17:23, 16.10s/it]
 43%|████▎     | 16429/37963 [70:24:53<93:20:24, 15.60s/it]
 43%|████▎     | 16430/37963 [70:25:07<90:39:53, 15.16s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '1.232', 'learning_rate': '1.263e-05', 'epoch': '0.4328'}

 43%|████▎     | 16430/37963 [70:25:07<90:39:53, 15.16s/it]
 43%|████▎     | 16431/37963 [70:25:21<89:25:11, 14.95s/it]
 43%|████▎     | 16432/37963 [70:25:35<87:32:49, 14.64s/it]
 43%|████▎     | 16433/37963 [70:25:56<98:36:24, 16.49s/it]
 43%|████▎     | 16434/37963 [70:26:10<94:55:04, 15.87s/it]
 43%|████▎     | 16435/37963 [70:26:25<92:15:57, 15.43s/it]
 43%|████▎     | 16436/37963 [70:26:45<101:29:01, 16.97s/it]
 43%|████▎     | 16437/37963 [70:27:00<96:24:49, 16.12s/it] 
 43%|████▎     | 16438/37963 [70:27:13<92:21:55, 15.45s/it]
 43%|████▎     | 16439/37963 [70:27:28<90:32:41, 15.14s/it]
 43%|████▎     | 16440/37963 [70:27:42<89:02:28, 14.89s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '2.019', 'learning_rate': '1.262e-05', 'epoch': '0.4331'}

 43%|████▎     | 16440/37963 [70:27:42<89:02:28, 14.89s/it]
 43%|████▎     | 16441/37963 [70:27:56<86:56:24, 14.54s/it]
 43%|████▎     | 16442/37963 [70:28:17<98:29:05, 16.47s/it]
 43%|████▎     | 16443/37963 [70:28:31<94:02:20, 15.73s/it]
 43%|████▎     | 16444/37963 [70:28:52<103:04:15, 17.24s/it]
 43%|████▎     | 16445/37963 [70:29:06<97:55:43, 16.38s/it] 
 43%|████▎     | 16446/37963 [70:29:20<94:15:20, 15.77s/it]
 43%|████▎     | 16447/37963 [70:29:35<91:57:53, 15.39s/it]
 43%|████▎     | 16448/37963 [70:29:49<89:35:37, 14.99s/it]
 43%|████▎     | 16449/37963 [70:30:03<88:29:14, 14.81s/it]
 43%|████▎     | 16450/37963 [70:30:18<87:44:35, 14.68s/it]
                                                           
{'loss': '0.1459', 'grad_norm': '2.626', 'learning_rate': '1.262e-05', 'epoch': '0.4333'}

 43%|████▎     | 16450/37963 [70:30:18<87:44:35, 14.68s/it]
 43%|████▎     | 16451/37963 [70:30:32<86:25:25, 14.46s/it]
 43%|████▎     | 16452/37963 [70:30:46<85:47:27, 14.36s/it]
 43%|████▎     | 16453/37963 [70:31:00<85:52:13, 14.37s/it]
 43%|████▎     | 16454/37963 [70:31:14<85:49:13, 14.36s/it]
 43%|████▎     | 16455/37963 [70:31:29<85:40:16, 14.34s/it]
 43%|████▎     | 16456/37963 [70:31:43<85:42:34, 14.35s/it]
 43%|████▎     | 16457/37963 [70:31:57<85:43:20, 14.35s/it]
 43%|████▎     | 16458/37963 [70:32:18<96:57:01, 16.23s/it]
 43%|████▎     | 16459/37963 [70:32:33<93:42:27, 15.69s/it]
 43%|████▎     | 16460/37963 [70:32:47<91:18:18, 15.29s/it]
                                                           
{'loss': '0.155', 'grad_norm': '3.19', 'learning_rate': '1.261e-05', 'epoch': '0.4336'}

 43%|████▎     | 16460/37963 [70:32:47<91:18:18, 15.29s/it]
 43%|████▎     | 16461/37963 [70:33:08<101:42:36, 17.03s/it]
 43%|████▎     | 16462/37963 [70:33:22<97:07:23, 16.26s/it] 
 43%|████▎     | 16463/37963 [70:33:36<92:50:04, 15.54s/it]
 43%|████▎     | 16464/37963 [70:33:51<90:31:30, 15.16s/it]
 43%|████▎     | 16465/37963 [70:34:11<99:23:22, 16.64s/it]
 43%|████▎     | 16466/37963 [70:34:24<94:10:42, 15.77s/it]
 43%|████▎     | 16467/37963 [70:34:39<91:42:33, 15.36s/it]
 43%|████▎     | 16468/37963 [70:34:53<89:03:55, 14.92s/it]
 43%|████▎     | 16469/37963 [70:35:07<88:06:21, 14.76s/it]
 43%|████▎     | 16470/37963 [70:35:22<87:40:41, 14.69s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '1.114', 'learning_rate': '1.26e-05', 'epoch': '0.4338'}

 43%|████▎     | 16470/37963 [70:35:22<87:40:41, 14.69s/it]
 43%|████▎     | 16471/37963 [70:35:36<86:20:56, 14.46s/it]
 43%|████▎     | 16472/37963 [70:35:50<86:16:20, 14.45s/it]
 43%|████▎     | 16473/37963 [70:36:04<86:10:33, 14.44s/it]
 43%|████▎     | 16474/37963 [70:36:19<86:07:52, 14.43s/it]
 43%|████▎     | 16475/37963 [70:36:40<97:44:13, 16.37s/it]
 43%|████▎     | 16476/37963 [70:36:54<94:24:35, 15.82s/it]
 43%|████▎     | 16477/37963 [70:37:09<91:59:09, 15.41s/it]
 43%|████▎     | 16478/37963 [70:37:23<89:26:15, 14.99s/it]
 43%|████▎     | 16479/37963 [70:37:37<88:14:58, 14.79s/it]
 43%|████▎     | 16480/37963 [70:37:51<87:20:20, 14.64s/it]
                                                           
{'loss': '0.1414', 'grad_norm': '3.373', 'learning_rate': '1.259e-05', 'epoch': '0.4341'}

 43%|████▎     | 16480/37963 [70:37:51<87:20:20, 14.64s/it]
 43%|████▎     | 16481/37963 [70:38:06<86:50:15, 14.55s/it]
 43%|████▎     | 16482/37963 [70:38:27<99:01:51, 16.60s/it]
 43%|████▎     | 16483/37963 [70:38:41<93:59:24, 15.75s/it]
 43%|████▎     | 16484/37963 [70:38:55<90:57:32, 15.25s/it]
 43%|████▎     | 16485/37963 [70:39:16<101:28:28, 17.01s/it]
 43%|████▎     | 16486/37963 [70:39:30<96:40:00, 16.20s/it] 
 43%|████▎     | 16487/37963 [70:39:44<92:40:23, 15.53s/it]
 43%|████▎     | 16488/37963 [70:39:59<90:37:30, 15.19s/it]
 43%|████▎     | 16489/37963 [70:40:13<88:32:30, 14.84s/it]
 43%|████▎     | 16490/37963 [70:40:27<87:43:55, 14.71s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '1.524', 'learning_rate': '1.258e-05', 'epoch': '0.4344'}

 43%|████▎     | 16490/37963 [70:40:27<87:43:55, 14.71s/it]
 43%|████▎     | 16491/37963 [70:40:41<86:20:26, 14.48s/it]
 43%|████▎     | 16492/37963 [70:41:02<97:45:14, 16.39s/it]
 43%|████▎     | 16493/37963 [70:41:16<94:03:20, 15.77s/it]
 43%|████▎     | 16494/37963 [70:41:30<90:48:03, 15.23s/it]
 43%|████▎     | 16495/37963 [70:41:51<100:27:48, 16.85s/it]
 43%|████▎     | 16496/37963 [70:42:05<95:42:02, 16.05s/it] 
 43%|████▎     | 16497/37963 [70:42:19<92:27:15, 15.51s/it]
 43%|████▎     | 16498/37963 [70:42:34<90:32:06, 15.18s/it]
 43%|████▎     | 16499/37963 [70:42:47<88:01:23, 14.76s/it]
 43%|████▎     | 16500/37963 [70:43:02<87:32:04, 14.68s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '2.904', 'learning_rate': '1.257e-05', 'epoch': '0.4346'}

 43%|████▎     | 16500/37963 [70:43:02<87:32:04, 14.68s/it]
 43%|████▎     | 16501/37963 [70:43:16<86:48:37, 14.56s/it]
 43%|████▎     | 16502/37963 [70:43:30<85:54:19, 14.41s/it]
 43%|████▎     | 16503/37963 [70:43:45<85:40:48, 14.37s/it]
 43%|████▎     | 16504/37963 [70:43:59<85:43:53, 14.38s/it]
 43%|████▎     | 16505/37963 [70:44:13<85:41:45, 14.38s/it]
 43%|████▎     | 16506/37963 [70:44:28<85:39:00, 14.37s/it]
 43%|████▎     | 16507/37963 [70:44:42<85:31:57, 14.35s/it]
 43%|████▎     | 16508/37963 [70:45:02<96:34:44, 16.21s/it]
 43%|████▎     | 16509/37963 [70:45:16<92:21:31, 15.50s/it]
 43%|████▎     | 16510/37963 [70:45:31<90:14:28, 15.14s/it]
                                                           
{'loss': '0.159', 'grad_norm': '1.752', 'learning_rate': '1.257e-05', 'epoch': '0.4349'}

 43%|████▎     | 16510/37963 [70:45:31<90:14:28, 15.14s/it]
 43%|████▎     | 16511/37963 [70:45:52<100:38:01, 16.89s/it]
 43%|████▎     | 16512/37963 [70:46:06<96:07:57, 16.13s/it] 
 43%|████▎     | 16513/37963 [70:46:20<92:57:03, 15.60s/it]
 44%|████▎     | 16514/37963 [70:46:41<102:15:01, 17.16s/it]
 44%|████▎     | 16515/37963 [70:46:56<97:15:20, 16.32s/it] 
 44%|████▎     | 16516/37963 [70:47:10<93:45:34, 15.74s/it]
 44%|████▎     | 16517/37963 [70:47:24<91:24:05, 15.34s/it]
 44%|████▎     | 16518/37963 [70:47:39<89:45:28, 15.07s/it]
 44%|████▎     | 16519/37963 [70:47:52<87:25:07, 14.68s/it]
 44%|████▎     | 16520/37963 [70:48:07<86:54:54, 14.59s/it]
                                                           
{'loss': '0.1471', 'grad_norm': '1.099', 'learning_rate': '1.256e-05', 'epoch': '0.4352'}

 44%|████▎     | 16520/37963 [70:48:07<86:54:54, 14.59s/it]
 44%|████▎     | 16521/37963 [70:48:21<85:16:20, 14.32s/it]
 44%|████▎     | 16522/37963 [70:48:35<85:22:21, 14.33s/it]
 44%|████▎     | 16523/37963 [70:48:49<85:11:27, 14.30s/it]
 44%|████▎     | 16524/37963 [70:49:03<85:13:08, 14.31s/it]
 44%|████▎     | 16525/37963 [70:49:18<84:52:40, 14.25s/it]
 44%|████▎     | 16526/37963 [70:49:38<96:18:38, 16.17s/it]
 44%|████▎     | 16527/37963 [70:49:52<92:30:58, 15.54s/it]
 44%|████▎     | 16528/37963 [70:50:07<90:27:35, 15.19s/it]
 44%|████▎     | 16529/37963 [70:50:21<89:09:27, 14.97s/it]
 44%|████▎     | 16530/37963 [70:50:42<100:26:19, 16.87s/it]
                                                            
{'loss': '0.1468', 'grad_norm': '1.601', 'learning_rate': '1.255e-05', 'epoch': '0.4354'}

 44%|████▎     | 16530/37963 [70:50:42<100:26:19, 16.87s/it]
 44%|████▎     | 16531/37963 [70:50:57<95:53:20, 16.11s/it] 
 44%|████▎     | 16532/37963 [70:51:11<92:37:21, 15.56s/it]
 44%|████▎     | 16533/37963 [70:51:25<90:12:03, 15.15s/it]
 44%|████▎     | 16534/37963 [70:51:46<100:32:37, 16.89s/it]
 44%|████▎     | 16535/37963 [70:52:01<96:01:01, 16.13s/it] 
 44%|████▎     | 16536/37963 [70:52:15<93:06:56, 15.64s/it]
 44%|████▎     | 16537/37963 [70:52:29<90:43:45, 15.24s/it]
 44%|████▎     | 16538/37963 [70:52:44<89:04:37, 14.97s/it]
 44%|████▎     | 16539/37963 [70:52:58<88:02:39, 14.79s/it]
 44%|████▎     | 16540/37963 [70:53:12<87:13:12, 14.66s/it]
                                                           
{'loss': '0.1366', 'grad_norm': '1.788', 'learning_rate': '1.254e-05', 'epoch': '0.4357'}

 44%|████▎     | 16540/37963 [70:53:12<87:13:12, 14.66s/it]
 44%|████▎     | 16541/37963 [70:53:33<98:06:54, 16.49s/it]
 44%|████▎     | 16542/37963 [70:53:48<94:15:02, 15.84s/it]
 44%|████▎     | 16543/37963 [70:54:02<91:31:24, 15.38s/it]
 44%|████▎     | 16544/37963 [70:54:22<99:56:49, 16.80s/it]
 44%|████▎     | 16545/37963 [70:54:36<95:10:30, 16.00s/it]
 44%|████▎     | 16546/37963 [70:54:50<92:15:19, 15.51s/it]
 44%|████▎     | 16547/37963 [70:55:05<90:19:19, 15.18s/it]
 44%|████▎     | 16548/37963 [70:55:19<88:58:54, 14.96s/it]
 44%|████▎     | 16549/37963 [70:55:34<87:54:06, 14.78s/it]
 44%|████▎     | 16550/37963 [70:55:48<87:19:21, 14.68s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '2.745', 'learning_rate': '1.253e-05', 'epoch': '0.436'}

 44%|████▎     | 16550/37963 [70:55:48<87:19:21, 14.68s/it]
 44%|████▎     | 16551/37963 [70:56:03<86:56:44, 14.62s/it]
 44%|████▎     | 16552/37963 [70:56:17<85:53:00, 14.44s/it]
 44%|████▎     | 16553/37963 [70:56:31<85:45:40, 14.42s/it]
 44%|████▎     | 16554/37963 [70:56:45<85:24:33, 14.36s/it]
 44%|████▎     | 16555/37963 [70:56:59<85:00:51, 14.30s/it]
 44%|████▎     | 16556/37963 [70:57:14<85:13:09, 14.33s/it]
 44%|████▎     | 16557/37963 [70:57:28<85:08:29, 14.32s/it]
 44%|████▎     | 16558/37963 [70:57:49<96:38:04, 16.25s/it]
 44%|████▎     | 16559/37963 [70:58:03<93:17:59, 15.69s/it]
 44%|████▎     | 16560/37963 [70:58:18<90:51:30, 15.28s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '0.884', 'learning_rate': '1.252e-05', 'epoch': '0.4362'}

 44%|████▎     | 16560/37963 [70:58:18<90:51:30, 15.28s/it]
 44%|████▎     | 16561/37963 [70:58:45<113:04:21, 19.02s/it]
 44%|████▎     | 16562/37963 [70:59:00<104:43:31, 17.62s/it]
 44%|████▎     | 16563/37963 [70:59:14<98:16:53, 16.53s/it] 
 44%|████▎     | 16564/37963 [70:59:28<94:24:11, 15.88s/it]
 44%|████▎     | 16565/37963 [70:59:42<91:07:06, 15.33s/it]
 44%|████▎     | 16566/37963 [70:59:56<89:21:24, 15.03s/it]
 44%|████▎     | 16567/37963 [71:00:11<87:57:54, 14.80s/it]
 44%|████▎     | 16568/37963 [71:00:25<86:33:46, 14.57s/it]
 44%|████▎     | 16569/37963 [71:00:39<86:02:24, 14.48s/it]
 44%|████▎     | 16570/37963 [71:00:53<85:57:25, 14.46s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '1.405', 'learning_rate': '1.252e-05', 'epoch': '0.4365'}

 44%|████▎     | 16570/37963 [71:00:53<85:57:25, 14.46s/it]
 44%|████▎     | 16571/37963 [71:01:07<84:19:07, 14.19s/it]
 44%|████▎     | 16572/37963 [71:01:21<83:56:24, 14.13s/it]
 44%|████▎     | 16573/37963 [71:01:35<84:22:34, 14.20s/it]
 44%|████▎     | 16574/37963 [71:01:50<84:35:18, 14.24s/it]
 44%|████▎     | 16575/37963 [71:02:11<97:16:55, 16.37s/it]
 44%|████▎     | 16576/37963 [71:02:25<93:45:40, 15.78s/it]
 44%|████▎     | 16577/37963 [71:02:40<91:08:11, 15.34s/it]
 44%|████▎     | 16578/37963 [71:02:53<87:46:30, 14.78s/it]
 44%|████▎     | 16579/37963 [71:03:14<99:28:23, 16.75s/it]
 44%|████▎     | 16580/37963 [71:03:28<94:06:57, 15.85s/it]
                                                           
{'loss': '0.1492', 'grad_norm': '2.369', 'learning_rate': '1.251e-05', 'epoch': '0.4367'}

 44%|████▎     | 16580/37963 [71:03:28<94:06:57, 15.85s/it]
 44%|████▎     | 16581/37963 [71:03:43<91:30:17, 15.41s/it]
 44%|████▎     | 16582/37963 [71:03:57<89:36:14, 15.09s/it]
 44%|████▎     | 16583/37963 [71:04:18<100:06:21, 16.86s/it]
 44%|████▎     | 16584/37963 [71:04:32<95:32:58, 16.09s/it] 
 44%|████▎     | 16585/37963 [71:04:47<92:31:10, 15.58s/it]
 44%|████▎     | 16586/37963 [71:05:00<89:15:51, 15.03s/it]
 44%|████▎     | 16587/37963 [71:05:15<88:17:17, 14.87s/it]
 44%|████▎     | 16588/37963 [71:05:29<87:23:44, 14.72s/it]
 44%|████▎     | 16589/37963 [71:05:43<85:46:04, 14.45s/it]
 44%|████▎     | 16590/37963 [71:06:03<94:55:52, 15.99s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '1.653', 'learning_rate': '1.25e-05', 'epoch': '0.437'}

 44%|████▎     | 16590/37963 [71:06:03<94:55:52, 15.99s/it]
 44%|████▎     | 16591/37963 [71:06:17<91:55:01, 15.48s/it]
 44%|████▎     | 16592/37963 [71:06:37<100:59:20, 17.01s/it]
 44%|████▎     | 16593/37963 [71:06:52<96:21:00, 16.23s/it] 
 44%|████▎     | 16594/37963 [71:07:06<93:07:50, 15.69s/it]
 44%|████▎     | 16595/37963 [71:07:21<90:52:34, 15.31s/it]
 44%|████▎     | 16596/37963 [71:07:35<89:13:00, 15.03s/it]
 44%|████▎     | 16597/37963 [71:07:49<87:43:16, 14.78s/it]
 44%|████▎     | 16598/37963 [71:08:04<86:56:30, 14.65s/it]
 44%|████▎     | 16599/37963 [71:08:18<86:34:36, 14.59s/it]
 44%|████▎     | 16600/37963 [71:08:33<86:44:28, 14.62s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '4.26', 'learning_rate': '1.249e-05', 'epoch': '0.4373'}

 44%|████▎     | 16600/37963 [71:08:33<86:44:28, 14.62s/it]
 44%|████▎     | 16601/37963 [71:08:47<86:26:40, 14.57s/it]
 44%|████▎     | 16602/37963 [71:09:02<86:08:42, 14.52s/it]
 44%|████▎     | 16603/37963 [71:09:16<86:03:02, 14.50s/it]
 44%|████▎     | 16604/37963 [71:09:30<85:39:04, 14.44s/it]
 44%|████▎     | 16605/37963 [71:09:45<85:37:35, 14.43s/it]
 44%|████▎     | 16606/37963 [71:09:59<85:26:37, 14.40s/it]
 44%|████▎     | 16607/37963 [71:10:20<97:37:12, 16.46s/it]
 44%|████▎     | 16608/37963 [71:10:34<93:13:03, 15.71s/it]
 44%|████▍     | 16609/37963 [71:10:49<90:25:48, 15.25s/it]
 44%|████▍     | 16610/37963 [71:11:03<88:53:17, 14.99s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '4.58', 'learning_rate': '1.248e-05', 'epoch': '0.4375'}

 44%|████▍     | 16610/37963 [71:11:03<88:53:17, 14.99s/it]
 44%|████▍     | 16611/37963 [71:11:24<99:30:13, 16.78s/it]
 44%|████▍     | 16612/37963 [71:11:45<106:30:37, 17.96s/it]
 44%|████▍     | 16613/37963 [71:11:59<99:52:23, 16.84s/it] 
 44%|████▍     | 16614/37963 [71:12:13<94:26:51, 15.93s/it]
 44%|████▍     | 16615/37963 [71:12:27<91:41:34, 15.46s/it]
 44%|████▍     | 16616/37963 [71:12:41<89:38:12, 15.12s/it]
 44%|████▍     | 16617/37963 [71:12:56<88:14:01, 14.88s/it]
 44%|████▍     | 16618/37963 [71:13:10<87:15:50, 14.72s/it]
 44%|████▍     | 16619/37963 [71:13:24<86:16:01, 14.55s/it]
 44%|████▍     | 16620/37963 [71:13:38<85:24:23, 14.41s/it]
                                                           
{'loss': '0.1423', 'grad_norm': '0.673', 'learning_rate': '1.248e-05', 'epoch': '0.4378'}

 44%|████▍     | 16620/37963 [71:13:38<85:24:23, 14.41s/it]
 44%|████▍     | 16621/37963 [71:13:52<84:38:14, 14.28s/it]
 44%|████▍     | 16622/37963 [71:14:07<84:44:53, 14.30s/it]
 44%|████▍     | 16623/37963 [71:14:21<84:17:17, 14.22s/it]
 44%|████▍     | 16624/37963 [71:14:41<95:57:25, 16.19s/it]
 44%|████▍     | 16625/37963 [71:14:55<92:00:20, 15.52s/it]
 44%|████▍     | 16626/37963 [71:15:10<89:50:08, 15.16s/it]
 44%|████▍     | 16627/37963 [71:15:24<87:47:23, 14.81s/it]
 44%|████▍     | 16628/37963 [71:15:45<100:09:01, 16.90s/it]
 44%|████▍     | 16629/37963 [71:16:00<95:44:19, 16.16s/it] 
 44%|████▍     | 16630/37963 [71:16:14<92:43:25, 15.65s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '2.185', 'learning_rate': '1.247e-05', 'epoch': '0.4381'}

 44%|████▍     | 16630/37963 [71:16:14<92:43:25, 15.65s/it]
 44%|████▍     | 16631/37963 [71:16:29<90:30:50, 15.28s/it]
 44%|████▍     | 16632/37963 [71:16:50<100:37:59, 16.98s/it]
 44%|████▍     | 16633/37963 [71:17:04<96:08:32, 16.23s/it] 
 44%|████▍     | 16634/37963 [71:17:19<92:58:17, 15.69s/it]
 44%|████▍     | 16635/37963 [71:17:33<90:23:44, 15.26s/it]
 44%|████▍     | 16636/37963 [71:17:47<88:12:23, 14.89s/it]
 44%|████▍     | 16637/37963 [71:18:01<87:15:41, 14.73s/it]
 44%|████▍     | 16638/37963 [71:18:15<85:58:06, 14.51s/it]
 44%|████▍     | 16639/37963 [71:18:30<85:59:53, 14.52s/it]
 44%|████▍     | 16640/37963 [71:18:56<107:21:21, 18.13s/it]
                                                            
{'loss': '0.1502', 'grad_norm': '1.176', 'learning_rate': '1.246e-05', 'epoch': '0.4383'}

 44%|████▍     | 16640/37963 [71:18:56<107:21:21, 18.13s/it]
 44%|████▍     | 16641/37963 [71:19:10<99:50:02, 16.86s/it] 
 44%|████▍     | 16642/37963 [71:19:24<94:45:20, 16.00s/it]
 44%|████▍     | 16643/37963 [71:19:39<91:53:12, 15.52s/it]
 44%|████▍     | 16644/37963 [71:19:53<89:07:32, 15.05s/it]
 44%|████▍     | 16645/37963 [71:20:07<87:37:11, 14.80s/it]
 44%|████▍     | 16646/37963 [71:20:21<86:49:42, 14.66s/it]
 44%|████▍     | 16647/37963 [71:20:36<86:25:23, 14.60s/it]
 44%|████▍     | 16648/37963 [71:20:50<85:43:53, 14.48s/it]
 44%|████▍     | 16649/37963 [71:21:04<85:36:42, 14.46s/it]
 44%|████▍     | 16650/37963 [71:21:18<84:55:13, 14.34s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '0.8533', 'learning_rate': '1.245e-05', 'epoch': '0.4386'}

 44%|████▍     | 16650/37963 [71:21:18<84:55:13, 14.34s/it]
 44%|████▍     | 16651/37963 [71:21:33<85:02:53, 14.37s/it]
 44%|████▍     | 16652/37963 [71:21:47<85:04:04, 14.37s/it]
 44%|████▍     | 16653/37963 [71:22:01<85:00:40, 14.36s/it]
 44%|████▍     | 16654/37963 [71:22:16<84:54:37, 14.34s/it]
 44%|████▍     | 16655/37963 [71:22:36<96:16:39, 16.27s/it]
 44%|████▍     | 16656/37963 [71:22:51<92:28:49, 15.63s/it]
 44%|████▍     | 16657/37963 [71:23:05<90:12:17, 15.24s/it]
 44%|████▍     | 16658/37963 [71:23:26<100:48:59, 17.04s/it]
 44%|████▍     | 16659/37963 [71:23:40<95:55:12, 16.21s/it] 
 44%|████▍     | 16660/37963 [71:24:01<103:35:01, 17.50s/it]
                                                            
{'loss': '0.16', 'grad_norm': '1.047', 'learning_rate': '1.244e-05', 'epoch': '0.4388'}

 44%|████▍     | 16660/37963 [71:24:01<103:35:01, 17.50s/it]
 44%|████▍     | 16661/37963 [71:24:15<97:16:22, 16.44s/it] 
 44%|████▍     | 16662/37963 [71:24:29<93:40:03, 15.83s/it]
 44%|████▍     | 16663/37963 [71:24:43<90:06:38, 15.23s/it]
 44%|████▍     | 16664/37963 [71:24:57<88:28:50, 14.96s/it]
 44%|████▍     | 16665/37963 [71:25:12<87:03:07, 14.71s/it]
 44%|████▍     | 16666/37963 [71:25:26<86:09:11, 14.56s/it]
 44%|████▍     | 16667/37963 [71:25:40<85:20:42, 14.43s/it]
 44%|████▍     | 16668/37963 [71:25:54<85:04:04, 14.38s/it]
 44%|████▍     | 16669/37963 [71:26:09<85:05:08, 14.38s/it]
 44%|████▍     | 16670/37963 [71:26:29<96:32:22, 16.32s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '2.584', 'learning_rate': '1.243e-05', 'epoch': '0.4391'}

 44%|████▍     | 16670/37963 [71:26:29<96:32:22, 16.32s/it]
 44%|████▍     | 16671/37963 [71:26:44<93:04:59, 15.74s/it]
 44%|████▍     | 16672/37963 [71:26:58<90:35:56, 15.32s/it]
 44%|████▍     | 16673/37963 [71:27:12<88:47:32, 15.01s/it]
 44%|████▍     | 16674/37963 [71:27:26<86:37:10, 14.65s/it]
 44%|████▍     | 16675/37963 [71:27:41<86:03:32, 14.55s/it]
 44%|████▍     | 16676/37963 [71:28:01<97:23:25, 16.47s/it]
 44%|████▍     | 16677/37963 [71:28:16<93:41:36, 15.85s/it]
 44%|████▍     | 16678/37963 [71:28:30<91:02:53, 15.40s/it]
 44%|████▍     | 16679/37963 [71:28:45<89:07:46, 15.08s/it]
 44%|████▍     | 16680/37963 [71:28:58<86:54:07, 14.70s/it]
                                                           
{'loss': '0.1427', 'grad_norm': '2.036', 'learning_rate': '1.243e-05', 'epoch': '0.4394'}

 44%|████▍     | 16680/37963 [71:28:58<86:54:07, 14.70s/it]
 44%|████▍     | 16681/37963 [71:29:13<86:14:35, 14.59s/it]
 44%|████▍     | 16682/37963 [71:29:27<85:54:15, 14.53s/it]
 44%|████▍     | 16683/37963 [71:29:48<97:34:11, 16.51s/it]
 44%|████▍     | 16684/37963 [71:30:03<93:45:43, 15.86s/it]
 44%|████▍     | 16685/37963 [71:30:17<90:55:15, 15.38s/it]
 44%|████▍     | 16686/37963 [71:30:31<88:54:45, 15.04s/it]
 44%|████▍     | 16687/37963 [71:30:45<87:46:24, 14.85s/it]
 44%|████▍     | 16688/37963 [71:31:06<98:07:56, 16.61s/it]
 44%|████▍     | 16689/37963 [71:31:21<94:14:24, 15.95s/it]
 44%|████▍     | 16690/37963 [71:31:34<90:24:38, 15.30s/it]
                                                           
{'loss': '0.1408', 'grad_norm': '2.464', 'learning_rate': '1.242e-05', 'epoch': '0.4396'}

 44%|████▍     | 16690/37963 [71:31:34<90:24:38, 15.30s/it]
 44%|████▍     | 16691/37963 [71:31:55<99:37:09, 16.86s/it]
 44%|████▍     | 16692/37963 [71:32:09<95:10:54, 16.11s/it]
 44%|████▍     | 16693/37963 [71:32:24<92:10:25, 15.60s/it]
 44%|████▍     | 16694/37963 [71:32:38<89:02:09, 15.07s/it]
 44%|████▍     | 16695/37963 [71:32:52<87:48:19, 14.86s/it]
 44%|████▍     | 16696/37963 [71:33:06<87:07:09, 14.75s/it]
 44%|████▍     | 16697/37963 [71:33:20<85:29:41, 14.47s/it]
 44%|████▍     | 16698/37963 [71:33:34<84:55:26, 14.38s/it]
 44%|████▍     | 16699/37963 [71:33:49<85:01:24, 14.39s/it]
 44%|████▍     | 16700/37963 [71:34:03<84:52:40, 14.37s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '2.763', 'learning_rate': '1.241e-05', 'epoch': '0.4399'}

 44%|████▍     | 16700/37963 [71:34:03<84:52:40, 14.37s/it]
 44%|████▍     | 16701/37963 [71:34:17<84:33:28, 14.32s/it]
 44%|████▍     | 16702/37963 [71:34:31<83:15:59, 14.10s/it]
 44%|████▍     | 16703/37963 [71:34:52<94:52:04, 16.06s/it]
 44%|████▍     | 16704/37963 [71:35:06<91:48:08, 15.55s/it]
 44%|████▍     | 16705/37963 [71:35:20<90:03:26, 15.25s/it]
 44%|████▍     | 16706/37963 [71:35:35<88:13:31, 14.94s/it]
 44%|████▍     | 16707/37963 [71:35:56<99:07:37, 16.79s/it]
 44%|████▍     | 16708/37963 [71:36:10<94:53:26, 16.07s/it]
 44%|████▍     | 16709/37963 [71:36:24<91:50:13, 15.56s/it]
 44%|████▍     | 16710/37963 [71:36:39<89:38:02, 15.18s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '2.972', 'learning_rate': '1.24e-05', 'epoch': '0.4402'}

 44%|████▍     | 16710/37963 [71:36:39<89:38:02, 15.18s/it]
 44%|████▍     | 16711/37963 [71:36:53<88:17:41, 14.96s/it]
 44%|████▍     | 16712/37963 [71:37:14<98:56:31, 16.76s/it]
 44%|████▍     | 16713/37963 [71:37:28<94:07:21, 15.95s/it]
 44%|████▍     | 16714/37963 [71:37:43<91:25:33, 15.49s/it]
 44%|████▍     | 16715/37963 [71:37:56<88:23:39, 14.98s/it]
 44%|████▍     | 16716/37963 [71:38:10<86:38:36, 14.68s/it]
 44%|████▍     | 16717/37963 [71:38:25<85:45:11, 14.53s/it]
 44%|████▍     | 16718/37963 [71:38:45<96:06:42, 16.29s/it]
 44%|████▍     | 16719/37963 [71:38:59<92:55:28, 15.75s/it]
 44%|████▍     | 16720/37963 [71:39:14<89:52:31, 15.23s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '3.828', 'learning_rate': '1.239e-05', 'epoch': '0.4404'}

 44%|████▍     | 16720/37963 [71:39:14<89:52:31, 15.23s/it]
 44%|████▍     | 16721/37963 [71:39:28<88:17:22, 14.96s/it]
 44%|████▍     | 16722/37963 [71:39:42<87:15:03, 14.79s/it]
 44%|████▍     | 16723/37963 [71:39:56<85:55:33, 14.56s/it]
 44%|████▍     | 16724/37963 [71:40:10<84:34:33, 14.34s/it]
 44%|████▍     | 16725/37963 [71:40:24<84:34:24, 14.34s/it]
 44%|████▍     | 16726/37963 [71:40:39<84:34:28, 14.34s/it]
 44%|████▍     | 16727/37963 [71:41:00<96:58:25, 16.44s/it]
 44%|████▍     | 16728/37963 [71:41:15<93:24:26, 15.84s/it]
 44%|████▍     | 16729/37963 [71:41:29<90:59:35, 15.43s/it]
 44%|████▍     | 16730/37963 [71:41:43<89:07:58, 15.11s/it]
                                                           
{'loss': '0.151', 'grad_norm': '0.9987', 'learning_rate': '1.238e-05', 'epoch': '0.4407'}

 44%|████▍     | 16730/37963 [71:41:43<89:07:58, 15.11s/it]
 44%|████▍     | 16731/37963 [71:41:58<87:45:11, 14.88s/it]
 44%|████▍     | 16732/37963 [71:42:19<98:45:43, 16.75s/it]
 44%|████▍     | 16733/37963 [71:42:33<94:27:48, 16.02s/it]
 44%|████▍     | 16734/37963 [71:42:48<91:33:19, 15.53s/it]
 44%|████▍     | 16735/37963 [71:43:02<89:06:04, 15.11s/it]
 44%|████▍     | 16736/37963 [71:43:16<87:49:35, 14.89s/it]
 44%|████▍     | 16737/37963 [71:43:30<86:54:57, 14.74s/it]
 44%|████▍     | 16738/37963 [71:43:52<98:17:12, 16.67s/it]
 44%|████▍     | 16739/37963 [71:44:06<94:11:31, 15.98s/it]
 44%|████▍     | 16740/37963 [71:44:27<102:57:54, 17.47s/it]
                                                            
{'loss': '0.1607', 'grad_norm': '1.192', 'learning_rate': '1.238e-05', 'epoch': '0.441'}

 44%|████▍     | 16740/37963 [71:44:27<102:57:54, 17.47s/it]
 44%|████▍     | 16741/37963 [71:44:41<97:44:26, 16.58s/it] 
 44%|████▍     | 16742/37963 [71:44:56<93:20:16, 15.83s/it]
 44%|████▍     | 16743/37963 [71:45:10<90:40:56, 15.38s/it]
 44%|████▍     | 16744/37963 [71:45:24<88:58:23, 15.10s/it]
 44%|████▍     | 16745/37963 [71:45:39<87:37:22, 14.87s/it]
 44%|████▍     | 16746/37963 [71:45:52<85:19:35, 14.48s/it]
 44%|████▍     | 16747/37963 [71:46:06<84:21:30, 14.31s/it]
 44%|████▍     | 16748/37963 [71:46:20<84:15:10, 14.30s/it]
 44%|████▍     | 16749/37963 [71:46:35<84:11:54, 14.29s/it]
 44%|████▍     | 16750/37963 [71:46:49<84:18:30, 14.31s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '3.055', 'learning_rate': '1.237e-05', 'epoch': '0.4412'}

 44%|████▍     | 16750/37963 [71:46:49<84:18:30, 14.31s/it]
 44%|████▍     | 16751/37963 [71:47:10<95:51:14, 16.27s/it]
 44%|████▍     | 16752/37963 [71:47:24<92:15:02, 15.66s/it]
 44%|████▍     | 16753/37963 [71:47:38<89:48:35, 15.24s/it]
 44%|████▍     | 16754/37963 [71:47:53<88:12:19, 14.97s/it]
 44%|████▍     | 16755/37963 [71:48:07<87:24:44, 14.84s/it]
 44%|████▍     | 16756/37963 [71:48:22<86:41:02, 14.72s/it]
 44%|████▍     | 16757/37963 [71:48:43<97:35:44, 16.57s/it]
 44%|████▍     | 16758/37963 [71:48:57<93:46:28, 15.92s/it]
 44%|████▍     | 16759/37963 [71:49:11<90:57:13, 15.44s/it]
 44%|████▍     | 16760/37963 [71:49:26<89:12:36, 15.15s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '3.537', 'learning_rate': '1.236e-05', 'epoch': '0.4415'}

 44%|████▍     | 16760/37963 [71:49:26<89:12:36, 15.15s/it]
 44%|████▍     | 16761/37963 [71:49:40<87:59:05, 14.94s/it]
 44%|████▍     | 16762/37963 [71:49:55<86:59:16, 14.77s/it]
 44%|████▍     | 16763/37963 [71:50:15<96:38:03, 16.41s/it]
 44%|████▍     | 16764/37963 [71:50:29<93:18:13, 15.84s/it]
 44%|████▍     | 16765/37963 [71:50:50<101:06:52, 17.17s/it]
 44%|████▍     | 16766/37963 [71:51:04<96:15:52, 16.35s/it] 
 44%|████▍     | 16767/37963 [71:51:18<92:47:12, 15.76s/it]
 44%|████▍     | 16768/37963 [71:51:33<90:14:02, 15.33s/it]
 44%|████▍     | 16769/37963 [71:51:47<88:33:13, 15.04s/it]
 44%|████▍     | 16770/37963 [71:52:02<87:33:33, 14.87s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '1.798', 'learning_rate': '1.235e-05', 'epoch': '0.4417'}

 44%|████▍     | 16770/37963 [71:52:02<87:33:33, 14.87s/it]
 44%|████▍     | 16771/37963 [71:52:16<86:03:43, 14.62s/it]
 44%|████▍     | 16772/37963 [71:52:30<85:40:55, 14.56s/it]
 44%|████▍     | 16773/37963 [71:52:44<85:23:38, 14.51s/it]
 44%|████▍     | 16774/37963 [71:52:59<85:15:59, 14.49s/it]
 44%|████▍     | 16775/37963 [71:53:20<96:58:13, 16.48s/it]
 44%|████▍     | 16776/37963 [71:53:34<93:19:49, 15.86s/it]
 44%|████▍     | 16777/37963 [71:53:49<90:45:58, 15.42s/it]
 44%|████▍     | 16778/37963 [71:54:03<88:58:30, 15.12s/it]
 44%|████▍     | 16779/37963 [71:54:18<87:33:47, 14.88s/it]
 44%|████▍     | 16780/37963 [71:54:32<86:06:17, 14.63s/it]
                                                           
{'loss': '0.1511', 'grad_norm': '2.329', 'learning_rate': '1.234e-05', 'epoch': '0.442'}

 44%|████▍     | 16780/37963 [71:54:32<86:06:17, 14.63s/it]
 44%|████▍     | 16781/37963 [71:54:53<97:36:16, 16.59s/it]
 44%|████▍     | 16782/37963 [71:55:07<93:40:51, 15.92s/it]
 44%|████▍     | 16783/37963 [71:55:21<90:54:02, 15.45s/it]
 44%|████▍     | 16784/37963 [71:55:36<89:04:10, 15.14s/it]
 44%|████▍     | 16785/37963 [71:55:57<99:26:19, 16.90s/it]
 44%|████▍     | 16786/37963 [71:56:11<94:00:14, 15.98s/it]
 44%|████▍     | 16787/37963 [71:56:25<90:24:28, 15.37s/it]
 44%|████▍     | 16788/37963 [71:56:38<87:38:32, 14.90s/it]
 44%|████▍     | 16789/37963 [71:56:59<98:18:20, 16.71s/it]
 44%|████▍     | 16790/37963 [71:57:14<94:05:57, 16.00s/it]
                                                           
{'loss': '0.1447', 'grad_norm': '1.895', 'learning_rate': '1.233e-05', 'epoch': '0.4423'}

 44%|████▍     | 16790/37963 [71:57:14<94:05:57, 16.00s/it]
 44%|████▍     | 16791/37963 [71:57:28<91:16:59, 15.52s/it]
 44%|████▍     | 16792/37963 [71:57:42<89:12:57, 15.17s/it]
 44%|████▍     | 16793/37963 [71:57:57<87:49:54, 14.94s/it]
 44%|████▍     | 16794/37963 [71:58:11<86:46:53, 14.76s/it]
 44%|████▍     | 16795/37963 [71:58:25<85:54:32, 14.61s/it]
 44%|████▍     | 16796/37963 [71:58:39<84:36:13, 14.39s/it]
 44%|████▍     | 16797/37963 [71:58:54<84:32:56, 14.38s/it]
 44%|████▍     | 16798/37963 [71:59:14<95:22:14, 16.22s/it]
 44%|████▍     | 16799/37963 [71:59:28<91:50:20, 15.62s/it]
 44%|████▍     | 16800/37963 [71:59:43<89:20:08, 15.20s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '2.367', 'learning_rate': '1.233e-05', 'epoch': '0.4425'}

 44%|████▍     | 16800/37963 [71:59:43<89:20:08, 15.20s/it]
 44%|████▍     | 16801/37963 [71:59:57<88:04:49, 14.98s/it]
 44%|████▍     | 16802/37963 [72:00:11<86:58:07, 14.80s/it]
 44%|████▍     | 16803/37963 [72:00:26<86:30:34, 14.72s/it]
 44%|████▍     | 16804/37963 [72:00:40<85:34:23, 14.56s/it]
 44%|████▍     | 16805/37963 [72:01:01<96:23:05, 16.40s/it]
 44%|████▍     | 16806/37963 [72:01:15<92:52:16, 15.80s/it]
 44%|████▍     | 16807/37963 [72:01:29<89:59:38, 15.31s/it]
 44%|████▍     | 16808/37963 [72:01:44<87:41:56, 14.92s/it]
 44%|████▍     | 16809/37963 [72:01:58<86:47:41, 14.77s/it]
 44%|████▍     | 16810/37963 [72:02:12<86:02:08, 14.64s/it]
                                                           
{'loss': '0.1495', 'grad_norm': '4.148', 'learning_rate': '1.232e-05', 'epoch': '0.4428'}

 44%|████▍     | 16810/37963 [72:02:12<86:02:08, 14.64s/it]
 44%|████▍     | 16811/37963 [72:02:27<85:30:52, 14.55s/it]
 44%|████▍     | 16812/37963 [72:02:41<84:31:20, 14.39s/it]
 44%|████▍     | 16813/37963 [72:03:01<95:40:21, 16.28s/it]
 44%|████▍     | 16814/37963 [72:03:22<102:57:07, 17.52s/it]
 44%|████▍     | 16815/37963 [72:03:36<97:17:59, 16.56s/it] 
 44%|████▍     | 16816/37963 [72:03:51<93:38:19, 15.94s/it]
 44%|████▍     | 16817/37963 [72:04:05<90:47:02, 15.46s/it]
 44%|████▍     | 16818/37963 [72:04:19<88:10:42, 15.01s/it]
 44%|████▍     | 16819/37963 [72:04:33<87:08:18, 14.84s/it]
 44%|████▍     | 16820/37963 [72:04:47<85:31:52, 14.56s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '1.525', 'learning_rate': '1.231e-05', 'epoch': '0.4431'}

 44%|████▍     | 16820/37963 [72:04:47<85:31:52, 14.56s/it]
 44%|████▍     | 16821/37963 [72:05:02<85:23:01, 14.54s/it]
 44%|████▍     | 16822/37963 [72:05:16<85:07:34, 14.50s/it]
 44%|████▍     | 16823/37963 [72:05:30<84:57:36, 14.47s/it]
 44%|████▍     | 16824/37963 [72:05:51<96:29:11, 16.43s/it]
 44%|████▍     | 16825/37963 [72:06:05<92:11:49, 15.70s/it]
 44%|████▍     | 16826/37963 [72:06:20<89:20:03, 15.22s/it]
 44%|████▍     | 16827/37963 [72:06:34<87:23:49, 14.89s/it]
 44%|████▍     | 16828/37963 [72:06:48<86:32:50, 14.74s/it]
 44%|████▍     | 16829/37963 [72:07:03<85:57:44, 14.64s/it]
 44%|████▍     | 16830/37963 [72:07:17<85:40:32, 14.59s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '0.9479', 'learning_rate': '1.23e-05', 'epoch': '0.4433'}

 44%|████▍     | 16830/37963 [72:07:17<85:40:32, 14.59s/it]
 44%|████▍     | 16831/37963 [72:07:31<85:11:19, 14.51s/it]
 44%|████▍     | 16832/37963 [72:07:53<97:16:27, 16.57s/it]
 44%|████▍     | 16833/37963 [72:08:07<93:24:16, 15.91s/it]
 44%|████▍     | 16834/37963 [72:08:22<90:59:28, 15.50s/it]
 44%|████▍     | 16835/37963 [72:08:36<88:56:55, 15.16s/it]
 44%|████▍     | 16836/37963 [72:08:57<98:51:05, 16.84s/it]
 44%|████▍     | 16837/37963 [72:09:18<106:10:02, 18.09s/it]
 44%|████▍     | 16838/37963 [72:09:32<99:35:03, 16.97s/it] 
 44%|████▍     | 16839/37963 [72:09:47<95:07:49, 16.21s/it]
 44%|████▍     | 16840/37963 [72:10:01<91:35:15, 15.61s/it]
                                                           
{'loss': '0.1406', 'grad_norm': '2.373', 'learning_rate': '1.229e-05', 'epoch': '0.4436'}

 44%|████▍     | 16840/37963 [72:10:01<91:35:15, 15.61s/it]
 44%|████▍     | 16841/37963 [72:10:15<89:30:18, 15.26s/it]
 44%|████▍     | 16842/37963 [72:10:29<87:03:31, 14.84s/it]
 44%|████▍     | 16843/37963 [72:10:44<86:23:11, 14.72s/it]
 44%|████▍     | 16844/37963 [72:10:58<85:29:27, 14.57s/it]
 44%|████▍     | 16845/37963 [72:11:12<84:37:55, 14.43s/it]
 44%|████▍     | 16846/37963 [72:11:33<95:39:22, 16.31s/it]
 44%|████▍     | 16847/37963 [72:11:47<91:56:59, 15.68s/it]
 44%|████▍     | 16848/37963 [72:12:01<89:39:19, 15.29s/it]
 44%|████▍     | 16849/37963 [72:12:15<87:57:55, 15.00s/it]
 44%|████▍     | 16850/37963 [72:12:29<85:51:44, 14.64s/it]
                                                           
{'loss': '0.1346', 'grad_norm': '1.021', 'learning_rate': '1.228e-05', 'epoch': '0.4439'}

 44%|████▍     | 16850/37963 [72:12:29<85:51:44, 14.64s/it]
 44%|████▍     | 16851/37963 [72:12:43<83:48:20, 14.29s/it]
 44%|████▍     | 16852/37963 [72:12:57<83:54:25, 14.31s/it]
 44%|████▍     | 16853/37963 [72:13:18<94:58:09, 16.20s/it]
 44%|████▍     | 16854/37963 [72:13:32<91:25:22, 15.59s/it]
 44%|████▍     | 16855/37963 [72:13:45<87:48:46, 14.98s/it]
 44%|████▍     | 16856/37963 [72:14:00<86:45:46, 14.80s/it]
 44%|████▍     | 16857/37963 [72:14:14<85:56:03, 14.66s/it]
 44%|████▍     | 16858/37963 [72:14:28<85:01:44, 14.50s/it]
 44%|████▍     | 16859/37963 [72:14:43<84:48:43, 14.47s/it]
 44%|████▍     | 16860/37963 [72:14:57<84:43:47, 14.45s/it]
                                                           
{'loss': '0.1453', 'grad_norm': '2.618', 'learning_rate': '1.228e-05', 'epoch': '0.4441'}

 44%|████▍     | 16860/37963 [72:14:57<84:43:47, 14.45s/it]
 44%|████▍     | 16861/37963 [72:15:17<94:56:26, 16.20s/it]
 44%|████▍     | 16862/37963 [72:15:38<103:44:15, 17.70s/it]
 44%|████▍     | 16863/37963 [72:15:53<97:53:58, 16.70s/it] 
 44%|████▍     | 16864/37963 [72:16:07<93:29:48, 15.95s/it]
 44%|████▍     | 16865/37963 [72:16:21<89:43:46, 15.31s/it]
 44%|████▍     | 16866/37963 [72:16:35<87:18:16, 14.90s/it]
 44%|████▍     | 16867/37963 [72:16:49<85:35:17, 14.61s/it]
 44%|████▍     | 16868/37963 [72:17:03<84:26:37, 14.41s/it]
 44%|████▍     | 16869/37963 [72:17:17<84:04:00, 14.35s/it]
 44%|████▍     | 16870/37963 [72:17:31<83:44:43, 14.29s/it]
                                                           
{'loss': '0.145', 'grad_norm': '3.965', 'learning_rate': '1.227e-05', 'epoch': '0.4444'}

 44%|████▍     | 16870/37963 [72:17:31<83:44:43, 14.29s/it]
 44%|████▍     | 16871/37963 [72:17:45<83:53:04, 14.32s/it]
 44%|████▍     | 16872/37963 [72:18:00<83:51:24, 14.31s/it]
 44%|████▍     | 16873/37963 [72:18:14<83:50:51, 14.31s/it]
 44%|████▍     | 16874/37963 [72:18:35<96:10:45, 16.42s/it]
 44%|████▍     | 16875/37963 [72:18:50<92:39:53, 15.82s/it]
 44%|████▍     | 16876/37963 [72:19:04<89:31:07, 15.28s/it]
 44%|████▍     | 16877/37963 [72:19:18<87:47:24, 14.99s/it]
 44%|████▍     | 16878/37963 [72:19:32<86:24:04, 14.75s/it]
 44%|████▍     | 16879/37963 [72:19:54<97:48:36, 16.70s/it]
 44%|████▍     | 16880/37963 [72:20:07<92:40:03, 15.82s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '1.398', 'learning_rate': '1.226e-05', 'epoch': '0.4446'}

 44%|████▍     | 16880/37963 [72:20:07<92:40:03, 15.82s/it]
 44%|████▍     | 16881/37963 [72:20:22<90:19:12, 15.42s/it]
 44%|████▍     | 16882/37963 [72:20:36<88:34:28, 15.13s/it]
 44%|████▍     | 16883/37963 [72:20:57<98:25:49, 16.81s/it]
 44%|████▍     | 16884/37963 [72:21:11<94:09:56, 16.08s/it]
 44%|████▍     | 16885/37963 [72:21:26<91:08:57, 15.57s/it]
 44%|████▍     | 16886/37963 [72:21:46<99:38:29, 17.02s/it]
 44%|████▍     | 16887/37963 [72:22:00<94:26:10, 16.13s/it]
 44%|████▍     | 16888/37963 [72:22:15<91:34:24, 15.64s/it]
 44%|████▍     | 16889/37963 [72:22:29<89:18:55, 15.26s/it]
 44%|████▍     | 16890/37963 [72:22:43<87:06:12, 14.88s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '3.513', 'learning_rate': '1.225e-05', 'epoch': '0.4449'}

 44%|████▍     | 16890/37963 [72:22:43<87:06:12, 14.88s/it]
 44%|████▍     | 16891/37963 [72:22:57<86:10:28, 14.72s/it]
 44%|████▍     | 16892/37963 [72:23:12<85:43:51, 14.65s/it]
 44%|████▍     | 16893/37963 [72:23:26<85:18:33, 14.58s/it]
 45%|████▍     | 16894/37963 [72:23:41<85:02:29, 14.53s/it]
 45%|████▍     | 16895/37963 [72:23:55<84:07:51, 14.38s/it]
 45%|████▍     | 16896/37963 [72:24:09<84:07:41, 14.38s/it]
 45%|████▍     | 16897/37963 [72:24:30<96:07:58, 16.43s/it]
 45%|████▍     | 16898/37963 [72:24:45<92:36:49, 15.83s/it]
 45%|████▍     | 16899/37963 [72:24:59<90:02:26, 15.39s/it]
 45%|████▍     | 16900/37963 [72:25:20<99:35:16, 17.02s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '1.236', 'learning_rate': '1.224e-05', 'epoch': '0.4452'}

 45%|████▍     | 16900/37963 [72:25:20<99:35:16, 17.02s/it]
 45%|████▍     | 16901/37963 [72:25:34<95:03:05, 16.25s/it]
 45%|████▍     | 16902/37963 [72:25:49<91:53:51, 15.71s/it]
 45%|████▍     | 16903/37963 [72:26:03<89:10:09, 15.24s/it]
 45%|████▍     | 16904/37963 [72:26:17<87:30:22, 14.96s/it]
 45%|████▍     | 16905/37963 [72:26:32<86:27:06, 14.78s/it]
 45%|████▍     | 16906/37963 [72:26:46<86:02:03, 14.71s/it]
 45%|████▍     | 16907/37963 [72:27:00<84:59:46, 14.53s/it]
 45%|████▍     | 16908/37963 [72:27:15<84:29:52, 14.45s/it]
 45%|████▍     | 16909/37963 [72:27:29<84:22:56, 14.43s/it]
 45%|████▍     | 16910/37963 [72:27:43<83:53:33, 14.35s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '2.825', 'learning_rate': '1.223e-05', 'epoch': '0.4454'}

 45%|████▍     | 16910/37963 [72:27:43<83:53:33, 14.35s/it]
 45%|████▍     | 16911/37963 [72:28:04<95:10:40, 16.28s/it]
 45%|████▍     | 16912/37963 [72:28:18<91:44:19, 15.69s/it]
 45%|████▍     | 16913/37963 [72:28:33<89:17:37, 15.27s/it]
 45%|████▍     | 16914/37963 [72:28:47<87:20:56, 14.94s/it]
 45%|████▍     | 16915/37963 [72:29:01<86:20:20, 14.77s/it]
 45%|████▍     | 16916/37963 [72:29:15<85:15:31, 14.58s/it]
 45%|████▍     | 16917/37963 [72:29:30<84:57:35, 14.53s/it]
 45%|████▍     | 16918/37963 [72:29:44<84:38:59, 14.48s/it]
 45%|████▍     | 16919/37963 [72:29:59<84:46:56, 14.50s/it]
 45%|████▍     | 16920/37963 [72:30:13<84:25:38, 14.44s/it]
                                                           
{'loss': '0.1486', 'grad_norm': '1.972', 'learning_rate': '1.223e-05', 'epoch': '0.4457'}

 45%|████▍     | 16920/37963 [72:30:13<84:25:38, 14.44s/it]
 45%|████▍     | 16921/37963 [72:30:27<84:26:02, 14.45s/it]
 45%|████▍     | 16922/37963 [72:30:42<84:23:08, 14.44s/it]
 45%|████▍     | 16923/37963 [72:31:03<95:59:03, 16.42s/it]
 45%|████▍     | 16924/37963 [72:31:17<92:21:06, 15.80s/it]
 45%|████▍     | 16925/37963 [72:31:31<89:11:54, 15.26s/it]
 45%|████▍     | 16926/37963 [72:31:45<87:33:49, 14.98s/it]
 45%|████▍     | 16927/37963 [72:32:06<97:27:44, 16.68s/it]
 45%|████▍     | 16928/37963 [72:32:20<93:20:34, 15.98s/it]
 45%|████▍     | 16929/37963 [72:32:35<90:25:48, 15.48s/it]
 45%|████▍     | 16930/37963 [72:32:49<88:29:29, 15.15s/it]
                                                           
{'loss': '0.1355', 'grad_norm': '1.865', 'learning_rate': '1.222e-05', 'epoch': '0.446'}

 45%|████▍     | 16930/37963 [72:32:49<88:29:29, 15.15s/it]
 45%|████▍     | 16931/37963 [72:33:10<98:07:37, 16.80s/it]
 45%|████▍     | 16932/37963 [72:33:24<94:06:35, 16.11s/it]
 45%|████▍     | 16933/37963 [72:33:45<101:24:20, 17.36s/it]
 45%|████▍     | 16934/37963 [72:33:59<96:03:24, 16.44s/it] 
 45%|████▍     | 16935/37963 [72:34:13<91:53:29, 15.73s/it]
 45%|████▍     | 16936/37963 [72:34:27<89:24:35, 15.31s/it]
 45%|████▍     | 16937/37963 [72:34:42<87:34:34, 14.99s/it]
 45%|████▍     | 16938/37963 [72:34:56<86:27:54, 14.80s/it]
 45%|████▍     | 16939/37963 [72:35:10<84:52:22, 14.53s/it]
 45%|████▍     | 16940/37963 [72:35:24<84:06:51, 14.40s/it]
                                                           
{'loss': '0.1473', 'grad_norm': '3.228', 'learning_rate': '1.221e-05', 'epoch': '0.4462'}

 45%|████▍     | 16940/37963 [72:35:24<84:06:51, 14.40s/it]
 45%|████▍     | 16941/37963 [72:35:38<84:01:21, 14.39s/it]
 45%|████▍     | 16942/37963 [72:35:53<84:03:07, 14.39s/it]
 45%|████▍     | 16943/37963 [72:36:07<84:05:57, 14.40s/it]
 45%|████▍     | 16944/37963 [72:36:28<94:53:45, 16.25s/it]
 45%|████▍     | 16945/37963 [72:36:42<91:43:14, 15.71s/it]
 45%|████▍     | 16946/37963 [72:36:56<89:05:30, 15.26s/it]
 45%|████▍     | 16947/37963 [72:37:11<87:17:07, 14.95s/it]
 45%|████▍     | 16948/37963 [72:37:25<85:51:13, 14.71s/it]
 45%|████▍     | 16949/37963 [72:37:39<85:19:29, 14.62s/it]
 45%|████▍     | 16950/37963 [72:38:00<97:12:54, 16.66s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '5.506', 'learning_rate': '1.22e-05', 'epoch': '0.4465'}

 45%|████▍     | 16950/37963 [72:38:00<97:12:54, 16.66s/it]
 45%|████▍     | 16951/37963 [72:38:15<93:05:40, 15.95s/it]
 45%|████▍     | 16952/37963 [72:38:29<90:20:17, 15.48s/it]
 45%|████▍     | 16953/37963 [72:38:44<88:42:52, 15.20s/it]
 45%|████▍     | 16954/37963 [72:38:58<87:11:29, 14.94s/it]
 45%|████▍     | 16955/37963 [72:39:12<85:08:56, 14.59s/it]
 45%|████▍     | 16956/37963 [72:39:26<84:39:27, 14.51s/it]
 45%|████▍     | 16957/37963 [72:39:47<95:33:09, 16.38s/it]
 45%|████▍     | 16958/37963 [72:40:01<91:29:58, 15.68s/it]
 45%|████▍     | 16959/37963 [72:40:15<89:15:48, 15.30s/it]
 45%|████▍     | 16960/37963 [72:40:30<87:54:58, 15.07s/it]
                                                           
{'loss': '0.1465', 'grad_norm': '1.583', 'learning_rate': '1.219e-05', 'epoch': '0.4468'}

 45%|████▍     | 16960/37963 [72:40:30<87:54:58, 15.07s/it]
 45%|████▍     | 16961/37963 [72:40:51<98:13:14, 16.84s/it]
 45%|████▍     | 16962/37963 [72:41:05<93:49:36, 16.08s/it]
 45%|████▍     | 16963/37963 [72:41:20<91:24:13, 15.67s/it]
 45%|████▍     | 16964/37963 [72:41:34<88:31:35, 15.18s/it]
 45%|████▍     | 16965/37963 [72:41:48<85:53:33, 14.73s/it]
 45%|████▍     | 16966/37963 [72:42:02<85:13:06, 14.61s/it]
 45%|████▍     | 16967/37963 [72:42:16<84:44:13, 14.53s/it]
 45%|████▍     | 16968/37963 [72:42:31<84:16:18, 14.45s/it]
 45%|████▍     | 16969/37963 [72:42:45<84:15:05, 14.45s/it]
 45%|████▍     | 16970/37963 [72:42:59<84:10:34, 14.44s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '1.116', 'learning_rate': '1.219e-05', 'epoch': '0.447'}

 45%|████▍     | 16970/37963 [72:42:59<84:10:34, 14.44s/it]
 45%|████▍     | 16971/37963 [72:43:21<95:56:04, 16.45s/it]
 45%|████▍     | 16972/37963 [72:43:35<92:07:18, 15.80s/it]
 45%|████▍     | 16973/37963 [72:43:49<89:36:41, 15.37s/it]
 45%|████▍     | 16974/37963 [72:44:03<87:37:01, 15.03s/it]
 45%|████▍     | 16975/37963 [72:44:17<85:34:29, 14.68s/it]
 45%|████▍     | 16976/37963 [72:44:32<84:55:21, 14.57s/it]
 45%|████▍     | 16977/37963 [72:44:53<97:08:25, 16.66s/it]
 45%|████▍     | 16978/37963 [72:45:08<93:15:04, 16.00s/it]
 45%|████▍     | 16979/37963 [72:45:22<90:09:08, 15.47s/it]
 45%|████▍     | 16980/37963 [72:45:36<88:12:33, 15.13s/it]
                                                           
{'loss': '0.1488', 'grad_norm': '2.337', 'learning_rate': '1.218e-05', 'epoch': '0.4473'}

 45%|████▍     | 16980/37963 [72:45:36<88:12:33, 15.13s/it]
 45%|████▍     | 16981/37963 [72:45:57<98:25:40, 16.89s/it]
 45%|████▍     | 16982/37963 [72:46:18<105:15:40, 18.06s/it]
 45%|████▍     | 16983/37963 [72:46:32<98:07:03, 16.84s/it] 
 45%|████▍     | 16984/37963 [72:46:46<93:47:22, 16.09s/it]
 45%|████▍     | 16985/37963 [72:47:01<90:32:34, 15.54s/it]
 45%|████▍     | 16986/37963 [72:47:15<88:29:14, 15.19s/it]
 45%|████▍     | 16987/37963 [72:47:29<85:54:46, 14.74s/it]
 45%|████▍     | 16988/37963 [72:47:43<85:10:24, 14.62s/it]
 45%|████▍     | 16989/37963 [72:47:57<84:42:40, 14.54s/it]
 45%|████▍     | 16990/37963 [72:48:12<84:31:06, 14.51s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '4.112', 'learning_rate': '1.217e-05', 'epoch': '0.4475'}

 45%|████▍     | 16990/37963 [72:48:12<84:31:06, 14.51s/it]
 45%|████▍     | 16991/37963 [72:48:26<83:18:31, 14.30s/it]
 45%|████▍     | 16992/37963 [72:48:40<83:33:57, 14.35s/it]
 45%|████▍     | 16993/37963 [72:48:54<83:43:21, 14.37s/it]
 45%|████▍     | 16994/37963 [72:49:15<94:22:12, 16.20s/it]
 45%|████▍     | 16995/37963 [72:49:29<91:12:55, 15.66s/it]
 45%|████▍     | 16996/37963 [72:49:44<88:56:12, 15.27s/it]
 45%|████▍     | 16997/37963 [72:49:57<86:24:30, 14.84s/it]
 45%|████▍     | 16998/37963 [72:50:12<85:34:54, 14.70s/it]
 45%|████▍     | 16999/37963 [72:50:33<96:49:38, 16.63s/it]
 45%|████▍     | 17000/37963 [72:50:47<92:51:08, 15.95s/it]
                                                           
{'loss': '0.141', 'grad_norm': '1.583', 'learning_rate': '1.216e-05', 'epoch': '0.4478'}

 45%|████▍     | 17000/37963 [72:50:47<92:51:08, 15.95s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:13<00:00, 13.96s/it]
Writing model shards: 100%|██████████| 1/1 [00:13<00:00, 13.96s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 45%|████▍     | 17001/37963 [72:52:31<245:40:19, 42.19s/it]
 45%|████▍     | 17002/37963 [72:52:45<196:43:51, 33.79s/it]
 45%|████▍     | 17003/37963 [72:52:59<162:44:36, 27.95s/it]
 45%|████▍     | 17004/37963 [72:53:14<138:58:46, 23.87s/it]
 45%|████▍     | 17005/37963 [72:53:28<122:03:20, 20.97s/it]
 45%|████▍     | 17006/37963 [72:53:42<110:18:56, 18.95s/it]
 45%|████▍     | 17007/37963 [72:54:02<112:12:26, 19.28s/it]
 45%|████▍     | 17008/37963 [72:54:16<103:18:37, 17.75s/it]
 45%|████▍     | 17009/37963 [72:54:31<97:40:22, 16.78s/it] 
 45%|████▍     | 17010/37963 [72:54:51<104:22:09, 17.93s/it]
                                                            
{'loss': '0.1402', 'grad_norm': '3.293', 'learning_rate': '1.215e-05', 'epoch': '0.4481'}

 45%|████▍     | 17010/37963 [72:54:51<104:22:09, 17.93s/it]
 45%|████▍     | 17011/37963 [72:55:06<97:51:22, 16.81s/it] 
 45%|████▍     | 17012/37963 [72:55:20<93:28:57, 16.06s/it]
 45%|████▍     | 17013/37963 [72:55:34<90:38:54, 15.58s/it]
 45%|████▍     | 17014/37963 [72:55:49<88:26:23, 15.20s/it]
 45%|████▍     | 17015/37963 [72:56:03<86:51:48, 14.93s/it]
 45%|████▍     | 17016/37963 [72:56:17<85:49:16, 14.75s/it]
 45%|████▍     | 17017/37963 [72:56:32<84:57:56, 14.60s/it]
 45%|████▍     | 17018/37963 [72:56:46<84:29:35, 14.52s/it]
 45%|████▍     | 17019/37963 [72:57:07<96:03:25, 16.51s/it]
 45%|████▍     | 17020/37963 [72:57:21<92:24:42, 15.89s/it]
                                                           
{'loss': '0.1427', 'grad_norm': '3.121', 'learning_rate': '1.214e-05', 'epoch': '0.4483'}

 45%|████▍     | 17020/37963 [72:57:21<92:24:42, 15.89s/it]
 45%|████▍     | 17021/37963 [72:57:36<89:46:08, 15.43s/it]
 45%|████▍     | 17022/37963 [72:57:50<88:08:41, 15.15s/it]
 45%|████▍     | 17023/37963 [72:58:05<86:40:40, 14.90s/it]
 45%|████▍     | 17024/37963 [72:58:19<85:50:51, 14.76s/it]
 45%|████▍     | 17025/37963 [72:58:39<95:32:03, 16.43s/it]
 45%|████▍     | 17026/37963 [72:58:54<91:50:08, 15.79s/it]
 45%|████▍     | 17027/37963 [72:59:08<89:11:30, 15.34s/it]
 45%|████▍     | 17028/37963 [72:59:22<87:32:53, 15.05s/it]
 45%|████▍     | 17029/37963 [72:59:43<96:29:27, 16.59s/it]
 45%|████▍     | 17030/37963 [73:00:03<102:20:05, 17.60s/it]
                                                            
{'loss': '0.1578', 'grad_norm': '4.581', 'learning_rate': '1.214e-05', 'epoch': '0.4486'}

 45%|████▍     | 17030/37963 [73:00:03<102:20:05, 17.60s/it]
 45%|████▍     | 17031/37963 [73:00:17<96:46:49, 16.64s/it] 
 45%|████▍     | 17032/37963 [73:00:31<92:04:14, 15.84s/it]
 45%|████▍     | 17033/37963 [73:00:45<89:27:15, 15.39s/it]
 45%|████▍     | 17034/37963 [73:01:00<87:47:38, 15.10s/it]
 45%|████▍     | 17035/37963 [73:01:14<86:34:57, 14.89s/it]
 45%|████▍     | 17036/37963 [73:01:28<84:38:10, 14.56s/it]
 45%|████▍     | 17037/37963 [73:01:42<84:28:31, 14.53s/it]
 45%|████▍     | 17038/37963 [73:01:57<84:07:22, 14.47s/it]
 45%|████▍     | 17039/37963 [73:02:11<83:13:12, 14.32s/it]
 45%|████▍     | 17040/37963 [73:02:25<82:42:17, 14.23s/it]
                                                           
{'loss': '0.1541', 'grad_norm': '1.251', 'learning_rate': '1.213e-05', 'epoch': '0.4489'}

 45%|████▍     | 17040/37963 [73:02:25<82:42:17, 14.23s/it]
 45%|████▍     | 17041/37963 [73:02:39<82:51:42, 14.26s/it]
 45%|████▍     | 17042/37963 [73:02:53<83:18:23, 14.34s/it]
 45%|████▍     | 17043/37963 [73:03:07<82:05:24, 14.13s/it]
 45%|████▍     | 17044/37963 [73:03:27<92:57:45, 16.00s/it]
 45%|████▍     | 17045/37963 [73:03:42<90:12:08, 15.52s/it]
 45%|████▍     | 17046/37963 [73:03:56<87:38:24, 15.08s/it]
 45%|████▍     | 17047/37963 [73:04:17<98:14:43, 16.91s/it]
 45%|████▍     | 17048/37963 [73:04:32<94:06:08, 16.20s/it]
 45%|████▍     | 17049/37963 [73:04:46<90:28:44, 15.57s/it]
 45%|████▍     | 17050/37963 [73:05:00<88:16:54, 15.20s/it]
                                                           
{'loss': '0.1576', 'grad_norm': '1.373', 'learning_rate': '1.212e-05', 'epoch': '0.4491'}

 45%|████▍     | 17050/37963 [73:05:00<88:16:54, 15.20s/it]
 45%|████▍     | 17051/37963 [73:05:14<86:49:14, 14.95s/it]
 45%|████▍     | 17052/37963 [73:05:29<85:50:32, 14.78s/it]
 45%|████▍     | 17053/37963 [73:05:43<84:50:48, 14.61s/it]
 45%|████▍     | 17054/37963 [73:05:57<83:27:21, 14.37s/it]
 45%|████▍     | 17055/37963 [73:06:11<82:34:34, 14.22s/it]
 45%|████▍     | 17056/37963 [73:06:25<82:44:32, 14.25s/it]
 45%|████▍     | 17057/37963 [73:06:39<82:45:46, 14.25s/it]
 45%|████▍     | 17058/37963 [73:07:00<93:47:55, 16.15s/it]
 45%|████▍     | 17059/37963 [73:07:21<101:54:01, 17.55s/it]
 45%|████▍     | 17060/37963 [73:07:35<96:27:42, 16.61s/it] 
                                                           
{'loss': '0.146', 'grad_norm': '6.121', 'learning_rate': '1.211e-05', 'epoch': '0.4494'}

 45%|████▍     | 17060/37963 [73:07:35<96:27:42, 16.61s/it]
 45%|████▍     | 17061/37963 [73:07:50<92:34:52, 15.95s/it]
 45%|████▍     | 17062/37963 [73:08:03<88:52:01, 15.31s/it]
 45%|████▍     | 17063/37963 [73:08:17<86:16:37, 14.86s/it]
 45%|████▍     | 17064/37963 [73:08:31<85:21:38, 14.70s/it]
 45%|████▍     | 17065/37963 [73:08:46<84:20:07, 14.53s/it]
 45%|████▍     | 17066/37963 [73:09:00<83:57:17, 14.46s/it]
 45%|████▍     | 17067/37963 [73:09:14<82:30:12, 14.21s/it]
 45%|████▍     | 17068/37963 [73:09:35<94:36:21, 16.30s/it]
 45%|████▍     | 17069/37963 [73:09:49<91:14:27, 15.72s/it]
 45%|████▍     | 17070/37963 [73:10:04<89:11:16, 15.37s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '1.813', 'learning_rate': '1.21e-05', 'epoch': '0.4496'}

 45%|████▍     | 17070/37963 [73:10:04<89:11:16, 15.37s/it]
 45%|████▍     | 17071/37963 [73:10:25<99:21:04, 17.12s/it]
 45%|████▍     | 17072/37963 [73:10:39<94:33:47, 16.30s/it]
 45%|████▍     | 17073/37963 [73:10:54<91:09:16, 15.71s/it]
 45%|████▍     | 17074/37963 [73:11:08<88:44:34, 15.29s/it]
 45%|████▍     | 17075/37963 [73:11:22<87:26:30, 15.07s/it]
 45%|████▍     | 17076/37963 [73:11:37<86:09:26, 14.85s/it]
 45%|████▍     | 17077/37963 [73:11:51<85:17:05, 14.70s/it]
 45%|████▍     | 17078/37963 [73:12:06<84:50:22, 14.62s/it]
 45%|████▍     | 17079/37963 [73:12:26<95:12:22, 16.41s/it]
 45%|████▍     | 17080/37963 [73:12:47<102:50:33, 17.73s/it]
                                                            
{'loss': '0.1346', 'grad_norm': '1.387', 'learning_rate': '1.209e-05', 'epoch': '0.4499'}

 45%|████▍     | 17080/37963 [73:12:47<102:50:33, 17.73s/it]
 45%|████▍     | 17081/37963 [73:13:01<97:00:18, 16.72s/it] 
 45%|████▍     | 17082/37963 [73:13:16<93:00:30, 16.04s/it]
 45%|████▍     | 17083/37963 [73:13:30<90:03:34, 15.53s/it]
 45%|████▌     | 17084/37963 [73:13:44<87:44:49, 15.13s/it]
 45%|████▌     | 17085/37963 [73:13:58<85:47:48, 14.79s/it]
 45%|████▌     | 17086/37963 [73:14:13<85:00:57, 14.66s/it]
 45%|████▌     | 17087/37963 [73:14:26<83:24:21, 14.38s/it]
 45%|████▌     | 17088/37963 [73:14:41<83:21:52, 14.38s/it]
 45%|████▌     | 17089/37963 [73:14:55<82:55:27, 14.30s/it]
 45%|████▌     | 17090/37963 [73:15:09<82:40:17, 14.26s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '4.478', 'learning_rate': '1.209e-05', 'epoch': '0.4502'}

 45%|████▌     | 17090/37963 [73:15:09<82:40:17, 14.26s/it]
 45%|████▌     | 17091/37963 [73:15:23<82:33:33, 14.24s/it]
 45%|████▌     | 17092/37963 [73:15:44<93:56:43, 16.20s/it]
 45%|████▌     | 17093/37963 [73:15:58<90:49:30, 15.67s/it]
 45%|████▌     | 17094/37963 [73:16:13<88:10:54, 15.21s/it]
 45%|████▌     | 17095/37963 [73:16:27<86:34:54, 14.94s/it]
 45%|████▌     | 17096/37963 [73:16:49<98:33:03, 17.00s/it]
 45%|████▌     | 17097/37963 [73:17:03<93:54:30, 16.20s/it]
 45%|████▌     | 17098/37963 [73:17:17<90:40:34, 15.65s/it]
 45%|████▌     | 17099/37963 [73:17:32<88:22:22, 15.25s/it]
 45%|████▌     | 17100/37963 [73:17:46<86:11:19, 14.87s/it]
                                                           
{'loss': '0.1447', 'grad_norm': '2.16', 'learning_rate': '1.208e-05', 'epoch': '0.4504'}

 45%|████▌     | 17100/37963 [73:17:46<86:11:19, 14.87s/it]
 45%|████▌     | 17101/37963 [73:18:00<85:05:54, 14.68s/it]
 45%|████▌     | 17102/37963 [73:18:14<84:29:48, 14.58s/it]
 45%|████▌     | 17103/37963 [73:18:29<84:09:53, 14.53s/it]
 45%|████▌     | 17104/37963 [73:18:42<82:37:15, 14.26s/it]
 45%|████▌     | 17105/37963 [73:19:03<93:24:59, 16.12s/it]
 45%|████▌     | 17106/37963 [73:19:17<90:05:09, 15.55s/it]
 45%|████▌     | 17107/37963 [73:19:31<88:06:17, 15.21s/it]
 45%|████▌     | 17108/37963 [73:19:46<86:40:36, 14.96s/it]
 45%|████▌     | 17109/37963 [73:20:00<85:20:18, 14.73s/it]
 45%|████▌     | 17110/37963 [73:20:21<96:01:40, 16.58s/it]
                                                           
{'loss': '0.1643', 'grad_norm': '5.36', 'learning_rate': '1.207e-05', 'epoch': '0.4507'}

 45%|████▌     | 17110/37963 [73:20:21<96:01:40, 16.58s/it]
 45%|████▌     | 17111/37963 [73:20:35<92:21:44, 15.95s/it]
 45%|████▌     | 17112/37963 [73:20:49<89:05:37, 15.38s/it]
 45%|████▌     | 17113/37963 [73:21:04<87:19:32, 15.08s/it]
 45%|████▌     | 17114/37963 [73:21:18<86:04:23, 14.86s/it]
 45%|████▌     | 17115/37963 [73:21:32<85:07:44, 14.70s/it]
 45%|████▌     | 17116/37963 [73:21:53<95:52:08, 16.56s/it]
 45%|████▌     | 17117/37963 [73:22:08<91:49:48, 15.86s/it]
 45%|████▌     | 17118/37963 [73:22:22<89:41:25, 15.49s/it]
 45%|████▌     | 17119/37963 [73:22:36<87:07:58, 15.05s/it]
 45%|████▌     | 17120/37963 [73:22:51<85:50:17, 14.83s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '1.988', 'learning_rate': '1.206e-05', 'epoch': '0.451'}

 45%|████▌     | 17120/37963 [73:22:51<85:50:17, 14.83s/it]
 45%|████▌     | 17121/37963 [73:23:12<96:39:20, 16.70s/it]
 45%|████▌     | 17122/37963 [73:23:26<92:39:39, 16.01s/it]
 45%|████▌     | 17123/37963 [73:23:40<89:29:00, 15.46s/it]
 45%|████▌     | 17124/37963 [73:23:55<87:40:28, 15.15s/it]
 45%|████▌     | 17125/37963 [73:24:08<85:09:29, 14.71s/it]
 45%|████▌     | 17126/37963 [73:24:22<83:44:29, 14.47s/it]
 45%|████▌     | 17127/37963 [73:24:43<94:35:33, 16.34s/it]
 45%|████▌     | 17128/37963 [73:24:57<91:03:53, 15.73s/it]
 45%|████▌     | 17129/37963 [73:25:18<99:56:25, 17.27s/it]
 45%|████▌     | 17130/37963 [73:25:32<94:43:34, 16.37s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '3.861', 'learning_rate': '1.205e-05', 'epoch': '0.4512'}

 45%|████▌     | 17130/37963 [73:25:32<94:43:34, 16.37s/it]
 45%|████▌     | 17131/37963 [73:25:47<91:18:05, 15.78s/it]
 45%|████▌     | 17132/37963 [73:26:01<89:02:44, 15.39s/it]
 45%|████▌     | 17133/37963 [73:26:16<87:16:43, 15.08s/it]
 45%|████▌     | 17134/37963 [73:26:30<86:08:20, 14.89s/it]
 45%|████▌     | 17135/37963 [73:26:44<84:21:02, 14.58s/it]
 45%|████▌     | 17136/37963 [73:26:58<84:02:51, 14.53s/it]
 45%|████▌     | 17137/37963 [73:27:13<83:54:42, 14.51s/it]
 45%|████▌     | 17138/37963 [73:27:27<83:44:00, 14.47s/it]
 45%|████▌     | 17139/37963 [73:27:42<83:38:34, 14.46s/it]
 45%|████▌     | 17140/37963 [73:28:02<94:05:02, 16.27s/it]
                                                           
{'loss': '0.1392', 'grad_norm': '1.203', 'learning_rate': '1.204e-05', 'epoch': '0.4515'}

 45%|████▌     | 17140/37963 [73:28:02<94:05:02, 16.27s/it]
 45%|████▌     | 17141/37963 [73:28:17<91:03:11, 15.74s/it]
 45%|████▌     | 17142/37963 [73:28:31<88:08:19, 15.24s/it]
 45%|████▌     | 17143/37963 [73:28:45<86:35:00, 14.97s/it]
 45%|████▌     | 17144/37963 [73:29:06<97:08:11, 16.80s/it]
 45%|████▌     | 17145/37963 [73:29:21<93:07:26, 16.10s/it]
 45%|████▌     | 17146/37963 [73:29:35<90:05:47, 15.58s/it]
 45%|████▌     | 17147/37963 [73:29:49<87:56:20, 15.21s/it]
 45%|████▌     | 17148/37963 [73:30:03<86:10:26, 14.90s/it]
 45%|████▌     | 17149/37963 [73:30:18<85:01:09, 14.70s/it]
 45%|████▌     | 17150/37963 [73:30:32<84:37:38, 14.64s/it]
                                                           
{'loss': '0.1494', 'grad_norm': '2.247', 'learning_rate': '1.203e-05', 'epoch': '0.4518'}

 45%|████▌     | 17150/37963 [73:30:32<84:37:38, 14.64s/it]
 45%|████▌     | 17151/37963 [73:30:47<84:10:05, 14.56s/it]
 45%|████▌     | 17152/37963 [73:31:01<84:14:01, 14.57s/it]
 45%|████▌     | 17153/37963 [73:31:16<84:00:14, 14.53s/it]
 45%|████▌     | 17154/37963 [73:31:29<82:55:22, 14.35s/it]
 45%|████▌     | 17155/37963 [73:31:50<94:15:19, 16.31s/it]
 45%|████▌     | 17156/37963 [73:32:04<90:28:49, 15.65s/it]
 45%|████▌     | 17157/37963 [73:32:19<88:06:40, 15.25s/it]
 45%|████▌     | 17158/37963 [73:32:33<86:40:36, 15.00s/it]
 45%|████▌     | 17159/37963 [73:32:48<85:30:57, 14.80s/it]
 45%|████▌     | 17160/37963 [73:33:08<95:50:05, 16.58s/it]
                                                           
{'loss': '0.1405', 'grad_norm': '3.342', 'learning_rate': '1.203e-05', 'epoch': '0.452'}

 45%|████▌     | 17160/37963 [73:33:08<95:50:05, 16.58s/it]
 45%|████▌     | 17161/37963 [73:33:22<90:45:45, 15.71s/it]
 45%|████▌     | 17162/37963 [73:33:36<88:21:31, 15.29s/it]
 45%|████▌     | 17163/37963 [73:33:51<86:46:09, 15.02s/it]
 45%|████▌     | 17164/37963 [73:34:05<84:46:59, 14.67s/it]
 45%|████▌     | 17165/37963 [73:34:19<84:09:44, 14.57s/it]
 45%|████▌     | 17166/37963 [73:34:40<95:33:42, 16.54s/it]
 45%|████▌     | 17167/37963 [73:34:55<92:03:04, 15.93s/it]
 45%|████▌     | 17168/37963 [73:35:09<89:19:02, 15.46s/it]
 45%|████▌     | 17169/37963 [73:35:23<87:05:37, 15.08s/it]
 45%|████▌     | 17170/37963 [73:35:38<86:03:20, 14.90s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '1.257', 'learning_rate': '1.202e-05', 'epoch': '0.4523'}

 45%|████▌     | 17170/37963 [73:35:38<86:03:20, 14.90s/it]
 45%|████▌     | 17171/37963 [73:35:58<95:36:59, 16.56s/it]
 45%|████▌     | 17172/37963 [73:36:12<91:45:23, 15.89s/it]
 45%|████▌     | 17173/37963 [73:36:27<89:06:57, 15.43s/it]
 45%|████▌     | 17174/37963 [73:36:47<97:22:07, 16.86s/it]
 45%|████▌     | 17175/37963 [73:37:07<103:46:48, 17.97s/it]
 45%|████▌     | 17176/37963 [73:37:22<97:36:37, 16.90s/it] 
 45%|████▌     | 17177/37963 [73:37:36<93:13:43, 16.15s/it]
 45%|████▌     | 17178/37963 [73:37:51<90:10:36, 15.62s/it]
 45%|████▌     | 17179/37963 [73:38:05<87:49:42, 15.21s/it]
 45%|████▌     | 17180/37963 [73:38:19<86:16:52, 14.95s/it]
                                                           
{'loss': '0.1427', 'grad_norm': '1.333', 'learning_rate': '1.201e-05', 'epoch': '0.4525'}

 45%|████▌     | 17180/37963 [73:38:19<86:16:52, 14.95s/it]
 45%|████▌     | 17181/37963 [73:38:33<84:47:04, 14.69s/it]
 45%|████▌     | 17182/37963 [73:38:48<84:07:35, 14.57s/it]
 45%|████▌     | 17183/37963 [73:39:02<83:38:51, 14.49s/it]
 45%|████▌     | 17184/37963 [73:39:16<82:19:04, 14.26s/it]
 45%|████▌     | 17185/37963 [73:39:30<81:51:00, 14.18s/it]
 45%|████▌     | 17186/37963 [73:39:44<82:01:00, 14.21s/it]
 45%|████▌     | 17187/37963 [73:39:58<82:19:51, 14.27s/it]
 45%|████▌     | 17188/37963 [73:40:12<81:49:10, 14.18s/it]
 45%|████▌     | 17189/37963 [73:40:33<92:58:09, 16.11s/it]
 45%|████▌     | 17190/37963 [73:40:47<88:55:58, 15.41s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '2.936', 'learning_rate': '1.2e-05', 'epoch': '0.4528'}

 45%|████▌     | 17190/37963 [73:40:47<88:55:58, 15.41s/it]
 45%|████▌     | 17191/37963 [73:41:01<87:09:52, 15.11s/it]
 45%|████▌     | 17192/37963 [73:41:15<85:53:14, 14.89s/it]
 45%|████▌     | 17193/37963 [73:41:30<84:52:29, 14.71s/it]
 45%|████▌     | 17194/37963 [73:41:51<96:03:02, 16.65s/it]
 45%|████▌     | 17195/37963 [73:42:05<92:12:03, 15.98s/it]
 45%|████▌     | 17196/37963 [73:42:19<88:31:00, 15.34s/it]
 45%|████▌     | 17197/37963 [73:42:34<86:56:12, 15.07s/it]
 45%|████▌     | 17198/37963 [73:42:48<85:39:14, 14.85s/it]
 45%|████▌     | 17199/37963 [73:43:02<84:46:53, 14.70s/it]
 45%|████▌     | 17200/37963 [73:43:17<84:12:58, 14.60s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '1.207', 'learning_rate': '1.199e-05', 'epoch': '0.4531'}

 45%|████▌     | 17200/37963 [73:43:17<84:12:58, 14.60s/it]
 45%|████▌     | 17201/37963 [73:43:31<83:47:21, 14.53s/it]
 45%|████▌     | 17202/37963 [73:43:45<83:00:20, 14.39s/it]
 45%|████▌     | 17203/37963 [73:44:06<94:07:16, 16.32s/it]
 45%|████▌     | 17204/37963 [73:44:20<90:52:00, 15.76s/it]
 45%|████▌     | 17205/37963 [73:44:34<87:35:47, 15.19s/it]
 45%|████▌     | 17206/37963 [73:44:49<86:11:17, 14.95s/it]
 45%|████▌     | 17207/37963 [73:45:03<85:23:06, 14.81s/it]
 45%|████▌     | 17208/37963 [73:45:24<96:02:09, 16.66s/it]
 45%|████▌     | 17209/37963 [73:45:38<91:24:52, 15.86s/it]
 45%|████▌     | 17210/37963 [73:45:52<88:46:16, 15.40s/it]
                                                           
{'loss': '0.146', 'grad_norm': '1.105', 'learning_rate': '1.198e-05', 'epoch': '0.4533'}

 45%|████▌     | 17210/37963 [73:45:52<88:46:16, 15.40s/it]
 45%|████▌     | 17211/37963 [73:46:07<87:14:02, 15.13s/it]
 45%|████▌     | 17212/37963 [73:46:21<85:17:29, 14.80s/it]
 45%|████▌     | 17213/37963 [73:46:35<83:58:55, 14.57s/it]
 45%|████▌     | 17214/37963 [73:46:56<95:11:21, 16.52s/it]
 45%|████▌     | 17215/37963 [73:47:10<91:37:36, 15.90s/it]
 45%|████▌     | 17216/37963 [73:47:25<88:56:44, 15.43s/it]
 45%|████▌     | 17217/37963 [73:47:39<87:17:20, 15.15s/it]
 45%|████▌     | 17218/37963 [73:47:54<86:12:22, 14.96s/it]
 45%|████▌     | 17219/37963 [73:48:08<85:21:07, 14.81s/it]
 45%|████▌     | 17220/37963 [73:48:29<96:17:02, 16.71s/it]
                                                           
{'loss': '0.1377', 'grad_norm': '2.135', 'learning_rate': '1.198e-05', 'epoch': '0.4536'}

 45%|████▌     | 17220/37963 [73:48:29<96:17:02, 16.71s/it]
 45%|████▌     | 17221/37963 [73:48:44<92:26:05, 16.04s/it]
 45%|████▌     | 17222/37963 [73:48:58<89:26:33, 15.52s/it]
 45%|████▌     | 17223/37963 [73:49:13<87:29:38, 15.19s/it]
 45%|████▌     | 17224/37963 [73:49:34<97:57:03, 17.00s/it]
 45%|████▌     | 17225/37963 [73:49:48<93:26:05, 16.22s/it]
 45%|████▌     | 17226/37963 [73:50:03<90:09:55, 15.65s/it]
 45%|████▌     | 17227/37963 [73:50:17<87:54:48, 15.26s/it]
 45%|████▌     | 17228/37963 [73:50:31<86:18:05, 14.98s/it]
 45%|████▌     | 17229/37963 [73:50:45<84:13:50, 14.62s/it]
 45%|████▌     | 17230/37963 [73:50:59<83:53:59, 14.57s/it]
                                                           
{'loss': '0.14', 'grad_norm': '2.27', 'learning_rate': '1.197e-05', 'epoch': '0.4539'}

 45%|████▌     | 17230/37963 [73:50:59<83:53:59, 14.57s/it]
 45%|████▌     | 17231/37963 [73:51:14<83:32:43, 14.51s/it]
 45%|████▌     | 17232/37963 [73:51:28<83:15:59, 14.46s/it]
 45%|████▌     | 17233/37963 [73:51:43<83:24:38, 14.49s/it]
 45%|████▌     | 17234/37963 [73:51:57<83:14:35, 14.46s/it]
 45%|████▌     | 17235/37963 [73:52:12<83:05:25, 14.43s/it]
 45%|████▌     | 17236/37963 [73:52:25<81:53:29, 14.22s/it]
 45%|████▌     | 17237/37963 [73:52:40<82:04:54, 14.26s/it]
 45%|████▌     | 17238/37963 [73:52:54<82:10:22, 14.27s/it]
 45%|████▌     | 17239/37963 [73:53:08<82:24:38, 14.32s/it]
 45%|████▌     | 17240/37963 [73:53:29<93:31:15, 16.25s/it]
                                                           
{'loss': '0.1525', 'grad_norm': '3.505', 'learning_rate': '1.196e-05', 'epoch': '0.4541'}

 45%|████▌     | 17240/37963 [73:53:29<93:31:15, 16.25s/it]
 45%|████▌     | 17241/37963 [73:53:43<90:17:11, 15.69s/it]
 45%|████▌     | 17242/37963 [73:53:58<88:08:03, 15.31s/it]
 45%|████▌     | 17243/37963 [73:54:19<97:49:01, 17.00s/it]
 45%|████▌     | 17244/37963 [73:54:32<91:55:07, 15.97s/it]
 45%|████▌     | 17245/37963 [73:54:47<89:14:05, 15.51s/it]
 45%|████▌     | 17246/37963 [73:55:01<87:40:51, 15.24s/it]
 45%|████▌     | 17247/37963 [73:55:16<86:10:56, 14.98s/it]
 45%|████▌     | 17248/37963 [73:55:30<85:07:13, 14.79s/it]
 45%|████▌     | 17249/37963 [73:55:45<84:22:34, 14.66s/it]
 45%|████▌     | 17250/37963 [73:56:05<94:17:25, 16.39s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '1.667', 'learning_rate': '1.195e-05', 'epoch': '0.4544'}

 45%|████▌     | 17250/37963 [73:56:05<94:17:25, 16.39s/it]
 45%|████▌     | 17251/37963 [73:56:19<90:43:08, 15.77s/it]
 45%|████▌     | 17252/37963 [73:56:33<87:46:00, 15.26s/it]
 45%|████▌     | 17253/37963 [73:56:47<85:29:53, 14.86s/it]
 45%|████▌     | 17254/37963 [73:57:02<84:43:50, 14.73s/it]
 45%|████▌     | 17255/37963 [73:57:23<95:24:16, 16.59s/it]
 45%|████▌     | 17256/37963 [73:57:37<91:14:12, 15.86s/it]
 45%|████▌     | 17257/37963 [73:57:51<88:38:36, 15.41s/it]
 45%|████▌     | 17258/37963 [73:58:05<86:43:11, 15.08s/it]
 45%|████▌     | 17259/37963 [73:58:20<85:28:08, 14.86s/it]
 45%|████▌     | 17260/37963 [73:58:33<82:58:36, 14.43s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '3.537', 'learning_rate': '1.194e-05', 'epoch': '0.4547'}

 45%|████▌     | 17260/37963 [73:58:33<82:58:36, 14.43s/it]
 45%|████▌     | 17261/37963 [73:58:47<82:14:43, 14.30s/it]
 45%|████▌     | 17262/37963 [73:59:01<81:15:17, 14.13s/it]
 45%|████▌     | 17263/37963 [73:59:22<93:07:57, 16.20s/it]
 45%|████▌     | 17264/37963 [73:59:36<89:58:11, 15.65s/it]
 45%|████▌     | 17265/37963 [73:59:51<87:37:01, 15.24s/it]
 45%|████▌     | 17266/37963 [74:00:05<86:03:28, 14.97s/it]
 45%|████▌     | 17267/37963 [74:00:19<84:30:30, 14.70s/it]
 45%|████▌     | 17268/37963 [74:00:33<83:48:59, 14.58s/it]
 45%|████▌     | 17269/37963 [74:00:54<94:45:16, 16.48s/it]
 45%|████▌     | 17270/37963 [74:01:09<91:07:31, 15.85s/it]
                                                           
{'loss': '0.1486', 'grad_norm': '2.105', 'learning_rate': '1.193e-05', 'epoch': '0.4549'}

 45%|████▌     | 17270/37963 [74:01:09<91:07:31, 15.85s/it]
 45%|████▌     | 17271/37963 [74:01:23<88:34:42, 15.41s/it]
 45%|████▌     | 17272/37963 [74:01:49<107:32:18, 18.71s/it]
 45%|████▌     | 17273/37963 [74:02:04<100:01:02, 17.40s/it]
 46%|████▌     | 17274/37963 [74:02:18<94:44:02, 16.48s/it] 
 46%|████▌     | 17275/37963 [74:02:32<91:01:34, 15.84s/it]
 46%|████▌     | 17276/37963 [74:02:47<88:30:58, 15.40s/it]
 46%|████▌     | 17277/37963 [74:03:01<86:04:36, 14.98s/it]
 46%|████▌     | 17278/37963 [74:03:15<84:33:14, 14.72s/it]
 46%|████▌     | 17279/37963 [74:03:29<83:38:49, 14.56s/it]
 46%|████▌     | 17280/37963 [74:03:43<83:13:31, 14.49s/it]
                                                           
{'loss': '0.1492', 'grad_norm': '1.073', 'learning_rate': '1.193e-05', 'epoch': '0.4552'}

 46%|████▌     | 17280/37963 [74:03:43<83:13:31, 14.49s/it]
 46%|████▌     | 17281/37963 [74:03:58<83:03:12, 14.46s/it]
 46%|████▌     | 17282/37963 [74:04:12<82:54:37, 14.43s/it]
 46%|████▌     | 17283/37963 [74:04:26<82:15:24, 14.32s/it]
 46%|████▌     | 17284/37963 [74:04:41<82:17:16, 14.33s/it]
 46%|████▌     | 17285/37963 [74:04:55<82:23:14, 14.34s/it]
 46%|████▌     | 17286/37963 [74:05:09<82:22:13, 14.34s/it]
 46%|████▌     | 17287/37963 [74:05:24<82:36:31, 14.38s/it]
 46%|████▌     | 17288/37963 [74:05:38<82:36:02, 14.38s/it]
 46%|████▌     | 17289/37963 [74:05:58<91:36:26, 15.95s/it]
 46%|████▌     | 17290/37963 [74:06:12<88:31:29, 15.42s/it]
                                                           
{'loss': '0.1584', 'grad_norm': '2.024', 'learning_rate': '1.192e-05', 'epoch': '0.4554'}

 46%|████▌     | 17290/37963 [74:06:12<88:31:29, 15.42s/it]
 46%|████▌     | 17291/37963 [74:06:26<86:19:05, 15.03s/it]
 46%|████▌     | 17292/37963 [74:06:47<96:21:38, 16.78s/it]
 46%|████▌     | 17293/37963 [74:07:01<92:00:26, 16.02s/it]
 46%|████▌     | 17294/37963 [74:07:16<89:10:44, 15.53s/it]
 46%|████▌     | 17295/37963 [74:07:30<87:11:10, 15.19s/it]
 46%|████▌     | 17296/37963 [74:07:44<85:39:30, 14.92s/it]
 46%|████▌     | 17297/37963 [74:08:05<95:49:15, 16.69s/it]
 46%|████▌     | 17298/37963 [74:08:19<91:31:18, 15.94s/it]
 46%|████▌     | 17299/37963 [74:08:34<89:00:42, 15.51s/it]
 46%|████▌     | 17300/37963 [74:08:48<86:37:20, 15.09s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '2.404', 'learning_rate': '1.191e-05', 'epoch': '0.4557'}

 46%|████▌     | 17300/37963 [74:08:48<86:37:20, 15.09s/it]
 46%|████▌     | 17301/37963 [74:09:02<84:36:18, 14.74s/it]
 46%|████▌     | 17302/37963 [74:09:16<83:59:55, 14.64s/it]
 46%|████▌     | 17303/37963 [74:09:31<83:28:59, 14.55s/it]
 46%|████▌     | 17304/37963 [74:09:51<94:25:37, 16.45s/it]
 46%|████▌     | 17305/37963 [74:10:06<90:42:00, 15.81s/it]
 46%|████▌     | 17306/37963 [74:10:20<87:55:16, 15.32s/it]
 46%|████▌     | 17307/37963 [74:10:34<86:16:53, 15.04s/it]
 46%|████▌     | 17308/37963 [74:10:49<85:13:39, 14.85s/it]
 46%|████▌     | 17309/37963 [74:11:03<84:28:53, 14.73s/it]
 46%|████▌     | 17310/37963 [74:11:17<83:47:57, 14.61s/it]
                                                           
{'loss': '0.1461', 'grad_norm': '4.219', 'learning_rate': '1.19e-05', 'epoch': '0.456'}

 46%|████▌     | 17310/37963 [74:11:17<83:47:57, 14.61s/it]
 46%|████▌     | 17311/37963 [74:11:31<82:02:41, 14.30s/it]
 46%|████▌     | 17312/37963 [74:11:52<93:31:06, 16.30s/it]
 46%|████▌     | 17313/37963 [74:12:07<90:32:19, 15.78s/it]
 46%|████▌     | 17314/37963 [74:12:21<88:12:23, 15.38s/it]
 46%|████▌     | 17315/37963 [74:12:35<86:20:21, 15.05s/it]
 46%|████▌     | 17316/37963 [74:12:50<84:54:50, 14.81s/it]
 46%|████▌     | 17317/37963 [74:13:10<94:42:37, 16.51s/it]
 46%|████▌     | 17318/37963 [74:13:24<90:51:03, 15.84s/it]
 46%|████▌     | 17319/37963 [74:13:38<87:34:23, 15.27s/it]
 46%|████▌     | 17320/37963 [74:13:52<85:20:07, 14.88s/it]
                                                           
{'loss': '0.1546', 'grad_norm': '2.162', 'learning_rate': '1.189e-05', 'epoch': '0.4562'}

 46%|████▌     | 17320/37963 [74:13:52<85:20:07, 14.88s/it]
 46%|████▌     | 17321/37963 [74:14:13<95:32:16, 16.66s/it]
 46%|████▌     | 17322/37963 [74:14:34<102:41:10, 17.91s/it]
 46%|████▌     | 17323/37963 [74:14:48<96:35:52, 16.85s/it] 
 46%|████▌     | 17324/37963 [74:15:03<92:15:18, 16.09s/it]
 46%|████▌     | 17325/37963 [74:15:17<89:03:13, 15.53s/it]
 46%|████▌     | 17326/37963 [74:15:31<87:03:23, 15.19s/it]
 46%|████▌     | 17327/37963 [74:15:45<85:29:28, 14.91s/it]
 46%|████▌     | 17328/37963 [74:16:00<84:29:46, 14.74s/it]
 46%|████▌     | 17329/37963 [74:16:14<83:10:06, 14.51s/it]
 46%|████▌     | 17330/37963 [74:16:28<82:59:23, 14.48s/it]
                                                           
{'loss': '0.142', 'grad_norm': '0.9743', 'learning_rate': '1.188e-05', 'epoch': '0.4565'}

 46%|████▌     | 17330/37963 [74:16:28<82:59:23, 14.48s/it]
 46%|████▌     | 17331/37963 [74:16:42<81:42:51, 14.26s/it]
 46%|████▌     | 17332/37963 [74:16:56<81:59:39, 14.31s/it]
 46%|████▌     | 17333/37963 [74:17:11<82:05:50, 14.33s/it]
 46%|████▌     | 17334/37963 [74:17:25<82:01:29, 14.31s/it]
 46%|████▌     | 17335/37963 [74:17:39<81:28:05, 14.22s/it]
 46%|████▌     | 17336/37963 [74:18:00<92:28:06, 16.14s/it]
 46%|████▌     | 17337/37963 [74:18:14<89:23:13, 15.60s/it]
 46%|████▌     | 17338/37963 [74:18:29<87:39:24, 15.30s/it]
 46%|████▌     | 17339/37963 [74:18:43<85:29:20, 14.92s/it]
 46%|████▌     | 17340/37963 [74:18:57<84:34:50, 14.76s/it]
                                                           
{'loss': '0.1358', 'grad_norm': '2.067', 'learning_rate': '1.188e-05', 'epoch': '0.4568'}

 46%|████▌     | 17340/37963 [74:18:57<84:34:50, 14.76s/it]
 46%|████▌     | 17341/37963 [74:19:11<83:36:45, 14.60s/it]
 46%|████▌     | 17342/37963 [74:19:32<94:59:19, 16.58s/it]
 46%|████▌     | 17343/37963 [74:19:47<91:16:59, 15.94s/it]
 46%|████▌     | 17344/37963 [74:20:01<88:34:04, 15.46s/it]
 46%|████▌     | 17345/37963 [74:20:15<86:26:44, 15.09s/it]
 46%|████▌     | 17346/37963 [74:20:36<95:03:15, 16.60s/it]
 46%|████▌     | 17347/37963 [74:20:50<91:26:25, 15.97s/it]
 46%|████▌     | 17348/37963 [74:21:04<88:18:10, 15.42s/it]
 46%|████▌     | 17349/37963 [74:21:19<86:21:37, 15.08s/it]
 46%|████▌     | 17350/37963 [74:21:33<85:23:32, 14.91s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '4.921', 'learning_rate': '1.187e-05', 'epoch': '0.457'}

 46%|████▌     | 17350/37963 [74:21:33<85:23:32, 14.91s/it]
 46%|████▌     | 17351/37963 [74:21:47<83:54:41, 14.66s/it]
 46%|████▌     | 17352/37963 [74:22:01<83:28:57, 14.58s/it]
 46%|████▌     | 17353/37963 [74:22:23<95:09:31, 16.62s/it]
 46%|████▌     | 17354/37963 [74:22:37<91:17:25, 15.95s/it]
 46%|████▌     | 17355/37963 [74:22:51<88:13:29, 15.41s/it]
 46%|████▌     | 17356/37963 [74:23:06<86:20:47, 15.08s/it]
 46%|████▌     | 17357/37963 [74:23:20<85:03:05, 14.86s/it]
 46%|████▌     | 17358/37963 [74:23:34<83:48:35, 14.64s/it]
 46%|████▌     | 17359/37963 [74:23:48<82:20:32, 14.39s/it]
 46%|████▌     | 17360/37963 [74:24:02<82:16:08, 14.38s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '2.734', 'learning_rate': '1.186e-05', 'epoch': '0.4573'}

 46%|████▌     | 17360/37963 [74:24:02<82:16:08, 14.38s/it]
 46%|████▌     | 17361/37963 [74:24:23<93:16:51, 16.30s/it]
 46%|████▌     | 17362/37963 [74:24:38<89:59:54, 15.73s/it]
 46%|████▌     | 17363/37963 [74:24:52<87:41:08, 15.32s/it]
 46%|████▌     | 17364/37963 [74:25:06<85:53:26, 15.01s/it]
 46%|████▌     | 17365/37963 [74:25:27<95:48:49, 16.75s/it]
 46%|████▌     | 17366/37963 [74:25:41<91:42:36, 16.03s/it]
 46%|████▌     | 17367/37963 [74:25:56<88:56:39, 15.55s/it]
 46%|████▌     | 17368/37963 [74:26:10<87:01:35, 15.21s/it]
 46%|████▌     | 17369/37963 [74:26:25<85:37:18, 14.97s/it]
 46%|████▌     | 17370/37963 [74:26:38<83:47:23, 14.65s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '7.373', 'learning_rate': '1.185e-05', 'epoch': '0.4576'}

 46%|████▌     | 17370/37963 [74:26:38<83:47:23, 14.65s/it]
 46%|████▌     | 17371/37963 [74:27:00<95:38:08, 16.72s/it]
 46%|████▌     | 17372/37963 [74:27:14<91:32:09, 16.00s/it]
 46%|████▌     | 17373/37963 [74:27:35<99:19:28, 17.37s/it]
 46%|████▌     | 17374/37963 [74:27:49<94:08:16, 16.46s/it]
 46%|████▌     | 17375/37963 [74:28:03<89:47:43, 15.70s/it]
 46%|████▌     | 17376/37963 [74:28:18<87:27:04, 15.29s/it]
 46%|████▌     | 17377/37963 [74:28:32<85:57:59, 15.03s/it]
 46%|████▌     | 17378/37963 [74:28:46<84:48:35, 14.83s/it]
 46%|████▌     | 17379/37963 [74:29:01<83:48:20, 14.66s/it]
 46%|████▌     | 17380/37963 [74:29:15<83:19:28, 14.57s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '1.366', 'learning_rate': '1.184e-05', 'epoch': '0.4578'}

 46%|████▌     | 17380/37963 [74:29:15<83:19:28, 14.57s/it]
 46%|████▌     | 17381/37963 [74:29:29<82:57:22, 14.51s/it]
 46%|████▌     | 17382/37963 [74:29:44<82:40:24, 14.46s/it]
 46%|████▌     | 17383/37963 [74:29:58<82:53:27, 14.50s/it]
 46%|████▌     | 17384/37963 [74:30:13<82:38:46, 14.46s/it]
 46%|████▌     | 17385/37963 [74:30:27<82:48:57, 14.49s/it]
 46%|████▌     | 17386/37963 [74:30:48<93:50:36, 16.42s/it]
 46%|████▌     | 17387/37963 [74:31:02<90:16:45, 15.80s/it]
 46%|████▌     | 17388/37963 [74:31:17<87:51:23, 15.37s/it]
 46%|████▌     | 17389/37963 [74:31:31<86:19:10, 15.10s/it]
 46%|████▌     | 17390/37963 [74:31:53<97:05:21, 16.99s/it]
                                                           
{'loss': '0.159', 'grad_norm': '3.278', 'learning_rate': '1.183e-05', 'epoch': '0.4581'}

 46%|████▌     | 17390/37963 [74:31:53<97:05:21, 16.99s/it]
 46%|████▌     | 17391/37963 [74:32:07<92:18:51, 16.15s/it]
 46%|████▌     | 17392/37963 [74:32:21<89:18:07, 15.63s/it]
 46%|████▌     | 17393/37963 [74:32:36<87:13:30, 15.27s/it]
 46%|████▌     | 17394/37963 [74:32:50<85:45:09, 15.01s/it]
 46%|████▌     | 17395/37963 [74:33:04<84:40:11, 14.82s/it]
 46%|████▌     | 17396/37963 [74:33:25<94:39:31, 16.57s/it]
 46%|████▌     | 17397/37963 [74:33:39<90:48:15, 15.89s/it]
 46%|████▌     | 17398/37963 [74:33:54<88:10:05, 15.43s/it]
 46%|████▌     | 17399/37963 [74:34:08<86:42:35, 15.18s/it]
 46%|████▌     | 17400/37963 [74:34:29<95:21:28, 16.69s/it]
                                                           
{'loss': '0.1403', 'grad_norm': '2.515', 'learning_rate': '1.183e-05', 'epoch': '0.4583'}

 46%|████▌     | 17400/37963 [74:34:29<95:21:28, 16.69s/it]
 46%|████▌     | 17401/37963 [74:34:43<91:25:07, 16.01s/it]
 46%|████▌     | 17402/37963 [74:34:57<88:30:11, 15.50s/it]
 46%|████▌     | 17403/37963 [74:35:12<86:34:43, 15.16s/it]
 46%|████▌     | 17404/37963 [74:35:26<85:15:58, 14.93s/it]
 46%|████▌     | 17405/37963 [74:35:40<84:08:51, 14.74s/it]
 46%|████▌     | 17406/37963 [74:35:55<83:19:10, 14.59s/it]
 46%|████▌     | 17407/37963 [74:36:09<82:53:40, 14.52s/it]
 46%|████▌     | 17408/37963 [74:36:23<82:42:27, 14.49s/it]
 46%|████▌     | 17409/37963 [74:36:37<81:47:15, 14.32s/it]
 46%|████▌     | 17410/37963 [74:36:59<93:45:13, 16.42s/it]
                                                           
{'loss': '0.1543', 'grad_norm': '3.6', 'learning_rate': '1.182e-05', 'epoch': '0.4586'}

 46%|████▌     | 17410/37963 [74:36:59<93:45:13, 16.42s/it]
 46%|████▌     | 17411/37963 [74:37:13<90:14:17, 15.81s/it]
 46%|████▌     | 17412/37963 [74:37:27<87:43:50, 15.37s/it]
 46%|████▌     | 17413/37963 [74:37:42<86:14:02, 15.11s/it]
 46%|████▌     | 17414/37963 [74:38:03<96:55:41, 16.98s/it]
 46%|████▌     | 17415/37963 [74:38:18<92:20:50, 16.18s/it]
 46%|████▌     | 17416/37963 [74:38:32<89:09:18, 15.62s/it]
 46%|████▌     | 17417/37963 [74:38:46<86:59:38, 15.24s/it]
 46%|████▌     | 17418/37963 [74:39:01<85:24:29, 14.97s/it]
 46%|████▌     | 17419/37963 [74:39:15<84:25:27, 14.79s/it]
 46%|████▌     | 17420/37963 [74:39:29<83:20:45, 14.61s/it]
                                                           
{'loss': '0.1536', 'grad_norm': '1.278', 'learning_rate': '1.181e-05', 'epoch': '0.4589'}

 46%|████▌     | 17420/37963 [74:39:29<83:20:45, 14.61s/it]
 46%|████▌     | 17421/37963 [74:39:44<83:06:54, 14.57s/it]
 46%|████▌     | 17422/37963 [74:40:04<93:38:25, 16.41s/it]
 46%|████▌     | 17423/37963 [74:40:19<90:02:05, 15.78s/it]
 46%|████▌     | 17424/37963 [74:40:39<98:40:38, 17.30s/it]
 46%|████▌     | 17425/37963 [74:40:54<93:38:10, 16.41s/it]
 46%|████▌     | 17426/37963 [74:41:08<90:11:13, 15.81s/it]
 46%|████▌     | 17427/37963 [74:41:23<87:38:06, 15.36s/it]
 46%|████▌     | 17428/37963 [74:41:37<85:57:37, 15.07s/it]
 46%|████▌     | 17429/37963 [74:41:51<84:47:58, 14.87s/it]
 46%|████▌     | 17430/37963 [74:42:05<83:16:17, 14.60s/it]
                                                           
{'loss': '0.1533', 'grad_norm': '5.019', 'learning_rate': '1.18e-05', 'epoch': '0.4591'}

 46%|████▌     | 17430/37963 [74:42:05<83:16:17, 14.60s/it]
 46%|████▌     | 17431/37963 [74:42:19<82:00:03, 14.38s/it]
 46%|████▌     | 17432/37963 [74:42:34<82:02:32, 14.39s/it]
 46%|████▌     | 17433/37963 [74:42:48<82:04:18, 14.39s/it]
 46%|████▌     | 17434/37963 [74:43:02<81:45:23, 14.34s/it]
 46%|████▌     | 17435/37963 [74:43:22<91:38:22, 16.07s/it]
 46%|████▌     | 17436/37963 [74:43:37<88:41:07, 15.55s/it]
 46%|████▌     | 17437/37963 [74:43:50<85:44:18, 15.04s/it]
 46%|████▌     | 17438/37963 [74:44:12<96:11:19, 16.87s/it]
 46%|████▌     | 17439/37963 [74:44:26<91:59:25, 16.14s/it]
 46%|████▌     | 17440/37963 [74:44:40<88:56:42, 15.60s/it]
                                                           
{'loss': '0.1448', 'grad_norm': '2.661', 'learning_rate': '1.179e-05', 'epoch': '0.4594'}

 46%|████▌     | 17440/37963 [74:44:40<88:56:42, 15.60s/it]
 46%|████▌     | 17441/37963 [74:44:55<86:41:20, 15.21s/it]
 46%|████▌     | 17442/37963 [74:45:09<85:20:20, 14.97s/it]
 46%|████▌     | 17443/37963 [74:45:24<84:28:05, 14.82s/it]
 46%|████▌     | 17444/37963 [74:45:38<83:34:33, 14.66s/it]
 46%|████▌     | 17445/37963 [74:45:58<93:45:19, 16.45s/it]
 46%|████▌     | 17446/37963 [74:46:13<90:13:55, 15.83s/it]
 46%|████▌     | 17447/37963 [74:46:27<87:37:10, 15.37s/it]
 46%|████▌     | 17448/37963 [74:46:42<85:53:13, 15.07s/it]
 46%|████▌     | 17449/37963 [74:46:55<83:54:56, 14.73s/it]
 46%|████▌     | 17450/37963 [74:47:10<82:49:13, 14.53s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '5.198', 'learning_rate': '1.178e-05', 'epoch': '0.4597'}

 46%|████▌     | 17450/37963 [74:47:10<82:49:13, 14.53s/it]
 46%|████▌     | 17451/37963 [74:47:24<82:31:54, 14.48s/it]
 46%|████▌     | 17452/37963 [74:47:38<82:23:37, 14.46s/it]
 46%|████▌     | 17453/37963 [74:47:59<93:35:47, 16.43s/it]
 46%|████▌     | 17454/37963 [74:48:14<90:03:20, 15.81s/it]
 46%|████▌     | 17455/37963 [74:48:28<87:25:45, 15.35s/it]
 46%|████▌     | 17456/37963 [74:48:42<84:28:07, 14.83s/it]
 46%|████▌     | 17457/37963 [74:48:55<82:54:41, 14.56s/it]
 46%|████▌     | 17458/37963 [74:49:16<93:47:53, 16.47s/it]
 46%|████▌     | 17459/37963 [74:49:31<89:44:57, 15.76s/it]
 46%|████▌     | 17460/37963 [74:49:44<86:12:21, 15.14s/it]
                                                           
{'loss': '0.1521', 'grad_norm': '2.13', 'learning_rate': '1.178e-05', 'epoch': '0.4599'}

 46%|████▌     | 17460/37963 [74:49:44<86:12:21, 15.14s/it]
 46%|████▌     | 17461/37963 [74:50:05<96:14:38, 16.90s/it]
 46%|████▌     | 17462/37963 [74:50:20<92:31:25, 16.25s/it]
 46%|████▌     | 17463/37963 [74:50:34<89:25:21, 15.70s/it]
 46%|████▌     | 17464/37963 [74:50:49<87:09:37, 15.31s/it]
 46%|████▌     | 17465/37963 [74:51:03<85:29:08, 15.01s/it]
 46%|████▌     | 17466/37963 [74:51:17<84:23:56, 14.82s/it]
 46%|████▌     | 17467/37963 [74:51:31<82:16:37, 14.45s/it]
 46%|████▌     | 17468/37963 [74:51:45<82:06:50, 14.42s/it]
 46%|████▌     | 17469/37963 [74:52:00<81:58:18, 14.40s/it]
 46%|████▌     | 17470/37963 [74:52:14<81:54:42, 14.39s/it]
                                                           
{'loss': '0.1582', 'grad_norm': '1.808', 'learning_rate': '1.177e-05', 'epoch': '0.4602'}

 46%|████▌     | 17470/37963 [74:52:14<81:54:42, 14.39s/it]
 46%|████▌     | 17471/37963 [74:52:28<81:49:30, 14.37s/it]
 46%|████▌     | 17472/37963 [74:52:43<81:46:25, 14.37s/it]
 46%|████▌     | 17473/37963 [74:53:10<103:46:00, 18.23s/it]
 46%|████▌     | 17474/37963 [74:53:24<97:07:58, 17.07s/it] 
 46%|████▌     | 17475/37963 [74:53:39<92:27:49, 16.25s/it]
 46%|████▌     | 17476/37963 [74:53:53<89:07:46, 15.66s/it]
 46%|████▌     | 17477/37963 [74:54:07<86:57:33, 15.28s/it]
 46%|████▌     | 17478/37963 [74:54:22<85:19:56, 15.00s/it]
 46%|████▌     | 17479/37963 [74:54:36<84:06:56, 14.78s/it]
 46%|████▌     | 17480/37963 [74:54:50<83:20:35, 14.65s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '2.27', 'learning_rate': '1.176e-05', 'epoch': '0.4604'}

 46%|████▌     | 17480/37963 [74:54:50<83:20:35, 14.65s/it]
 46%|████▌     | 17481/37963 [74:55:05<82:49:12, 14.56s/it]
 46%|████▌     | 17482/37963 [74:55:19<82:19:05, 14.47s/it]
 46%|████▌     | 17483/37963 [74:55:33<82:03:48, 14.43s/it]
 46%|████▌     | 17484/37963 [74:55:54<92:46:41, 16.31s/it]
 46%|████▌     | 17485/37963 [74:56:08<88:00:42, 15.47s/it]
 46%|████▌     | 17486/37963 [74:56:22<85:32:56, 15.04s/it]
 46%|████▌     | 17487/37963 [74:56:43<95:56:21, 16.87s/it]
 46%|████▌     | 17488/37963 [74:56:57<91:43:15, 16.13s/it]
 46%|████▌     | 17489/37963 [74:57:11<87:46:26, 15.43s/it]
 46%|████▌     | 17490/37963 [74:57:25<85:31:06, 15.04s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '1.378', 'learning_rate': '1.175e-05', 'epoch': '0.4607'}

 46%|████▌     | 17490/37963 [74:57:25<85:31:06, 15.04s/it]
 46%|████▌     | 17491/37963 [74:57:39<84:13:55, 14.81s/it]
 46%|████▌     | 17492/37963 [74:57:54<83:32:02, 14.69s/it]
 46%|████▌     | 17493/37963 [74:58:08<83:01:24, 14.60s/it]
 46%|████▌     | 17494/37963 [74:58:22<82:36:36, 14.53s/it]
 46%|████▌     | 17495/37963 [74:58:43<93:10:19, 16.39s/it]
 46%|████▌     | 17496/37963 [74:58:58<90:21:03, 15.89s/it]
 46%|████▌     | 17497/37963 [74:59:11<86:21:24, 15.19s/it]
 46%|████▌     | 17498/37963 [74:59:26<84:50:15, 14.92s/it]
 46%|████▌     | 17499/37963 [74:59:47<96:18:35, 16.94s/it]
 46%|████▌     | 17500/37963 [75:00:01<91:17:16, 16.06s/it]
                                                           
{'loss': '0.1348', 'grad_norm': '4.676', 'learning_rate': '1.174e-05', 'epoch': '0.461'}

 46%|████▌     | 17500/37963 [75:00:01<91:17:16, 16.06s/it]
 46%|████▌     | 17501/37963 [75:00:16<88:15:56, 15.53s/it]
 46%|████▌     | 17502/37963 [75:00:30<86:28:40, 15.22s/it]
 46%|████▌     | 17503/37963 [75:00:45<84:56:32, 14.95s/it]
 46%|████▌     | 17504/37963 [75:00:58<82:34:27, 14.53s/it]
 46%|████▌     | 17505/37963 [75:01:12<81:54:32, 14.41s/it]
 46%|████▌     | 17506/37963 [75:01:27<81:53:41, 14.41s/it]
 46%|████▌     | 17507/37963 [75:01:48<93:24:26, 16.44s/it]
 46%|████▌     | 17508/37963 [75:02:02<89:46:25, 15.80s/it]
 46%|████▌     | 17509/37963 [75:02:16<86:14:52, 15.18s/it]
 46%|████▌     | 17510/37963 [75:02:37<96:28:27, 16.98s/it]
                                                           
{'loss': '0.1442', 'grad_norm': '3.779', 'learning_rate': '1.173e-05', 'epoch': '0.4612'}

 46%|████▌     | 17510/37963 [75:02:37<96:28:27, 16.98s/it]
 46%|████▌     | 17511/37963 [75:02:51<92:02:26, 16.20s/it]
 46%|████▌     | 17512/37963 [75:03:06<88:43:56, 15.62s/it]
 46%|████▌     | 17513/37963 [75:03:20<85:50:24, 15.11s/it]
 46%|████▌     | 17514/37963 [75:03:34<84:33:08, 14.89s/it]
 46%|████▌     | 17515/37963 [75:03:48<83:24:50, 14.69s/it]
 46%|████▌     | 17516/37963 [75:04:03<82:53:58, 14.60s/it]
 46%|████▌     | 17517/37963 [75:04:17<82:03:35, 14.45s/it]
 46%|████▌     | 17518/37963 [75:04:31<81:53:04, 14.42s/it]
 46%|████▌     | 17519/37963 [75:04:45<81:15:06, 14.31s/it]
 46%|████▌     | 17520/37963 [75:05:00<81:26:53, 14.34s/it]
                                                           
{'loss': '0.1426', 'grad_norm': '1.942', 'learning_rate': '1.172e-05', 'epoch': '0.4615'}

 46%|████▌     | 17520/37963 [75:05:00<81:26:53, 14.34s/it]
 46%|████▌     | 17521/37963 [75:05:20<92:46:03, 16.34s/it]
 46%|████▌     | 17522/37963 [75:05:34<88:10:59, 15.53s/it]
 46%|████▌     | 17523/37963 [75:05:55<96:54:21, 17.07s/it]
 46%|████▌     | 17524/37963 [75:06:09<91:40:22, 16.15s/it]
 46%|████▌     | 17525/37963 [75:06:23<88:37:31, 15.61s/it]
 46%|████▌     | 17526/37963 [75:06:38<86:34:45, 15.25s/it]
 46%|████▌     | 17527/37963 [75:06:51<84:08:38, 14.82s/it]
 46%|████▌     | 17528/37963 [75:07:06<83:20:23, 14.68s/it]
 46%|████▌     | 17529/37963 [75:07:20<81:51:19, 14.42s/it]
 46%|████▌     | 17530/37963 [75:07:33<80:52:42, 14.25s/it]
                                                           
{'loss': '0.157', 'grad_norm': '1.315', 'learning_rate': '1.172e-05', 'epoch': '0.4618'}

 46%|████▌     | 17530/37963 [75:07:33<80:52:42, 14.25s/it]
 46%|████▌     | 17531/37963 [75:07:48<80:59:49, 14.27s/it]
 46%|████▌     | 17532/37963 [75:08:08<91:59:45, 16.21s/it]
 46%|████▌     | 17533/37963 [75:08:23<89:05:30, 15.70s/it]
 46%|████▌     | 17534/37963 [75:08:37<86:48:05, 15.30s/it]
 46%|████▌     | 17535/37963 [75:08:51<84:23:43, 14.87s/it]
 46%|████▌     | 17536/37963 [75:09:12<95:10:10, 16.77s/it]
 46%|████▌     | 17537/37963 [75:09:27<91:04:21, 16.05s/it]
 46%|████▌     | 17538/37963 [75:09:41<88:05:49, 15.53s/it]
 46%|████▌     | 17539/37963 [75:09:56<86:14:50, 15.20s/it]
 46%|████▌     | 17540/37963 [75:10:10<84:43:36, 14.93s/it]
                                                           
{'loss': '0.1455', 'grad_norm': '2.397', 'learning_rate': '1.171e-05', 'epoch': '0.462'}

 46%|████▌     | 17540/37963 [75:10:10<84:43:36, 14.93s/it]
 46%|████▌     | 17541/37963 [75:10:24<82:50:11, 14.60s/it]
 46%|████▌     | 17542/37963 [75:10:44<91:52:08, 16.20s/it]
 46%|████▌     | 17543/37963 [75:10:58<88:49:00, 15.66s/it]
 46%|████▌     | 17544/37963 [75:11:12<86:42:02, 15.29s/it]
 46%|████▌     | 17545/37963 [75:11:27<85:12:54, 15.02s/it]
 46%|████▌     | 17546/37963 [75:11:47<94:18:26, 16.63s/it]
 46%|████▌     | 17547/37963 [75:12:02<90:33:48, 15.97s/it]
 46%|████▌     | 17548/37963 [75:12:16<87:40:36, 15.46s/it]
 46%|████▌     | 17549/37963 [75:12:30<85:21:35, 15.05s/it]
 46%|████▌     | 17550/37963 [75:12:44<83:10:04, 14.67s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '2.055', 'learning_rate': '1.17e-05', 'epoch': '0.4623'}

 46%|████▌     | 17550/37963 [75:12:44<83:10:04, 14.67s/it]
 46%|████▌     | 17551/37963 [75:12:58<82:31:21, 14.55s/it]
 46%|████▌     | 17552/37963 [75:13:12<82:04:31, 14.48s/it]
 46%|████▌     | 17553/37963 [75:13:26<81:17:44, 14.34s/it]
 46%|████▌     | 17554/37963 [75:13:41<81:21:44, 14.35s/it]
 46%|████▌     | 17555/37963 [75:13:55<81:24:59, 14.36s/it]
 46%|████▌     | 17556/37963 [75:14:16<93:19:19, 16.46s/it]
 46%|████▌     | 17557/37963 [75:14:31<89:23:33, 15.77s/it]
 46%|████▋     | 17558/37963 [75:14:45<87:06:59, 15.37s/it]
 46%|████▋     | 17559/37963 [75:14:59<84:15:22, 14.87s/it]
 46%|████▋     | 17560/37963 [75:15:20<95:10:32, 16.79s/it]
                                                           
{'loss': '0.146', 'grad_norm': '2.119', 'learning_rate': '1.169e-05', 'epoch': '0.4626'}

 46%|████▋     | 17560/37963 [75:15:20<95:10:32, 16.79s/it]
 46%|████▋     | 17561/37963 [75:15:34<91:00:11, 16.06s/it]
 46%|████▋     | 17562/37963 [75:15:49<88:08:49, 15.55s/it]
 46%|████▋     | 17563/37963 [75:16:03<86:19:39, 15.23s/it]
 46%|████▋     | 17564/37963 [75:16:18<84:49:02, 14.97s/it]
 46%|████▋     | 17565/37963 [75:16:32<83:07:54, 14.67s/it]
 46%|████▋     | 17566/37963 [75:16:46<82:43:09, 14.60s/it]
 46%|████▋     | 17567/37963 [75:17:00<82:22:51, 14.54s/it]
 46%|████▋     | 17568/37963 [75:17:21<92:57:04, 16.41s/it]
 46%|████▋     | 17569/37963 [75:17:36<89:33:01, 15.81s/it]
 46%|████▋     | 17570/37963 [75:17:50<87:29:11, 15.44s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '1.921', 'learning_rate': '1.168e-05', 'epoch': '0.4628'}

 46%|████▋     | 17570/37963 [75:17:50<87:29:11, 15.44s/it]
 46%|████▋     | 17571/37963 [75:18:05<85:36:50, 15.11s/it]
 46%|████▋     | 17572/37963 [75:18:19<83:49:12, 14.80s/it]
 46%|████▋     | 17573/37963 [75:18:40<94:11:26, 16.63s/it]
 46%|████▋     | 17574/37963 [75:18:54<90:14:56, 15.93s/it]
 46%|████▋     | 17575/37963 [75:19:08<87:39:44, 15.48s/it]
 46%|████▋     | 17576/37963 [75:19:23<86:21:13, 15.25s/it]
 46%|████▋     | 17577/37963 [75:19:37<84:50:16, 14.98s/it]
 46%|████▋     | 17578/37963 [75:19:52<83:58:04, 14.83s/it]
 46%|████▋     | 17579/37963 [75:20:06<83:03:17, 14.67s/it]
 46%|████▋     | 17580/37963 [75:20:26<92:29:15, 16.33s/it]
                                                           
{'loss': '0.1529', 'grad_norm': '2.416', 'learning_rate': '1.167e-05', 'epoch': '0.4631'}

 46%|████▋     | 17580/37963 [75:20:26<92:29:15, 16.33s/it]
 46%|████▋     | 17581/37963 [75:20:41<89:01:12, 15.72s/it]
 46%|████▋     | 17582/37963 [75:20:55<86:48:34, 15.33s/it]
 46%|████▋     | 17583/37963 [75:21:09<84:08:32, 14.86s/it]
 46%|████▋     | 17584/37963 [75:21:23<82:45:22, 14.62s/it]
 46%|████▋     | 17585/37963 [75:21:44<94:36:42, 16.71s/it]
 46%|████▋     | 17586/37963 [75:21:59<91:01:59, 16.08s/it]
 46%|████▋     | 17587/37963 [75:22:13<87:13:39, 15.41s/it]
 46%|████▋     | 17588/37963 [75:22:27<84:29:12, 14.93s/it]
 46%|████▋     | 17589/37963 [75:22:41<83:20:04, 14.72s/it]
 46%|████▋     | 17590/37963 [75:22:55<82:47:24, 14.63s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '4.166', 'learning_rate': '1.167e-05', 'epoch': '0.4633'}

 46%|████▋     | 17590/37963 [75:22:55<82:47:24, 14.63s/it]
 46%|████▋     | 17591/37963 [75:23:10<82:27:57, 14.57s/it]
 46%|████▋     | 17592/37963 [75:23:24<82:06:59, 14.51s/it]
 46%|████▋     | 17593/37963 [75:23:45<92:35:27, 16.36s/it]
 46%|████▋     | 17594/37963 [75:24:05<99:12:28, 17.53s/it]
 46%|████▋     | 17595/37963 [75:24:20<94:08:07, 16.64s/it]
 46%|████▋     | 17596/37963 [75:24:34<90:17:35, 15.96s/it]
 46%|████▋     | 17597/37963 [75:24:48<87:16:30, 15.43s/it]
 46%|████▋     | 17598/37963 [75:25:02<84:49:07, 14.99s/it]
 46%|████▋     | 17599/37963 [75:25:17<83:52:17, 14.83s/it]
 46%|████▋     | 17600/37963 [75:25:31<82:29:05, 14.58s/it]
                                                           
{'loss': '0.1395', 'grad_norm': '1.989', 'learning_rate': '1.166e-05', 'epoch': '0.4636'}

 46%|████▋     | 17600/37963 [75:25:31<82:29:05, 14.58s/it]
 46%|████▋     | 17601/37963 [75:25:45<81:21:08, 14.38s/it]
 46%|████▋     | 17602/37963 [75:25:59<81:01:21, 14.33s/it]
 46%|████▋     | 17603/37963 [75:26:13<81:05:24, 14.34s/it]
 46%|████▋     | 17604/37963 [75:26:28<81:15:32, 14.37s/it]
 46%|████▋     | 17605/37963 [75:26:49<92:55:29, 16.43s/it]
 46%|████▋     | 17606/37963 [75:27:03<88:31:34, 15.66s/it]
 46%|████▋     | 17607/37963 [75:27:17<86:37:25, 15.32s/it]
 46%|████▋     | 17608/37963 [75:27:32<84:58:34, 15.03s/it]
 46%|████▋     | 17609/37963 [75:27:53<95:18:06, 16.86s/it]
 46%|████▋     | 17610/37963 [75:28:07<90:55:45, 16.08s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '1.375', 'learning_rate': '1.165e-05', 'epoch': '0.4639'}

 46%|████▋     | 17610/37963 [75:28:07<90:55:45, 16.08s/it]
 46%|████▋     | 17611/37963 [75:28:21<88:03:22, 15.58s/it]
 46%|████▋     | 17612/37963 [75:28:36<85:45:00, 15.17s/it]
 46%|████▋     | 17613/37963 [75:28:50<83:59:05, 14.86s/it]
 46%|████▋     | 17614/37963 [75:29:04<83:04:50, 14.70s/it]
 46%|████▋     | 17615/37963 [75:29:18<81:54:18, 14.49s/it]
 46%|████▋     | 17616/37963 [75:29:32<81:37:51, 14.44s/it]
 46%|████▋     | 17617/37963 [75:29:53<92:18:27, 16.33s/it]
 46%|████▋     | 17618/37963 [75:30:07<88:06:01, 15.59s/it]
 46%|████▋     | 17619/37963 [75:30:21<86:04:44, 15.23s/it]
 46%|████▋     | 17620/37963 [75:30:36<84:38:57, 14.98s/it]
                                                           
{'loss': '0.144', 'grad_norm': '2.873', 'learning_rate': '1.164e-05', 'epoch': '0.4641'}

 46%|████▋     | 17620/37963 [75:30:36<84:38:57, 14.98s/it]
 46%|████▋     | 17621/37963 [75:30:50<84:00:45, 14.87s/it]
 46%|████▋     | 17622/37963 [75:31:12<94:53:40, 16.79s/it]
 46%|████▋     | 17623/37963 [75:31:26<90:50:28, 16.08s/it]
 46%|████▋     | 17624/37963 [75:31:41<88:44:52, 15.71s/it]
 46%|████▋     | 17625/37963 [75:31:55<86:34:49, 15.33s/it]
 46%|████▋     | 17626/37963 [75:32:09<83:16:15, 14.74s/it]
 46%|████▋     | 17627/37963 [75:32:23<82:17:21, 14.57s/it]
 46%|████▋     | 17628/37963 [75:32:37<81:55:27, 14.50s/it]
 46%|████▋     | 17629/37963 [75:32:52<81:47:00, 14.48s/it]
 46%|████▋     | 17630/37963 [75:33:06<80:46:24, 14.30s/it]
                                                           
{'loss': '0.1408', 'grad_norm': '8.886', 'learning_rate': '1.163e-05', 'epoch': '0.4644'}

 46%|████▋     | 17630/37963 [75:33:06<80:46:24, 14.30s/it]
 46%|████▋     | 17631/37963 [75:33:26<90:55:36, 16.10s/it]
 46%|████▋     | 17632/37963 [75:33:40<88:27:47, 15.66s/it]
 46%|████▋     | 17633/37963 [75:33:54<85:39:44, 15.17s/it]
 46%|████▋     | 17634/37963 [75:34:15<94:50:11, 16.79s/it]
 46%|████▋     | 17635/37963 [75:34:29<90:39:47, 16.06s/it]
 46%|████▋     | 17636/37963 [75:34:44<87:56:23, 15.57s/it]
 46%|████▋     | 17637/37963 [75:34:58<85:55:17, 15.22s/it]
 46%|████▋     | 17638/37963 [75:35:13<84:18:05, 14.93s/it]
 46%|████▋     | 17639/37963 [75:35:27<82:45:09, 14.66s/it]
 46%|████▋     | 17640/37963 [75:35:47<92:40:52, 16.42s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '3.338', 'learning_rate': '1.162e-05', 'epoch': '0.4647'}

 46%|████▋     | 17640/37963 [75:35:47<92:40:52, 16.42s/it]
 46%|████▋     | 17641/37963 [75:36:01<89:11:01, 15.80s/it]
 46%|████▋     | 17642/37963 [75:36:16<86:41:11, 15.36s/it]
 46%|████▋     | 17643/37963 [75:36:37<95:52:00, 16.98s/it]
 46%|████▋     | 17644/37963 [75:36:51<91:16:52, 16.17s/it]
 46%|████▋     | 17645/37963 [75:37:05<88:26:02, 15.67s/it]
 46%|████▋     | 17646/37963 [75:37:20<86:37:04, 15.35s/it]
 46%|████▋     | 17647/37963 [75:37:34<84:37:37, 15.00s/it]
 46%|████▋     | 17648/37963 [75:37:48<82:57:02, 14.70s/it]
 46%|████▋     | 17649/37963 [75:38:02<82:22:33, 14.60s/it]
 46%|████▋     | 17650/37963 [75:38:17<82:02:00, 14.54s/it]
                                                           
{'loss': '0.158', 'grad_norm': '5.551', 'learning_rate': '1.162e-05', 'epoch': '0.4649'}

 46%|████▋     | 17650/37963 [75:38:17<82:02:00, 14.54s/it]
 46%|████▋     | 17651/37963 [75:38:31<81:01:51, 14.36s/it]
 46%|████▋     | 17652/37963 [75:38:45<80:47:49, 14.32s/it]
 47%|████▋     | 17653/37963 [75:39:06<91:29:05, 16.22s/it]
 47%|████▋     | 17654/37963 [75:39:20<88:56:10, 15.76s/it]
 47%|████▋     | 17655/37963 [75:39:35<86:27:43, 15.33s/it]
 47%|████▋     | 17656/37963 [75:39:49<84:20:30, 14.95s/it]
 47%|████▋     | 17657/37963 [75:40:03<83:28:42, 14.80s/it]
 47%|████▋     | 17658/37963 [75:40:25<94:31:29, 16.76s/it]
 47%|████▋     | 17659/37963 [75:40:39<90:36:47, 16.07s/it]
 47%|████▋     | 17660/37963 [75:40:53<87:11:07, 15.46s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '1.415', 'learning_rate': '1.161e-05', 'epoch': '0.4652'}

 47%|████▋     | 17660/37963 [75:40:53<87:11:07, 15.46s/it]
 47%|████▋     | 17661/37963 [75:41:07<85:03:54, 15.08s/it]
 47%|████▋     | 17662/37963 [75:41:22<83:44:54, 14.85s/it]
 47%|████▋     | 17663/37963 [75:41:36<82:52:57, 14.70s/it]
 47%|████▋     | 17664/37963 [75:41:50<82:21:36, 14.61s/it]
 47%|████▋     | 17665/37963 [75:42:04<80:30:44, 14.28s/it]
 47%|████▋     | 17666/37963 [75:42:25<92:18:26, 16.37s/it]
 47%|████▋     | 17667/37963 [75:42:39<88:22:54, 15.68s/it]
 47%|████▋     | 17668/37963 [75:42:54<86:20:34, 15.32s/it]
 47%|████▋     | 17669/37963 [75:43:07<83:37:35, 14.83s/it]
 47%|████▋     | 17670/37963 [75:43:28<93:46:49, 16.64s/it]
                                                           
{'loss': '0.1527', 'grad_norm': '2.455', 'learning_rate': '1.16e-05', 'epoch': '0.4655'}

 47%|████▋     | 17670/37963 [75:43:28<93:46:49, 16.64s/it]
 47%|████▋     | 17671/37963 [75:43:42<89:32:45, 15.89s/it]
 47%|████▋     | 17672/37963 [75:43:56<86:36:01, 15.36s/it]
 47%|████▋     | 17673/37963 [75:44:11<84:56:30, 15.07s/it]
 47%|████▋     | 17674/37963 [75:44:25<82:51:24, 14.70s/it]
 47%|████▋     | 17675/37963 [75:44:39<82:19:57, 14.61s/it]
 47%|████▋     | 17676/37963 [75:44:53<81:57:04, 14.54s/it]
 47%|████▋     | 17677/37963 [75:45:08<81:25:46, 14.45s/it]
 47%|████▋     | 17678/37963 [75:45:22<81:14:29, 14.42s/it]
 47%|████▋     | 17679/37963 [75:45:43<91:43:39, 16.28s/it]
 47%|████▋     | 17680/37963 [75:45:57<88:36:31, 15.73s/it]
                                                           
{'loss': '0.1576', 'grad_norm': '3.055', 'learning_rate': '1.159e-05', 'epoch': '0.4657'}

 47%|████▋     | 17680/37963 [75:45:57<88:36:31, 15.73s/it]
 47%|████▋     | 17681/37963 [75:46:11<86:25:48, 15.34s/it]
 47%|████▋     | 17682/37963 [75:46:32<95:42:50, 16.99s/it]
 47%|████▋     | 17683/37963 [75:46:47<91:34:05, 16.25s/it]
 47%|████▋     | 17684/37963 [75:47:01<88:38:40, 15.74s/it]
 47%|████▋     | 17685/37963 [75:47:16<86:08:01, 15.29s/it]
 47%|████▋     | 17686/37963 [75:47:30<84:40:09, 15.03s/it]
 47%|████▋     | 17687/37963 [75:47:44<83:22:17, 14.80s/it]
 47%|████▋     | 17688/37963 [75:47:59<82:38:29, 14.67s/it]
 47%|████▋     | 17689/37963 [75:48:13<82:16:54, 14.61s/it]
 47%|████▋     | 17690/37963 [75:48:34<92:44:47, 16.47s/it]
                                                           
{'loss': '0.1399', 'grad_norm': '3.559', 'learning_rate': '1.158e-05', 'epoch': '0.466'}

 47%|████▋     | 17690/37963 [75:48:34<92:44:47, 16.47s/it]
 47%|████▋     | 17691/37963 [75:48:48<89:19:30, 15.86s/it]
 47%|████▋     | 17692/37963 [75:49:09<98:02:17, 17.41s/it]
 47%|████▋     | 17693/37963 [75:49:24<93:01:37, 16.52s/it]
 47%|████▋     | 17694/37963 [75:49:38<88:44:48, 15.76s/it]
 47%|████▋     | 17695/37963 [75:49:52<86:23:11, 15.34s/it]
 47%|████▋     | 17696/37963 [75:50:07<84:46:37, 15.06s/it]
 47%|████▋     | 17697/37963 [75:50:21<83:53:24, 14.90s/it]
 47%|████▋     | 17698/37963 [75:50:35<82:21:24, 14.63s/it]
 47%|████▋     | 17699/37963 [75:50:50<81:59:39, 14.57s/it]
 47%|████▋     | 17700/37963 [75:51:04<81:03:16, 14.40s/it]
                                                           
{'loss': '0.1409', 'grad_norm': '4.083', 'learning_rate': '1.157e-05', 'epoch': '0.4662'}

 47%|████▋     | 17700/37963 [75:51:04<81:03:16, 14.40s/it]
 47%|████▋     | 17701/37963 [75:51:17<80:03:19, 14.22s/it]
 47%|████▋     | 17702/37963 [75:51:39<92:09:52, 16.38s/it]
 47%|████▋     | 17703/37963 [75:51:53<88:53:32, 15.80s/it]
 47%|████▋     | 17704/37963 [75:52:08<86:31:27, 15.38s/it]
 47%|████▋     | 17705/37963 [75:52:22<84:21:53, 14.99s/it]
 47%|████▋     | 17706/37963 [75:52:36<83:14:24, 14.79s/it]
 47%|████▋     | 17707/37963 [75:52:57<93:56:22, 16.70s/it]
 47%|████▋     | 17708/37963 [75:53:12<90:03:11, 16.01s/it]
 47%|████▋     | 17709/37963 [75:53:26<87:15:42, 15.51s/it]
 47%|████▋     | 17710/37963 [75:53:40<85:18:18, 15.16s/it]
                                                           
{'loss': '0.149', 'grad_norm': '1.135', 'learning_rate': '1.157e-05', 'epoch': '0.4665'}

 47%|████▋     | 17710/37963 [75:53:40<85:18:18, 15.16s/it]
 47%|████▋     | 17711/37963 [75:53:55<83:53:35, 14.91s/it]
 47%|████▋     | 17712/37963 [75:54:09<82:56:06, 14.74s/it]
 47%|████▋     | 17713/37963 [75:54:23<82:24:06, 14.65s/it]
 47%|████▋     | 17714/37963 [75:54:38<82:05:13, 14.59s/it]
 47%|████▋     | 17715/37963 [75:54:58<90:49:42, 16.15s/it]
 47%|████▋     | 17716/37963 [75:55:12<87:48:49, 15.61s/it]
 47%|████▋     | 17717/37963 [75:55:26<85:46:13, 15.25s/it]
 47%|████▋     | 17718/37963 [75:55:41<84:23:04, 15.01s/it]
 47%|████▋     | 17719/37963 [75:56:01<93:01:44, 16.54s/it]
 47%|████▋     | 17720/37963 [75:56:15<89:17:42, 15.88s/it]
                                                           
{'loss': '0.1408', 'grad_norm': '1.177', 'learning_rate': '1.156e-05', 'epoch': '0.4668'}

 47%|████▋     | 17720/37963 [75:56:15<89:17:42, 15.88s/it]
 47%|████▋     | 17721/37963 [75:56:30<86:40:20, 15.41s/it]
 47%|████▋     | 17722/37963 [75:56:44<84:56:42, 15.11s/it]
 47%|████▋     | 17723/37963 [75:56:58<83:08:03, 14.79s/it]
 47%|████▋     | 17724/37963 [75:57:12<81:48:15, 14.55s/it]
 47%|████▋     | 17725/37963 [75:57:27<81:42:22, 14.53s/it]
 47%|████▋     | 17726/37963 [75:57:41<81:26:47, 14.49s/it]
 47%|████▋     | 17727/37963 [75:57:55<81:13:44, 14.45s/it]
 47%|████▋     | 17728/37963 [75:58:10<81:01:33, 14.42s/it]
 47%|████▋     | 17729/37963 [75:58:30<91:36:11, 16.30s/it]
 47%|████▋     | 17730/37963 [75:58:51<99:39:47, 17.73s/it]
                                                           
{'loss': '0.143', 'grad_norm': '5.545', 'learning_rate': '1.155e-05', 'epoch': '0.467'}

 47%|████▋     | 17730/37963 [75:58:51<99:39:47, 17.73s/it]
 47%|████▋     | 17731/37963 [75:59:05<93:00:16, 16.55s/it]
 47%|████▋     | 17732/37963 [75:59:20<89:17:17, 15.89s/it]
 47%|████▋     | 17733/37963 [75:59:34<86:43:01, 15.43s/it]
 47%|████▋     | 17734/37963 [75:59:48<84:38:25, 15.06s/it]
 47%|████▋     | 17735/37963 [76:00:03<83:33:48, 14.87s/it]
 47%|████▋     | 17736/37963 [76:00:17<82:53:57, 14.75s/it]
 47%|████▋     | 17737/37963 [76:00:31<82:12:47, 14.63s/it]
 47%|████▋     | 17738/37963 [76:00:46<81:34:46, 14.52s/it]
 47%|████▋     | 17739/37963 [76:01:00<81:27:02, 14.50s/it]
 47%|████▋     | 17740/37963 [76:01:20<91:05:36, 16.22s/it]
                                                           
{'loss': '0.1465', 'grad_norm': '1.882', 'learning_rate': '1.154e-05', 'epoch': '0.4673'}

 47%|████▋     | 17740/37963 [76:01:20<91:05:36, 16.22s/it]
 47%|████▋     | 17741/37963 [76:01:41<99:06:44, 17.64s/it]
 47%|████▋     | 17742/37963 [76:01:56<93:57:41, 16.73s/it]
 47%|████▋     | 17743/37963 [76:02:10<90:04:20, 16.04s/it]
 47%|████▋     | 17744/37963 [76:02:25<87:07:47, 15.51s/it]
 47%|████▋     | 17745/37963 [76:02:39<85:14:04, 15.18s/it]
 47%|████▋     | 17746/37963 [76:02:53<83:50:52, 14.93s/it]
 47%|████▋     | 17747/37963 [76:03:07<82:16:01, 14.65s/it]
 47%|████▋     | 17748/37963 [76:03:22<81:47:14, 14.57s/it]
 47%|████▋     | 17749/37963 [76:03:36<81:29:40, 14.51s/it]
 47%|████▋     | 17750/37963 [76:03:50<81:14:27, 14.47s/it]
                                                           
{'loss': '0.1386', 'grad_norm': '1.482', 'learning_rate': '1.153e-05', 'epoch': '0.4676'}

 47%|████▋     | 17750/37963 [76:03:50<81:14:27, 14.47s/it]
 47%|████▋     | 17751/37963 [76:04:12<92:34:28, 16.49s/it]
 47%|████▋     | 17752/37963 [76:04:26<89:02:26, 15.86s/it]
 47%|████▋     | 17753/37963 [76:04:40<86:26:57, 15.40s/it]
 47%|████▋     | 17754/37963 [76:04:55<84:41:23, 15.09s/it]
 47%|████▋     | 17755/37963 [76:05:16<94:16:57, 16.80s/it]
 47%|████▋     | 17756/37963 [76:05:30<90:15:23, 16.08s/it]
 47%|████▋     | 17757/37963 [76:05:44<87:17:32, 15.55s/it]
 47%|████▋     | 17758/37963 [76:05:59<85:25:38, 15.22s/it]
 47%|████▋     | 17759/37963 [76:06:13<83:51:37, 14.94s/it]
 47%|████▋     | 17760/37963 [76:06:27<82:57:17, 14.78s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '2.995', 'learning_rate': '1.152e-05', 'epoch': '0.4678'}

 47%|████▋     | 17760/37963 [76:06:27<82:57:17, 14.78s/it]
 47%|████▋     | 17761/37963 [76:06:42<81:59:12, 14.61s/it]
 47%|████▋     | 17762/37963 [76:06:56<81:30:50, 14.53s/it]
 47%|████▋     | 17763/37963 [76:07:10<81:11:06, 14.47s/it]
 47%|████▋     | 17764/37963 [76:07:31<91:43:20, 16.35s/it]
 47%|████▋     | 17765/37963 [76:07:45<88:25:46, 15.76s/it]
 47%|████▋     | 17766/37963 [76:08:06<96:46:03, 17.25s/it]
 47%|████▋     | 17767/37963 [76:08:20<91:20:07, 16.28s/it]
 47%|████▋     | 17768/37963 [76:08:34<87:06:44, 15.53s/it]
 47%|████▋     | 17769/37963 [76:08:48<84:40:27, 15.09s/it]
 47%|████▋     | 17770/37963 [76:09:02<83:18:22, 14.85s/it]
                                                           
{'loss': '0.1323', 'grad_norm': '1.831', 'learning_rate': '1.151e-05', 'epoch': '0.4681'}

 47%|████▋     | 17770/37963 [76:09:02<83:18:22, 14.85s/it]
 47%|████▋     | 17771/37963 [76:09:17<82:40:49, 14.74s/it]
 47%|████▋     | 17772/37963 [76:09:31<82:01:48, 14.63s/it]
 47%|████▋     | 17773/37963 [76:09:45<81:29:55, 14.53s/it]
 47%|████▋     | 17774/37963 [76:10:00<81:06:32, 14.46s/it]
 47%|████▋     | 17775/37963 [76:10:14<80:54:21, 14.43s/it]
 47%|████▋     | 17776/37963 [76:10:28<80:44:19, 14.40s/it]
 47%|████▋     | 17777/37963 [76:10:43<80:50:25, 14.42s/it]
 47%|████▋     | 17778/37963 [76:11:03<91:16:04, 16.28s/it]
 47%|████▋     | 17779/37963 [76:11:24<99:00:06, 17.66s/it]
 47%|████▋     | 17780/37963 [76:11:38<92:52:25, 16.57s/it]
                                                           
{'loss': '0.151', 'grad_norm': '1.476', 'learning_rate': '1.151e-05', 'epoch': '0.4684'}

 47%|████▋     | 17780/37963 [76:11:38<92:52:25, 16.57s/it]
 47%|████▋     | 17781/37963 [76:11:53<89:09:39, 15.90s/it]
 47%|████▋     | 17782/37963 [76:12:07<86:36:40, 15.45s/it]
 47%|████▋     | 17783/37963 [76:12:21<84:42:56, 15.11s/it]
 47%|████▋     | 17784/37963 [76:12:36<83:09:55, 14.84s/it]
 47%|████▋     | 17785/37963 [76:12:50<82:19:45, 14.69s/it]
 47%|████▋     | 17786/37963 [76:13:04<81:44:10, 14.58s/it]
 47%|████▋     | 17787/37963 [76:13:18<79:56:37, 14.26s/it]
 47%|████▋     | 17788/37963 [76:13:38<90:19:12, 16.12s/it]
 47%|████▋     | 17789/37963 [76:13:53<87:28:23, 15.61s/it]
 47%|████▋     | 17790/37963 [76:14:07<85:17:50, 15.22s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '4.925', 'learning_rate': '1.15e-05', 'epoch': '0.4686'}

 47%|████▋     | 17790/37963 [76:14:07<85:17:50, 15.22s/it]
 47%|████▋     | 17791/37963 [76:14:29<96:21:47, 17.20s/it]
 47%|████▋     | 17792/37963 [76:14:43<91:36:34, 16.35s/it]
 47%|████▋     | 17793/37963 [76:14:58<88:11:13, 15.74s/it]
 47%|████▋     | 17794/37963 [76:15:12<86:01:03, 15.35s/it]
 47%|████▋     | 17795/37963 [76:15:26<84:17:34, 15.05s/it]
 47%|████▋     | 17796/37963 [76:15:41<83:00:03, 14.82s/it]
 47%|████▋     | 17797/37963 [76:15:54<81:24:38, 14.53s/it]
 47%|████▋     | 17798/37963 [76:16:09<80:59:57, 14.46s/it]
 47%|████▋     | 17799/37963 [76:16:23<80:48:19, 14.43s/it]
 47%|████▋     | 17800/37963 [76:16:37<80:11:18, 14.32s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '3.444', 'learning_rate': '1.149e-05', 'epoch': '0.4689'}

 47%|████▋     | 17800/37963 [76:16:37<80:11:18, 14.32s/it]
 47%|████▋     | 17801/37963 [76:16:58<91:15:49, 16.30s/it]
 47%|████▋     | 17802/37963 [76:17:12<87:47:17, 15.68s/it]
 47%|████▋     | 17803/37963 [76:17:26<84:46:39, 15.14s/it]
 47%|████▋     | 17804/37963 [76:17:48<95:20:55, 17.03s/it]
 47%|████▋     | 17805/37963 [76:18:02<90:40:50, 16.19s/it]
 47%|████▋     | 17806/37963 [76:18:16<86:37:13, 15.47s/it]
 47%|████▋     | 17807/37963 [76:18:30<84:27:07, 15.08s/it]
 47%|████▋     | 17808/37963 [76:18:44<82:37:55, 14.76s/it]
 47%|████▋     | 17809/37963 [76:18:58<81:57:51, 14.64s/it]
 47%|████▋     | 17810/37963 [76:19:13<81:35:08, 14.57s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '1.536', 'learning_rate': '1.148e-05', 'epoch': '0.4691'}

 47%|████▋     | 17810/37963 [76:19:13<81:35:08, 14.57s/it]
 47%|████▋     | 17811/37963 [76:19:27<80:31:41, 14.39s/it]
 47%|████▋     | 17812/37963 [76:19:40<79:03:56, 14.13s/it]
 47%|████▋     | 17813/37963 [76:20:07<101:00:04, 18.04s/it]
 47%|████▋     | 17814/37963 [76:20:22<94:43:43, 16.93s/it] 
 47%|████▋     | 17815/37963 [76:20:36<90:31:47, 16.18s/it]
 47%|████▋     | 17816/37963 [76:20:50<87:37:28, 15.66s/it]
 47%|████▋     | 17817/37963 [76:21:05<85:16:03, 15.24s/it]
 47%|████▋     | 17818/37963 [76:21:19<83:48:17, 14.98s/it]
 47%|████▋     | 17819/37963 [76:21:33<82:29:12, 14.74s/it]
 47%|████▋     | 17820/37963 [76:21:48<81:52:29, 14.63s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '3.368', 'learning_rate': '1.147e-05', 'epoch': '0.4694'}

 47%|████▋     | 17820/37963 [76:21:48<81:52:29, 14.63s/it]
 47%|████▋     | 17821/37963 [76:22:02<81:29:35, 14.57s/it]
 47%|████▋     | 17822/37963 [76:22:17<81:19:40, 14.54s/it]
 47%|████▋     | 17823/37963 [76:22:31<80:37:12, 14.41s/it]
 47%|████▋     | 17824/37963 [76:22:45<80:17:38, 14.35s/it]
 47%|████▋     | 17825/37963 [76:22:58<78:36:10, 14.05s/it]
 47%|████▋     | 17826/37963 [76:23:19<89:54:16, 16.07s/it]
 47%|████▋     | 17827/37963 [76:23:33<86:43:38, 15.51s/it]
 47%|████▋     | 17828/37963 [76:23:54<95:16:11, 17.03s/it]
 47%|████▋     | 17829/37963 [76:24:08<90:13:06, 16.13s/it]
 47%|████▋     | 17830/37963 [76:24:22<87:21:25, 15.62s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '1.739', 'learning_rate': '1.146e-05', 'epoch': '0.4697'}

 47%|████▋     | 17830/37963 [76:24:22<87:21:25, 15.62s/it]
 47%|████▋     | 17831/37963 [76:24:37<85:14:35, 15.24s/it]
 47%|████▋     | 17832/37963 [76:24:51<83:28:22, 14.93s/it]
 47%|████▋     | 17833/37963 [76:25:05<82:31:35, 14.76s/it]
 47%|████▋     | 17834/37963 [76:25:20<81:59:21, 14.66s/it]
 47%|████▋     | 17835/37963 [76:25:34<81:25:48, 14.56s/it]
 47%|████▋     | 17836/37963 [76:25:48<81:11:28, 14.52s/it]
 47%|████▋     | 17837/37963 [76:26:03<81:00:20, 14.49s/it]
 47%|████▋     | 17838/37963 [76:26:22<89:44:40, 16.05s/it]
 47%|████▋     | 17839/37963 [76:26:43<97:40:42, 17.47s/it]
 47%|████▋     | 17840/37963 [76:26:57<91:51:38, 16.43s/it]
                                                           
{'loss': '0.144', 'grad_norm': '2.732', 'learning_rate': '1.146e-05', 'epoch': '0.4699'}

 47%|████▋     | 17840/37963 [76:26:57<91:51:38, 16.43s/it]
 47%|████▋     | 17841/37963 [76:27:11<87:30:20, 15.66s/it]
 47%|████▋     | 17842/37963 [76:27:25<85:21:17, 15.27s/it]
 47%|████▋     | 17843/37963 [76:27:40<83:50:56, 15.00s/it]
 47%|████▋     | 17844/37963 [76:27:54<82:42:53, 14.80s/it]
 47%|████▋     | 17845/37963 [76:28:08<81:08:48, 14.52s/it]
 47%|████▋     | 17846/37963 [76:28:22<80:50:05, 14.47s/it]
 47%|████▋     | 17847/37963 [76:28:37<80:41:27, 14.44s/it]
 47%|████▋     | 17848/37963 [76:28:57<90:45:07, 16.24s/it]
 47%|████▋     | 17849/37963 [76:29:12<87:40:26, 15.69s/it]
 47%|████▋     | 17850/37963 [76:29:26<85:35:20, 15.32s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '2.665', 'learning_rate': '1.145e-05', 'epoch': '0.4702'}

 47%|████▋     | 17850/37963 [76:29:26<85:35:20, 15.32s/it]
 47%|████▋     | 17851/37963 [76:29:40<84:02:24, 15.04s/it]
 47%|████▋     | 17852/37963 [76:29:55<82:50:44, 14.83s/it]
 47%|████▋     | 17853/37963 [76:30:16<93:19:13, 16.71s/it]
 47%|████▋     | 17854/37963 [76:30:30<89:22:40, 16.00s/it]
 47%|████▋     | 17855/37963 [76:30:44<86:11:16, 15.43s/it]
 47%|████▋     | 17856/37963 [76:30:59<84:17:34, 15.09s/it]
 47%|████▋     | 17857/37963 [76:31:13<82:20:51, 14.74s/it]
 47%|████▋     | 17858/37963 [76:31:27<81:36:51, 14.61s/it]
 47%|████▋     | 17859/37963 [76:31:41<81:05:01, 14.52s/it]
 47%|████▋     | 17860/37963 [76:31:55<80:10:54, 14.36s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '1.658', 'learning_rate': '1.144e-05', 'epoch': '0.4705'}

 47%|████▋     | 17860/37963 [76:31:55<80:10:54, 14.36s/it]
 47%|████▋     | 17861/37963 [76:32:10<80:07:38, 14.35s/it]
 47%|████▋     | 17862/37963 [76:32:37<102:24:34, 18.34s/it]
 47%|████▋     | 17863/37963 [76:32:52<95:52:50, 17.17s/it] 
 47%|████▋     | 17864/37963 [76:33:06<91:07:40, 16.32s/it]
 47%|████▋     | 17865/37963 [76:33:20<87:47:06, 15.72s/it]
 47%|████▋     | 17866/37963 [76:33:35<85:18:05, 15.28s/it]
 47%|████▋     | 17867/37963 [76:33:49<83:23:30, 14.94s/it]
 47%|████▋     | 17868/37963 [76:34:03<82:20:09, 14.75s/it]
 47%|████▋     | 17869/37963 [76:34:17<81:38:13, 14.63s/it]
 47%|████▋     | 17870/37963 [76:34:32<81:11:16, 14.55s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '2.165', 'learning_rate': '1.143e-05', 'epoch': '0.4707'}

 47%|████▋     | 17870/37963 [76:34:32<81:11:16, 14.55s/it]
 47%|████▋     | 17871/37963 [76:34:46<80:51:38, 14.49s/it]
 47%|████▋     | 17872/37963 [76:35:00<80:34:39, 14.44s/it]
 47%|████▋     | 17873/37963 [76:35:14<79:44:18, 14.29s/it]
 47%|████▋     | 17874/37963 [76:35:35<90:28:53, 16.21s/it]
 47%|████▋     | 17875/37963 [76:35:55<97:36:10, 17.49s/it]
 47%|████▋     | 17876/37963 [76:36:10<92:33:58, 16.59s/it]
 47%|████▋     | 17877/37963 [76:36:24<88:30:04, 15.86s/it]
 47%|████▋     | 17878/37963 [76:36:39<86:04:30, 15.43s/it]
 47%|████▋     | 17879/37963 [76:36:53<84:13:41, 15.10s/it]
 47%|████▋     | 17880/37963 [76:37:07<81:51:33, 14.67s/it]
                                                           
{'loss': '0.1437', 'grad_norm': '2.316', 'learning_rate': '1.142e-05', 'epoch': '0.471'}

 47%|████▋     | 17880/37963 [76:37:07<81:51:33, 14.67s/it]
 47%|████▋     | 17881/37963 [76:37:21<81:25:55, 14.60s/it]
 47%|████▋     | 17882/37963 [76:37:35<80:53:55, 14.50s/it]
 47%|████▋     | 17883/37963 [76:37:50<80:52:49, 14.50s/it]
 47%|████▋     | 17884/37963 [76:38:04<80:45:31, 14.48s/it]
 47%|████▋     | 17885/37963 [76:38:19<80:32:14, 14.44s/it]
 47%|████▋     | 17886/37963 [76:38:33<80:26:28, 14.42s/it]
 47%|████▋     | 17887/37963 [76:39:01<102:58:18, 18.46s/it]
 47%|████▋     | 17888/37963 [76:39:15<96:05:42, 17.23s/it] 
 47%|████▋     | 17889/37963 [76:39:30<91:17:58, 16.37s/it]
 47%|████▋     | 17890/37963 [76:39:44<87:56:14, 15.77s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '2.067', 'learning_rate': '1.141e-05', 'epoch': '0.4712'}

 47%|████▋     | 17890/37963 [76:39:44<87:56:14, 15.77s/it]
 47%|████▋     | 17891/37963 [76:39:58<85:36:00, 15.35s/it]
 47%|████▋     | 17892/37963 [76:40:12<83:19:19, 14.94s/it]
 47%|████▋     | 17893/37963 [76:40:27<82:09:31, 14.74s/it]
 47%|████▋     | 17894/37963 [76:40:41<81:19:40, 14.59s/it]
 47%|████▋     | 17895/37963 [76:40:55<81:01:38, 14.54s/it]
 47%|████▋     | 17896/37963 [76:41:09<80:39:52, 14.47s/it]
 47%|████▋     | 17897/37963 [76:41:31<92:03:28, 16.52s/it]
 47%|████▋     | 17898/37963 [76:41:45<88:27:31, 15.87s/it]
 47%|████▋     | 17899/37963 [76:41:59<85:18:05, 15.31s/it]
 47%|████▋     | 17900/37963 [76:42:14<83:46:56, 15.03s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '2.31', 'learning_rate': '1.14e-05', 'epoch': '0.4715'}

 47%|████▋     | 17900/37963 [76:42:14<83:46:56, 15.03s/it]
 47%|████▋     | 17901/37963 [76:42:34<93:27:39, 16.77s/it]
 47%|████▋     | 17902/37963 [76:42:49<89:31:32, 16.07s/it]
 47%|████▋     | 17903/37963 [76:43:03<86:37:40, 15.55s/it]
 47%|████▋     | 17904/37963 [76:43:18<84:50:32, 15.23s/it]
 47%|████▋     | 17905/37963 [76:43:32<83:38:05, 15.01s/it]
 47%|████▋     | 17906/37963 [76:43:46<82:25:46, 14.80s/it]
 47%|████▋     | 17907/37963 [76:44:00<81:02:00, 14.55s/it]
 47%|████▋     | 17908/37963 [76:44:15<80:38:44, 14.48s/it]
 47%|████▋     | 17909/37963 [76:44:35<90:07:50, 16.18s/it]
 47%|████▋     | 17910/37963 [76:44:50<87:38:09, 15.73s/it]
                                                           
{'loss': '0.138', 'grad_norm': '2.01', 'learning_rate': '1.14e-05', 'epoch': '0.4718'}

 47%|████▋     | 17910/37963 [76:44:50<87:38:09, 15.73s/it]
 47%|████▋     | 17911/37963 [76:45:11<96:32:52, 17.33s/it]
 47%|████▋     | 17912/37963 [76:45:25<91:35:47, 16.45s/it]
 47%|████▋     | 17913/37963 [76:45:39<88:06:52, 15.82s/it]
 47%|████▋     | 17914/37963 [76:45:54<85:54:21, 15.43s/it]
 47%|████▋     | 17915/37963 [76:46:07<82:57:24, 14.90s/it]
 47%|████▋     | 17916/37963 [76:46:22<82:15:33, 14.77s/it]
 47%|████▋     | 17917/37963 [76:46:36<80:43:05, 14.50s/it]
 47%|████▋     | 17918/37963 [76:46:50<80:06:53, 14.39s/it]
 47%|████▋     | 17919/37963 [76:47:04<79:30:18, 14.28s/it]
 47%|████▋     | 17920/37963 [76:47:18<79:48:52, 14.34s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '1.817', 'learning_rate': '1.139e-05', 'epoch': '0.472'}

 47%|████▋     | 17920/37963 [76:47:18<79:48:52, 14.34s/it]
 47%|████▋     | 17921/37963 [76:47:33<79:43:53, 14.32s/it]
 47%|████▋     | 17922/37963 [76:47:54<90:35:44, 16.27s/it]
 47%|████▋     | 17923/37963 [76:48:15<98:59:35, 17.78s/it]
 47%|████▋     | 17924/37963 [76:48:29<92:27:29, 16.61s/it]
 47%|████▋     | 17925/37963 [76:48:43<88:17:30, 15.86s/it]
 47%|████▋     | 17926/37963 [76:48:57<85:19:59, 15.33s/it]
 47%|████▋     | 17927/37963 [76:49:11<83:05:59, 14.93s/it]
 47%|████▋     | 17928/37963 [76:49:25<82:12:51, 14.77s/it]
 47%|████▋     | 17929/37963 [76:49:40<81:43:56, 14.69s/it]
 47%|████▋     | 17930/37963 [76:49:54<80:55:27, 14.54s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '1.617', 'learning_rate': '1.138e-05', 'epoch': '0.4723'}

 47%|████▋     | 17930/37963 [76:49:54<80:55:27, 14.54s/it]
 47%|████▋     | 17931/37963 [76:50:08<80:37:20, 14.49s/it]
 47%|████▋     | 17932/37963 [76:50:23<80:08:47, 14.40s/it]
 47%|████▋     | 17933/37963 [76:50:37<80:07:31, 14.40s/it]
 47%|████▋     | 17934/37963 [76:50:51<79:34:33, 14.30s/it]
 47%|████▋     | 17935/37963 [76:51:05<79:16:07, 14.25s/it]
 47%|████▋     | 17936/37963 [76:51:19<79:02:34, 14.21s/it]
 47%|████▋     | 17937/37963 [76:51:47<100:57:16, 18.15s/it]
 47%|████▋     | 17938/37963 [76:52:01<94:34:06, 17.00s/it] 
 47%|████▋     | 17939/37963 [76:52:15<89:48:08, 16.15s/it]
 47%|████▋     | 17940/37963 [76:52:30<86:50:00, 15.61s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '1.2', 'learning_rate': '1.137e-05', 'epoch': '0.4726'}

 47%|████▋     | 17940/37963 [76:52:30<86:50:00, 15.61s/it]
 47%|████▋     | 17941/37963 [76:52:44<84:44:55, 15.24s/it]
 47%|████▋     | 17942/37963 [76:52:58<83:14:05, 14.97s/it]
 47%|████▋     | 17943/37963 [76:53:12<81:45:12, 14.70s/it]
 47%|████▋     | 17944/37963 [76:53:27<81:02:33, 14.57s/it]
 47%|████▋     | 17945/37963 [76:53:41<80:36:42, 14.50s/it]
 47%|████▋     | 17946/37963 [76:54:02<91:07:18, 16.39s/it]
 47%|████▋     | 17947/37963 [76:54:16<88:03:44, 15.84s/it]
 47%|████▋     | 17948/37963 [76:54:31<85:37:14, 15.40s/it]
 47%|████▋     | 17949/37963 [76:54:45<83:49:36, 15.08s/it]
 47%|████▋     | 17950/37963 [76:55:07<94:52:42, 17.07s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '5.081', 'learning_rate': '1.136e-05', 'epoch': '0.4728'}

 47%|████▋     | 17950/37963 [76:55:07<94:52:42, 17.07s/it]
 47%|████▋     | 17951/37963 [76:55:21<90:08:12, 16.21s/it]
 47%|████▋     | 17952/37963 [76:55:35<86:54:52, 15.64s/it]
 47%|████▋     | 17953/37963 [76:55:49<84:26:39, 15.19s/it]
 47%|████▋     | 17954/37963 [76:56:04<83:11:04, 14.97s/it]
 47%|████▋     | 17955/37963 [76:56:18<82:11:28, 14.79s/it]
 47%|████▋     | 17956/37963 [76:56:32<81:27:08, 14.66s/it]
 47%|████▋     | 17957/37963 [76:56:47<81:18:01, 14.63s/it]
 47%|████▋     | 17958/37963 [76:57:01<80:22:55, 14.47s/it]
 47%|████▋     | 17959/37963 [76:57:22<91:12:31, 16.41s/it]
 47%|████▋     | 17960/37963 [76:57:36<87:47:20, 15.80s/it]
                                                           
{'loss': '0.1376', 'grad_norm': '1.016', 'learning_rate': '1.135e-05', 'epoch': '0.4731'}

 47%|████▋     | 17960/37963 [76:57:36<87:47:20, 15.80s/it]
 47%|████▋     | 17961/37963 [76:57:51<85:19:15, 15.36s/it]
 47%|████▋     | 17962/37963 [76:58:05<83:36:05, 15.05s/it]
 47%|████▋     | 17963/37963 [76:58:19<82:11:02, 14.79s/it]
 47%|████▋     | 17964/37963 [76:58:34<81:34:04, 14.68s/it]
 47%|████▋     | 17965/37963 [76:58:48<81:00:57, 14.58s/it]
 47%|████▋     | 17966/37963 [76:59:02<79:43:18, 14.35s/it]
 47%|████▋     | 17967/37963 [76:59:16<79:42:08, 14.35s/it]
 47%|████▋     | 17968/37963 [76:59:30<79:17:00, 14.27s/it]
 47%|████▋     | 17969/37963 [76:59:45<79:30:36, 14.32s/it]
 47%|████▋     | 17970/37963 [76:59:59<79:35:06, 14.33s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '2.344', 'learning_rate': '1.135e-05', 'epoch': '0.4734'}

 47%|████▋     | 17970/37963 [76:59:59<79:35:06, 14.33s/it]
 47%|████▋     | 17971/37963 [77:00:14<79:44:30, 14.36s/it]
 47%|████▋     | 17972/37963 [77:00:34<90:42:08, 16.33s/it]
 47%|████▋     | 17973/37963 [77:00:55<98:24:58, 17.72s/it]
 47%|████▋     | 17974/37963 [77:01:09<92:14:08, 16.61s/it]
 47%|████▋     | 17975/37963 [77:01:24<88:28:08, 15.93s/it]
 47%|████▋     | 17976/37963 [77:01:38<85:55:02, 15.48s/it]
 47%|████▋     | 17977/37963 [77:01:52<83:44:19, 15.08s/it]
 47%|████▋     | 17978/37963 [77:02:07<82:31:44, 14.87s/it]
 47%|████▋     | 17979/37963 [77:02:20<80:36:00, 14.52s/it]
 47%|████▋     | 17980/37963 [77:02:35<80:31:36, 14.51s/it]
                                                           
{'loss': '0.1516', 'grad_norm': '4.524', 'learning_rate': '1.134e-05', 'epoch': '0.4736'}

 47%|████▋     | 17980/37963 [77:02:35<80:31:36, 14.51s/it]
 47%|████▋     | 17981/37963 [77:02:49<80:29:16, 14.50s/it]
 47%|████▋     | 17982/37963 [77:03:04<80:10:25, 14.44s/it]
 47%|████▋     | 17983/37963 [77:03:18<79:30:48, 14.33s/it]
 47%|████▋     | 17984/37963 [77:03:39<90:35:09, 16.32s/it]
 47%|████▋     | 17985/37963 [77:03:53<87:28:14, 15.76s/it]
 47%|████▋     | 17986/37963 [77:04:14<96:25:15, 17.38s/it]
 47%|████▋     | 17987/37963 [77:04:29<91:27:50, 16.48s/it]
 47%|████▋     | 17988/37963 [77:04:43<87:11:03, 15.71s/it]
 47%|████▋     | 17989/37963 [77:04:57<85:15:44, 15.37s/it]
 47%|████▋     | 17990/37963 [77:05:11<82:49:59, 14.93s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '1.551', 'learning_rate': '1.133e-05', 'epoch': '0.4739'}

 47%|████▋     | 17990/37963 [77:05:11<82:49:59, 14.93s/it]
 47%|████▋     | 17991/37963 [77:05:26<82:03:14, 14.79s/it]
 47%|████▋     | 17992/37963 [77:05:40<81:08:14, 14.63s/it]
 47%|████▋     | 17993/37963 [77:05:54<80:45:19, 14.56s/it]
 47%|████▋     | 17994/37963 [77:06:16<92:03:42, 16.60s/it]
 47%|████▋     | 17995/37963 [77:06:30<88:18:35, 15.92s/it]
 47%|████▋     | 17996/37963 [77:06:44<85:27:53, 15.41s/it]
 47%|████▋     | 17997/37963 [77:06:59<83:53:48, 15.13s/it]
 47%|████▋     | 17998/37963 [77:07:20<93:31:27, 16.86s/it]
 47%|████▋     | 17999/37963 [77:07:34<89:44:50, 16.18s/it]
 47%|████▋     | 18000/37963 [77:07:49<86:47:19, 15.65s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '3.263', 'learning_rate': '1.132e-05', 'epoch': '0.4741'}

 47%|████▋     | 18000/37963 [77:07:49<86:47:19, 15.65s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:16<00:00, 16.22s/it]
Writing model shards: 100%|██████████| 1/1 [00:16<00:00, 16.22s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 47%|████▋     | 18001/37963 [77:09:33<235:15:51, 42.43s/it]
 47%|████▋     | 18002/37963 [77:09:48<188:27:46, 33.99s/it]
 47%|████▋     | 18003/37963 [77:10:02<155:44:54, 28.09s/it]
 47%|████▋     | 18004/37963 [77:10:16<131:26:28, 23.71s/it]
 47%|████▋     | 18005/37963 [77:10:30<115:51:07, 20.90s/it]
 47%|████▋     | 18006/37963 [77:10:44<104:52:35, 18.92s/it]
 47%|████▋     | 18007/37963 [77:11:05<107:55:48, 19.47s/it]
 47%|████▋     | 18008/37963 [77:11:19<99:21:56, 17.93s/it] 
 47%|████▋     | 18009/37963 [77:11:33<92:24:42, 16.67s/it]
 47%|████▋     | 18010/37963 [77:11:47<87:40:46, 15.82s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '6.17', 'learning_rate': '1.131e-05', 'epoch': '0.4744'}

 47%|████▋     | 18010/37963 [77:11:47<87:40:46, 15.82s/it]
 47%|████▋     | 18011/37963 [77:12:08<96:03:57, 17.33s/it]
 47%|████▋     | 18012/37963 [77:12:22<91:04:12, 16.43s/it]
 47%|████▋     | 18013/37963 [77:12:36<87:29:42, 15.79s/it]
 47%|████▋     | 18014/37963 [77:12:51<85:02:39, 15.35s/it]
 47%|████▋     | 18015/37963 [77:13:05<83:21:56, 15.04s/it]
 47%|████▋     | 18016/37963 [77:13:19<81:22:02, 14.69s/it]
 47%|████▋     | 18017/37963 [77:13:33<80:59:24, 14.62s/it]
 47%|████▋     | 18018/37963 [77:13:48<80:32:05, 14.54s/it]
 47%|████▋     | 18019/37963 [77:14:02<80:13:31, 14.48s/it]
 47%|████▋     | 18020/37963 [77:14:16<79:37:42, 14.37s/it]
                                                           
{'loss': '0.1437', 'grad_norm': '4.1', 'learning_rate': '1.13e-05', 'epoch': '0.4747'}

 47%|████▋     | 18020/37963 [77:14:16<79:37:42, 14.37s/it]
 47%|████▋     | 18021/37963 [77:14:44<101:31:01, 18.33s/it]
 47%|████▋     | 18022/37963 [77:14:58<95:02:43, 17.16s/it] 
 47%|████▋     | 18023/37963 [77:15:12<89:51:29, 16.22s/it]
 47%|████▋     | 18024/37963 [77:15:26<86:42:31, 15.66s/it]
 47%|████▋     | 18025/37963 [77:15:41<84:43:17, 15.30s/it]
 47%|████▋     | 18026/37963 [77:15:55<83:14:15, 15.03s/it]
 47%|████▋     | 18027/37963 [77:16:10<82:08:18, 14.83s/it]
 47%|████▋     | 18028/37963 [77:16:24<81:12:13, 14.66s/it]
 47%|████▋     | 18029/37963 [77:16:38<80:46:35, 14.59s/it]
 47%|████▋     | 18030/37963 [77:16:53<80:28:58, 14.54s/it]
                                                           
{'loss': '0.1467', 'grad_norm': '1.262', 'learning_rate': '1.129e-05', 'epoch': '0.4749'}

 47%|████▋     | 18030/37963 [77:16:53<80:28:58, 14.54s/it]
 47%|████▋     | 18031/37963 [77:17:14<91:28:35, 16.52s/it]
 47%|████▋     | 18032/37963 [77:17:28<87:40:01, 15.83s/it]
 48%|████▊     | 18033/37963 [77:17:43<85:15:26, 15.40s/it]
 48%|████▊     | 18034/37963 [77:18:04<94:28:45, 17.07s/it]
 48%|████▊     | 18035/37963 [77:18:18<90:00:29, 16.26s/it]
 48%|████▊     | 18036/37963 [77:18:32<87:04:46, 15.73s/it]
 48%|████▊     | 18037/37963 [77:18:47<84:55:04, 15.34s/it]
 48%|████▊     | 18038/37963 [77:19:01<83:14:44, 15.04s/it]
 48%|████▊     | 18039/37963 [77:19:15<81:39:41, 14.76s/it]
 48%|████▊     | 18040/37963 [77:19:37<93:37:25, 16.92s/it]
                                                           
{'loss': '0.1533', 'grad_norm': '1.133', 'learning_rate': '1.129e-05', 'epoch': '0.4752'}

 48%|████▊     | 18040/37963 [77:19:37<93:37:25, 16.92s/it]
 48%|████▊     | 18041/37963 [77:19:52<89:39:36, 16.20s/it]
 48%|████▊     | 18042/37963 [77:20:06<86:40:33, 15.66s/it]
 48%|████▊     | 18043/37963 [77:20:21<84:54:55, 15.35s/it]
 48%|████▊     | 18044/37963 [77:20:35<83:19:18, 15.06s/it]
 48%|████▊     | 18045/37963 [77:20:50<82:18:30, 14.88s/it]
 48%|████▊     | 18046/37963 [77:21:04<81:27:42, 14.72s/it]
 48%|████▊     | 18047/37963 [77:21:25<91:46:40, 16.59s/it]
 48%|████▊     | 18048/37963 [77:21:39<87:59:19, 15.91s/it]
 48%|████▊     | 18049/37963 [77:21:54<85:25:36, 15.44s/it]
 48%|████▊     | 18050/37963 [77:22:08<83:03:27, 15.02s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '2.337', 'learning_rate': '1.128e-05', 'epoch': '0.4755'}

 48%|████▊     | 18050/37963 [77:22:08<83:03:27, 15.02s/it]
 48%|████▊     | 18051/37963 [77:22:22<81:50:18, 14.80s/it]
 48%|████▊     | 18052/37963 [77:22:36<81:16:58, 14.70s/it]
 48%|████▊     | 18053/37963 [77:22:51<81:03:00, 14.65s/it]
 48%|████▊     | 18054/37963 [77:23:05<80:29:43, 14.56s/it]
 48%|████▊     | 18055/37963 [77:23:20<80:05:36, 14.48s/it]
 48%|████▊     | 18056/37963 [77:23:40<90:10:38, 16.31s/it]
 48%|████▊     | 18057/37963 [77:23:54<86:05:45, 15.57s/it]
 48%|████▊     | 18058/37963 [77:24:09<84:22:41, 15.26s/it]
 48%|████▊     | 18059/37963 [77:24:23<82:44:37, 14.97s/it]
 48%|████▊     | 18060/37963 [77:24:37<81:38:32, 14.77s/it]
                                                           
{'loss': '0.1468', 'grad_norm': '2.543', 'learning_rate': '1.127e-05', 'epoch': '0.4757'}

 48%|████▊     | 18060/37963 [77:24:37<81:38:32, 14.77s/it]
 48%|████▊     | 18061/37963 [77:24:52<81:07:10, 14.67s/it]
 48%|████▊     | 18062/37963 [77:25:13<91:37:32, 16.57s/it]
 48%|████▊     | 18063/37963 [77:25:27<87:59:45, 15.92s/it]
 48%|████▊     | 18064/37963 [77:25:41<85:20:51, 15.44s/it]
 48%|████▊     | 18065/37963 [77:25:56<83:35:47, 15.12s/it]
 48%|████▊     | 18066/37963 [77:26:10<82:06:38, 14.86s/it]
 48%|████▊     | 18067/37963 [77:26:24<81:24:50, 14.73s/it]
 48%|████▊     | 18068/37963 [77:26:39<80:47:54, 14.62s/it]
 48%|████▊     | 18069/37963 [77:27:00<91:14:04, 16.51s/it]
 48%|████▊     | 18070/37963 [77:27:20<98:00:26, 17.74s/it]
                                                           
{'loss': '0.1379', 'grad_norm': '2.131', 'learning_rate': '1.126e-05', 'epoch': '0.476'}

 48%|████▊     | 18070/37963 [77:27:20<98:00:26, 17.74s/it]
 48%|████▊     | 18071/37963 [77:27:35<92:36:34, 16.76s/it]
 48%|████▊     | 18072/37963 [77:27:49<88:45:28, 16.06s/it]
 48%|████▊     | 18073/37963 [77:28:03<85:03:32, 15.40s/it]
 48%|████▊     | 18074/37963 [77:28:17<83:11:09, 15.06s/it]
 48%|████▊     | 18075/37963 [77:28:32<81:54:11, 14.83s/it]
 48%|████▊     | 18076/37963 [77:28:46<81:12:16, 14.70s/it]
 48%|████▊     | 18077/37963 [77:29:00<80:43:15, 14.61s/it]
 48%|████▊     | 18078/37963 [77:29:14<79:09:15, 14.33s/it]
 48%|████▊     | 18079/37963 [77:29:34<88:55:41, 16.10s/it]
 48%|████▊     | 18080/37963 [77:29:48<85:07:06, 15.41s/it]
                                                           
{'loss': '0.151', 'grad_norm': '3.055', 'learning_rate': '1.125e-05', 'epoch': '0.4763'}

 48%|████▊     | 18080/37963 [77:29:48<85:07:06, 15.41s/it]
 48%|████▊     | 18081/37963 [77:30:02<83:19:31, 15.09s/it]
 48%|████▊     | 18082/37963 [77:30:17<81:59:49, 14.85s/it]
 48%|████▊     | 18083/37963 [77:30:38<92:04:05, 16.67s/it]
 48%|████▊     | 18084/37963 [77:30:52<88:25:37, 16.01s/it]
 48%|████▊     | 18085/37963 [77:31:06<85:17:43, 15.45s/it]
 48%|████▊     | 18086/37963 [77:31:21<83:35:53, 15.14s/it]
 48%|████▊     | 18087/37963 [77:31:35<82:42:09, 14.98s/it]
 48%|████▊     | 18088/37963 [77:31:50<81:43:39, 14.80s/it]
 48%|████▊     | 18089/37963 [77:32:11<93:13:51, 16.89s/it]
 48%|████▊     | 18090/37963 [77:32:26<89:00:37, 16.12s/it]
                                                           
{'loss': '0.1436', 'grad_norm': '3.894', 'learning_rate': '1.124e-05', 'epoch': '0.4765'}

 48%|████▊     | 18090/37963 [77:32:26<89:00:37, 16.12s/it]
 48%|████▊     | 18091/37963 [77:32:40<86:04:26, 15.59s/it]
 48%|████▊     | 18092/37963 [77:32:54<83:53:44, 15.20s/it]
 48%|████▊     | 18093/37963 [77:33:08<81:41:05, 14.80s/it]
 48%|████▊     | 18094/37963 [77:33:23<80:53:58, 14.66s/it]
 48%|████▊     | 18095/37963 [77:33:37<80:32:11, 14.59s/it]
 48%|████▊     | 18096/37963 [77:33:57<90:03:40, 16.32s/it]
 48%|████▊     | 18097/37963 [77:34:11<86:02:35, 15.59s/it]
 48%|████▊     | 18098/37963 [77:34:26<83:53:10, 15.20s/it]
 48%|████▊     | 18099/37963 [77:34:40<82:06:29, 14.88s/it]
 48%|████▊     | 18100/37963 [77:34:54<81:06:40, 14.70s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '2.029', 'learning_rate': '1.124e-05', 'epoch': '0.4768'}

 48%|████▊     | 18100/37963 [77:34:54<81:06:40, 14.70s/it]
 48%|████▊     | 18101/37963 [77:35:08<80:31:20, 14.59s/it]
 48%|████▊     | 18102/37963 [77:35:22<78:42:41, 14.27s/it]
 48%|████▊     | 18103/37963 [77:35:36<78:46:16, 14.28s/it]
 48%|████▊     | 18104/37963 [77:35:51<78:59:50, 14.32s/it]
 48%|████▊     | 18105/37963 [77:36:11<89:45:05, 16.27s/it]
 48%|████▊     | 18106/37963 [77:36:25<85:40:37, 15.53s/it]
 48%|████▊     | 18107/37963 [77:36:39<83:12:34, 15.09s/it]
 48%|████▊     | 18108/37963 [77:36:54<82:02:09, 14.87s/it]
 48%|████▊     | 18109/37963 [77:37:08<80:56:23, 14.68s/it]
 48%|████▊     | 18110/37963 [77:37:22<80:28:13, 14.59s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '2.838', 'learning_rate': '1.123e-05', 'epoch': '0.477'}

 48%|████▊     | 18110/37963 [77:37:22<80:28:13, 14.59s/it]
 48%|████▊     | 18111/37963 [77:37:43<91:16:43, 16.55s/it]
 48%|████▊     | 18112/37963 [77:37:58<87:42:41, 15.91s/it]
 48%|████▊     | 18113/37963 [77:38:12<84:31:21, 15.33s/it]
 48%|████▊     | 18114/37963 [77:38:26<82:57:05, 15.04s/it]
 48%|████▊     | 18115/37963 [77:38:41<82:03:53, 14.88s/it]
 48%|████▊     | 18116/37963 [77:38:55<81:13:45, 14.73s/it]
 48%|████▊     | 18117/37963 [77:39:16<92:03:00, 16.70s/it]
 48%|████▊     | 18118/37963 [77:39:31<88:10:41, 16.00s/it]
 48%|████▊     | 18119/37963 [77:39:52<96:17:03, 17.47s/it]
 48%|████▊     | 18120/37963 [77:40:06<91:06:07, 16.53s/it]
                                                           
{'loss': '0.1486', 'grad_norm': '1.641', 'learning_rate': '1.122e-05', 'epoch': '0.4773'}

 48%|████▊     | 18120/37963 [77:40:06<91:06:07, 16.53s/it]
 48%|████▊     | 18121/37963 [77:40:20<87:32:42, 15.88s/it]
 48%|████▊     | 18122/37963 [77:40:35<85:06:37, 15.44s/it]
 48%|████▊     | 18123/37963 [77:40:49<83:16:32, 15.11s/it]
 48%|████▊     | 18124/37963 [77:41:03<81:43:49, 14.83s/it]
 48%|████▊     | 18125/37963 [77:41:18<81:13:53, 14.74s/it]
 48%|████▊     | 18126/37963 [77:41:32<80:31:09, 14.61s/it]
 48%|████▊     | 18127/37963 [77:41:46<79:59:51, 14.52s/it]
 48%|████▊     | 18128/37963 [77:42:06<89:19:40, 16.21s/it]
 48%|████▊     | 18129/37963 [77:42:21<86:12:37, 15.65s/it]
 48%|████▊     | 18130/37963 [77:42:35<84:07:34, 15.27s/it]
                                                           
{'loss': '0.1417', 'grad_norm': '2.334', 'learning_rate': '1.121e-05', 'epoch': '0.4776'}

 48%|████▊     | 18130/37963 [77:42:35<84:07:34, 15.27s/it]
 48%|████▊     | 18131/37963 [77:42:49<81:16:14, 14.75s/it]
 48%|████▊     | 18132/37963 [77:43:09<90:52:25, 16.50s/it]
 48%|████▊     | 18133/37963 [77:43:24<87:23:08, 15.86s/it]
 48%|████▊     | 18134/37963 [77:43:38<85:01:18, 15.44s/it]
 48%|████▊     | 18135/37963 [77:43:53<83:26:31, 15.15s/it]
 48%|████▊     | 18136/37963 [77:44:07<82:10:31, 14.92s/it]
 48%|████▊     | 18137/37963 [77:44:22<81:43:04, 14.84s/it]
 48%|████▊     | 18138/37963 [77:44:43<92:32:58, 16.81s/it]
 48%|████▊     | 18139/37963 [77:44:57<88:27:50, 16.06s/it]
 48%|████▊     | 18140/37963 [77:45:12<85:42:24, 15.56s/it]
                                                           
{'loss': '0.1603', 'grad_norm': '5.73', 'learning_rate': '1.12e-05', 'epoch': '0.4778'}

 48%|████▊     | 18140/37963 [77:45:12<85:42:24, 15.56s/it]
 48%|████▊     | 18141/37963 [77:45:25<82:08:59, 14.92s/it]
 48%|████▊     | 18142/37963 [77:45:40<81:10:56, 14.74s/it]
 48%|████▊     | 18143/37963 [77:45:54<80:36:24, 14.64s/it]
 48%|████▊     | 18144/37963 [77:46:15<90:31:00, 16.44s/it]
 48%|████▊     | 18145/37963 [77:46:29<87:13:16, 15.84s/it]
 48%|████▊     | 18146/37963 [77:46:43<84:51:03, 15.41s/it]
 48%|████▊     | 18147/37963 [77:46:58<82:48:32, 15.04s/it]
 48%|████▊     | 18148/37963 [77:47:12<81:41:26, 14.84s/it]
 48%|████▊     | 18149/37963 [77:47:26<80:27:39, 14.62s/it]
 48%|████▊     | 18150/37963 [77:47:40<79:55:14, 14.52s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '2.117', 'learning_rate': '1.119e-05', 'epoch': '0.4781'}

 48%|████▊     | 18150/37963 [77:47:40<79:55:14, 14.52s/it]
 48%|████▊     | 18151/37963 [77:47:54<78:48:46, 14.32s/it]
 48%|████▊     | 18152/37963 [77:48:09<78:54:13, 14.34s/it]
 48%|████▊     | 18153/37963 [77:48:23<78:25:19, 14.25s/it]
 48%|████▊     | 18154/37963 [77:48:37<78:38:21, 14.29s/it]
 48%|████▊     | 18155/37963 [77:48:58<89:54:33, 16.34s/it]
 48%|████▊     | 18156/37963 [77:49:13<86:53:09, 15.79s/it]
 48%|████▊     | 18157/37963 [77:49:27<84:32:33, 15.37s/it]
 48%|████▊     | 18158/37963 [77:49:42<83:07:31, 15.11s/it]
 48%|████▊     | 18159/37963 [77:49:56<82:01:58, 14.91s/it]
 48%|████▊     | 18160/37963 [77:50:17<91:51:29, 16.70s/it]
                                                           
{'loss': '0.1348', 'grad_norm': '1.878', 'learning_rate': '1.118e-05', 'epoch': '0.4784'}

 48%|████▊     | 18160/37963 [77:50:17<91:51:29, 16.70s/it]
 48%|████▊     | 18161/37963 [77:50:31<87:59:12, 16.00s/it]
 48%|████▊     | 18162/37963 [77:50:46<85:16:02, 15.50s/it]
 48%|████▊     | 18163/37963 [77:51:00<83:35:47, 15.20s/it]
 48%|████▊     | 18164/37963 [77:51:14<81:52:12, 14.89s/it]
 48%|████▊     | 18165/37963 [77:51:29<81:04:30, 14.74s/it]
 48%|████▊     | 18166/37963 [77:51:50<92:35:37, 16.84s/it]
 48%|████▊     | 18167/37963 [77:52:05<88:27:36, 16.09s/it]
 48%|████▊     | 18168/37963 [77:52:19<85:31:32, 15.55s/it]
 48%|████▊     | 18169/37963 [77:52:33<83:32:54, 15.20s/it]
 48%|████▊     | 18170/37963 [77:52:54<92:45:27, 16.87s/it]
                                                           
{'loss': '0.156', 'grad_norm': '2.303', 'learning_rate': '1.118e-05', 'epoch': '0.4786'}

 48%|████▊     | 18170/37963 [77:52:54<92:45:27, 16.87s/it]
 48%|████▊     | 18171/37963 [77:53:08<88:34:46, 16.11s/it]
 48%|████▊     | 18172/37963 [77:53:23<85:48:57, 15.61s/it]
 48%|████▊     | 18173/37963 [77:53:37<83:38:47, 15.22s/it]
 48%|████▊     | 18174/37963 [77:53:52<82:13:25, 14.96s/it]
 48%|████▊     | 18175/37963 [77:54:06<81:18:20, 14.79s/it]
 48%|████▊     | 18176/37963 [77:54:20<80:32:45, 14.65s/it]
 48%|████▊     | 18177/37963 [77:54:41<90:39:12, 16.49s/it]
 48%|████▊     | 18178/37963 [77:54:55<87:03:55, 15.84s/it]
 48%|████▊     | 18179/37963 [77:55:10<84:50:55, 15.44s/it]
 48%|████▊     | 18180/37963 [77:55:24<82:47:43, 15.07s/it]
                                                           
{'loss': '0.1385', 'grad_norm': '2.109', 'learning_rate': '1.117e-05', 'epoch': '0.4789'}

 48%|████▊     | 18180/37963 [77:55:24<82:47:43, 15.07s/it]
 48%|████▊     | 18181/37963 [77:55:38<81:37:01, 14.85s/it]
 48%|████▊     | 18182/37963 [77:55:59<91:27:17, 16.64s/it]
 48%|████▊     | 18183/37963 [77:56:14<87:40:53, 15.96s/it]
 48%|████▊     | 18184/37963 [77:56:28<84:46:08, 15.43s/it]
 48%|████▊     | 18185/37963 [77:56:49<94:04:14, 17.12s/it]
 48%|████▊     | 18186/37963 [77:57:03<89:25:51, 16.28s/it]
 48%|████▊     | 18187/37963 [77:57:18<86:10:52, 15.69s/it]
 48%|████▊     | 18188/37963 [77:57:31<83:12:53, 15.15s/it]
 48%|████▊     | 18189/37963 [77:57:46<82:00:33, 14.93s/it]
 48%|████▊     | 18190/37963 [77:58:00<81:09:10, 14.78s/it]
                                                           
{'loss': '0.145', 'grad_norm': '2.366', 'learning_rate': '1.116e-05', 'epoch': '0.4792'}

 48%|████▊     | 18190/37963 [77:58:00<81:09:10, 14.78s/it]
 48%|████▊     | 18191/37963 [77:58:15<80:29:13, 14.65s/it]
 48%|████▊     | 18192/37963 [77:58:29<79:54:04, 14.55s/it]
 48%|████▊     | 18193/37963 [77:58:43<79:43:05, 14.52s/it]
 48%|████▊     | 18194/37963 [77:59:04<90:25:15, 16.47s/it]
 48%|████▊     | 18195/37963 [77:59:19<86:57:50, 15.84s/it]
 48%|████▊     | 18196/37963 [77:59:33<84:36:32, 15.41s/it]
 48%|████▊     | 18197/37963 [77:59:48<82:55:56, 15.10s/it]
 48%|████▊     | 18198/37963 [78:00:02<81:57:46, 14.93s/it]
 48%|████▊     | 18199/37963 [78:00:16<80:44:06, 14.71s/it]
 48%|████▊     | 18200/37963 [78:00:30<79:48:16, 14.54s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '4.575', 'learning_rate': '1.115e-05', 'epoch': '0.4794'}

 48%|████▊     | 18200/37963 [78:00:30<79:48:16, 14.54s/it]
 48%|████▊     | 18201/37963 [78:00:45<79:33:26, 14.49s/it]
 48%|████▊     | 18202/37963 [78:01:06<89:49:37, 16.36s/it]
 48%|████▊     | 18203/37963 [78:01:20<86:14:25, 15.71s/it]
 48%|████▊     | 18204/37963 [78:01:34<84:02:30, 15.31s/it]
 48%|████▊     | 18205/37963 [78:01:49<82:37:10, 15.05s/it]
 48%|████▊     | 18206/37963 [78:02:02<80:30:00, 14.67s/it]
 48%|████▊     | 18207/37963 [78:02:17<79:55:18, 14.56s/it]
 48%|████▊     | 18208/37963 [78:02:31<79:45:17, 14.53s/it]
 48%|████▊     | 18209/37963 [78:02:52<90:24:04, 16.47s/it]
 48%|████▊     | 18210/37963 [78:03:06<85:50:12, 15.64s/it]
                                                           
{'loss': '0.15', 'grad_norm': '1.921', 'learning_rate': '1.114e-05', 'epoch': '0.4797'}

 48%|████▊     | 18210/37963 [78:03:06<85:50:12, 15.64s/it]
 48%|████▊     | 18211/37963 [78:03:20<84:10:17, 15.34s/it]
 48%|████▊     | 18212/37963 [78:03:34<81:33:41, 14.87s/it]
 48%|████▊     | 18213/37963 [78:03:49<80:36:43, 14.69s/it]
 48%|████▊     | 18214/37963 [78:04:10<91:06:47, 16.61s/it]
 48%|████▊     | 18215/37963 [78:04:24<86:49:28, 15.83s/it]
 48%|████▊     | 18216/37963 [78:04:38<84:17:55, 15.37s/it]
 48%|████▊     | 18217/37963 [78:04:52<82:30:16, 15.04s/it]
 48%|████▊     | 18218/37963 [78:05:13<91:18:39, 16.65s/it]
 48%|████▊     | 18219/37963 [78:05:27<87:29:12, 15.95s/it]
 48%|████▊     | 18220/37963 [78:05:41<84:43:11, 15.45s/it]
                                                           
{'loss': '0.1603', 'grad_norm': '1.648', 'learning_rate': '1.113e-05', 'epoch': '0.4799'}

 48%|████▊     | 18220/37963 [78:05:41<84:43:11, 15.45s/it]
 48%|████▊     | 18221/37963 [78:05:55<82:29:53, 15.04s/it]
 48%|████▊     | 18222/37963 [78:06:10<81:18:00, 14.83s/it]
 48%|████▊     | 18223/37963 [78:06:24<80:44:23, 14.72s/it]
 48%|████▊     | 18224/37963 [78:06:38<79:13:30, 14.45s/it]
 48%|████▊     | 18225/37963 [78:06:52<78:11:33, 14.26s/it]
 48%|████▊     | 18226/37963 [78:07:13<89:51:14, 16.39s/it]
 48%|████▊     | 18227/37963 [78:07:27<86:19:11, 15.75s/it]
 48%|████▊     | 18228/37963 [78:07:42<84:00:52, 15.33s/it]
 48%|████▊     | 18229/37963 [78:07:56<81:53:15, 14.94s/it]
 48%|████▊     | 18230/37963 [78:08:10<80:03:25, 14.61s/it]
                                                           
{'loss': '0.1504', 'grad_norm': '1.521', 'learning_rate': '1.113e-05', 'epoch': '0.4802'}

 48%|████▊     | 18230/37963 [78:08:10<80:03:25, 14.61s/it]
 48%|████▊     | 18231/37963 [78:08:30<90:31:04, 16.51s/it]
 48%|████▊     | 18232/37963 [78:08:45<86:52:44, 15.85s/it]
 48%|████▊     | 18233/37963 [78:08:59<84:10:56, 15.36s/it]
 48%|████▊     | 18234/37963 [78:09:20<93:20:29, 17.03s/it]
 48%|████▊     | 18235/37963 [78:09:33<87:17:14, 15.93s/it]
 48%|████▊     | 18236/37963 [78:09:48<84:39:39, 15.45s/it]
 48%|████▊     | 18237/37963 [78:10:02<82:26:45, 15.05s/it]
 48%|████▊     | 18238/37963 [78:10:16<80:55:44, 14.77s/it]
 48%|████▊     | 18239/37963 [78:10:30<79:51:53, 14.58s/it]
 48%|████▊     | 18240/37963 [78:10:44<79:38:25, 14.54s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '2.238', 'learning_rate': '1.112e-05', 'epoch': '0.4805'}

 48%|████▊     | 18240/37963 [78:10:44<79:38:25, 14.54s/it]
 48%|████▊     | 18241/37963 [78:11:06<90:28:18, 16.51s/it]
 48%|████▊     | 18242/37963 [78:11:20<87:06:52, 15.90s/it]
 48%|████▊     | 18243/37963 [78:11:34<84:33:06, 15.44s/it]
 48%|████▊     | 18244/37963 [78:11:49<82:37:36, 15.08s/it]
 48%|████▊     | 18245/37963 [78:12:03<81:21:48, 14.85s/it]
 48%|████▊     | 18246/37963 [78:12:17<80:28:21, 14.69s/it]
 48%|████▊     | 18247/37963 [78:12:32<79:52:18, 14.58s/it]
 48%|████▊     | 18248/37963 [78:12:46<78:53:17, 14.41s/it]
 48%|████▊     | 18249/37963 [78:13:00<78:31:09, 14.34s/it]
 48%|████▊     | 18250/37963 [78:13:14<78:30:08, 14.34s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '2.502', 'learning_rate': '1.111e-05', 'epoch': '0.4807'}

 48%|████▊     | 18250/37963 [78:13:14<78:30:08, 14.34s/it]
 48%|████▊     | 18251/37963 [78:13:35<89:06:04, 16.27s/it]
 48%|████▊     | 18252/37963 [78:13:49<86:09:18, 15.74s/it]
 48%|████▊     | 18253/37963 [78:14:04<83:57:43, 15.34s/it]
 48%|████▊     | 18254/37963 [78:14:18<81:51:16, 14.95s/it]
 48%|████▊     | 18255/37963 [78:14:32<80:17:17, 14.67s/it]
 48%|████▊     | 18256/37963 [78:14:46<79:48:48, 14.58s/it]
 48%|████▊     | 18257/37963 [78:15:00<78:41:31, 14.38s/it]
 48%|████▊     | 18258/37963 [78:15:14<78:19:46, 14.31s/it]
 48%|████▊     | 18259/37963 [78:15:29<78:24:15, 14.32s/it]
 48%|████▊     | 18260/37963 [78:15:50<90:02:12, 16.45s/it]
                                                           
{'loss': '0.147', 'grad_norm': '2.417', 'learning_rate': '1.11e-05', 'epoch': '0.481'}

 48%|████▊     | 18260/37963 [78:15:50<90:02:12, 16.45s/it]
 48%|████▊     | 18261/37963 [78:16:04<85:45:30, 15.67s/it]
 48%|████▊     | 18262/37963 [78:16:18<83:35:23, 15.27s/it]
 48%|████▊     | 18263/37963 [78:16:39<93:20:29, 17.06s/it]
 48%|████▊     | 18264/37963 [78:16:54<89:10:18, 16.30s/it]
 48%|████▊     | 18265/37963 [78:17:08<85:37:12, 15.65s/it]
 48%|████▊     | 18266/37963 [78:17:29<93:48:46, 17.15s/it]
 48%|████▊     | 18267/37963 [78:17:43<89:23:25, 16.34s/it]
 48%|████▊     | 18268/37963 [78:17:58<86:17:58, 15.77s/it]
 48%|████▊     | 18269/37963 [78:18:12<84:03:15, 15.36s/it]
 48%|████▊     | 18270/37963 [78:18:26<81:26:20, 14.89s/it]
                                                           
{'loss': '0.1377', 'grad_norm': '5.655', 'learning_rate': '1.109e-05', 'epoch': '0.4813'}

 48%|████▊     | 18270/37963 [78:18:26<81:26:20, 14.89s/it]
 48%|████▊     | 18271/37963 [78:18:40<80:47:17, 14.77s/it]
 48%|████▊     | 18272/37963 [78:18:55<80:08:31, 14.65s/it]
 48%|████▊     | 18273/37963 [78:19:09<79:02:53, 14.45s/it]
 48%|████▊     | 18274/37963 [78:19:29<89:22:25, 16.34s/it]
 48%|████▊     | 18275/37963 [78:19:44<86:04:49, 15.74s/it]
 48%|████▊     | 18276/37963 [78:19:58<82:54:03, 15.16s/it]
 48%|████▊     | 18277/37963 [78:20:12<81:47:57, 14.96s/it]
 48%|████▊     | 18278/37963 [78:20:26<80:47:25, 14.77s/it]
 48%|████▊     | 18279/37963 [78:20:40<79:26:43, 14.53s/it]
 48%|████▊     | 18280/37963 [78:20:55<78:54:59, 14.43s/it]
                                                           
{'loss': '0.1364', 'grad_norm': '2.143', 'learning_rate': '1.108e-05', 'epoch': '0.4815'}

 48%|████▊     | 18280/37963 [78:20:55<78:54:59, 14.43s/it]
 48%|████▊     | 18281/37963 [78:21:09<78:46:08, 14.41s/it]
 48%|████▊     | 18282/37963 [78:21:29<88:03:55, 16.11s/it]
 48%|████▊     | 18283/37963 [78:21:50<96:37:57, 17.68s/it]
 48%|████▊     | 18284/37963 [78:22:05<91:05:15, 16.66s/it]
 48%|████▊     | 18285/37963 [78:22:19<87:13:20, 15.96s/it]
 48%|████▊     | 18286/37963 [78:22:33<84:42:37, 15.50s/it]
 48%|████▊     | 18287/37963 [78:22:48<82:49:04, 15.15s/it]
 48%|████▊     | 18288/37963 [78:23:02<81:24:57, 14.90s/it]
 48%|████▊     | 18289/37963 [78:23:23<91:29:01, 16.74s/it]
 48%|████▊     | 18290/37963 [78:23:37<87:08:19, 15.95s/it]
                                                           
{'loss': '0.1414', 'grad_norm': '2.572', 'learning_rate': '1.107e-05', 'epoch': '0.4818'}

 48%|████▊     | 18290/37963 [78:23:37<87:08:19, 15.95s/it]
 48%|████▊     | 18291/37963 [78:23:52<84:35:29, 15.48s/it]
 48%|████▊     | 18292/37963 [78:24:06<82:40:59, 15.13s/it]
 48%|████▊     | 18293/37963 [78:24:20<81:21:29, 14.89s/it]
 48%|████▊     | 18294/37963 [78:24:35<80:26:58, 14.72s/it]
 48%|████▊     | 18295/37963 [78:24:49<79:54:18, 14.63s/it]
 48%|████▊     | 18296/37963 [78:25:03<78:43:28, 14.41s/it]
 48%|████▊     | 18297/37963 [78:25:17<78:31:45, 14.38s/it]
 48%|████▊     | 18298/37963 [78:25:31<77:58:56, 14.28s/it]
 48%|████▊     | 18299/37963 [78:25:46<78:02:49, 14.29s/it]
 48%|████▊     | 18300/37963 [78:26:06<88:32:55, 16.21s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '1.855', 'learning_rate': '1.107e-05', 'epoch': '0.482'}

 48%|████▊     | 18300/37963 [78:26:06<88:32:55, 16.21s/it]
 48%|████▊     | 18301/37963 [78:26:20<85:17:36, 15.62s/it]
 48%|████▊     | 18302/37963 [78:26:34<82:01:56, 15.02s/it]
 48%|████▊     | 18303/37963 [78:26:48<80:27:03, 14.73s/it]
 48%|████▊     | 18304/37963 [78:27:02<78:42:53, 14.41s/it]
 48%|████▊     | 18305/37963 [78:27:16<78:20:40, 14.35s/it]
 48%|████▊     | 18306/37963 [78:27:30<78:22:03, 14.35s/it]
 48%|████▊     | 18307/37963 [78:27:45<78:29:18, 14.38s/it]
 48%|████▊     | 18308/37963 [78:27:59<78:24:48, 14.36s/it]
 48%|████▊     | 18309/37963 [78:28:20<88:38:08, 16.24s/it]
 48%|████▊     | 18310/37963 [78:28:34<85:33:17, 15.67s/it]
                                                           
{'loss': '0.1397', 'grad_norm': '0.9436', 'learning_rate': '1.106e-05', 'epoch': '0.4823'}

 48%|████▊     | 18310/37963 [78:28:34<85:33:17, 15.67s/it]
 48%|████▊     | 18311/37963 [78:28:55<94:03:37, 17.23s/it]
 48%|████▊     | 18312/37963 [78:29:09<89:20:24, 16.37s/it]
 48%|████▊     | 18313/37963 [78:29:24<86:00:57, 15.76s/it]
 48%|████▊     | 18314/37963 [78:29:44<93:59:17, 17.22s/it]
 48%|████▊     | 18315/37963 [78:29:59<89:18:18, 16.36s/it]
 48%|████▊     | 18316/37963 [78:30:12<85:11:50, 15.61s/it]
 48%|████▊     | 18317/37963 [78:30:27<82:47:40, 15.17s/it]
 48%|████▊     | 18318/37963 [78:30:41<81:19:37, 14.90s/it]
 48%|████▊     | 18319/37963 [78:30:55<80:11:17, 14.70s/it]
 48%|████▊     | 18320/37963 [78:31:10<79:42:57, 14.61s/it]
                                                           
{'loss': '0.1455', 'grad_norm': '0.9288', 'learning_rate': '1.105e-05', 'epoch': '0.4826'}

 48%|████▊     | 18320/37963 [78:31:10<79:42:57, 14.61s/it]
 48%|████▊     | 18321/37963 [78:31:24<79:18:25, 14.54s/it]
 48%|████▊     | 18322/37963 [78:31:38<79:02:10, 14.49s/it]
 48%|████▊     | 18323/37963 [78:31:53<78:58:49, 14.48s/it]
 48%|████▊     | 18324/37963 [78:32:14<89:42:32, 16.44s/it]
 48%|████▊     | 18325/37963 [78:32:28<86:13:34, 15.81s/it]
 48%|████▊     | 18326/37963 [78:32:42<83:01:37, 15.22s/it]
 48%|████▊     | 18327/37963 [78:32:56<81:36:47, 14.96s/it]
 48%|████▊     | 18328/37963 [78:33:11<80:42:36, 14.80s/it]
 48%|████▊     | 18329/37963 [78:33:25<79:43:09, 14.62s/it]
 48%|████▊     | 18330/37963 [78:33:39<79:14:01, 14.53s/it]
                                                           
{'loss': '0.154', 'grad_norm': '1.273', 'learning_rate': '1.104e-05', 'epoch': '0.4828'}

 48%|████▊     | 18330/37963 [78:33:39<79:14:01, 14.53s/it]
 48%|████▊     | 18331/37963 [78:33:54<78:53:20, 14.47s/it]
 48%|████▊     | 18332/37963 [78:34:21<100:27:31, 18.42s/it]
 48%|████▊     | 18333/37963 [78:34:35<93:43:53, 17.19s/it] 
 48%|████▊     | 18334/37963 [78:34:50<88:51:01, 16.30s/it]
 48%|████▊     | 18335/37963 [78:35:04<85:48:07, 15.74s/it]
 48%|████▊     | 18336/37963 [78:35:18<83:31:01, 15.32s/it]
 48%|████▊     | 18337/37963 [78:35:39<91:59:17, 16.87s/it]
 48%|████▊     | 18338/37963 [78:35:53<86:46:29, 15.92s/it]
 48%|████▊     | 18339/37963 [78:36:07<84:17:47, 15.46s/it]
 48%|████▊     | 18340/37963 [78:36:21<81:52:51, 15.02s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '1.831', 'learning_rate': '1.103e-05', 'epoch': '0.4831'}

 48%|████▊     | 18340/37963 [78:36:21<81:52:51, 15.02s/it]
 48%|████▊     | 18341/37963 [78:36:35<80:51:46, 14.84s/it]
 48%|████▊     | 18342/37963 [78:36:50<80:07:32, 14.70s/it]
 48%|████▊     | 18343/37963 [78:37:04<79:40:20, 14.62s/it]
 48%|████▊     | 18344/37963 [78:37:19<79:24:12, 14.57s/it]
 48%|████▊     | 18345/37963 [78:37:32<77:40:50, 14.25s/it]
 48%|████▊     | 18346/37963 [78:37:47<77:48:28, 14.28s/it]
 48%|████▊     | 18347/37963 [78:38:01<78:02:31, 14.32s/it]
 48%|████▊     | 18348/37963 [78:38:15<77:31:17, 14.23s/it]
 48%|████▊     | 18349/37963 [78:38:36<88:15:04, 16.20s/it]
 48%|████▊     | 18350/37963 [78:38:50<85:28:26, 15.69s/it]
                                                           
{'loss': '0.1524', 'grad_norm': '4.158', 'learning_rate': '1.102e-05', 'epoch': '0.4834'}

 48%|████▊     | 18350/37963 [78:38:50<85:28:26, 15.69s/it]
 48%|████▊     | 18351/37963 [78:39:05<83:13:34, 15.28s/it]
 48%|████▊     | 18352/37963 [78:39:18<80:26:38, 14.77s/it]
 48%|████▊     | 18353/37963 [78:39:33<79:53:47, 14.67s/it]
 48%|████▊     | 18354/37963 [78:39:53<89:54:26, 16.51s/it]
 48%|████▊     | 18355/37963 [78:40:08<86:21:26, 15.86s/it]
 48%|████▊     | 18356/37963 [78:40:22<83:50:02, 15.39s/it]
 48%|████▊     | 18357/37963 [78:40:36<81:36:00, 14.98s/it]
 48%|████▊     | 18358/37963 [78:40:50<80:32:51, 14.79s/it]
 48%|████▊     | 18359/37963 [78:41:05<79:53:45, 14.67s/it]
 48%|████▊     | 18360/37963 [78:41:25<89:33:13, 16.45s/it]
                                                           
{'loss': '0.1458', 'grad_norm': '1.253', 'learning_rate': '1.102e-05', 'epoch': '0.4836'}

 48%|████▊     | 18360/37963 [78:41:25<89:33:13, 16.45s/it]
 48%|████▊     | 18361/37963 [78:41:40<86:08:01, 15.82s/it]
 48%|████▊     | 18362/37963 [78:41:54<83:38:37, 15.36s/it]
 48%|████▊     | 18363/37963 [78:42:16<93:33:22, 17.18s/it]
 48%|████▊     | 18364/37963 [78:42:30<88:54:46, 16.33s/it]
 48%|████▊     | 18365/37963 [78:42:44<85:30:47, 15.71s/it]
 48%|████▊     | 18366/37963 [78:42:58<83:15:55, 15.30s/it]
 48%|████▊     | 18367/37963 [78:43:13<81:41:42, 15.01s/it]
 48%|████▊     | 18368/37963 [78:43:26<79:29:16, 14.60s/it]
 48%|████▊     | 18369/37963 [78:43:40<78:28:10, 14.42s/it]
 48%|████▊     | 18370/37963 [78:43:55<78:21:57, 14.40s/it]
                                                           
{'loss': '0.1352', 'grad_norm': '0.9112', 'learning_rate': '1.101e-05', 'epoch': '0.4839'}

 48%|████▊     | 18370/37963 [78:43:55<78:21:57, 14.40s/it]
 48%|████▊     | 18371/37963 [78:44:09<78:15:33, 14.38s/it]
 48%|████▊     | 18372/37963 [78:44:29<88:01:53, 16.18s/it]
 48%|████▊     | 18373/37963 [78:44:44<84:58:41, 15.62s/it]
 48%|████▊     | 18374/37963 [78:44:58<82:53:13, 15.23s/it]
 48%|████▊     | 18375/37963 [78:45:12<80:55:08, 14.87s/it]
 48%|████▊     | 18376/37963 [78:45:26<79:12:05, 14.56s/it]
 48%|████▊     | 18377/37963 [78:45:40<78:55:49, 14.51s/it]
 48%|████▊     | 18378/37963 [78:45:55<78:24:29, 14.41s/it]
 48%|████▊     | 18379/37963 [78:46:08<77:33:02, 14.26s/it]
 48%|████▊     | 18380/37963 [78:46:29<88:11:20, 16.21s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '2.816', 'learning_rate': '1.1e-05', 'epoch': '0.4842'}

 48%|████▊     | 18380/37963 [78:46:29<88:11:20, 16.21s/it]
 48%|████▊     | 18381/37963 [78:46:50<95:27:32, 17.55s/it]
 48%|████▊     | 18382/37963 [78:47:04<89:26:09, 16.44s/it]
 48%|████▊     | 18383/37963 [78:47:18<85:45:44, 15.77s/it]
 48%|████▊     | 18384/37963 [78:47:32<83:23:19, 15.33s/it]
 48%|████▊     | 18385/37963 [78:47:47<81:52:30, 15.06s/it]
 48%|████▊     | 18386/37963 [78:48:08<92:20:35, 16.98s/it]
 48%|████▊     | 18387/37963 [78:48:23<88:05:49, 16.20s/it]
 48%|████▊     | 18388/37963 [78:48:36<84:11:18, 15.48s/it]
 48%|████▊     | 18389/37963 [78:48:50<81:55:18, 15.07s/it]
 48%|████▊     | 18390/37963 [78:49:05<80:50:17, 14.87s/it]
                                                           
{'loss': '0.152', 'grad_norm': '1.999', 'learning_rate': '1.099e-05', 'epoch': '0.4844'}

 48%|████▊     | 18390/37963 [78:49:05<80:50:17, 14.87s/it]
 48%|████▊     | 18391/37963 [78:49:19<79:57:13, 14.71s/it]
 48%|████▊     | 18392/37963 [78:49:34<79:24:35, 14.61s/it]
 48%|████▊     | 18393/37963 [78:49:48<78:43:19, 14.48s/it]
 48%|████▊     | 18394/37963 [78:50:02<78:33:27, 14.45s/it]
 48%|████▊     | 18395/37963 [78:50:16<78:08:06, 14.37s/it]
 48%|████▊     | 18396/37963 [78:50:31<78:11:07, 14.38s/it]
 48%|████▊     | 18397/37963 [78:50:45<78:12:37, 14.39s/it]
 48%|████▊     | 18398/37963 [78:51:06<88:29:08, 16.28s/it]
 48%|████▊     | 18399/37963 [78:51:20<85:24:22, 15.72s/it]
 48%|████▊     | 18400/37963 [78:51:35<83:07:40, 15.30s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '3.328', 'learning_rate': '1.098e-05', 'epoch': '0.4847'}

 48%|████▊     | 18400/37963 [78:51:35<83:07:40, 15.30s/it]
 48%|████▊     | 18401/37963 [78:51:49<81:34:37, 15.01s/it]
 48%|████▊     | 18402/37963 [78:52:03<80:33:36, 14.83s/it]
 48%|████▊     | 18403/37963 [78:52:24<89:45:46, 16.52s/it]
 48%|████▊     | 18404/37963 [78:52:38<86:19:22, 15.89s/it]
 48%|████▊     | 18405/37963 [78:52:53<83:55:48, 15.45s/it]
 48%|████▊     | 18406/37963 [78:53:07<82:07:50, 15.12s/it]
 48%|████▊     | 18407/37963 [78:53:21<80:45:33, 14.87s/it]
 48%|████▊     | 18408/37963 [78:53:36<79:52:32, 14.70s/it]
 48%|████▊     | 18409/37963 [78:53:49<77:55:17, 14.35s/it]
 48%|████▊     | 18410/37963 [78:54:10<88:45:01, 16.34s/it]
                                                           
{'loss': '0.1502', 'grad_norm': '2.421', 'learning_rate': '1.097e-05', 'epoch': '0.4849'}

 48%|████▊     | 18410/37963 [78:54:10<88:45:01, 16.34s/it]
 48%|████▊     | 18411/37963 [78:54:32<97:13:44, 17.90s/it]
 48%|████▊     | 18412/37963 [78:54:46<91:26:59, 16.84s/it]
 49%|████▊     | 18413/37963 [78:55:00<87:23:15, 16.09s/it]
 49%|████▊     | 18414/37963 [78:55:15<84:38:29, 15.59s/it]
 49%|████▊     | 18415/37963 [78:55:29<81:45:23, 15.06s/it]
 49%|████▊     | 18416/37963 [78:55:43<81:04:53, 14.93s/it]
 49%|████▊     | 18417/37963 [78:55:57<79:39:03, 14.67s/it]
 49%|████▊     | 18418/37963 [78:56:12<79:08:11, 14.58s/it]
 49%|████▊     | 18419/37963 [78:56:26<78:24:41, 14.44s/it]
 49%|████▊     | 18420/37963 [78:56:39<76:53:07, 14.16s/it]
                                                           
{'loss': '0.1396', 'grad_norm': '2.999', 'learning_rate': '1.096e-05', 'epoch': '0.4852'}

 49%|████▊     | 18420/37963 [78:56:39<76:53:07, 14.16s/it]
 49%|████▊     | 18421/37963 [78:57:00<87:50:46, 16.18s/it]
 49%|████▊     | 18422/37963 [78:57:14<84:48:40, 15.62s/it]
 49%|████▊     | 18423/37963 [78:57:29<82:38:54, 15.23s/it]
 49%|████▊     | 18424/37963 [78:57:43<81:11:06, 14.96s/it]
 49%|████▊     | 18425/37963 [78:57:57<79:17:41, 14.61s/it]
 49%|████▊     | 18426/37963 [78:58:11<78:52:57, 14.54s/it]
 49%|████▊     | 18427/37963 [78:58:25<78:05:37, 14.39s/it]
 49%|████▊     | 18428/37963 [78:58:46<87:41:22, 16.16s/it]
 49%|████▊     | 18429/37963 [78:59:07<95:34:07, 17.61s/it]
 49%|████▊     | 18430/37963 [78:59:21<90:15:37, 16.64s/it]
                                                           
{'loss': '0.1402', 'grad_norm': '1.557', 'learning_rate': '1.096e-05', 'epoch': '0.4855'}

 49%|████▊     | 18430/37963 [78:59:21<90:15:37, 16.64s/it]
 49%|████▊     | 18431/37963 [78:59:35<86:35:52, 15.96s/it]
 49%|████▊     | 18432/37963 [78:59:50<84:05:59, 15.50s/it]
 49%|████▊     | 18433/37963 [79:00:04<82:16:59, 15.17s/it]
 49%|████▊     | 18434/37963 [79:00:19<80:57:02, 14.92s/it]
 49%|████▊     | 18435/37963 [79:00:40<91:29:32, 16.87s/it]
 49%|████▊     | 18436/37963 [79:00:54<87:19:00, 16.10s/it]
 49%|████▊     | 18437/37963 [79:01:09<84:40:17, 15.61s/it]
 49%|████▊     | 18438/37963 [79:01:23<82:32:53, 15.22s/it]
 49%|████▊     | 18439/37963 [79:01:37<81:00:53, 14.94s/it]
 49%|████▊     | 18440/37963 [79:01:52<79:53:41, 14.73s/it]
                                                           
{'loss': '0.1215', 'grad_norm': '3.906', 'learning_rate': '1.095e-05', 'epoch': '0.4857'}

 49%|████▊     | 18440/37963 [79:01:52<79:53:41, 14.73s/it]
 49%|████▊     | 18441/37963 [79:02:06<79:10:53, 14.60s/it]
 49%|████▊     | 18442/37963 [79:02:19<77:28:32, 14.29s/it]
 49%|████▊     | 18443/37963 [79:02:34<77:33:32, 14.30s/it]
 49%|████▊     | 18444/37963 [79:02:48<77:40:45, 14.33s/it]
 49%|████▊     | 18445/37963 [79:03:02<77:47:37, 14.35s/it]
 49%|████▊     | 18446/37963 [79:03:17<77:49:10, 14.35s/it]
 49%|████▊     | 18447/37963 [79:03:31<77:55:32, 14.37s/it]
 49%|████▊     | 18448/37963 [79:03:52<87:55:01, 16.22s/it]
 49%|████▊     | 18449/37963 [79:04:06<84:31:57, 15.59s/it]
 49%|████▊     | 18450/37963 [79:04:20<81:16:58, 15.00s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '2.12', 'learning_rate': '1.094e-05', 'epoch': '0.486'}

 49%|████▊     | 18450/37963 [79:04:20<81:16:58, 15.00s/it]
 49%|████▊     | 18451/37963 [79:04:40<90:50:50, 16.76s/it]
 49%|████▊     | 18452/37963 [79:04:55<87:00:38, 16.05s/it]
 49%|████▊     | 18453/37963 [79:05:09<84:16:37, 15.55s/it]
 49%|████▊     | 18454/37963 [79:05:23<81:51:25, 15.11s/it]
 49%|████▊     | 18455/37963 [79:05:38<80:39:51, 14.89s/it]
 49%|████▊     | 18456/37963 [79:05:52<79:43:34, 14.71s/it]
 49%|████▊     | 18457/37963 [79:06:06<79:19:51, 14.64s/it]
 49%|████▊     | 18458/37963 [79:06:20<77:19:25, 14.27s/it]
 49%|████▊     | 18459/37963 [79:06:40<87:33:49, 16.16s/it]
 49%|████▊     | 18460/37963 [79:07:00<93:39:00, 17.29s/it]
                                                           
{'loss': '0.1342', 'grad_norm': '1.713', 'learning_rate': '1.093e-05', 'epoch': '0.4863'}

 49%|████▊     | 18460/37963 [79:07:00<93:39:00, 17.29s/it]
 49%|████▊     | 18461/37963 [79:07:15<88:48:58, 16.40s/it]
 49%|████▊     | 18462/37963 [79:07:29<85:26:47, 15.77s/it]
 49%|████▊     | 18463/37963 [79:07:43<83:19:38, 15.38s/it]
 49%|████▊     | 18464/37963 [79:07:58<81:38:56, 15.07s/it]
 49%|████▊     | 18465/37963 [79:08:12<80:24:15, 14.85s/it]
 49%|████▊     | 18466/37963 [79:08:26<78:55:47, 14.57s/it]
 49%|████▊     | 18467/37963 [79:08:40<77:11:11, 14.25s/it]
 49%|████▊     | 18468/37963 [79:08:54<77:22:50, 14.29s/it]
 49%|████▊     | 18469/37963 [79:09:08<77:15:08, 14.27s/it]
 49%|████▊     | 18470/37963 [79:09:29<87:54:10, 16.23s/it]
                                                           
{'loss': '0.1459', 'grad_norm': '0.9849', 'learning_rate': '1.092e-05', 'epoch': '0.4865'}

 49%|████▊     | 18470/37963 [79:09:29<87:54:10, 16.23s/it]
 49%|████▊     | 18471/37963 [79:09:43<84:42:19, 15.64s/it]
 49%|████▊     | 18472/37963 [79:09:58<82:37:13, 15.26s/it]
 49%|████▊     | 18473/37963 [79:10:12<80:58:49, 14.96s/it]
 49%|████▊     | 18474/37963 [79:10:26<79:57:23, 14.77s/it]
 49%|████▊     | 18475/37963 [79:10:41<79:18:24, 14.65s/it]
 49%|████▊     | 18476/37963 [79:10:55<78:46:59, 14.55s/it]
 49%|████▊     | 18477/37963 [79:11:16<88:47:48, 16.41s/it]
 49%|████▊     | 18478/37963 [79:11:37<96:19:59, 17.80s/it]
 49%|████▊     | 18479/37963 [79:11:51<90:43:32, 16.76s/it]
 49%|████▊     | 18480/37963 [79:12:05<86:52:30, 16.05s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '3.755', 'learning_rate': '1.091e-05', 'epoch': '0.4868'}

 49%|████▊     | 18480/37963 [79:12:05<86:52:30, 16.05s/it]
 49%|████▊     | 18481/37963 [79:12:20<84:05:47, 15.54s/it]
 49%|████▊     | 18482/37963 [79:12:41<93:06:40, 17.21s/it]
 49%|████▊     | 18483/37963 [79:12:55<88:03:54, 16.27s/it]
 49%|████▊     | 18484/37963 [79:13:09<84:57:40, 15.70s/it]
 49%|████▊     | 18485/37963 [79:13:23<81:52:46, 15.13s/it]
 49%|████▊     | 18486/37963 [79:13:37<80:36:40, 14.90s/it]
 49%|████▊     | 18487/37963 [79:13:52<79:44:13, 14.74s/it]
 49%|████▊     | 18488/37963 [79:14:06<78:51:50, 14.58s/it]
 49%|████▊     | 18489/37963 [79:14:20<78:22:47, 14.49s/it]
 49%|████▊     | 18490/37963 [79:14:34<77:11:47, 14.27s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '2.07', 'learning_rate': '1.09e-05', 'epoch': '0.4871'}

 49%|████▊     | 18490/37963 [79:14:34<77:11:47, 14.27s/it]
 49%|████▊     | 18491/37963 [79:14:48<77:13:30, 14.28s/it]
 49%|████▊     | 18492/37963 [79:15:03<77:19:59, 14.30s/it]
 49%|████▊     | 18493/37963 [79:15:17<77:06:00, 14.26s/it]
 49%|████▊     | 18494/37963 [79:15:31<77:17:47, 14.29s/it]
 49%|████▊     | 18495/37963 [79:15:52<87:48:14, 16.24s/it]
 49%|████▊     | 18496/37963 [79:16:06<83:37:02, 15.46s/it]
 49%|████▊     | 18497/37963 [79:16:20<81:49:44, 15.13s/it]
 49%|████▊     | 18498/37963 [79:16:41<91:06:13, 16.85s/it]
 49%|████▊     | 18499/37963 [79:16:55<87:03:06, 16.10s/it]
 49%|████▊     | 18500/37963 [79:17:10<84:10:12, 15.57s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '3.63', 'learning_rate': '1.09e-05', 'epoch': '0.4873'}

 49%|████▊     | 18500/37963 [79:17:10<84:10:12, 15.57s/it]
 49%|████▊     | 18501/37963 [79:17:24<82:08:52, 15.20s/it]
 49%|████▊     | 18502/37963 [79:17:38<80:54:01, 14.97s/it]
 49%|████▊     | 18503/37963 [79:17:52<79:34:22, 14.72s/it]
 49%|████▊     | 18504/37963 [79:18:07<79:01:13, 14.62s/it]
 49%|████▊     | 18505/37963 [79:18:21<78:52:43, 14.59s/it]
 49%|████▊     | 18506/37963 [79:18:36<78:27:52, 14.52s/it]
 49%|████▉     | 18507/37963 [79:18:56<88:25:47, 16.36s/it]
 49%|████▉     | 18508/37963 [79:19:17<94:50:59, 17.55s/it]
 49%|████▉     | 18509/37963 [79:19:31<89:17:11, 16.52s/it]
 49%|████▉     | 18510/37963 [79:19:45<85:37:41, 15.85s/it]
                                                           
{'loss': '0.1384', 'grad_norm': '1.227', 'learning_rate': '1.089e-05', 'epoch': '0.4876'}

 49%|████▉     | 18510/37963 [79:19:45<85:37:41, 15.85s/it]
 49%|████▉     | 18511/37963 [79:19:59<83:09:57, 15.39s/it]
 49%|████▉     | 18512/37963 [79:20:14<81:25:39, 15.07s/it]
 49%|████▉     | 18513/37963 [79:20:28<80:16:45, 14.86s/it]
 49%|████▉     | 18514/37963 [79:20:42<79:26:14, 14.70s/it]
 49%|████▉     | 18515/37963 [79:20:57<79:02:51, 14.63s/it]
 49%|████▉     | 18516/37963 [79:21:12<79:11:41, 14.66s/it]
 49%|████▉     | 18517/37963 [79:21:26<78:39:04, 14.56s/it]
 49%|████▉     | 18518/37963 [79:21:41<78:35:04, 14.55s/it]
 49%|████▉     | 18519/37963 [79:21:55<78:21:06, 14.51s/it]
 49%|████▉     | 18520/37963 [79:22:16<88:47:24, 16.44s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '0.8464', 'learning_rate': '1.088e-05', 'epoch': '0.4878'}

 49%|████▉     | 18520/37963 [79:22:16<88:47:24, 16.44s/it]
 49%|████▉     | 18521/37963 [79:22:30<85:18:03, 15.79s/it]
 49%|████▉     | 18522/37963 [79:22:44<81:43:21, 15.13s/it]
 49%|████▉     | 18523/37963 [79:23:04<90:35:56, 16.78s/it]
 49%|████▉     | 18524/37963 [79:23:18<85:49:19, 15.89s/it]
 49%|████▉     | 18525/37963 [79:23:33<83:24:10, 15.45s/it]
 49%|████▉     | 18526/37963 [79:23:47<81:39:35, 15.12s/it]
 49%|████▉     | 18527/37963 [79:24:08<91:12:56, 16.90s/it]
 49%|████▉     | 18528/37963 [79:24:22<87:03:09, 16.13s/it]
 49%|████▉     | 18529/37963 [79:24:37<84:09:02, 15.59s/it]
 49%|████▉     | 18530/37963 [79:24:51<82:05:06, 15.21s/it]
                                                           
{'loss': '0.1463', 'grad_norm': '1.093', 'learning_rate': '1.087e-05', 'epoch': '0.4881'}

 49%|████▉     | 18530/37963 [79:24:51<82:05:06, 15.21s/it]
 49%|████▉     | 18531/37963 [79:25:05<80:30:54, 14.92s/it]
 49%|████▉     | 18532/37963 [79:25:20<79:40:13, 14.76s/it]
 49%|████▉     | 18533/37963 [79:25:34<78:35:50, 14.56s/it]
 49%|████▉     | 18534/37963 [79:25:55<88:55:00, 16.48s/it]
 49%|████▉     | 18535/37963 [79:26:09<85:23:03, 15.82s/it]
 49%|████▉     | 18536/37963 [79:26:23<83:06:01, 15.40s/it]
 49%|████▉     | 18537/37963 [79:26:38<81:31:21, 15.11s/it]
 49%|████▉     | 18538/37963 [79:26:52<80:28:10, 14.91s/it]
 49%|████▉     | 18539/37963 [79:27:07<79:40:07, 14.77s/it]
 49%|████▉     | 18540/37963 [79:27:21<79:17:11, 14.70s/it]
                                                           
{'loss': '0.1361', 'grad_norm': '1.769', 'learning_rate': '1.086e-05', 'epoch': '0.4884'}

 49%|████▉     | 18540/37963 [79:27:21<79:17:11, 14.70s/it]
 49%|████▉     | 18541/37963 [79:27:42<88:30:11, 16.40s/it]
 49%|████▉     | 18542/37963 [79:27:56<84:58:25, 15.75s/it]
 49%|████▉     | 18543/37963 [79:28:10<82:43:56, 15.34s/it]
 49%|████▉     | 18544/37963 [79:28:25<81:07:34, 15.04s/it]
 49%|████▉     | 18545/37963 [79:28:45<89:59:21, 16.68s/it]
 49%|████▉     | 18546/37963 [79:28:59<86:15:07, 15.99s/it]
 49%|████▉     | 18547/37963 [79:29:14<83:10:00, 15.42s/it]
 49%|████▉     | 18548/37963 [79:29:28<81:12:23, 15.06s/it]
 49%|████▉     | 18549/37963 [79:29:42<80:13:37, 14.88s/it]
 49%|████▉     | 18550/37963 [79:29:57<79:22:43, 14.72s/it]
                                                           
{'loss': '0.1503', 'grad_norm': '3.975', 'learning_rate': '1.085e-05', 'epoch': '0.4886'}

 49%|████▉     | 18550/37963 [79:29:57<79:22:43, 14.72s/it]
 49%|████▉     | 18551/37963 [79:30:11<78:42:26, 14.60s/it]
 49%|████▉     | 18552/37963 [79:30:25<78:14:45, 14.51s/it]
 49%|████▉     | 18553/37963 [79:30:40<78:01:28, 14.47s/it]
 49%|████▉     | 18554/37963 [79:30:54<78:11:19, 14.50s/it]
 49%|████▉     | 18555/37963 [79:31:21<98:53:23, 18.34s/it]
 49%|████▉     | 18556/37963 [79:31:35<91:40:14, 17.00s/it]
 49%|████▉     | 18557/37963 [79:31:50<87:21:41, 16.21s/it]
 49%|████▉     | 18558/37963 [79:32:04<84:20:04, 15.65s/it]
 49%|████▉     | 18559/37963 [79:32:18<81:44:06, 15.16s/it]
 49%|████▉     | 18560/37963 [79:32:32<80:19:34, 14.90s/it]
                                                           
{'loss': '0.1454', 'grad_norm': '4.656', 'learning_rate': '1.085e-05', 'epoch': '0.4889'}

 49%|████▉     | 18560/37963 [79:32:32<80:19:34, 14.90s/it]
 49%|████▉     | 18561/37963 [79:32:47<79:25:38, 14.74s/it]
 49%|████▉     | 18562/37963 [79:33:01<78:48:14, 14.62s/it]
 49%|████▉     | 18563/37963 [79:33:15<78:07:36, 14.50s/it]
 49%|████▉     | 18564/37963 [79:33:30<78:15:37, 14.52s/it]
 49%|████▉     | 18565/37963 [79:33:44<77:53:48, 14.46s/it]
 49%|████▉     | 18566/37963 [79:33:58<76:54:34, 14.27s/it]
 49%|████▉     | 18567/37963 [79:34:12<76:57:02, 14.28s/it]
 49%|████▉     | 18568/37963 [79:34:27<76:58:56, 14.29s/it]
 49%|████▉     | 18569/37963 [79:34:47<86:52:39, 16.13s/it]
 49%|████▉     | 18570/37963 [79:35:07<93:46:20, 17.41s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '3.169', 'learning_rate': '1.084e-05', 'epoch': '0.4892'}

 49%|████▉     | 18570/37963 [79:35:07<93:46:20, 17.41s/it]
 49%|████▉     | 18571/37963 [79:35:22<88:46:30, 16.48s/it]
 49%|████▉     | 18572/37963 [79:35:36<85:31:05, 15.88s/it]
 49%|████▉     | 18573/37963 [79:35:50<81:38:32, 15.16s/it]
 49%|████▉     | 18574/37963 [79:36:04<80:21:34, 14.92s/it]
 49%|████▉     | 18575/37963 [79:36:18<78:42:56, 14.62s/it]
 49%|████▉     | 18576/37963 [79:36:39<88:35:21, 16.45s/it]
 49%|████▉     | 18577/37963 [79:36:53<85:10:58, 15.82s/it]
 49%|████▉     | 18578/37963 [79:37:07<81:52:10, 15.20s/it]
 49%|████▉     | 18579/37963 [79:37:21<80:28:39, 14.95s/it]
 49%|████▉     | 18580/37963 [79:37:35<79:28:59, 14.76s/it]
                                                           
{'loss': '0.1386', 'grad_norm': '1.539', 'learning_rate': '1.083e-05', 'epoch': '0.4894'}

 49%|████▉     | 18580/37963 [79:37:35<79:28:59, 14.76s/it]
 49%|████▉     | 18581/37963 [79:37:50<78:31:08, 14.58s/it]
 49%|████▉     | 18582/37963 [79:38:04<77:47:43, 14.45s/it]
 49%|████▉     | 18583/37963 [79:38:25<89:34:11, 16.64s/it]
 49%|████▉     | 18584/37963 [79:38:40<85:55:10, 15.96s/it]
 49%|████▉     | 18585/37963 [79:38:54<83:14:54, 15.47s/it]
 49%|████▉     | 18586/37963 [79:39:09<81:41:19, 15.18s/it]
 49%|████▉     | 18587/37963 [79:39:23<80:26:32, 14.95s/it]
 49%|████▉     | 18588/37963 [79:39:38<79:39:20, 14.80s/it]
 49%|████▉     | 18589/37963 [79:39:59<89:38:11, 16.66s/it]
 49%|████▉     | 18590/37963 [79:40:13<85:36:46, 15.91s/it]
                                                           
{'loss': '0.1408', 'grad_norm': '1.606', 'learning_rate': '1.082e-05', 'epoch': '0.4897'}

 49%|████▉     | 18590/37963 [79:40:13<85:36:46, 15.91s/it]
 49%|████▉     | 18591/37963 [79:40:27<82:57:21, 15.42s/it]
 49%|████▉     | 18592/37963 [79:40:41<80:30:38, 14.96s/it]
 49%|████▉     | 18593/37963 [79:40:55<78:43:28, 14.63s/it]
 49%|████▉     | 18594/37963 [79:41:16<88:48:38, 16.51s/it]
 49%|████▉     | 18595/37963 [79:41:30<85:26:13, 15.88s/it]
 49%|████▉     | 18596/37963 [79:41:44<83:00:55, 15.43s/it]
 49%|████▉     | 18597/37963 [79:41:59<81:21:13, 15.12s/it]
 49%|████▉     | 18598/37963 [79:42:13<79:56:16, 14.86s/it]
 49%|████▉     | 18599/37963 [79:42:27<78:38:52, 14.62s/it]
 49%|████▉     | 18600/37963 [79:42:42<78:15:56, 14.55s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '2.382', 'learning_rate': '1.081e-05', 'epoch': '0.49'}

 49%|████▉     | 18600/37963 [79:42:42<78:15:56, 14.55s/it]
 49%|████▉     | 18601/37963 [79:42:56<77:51:01, 14.47s/it]
 49%|████▉     | 18602/37963 [79:43:17<89:05:50, 16.57s/it]
 49%|████▉     | 18603/37963 [79:43:32<85:25:24, 15.88s/it]
 49%|████▉     | 18604/37963 [79:43:53<93:58:58, 17.48s/it]
 49%|████▉     | 18605/37963 [79:44:07<88:26:22, 16.45s/it]
 49%|████▉     | 18606/37963 [79:44:21<84:47:20, 15.77s/it]
 49%|████▉     | 18607/37963 [79:44:35<82:23:27, 15.32s/it]
 49%|████▉     | 18608/37963 [79:44:50<80:46:41, 15.02s/it]
 49%|████▉     | 18609/37963 [79:45:04<79:11:57, 14.73s/it]
 49%|████▉     | 18610/37963 [79:45:18<78:31:43, 14.61s/it]
                                                           
{'loss': '0.145', 'grad_norm': '2.387', 'learning_rate': '1.08e-05', 'epoch': '0.4902'}

 49%|████▉     | 18610/37963 [79:45:18<78:31:43, 14.61s/it]
 49%|████▉     | 18611/37963 [79:45:32<78:14:08, 14.55s/it]
 49%|████▉     | 18612/37963 [79:45:47<77:57:44, 14.50s/it]
 49%|████▉     | 18613/37963 [79:46:01<77:08:39, 14.35s/it]
 49%|████▉     | 18614/37963 [79:46:15<77:01:45, 14.33s/it]
 49%|████▉     | 18615/37963 [79:46:29<76:39:33, 14.26s/it]
 49%|████▉     | 18616/37963 [79:46:43<76:16:57, 14.19s/it]
 49%|████▉     | 18617/37963 [79:46:58<76:37:02, 14.26s/it]
 49%|████▉     | 18618/37963 [79:47:18<87:04:37, 16.20s/it]
 49%|████▉     | 18619/37963 [79:47:33<84:09:37, 15.66s/it]
 49%|████▉     | 18620/37963 [79:47:53<91:04:40, 16.95s/it]
                                                           
{'loss': '0.1437', 'grad_norm': '4.03', 'learning_rate': '1.079e-05', 'epoch': '0.4905'}

 49%|████▉     | 18620/37963 [79:47:53<91:04:40, 16.95s/it]
 49%|████▉     | 18621/37963 [79:48:07<86:57:37, 16.19s/it]
 49%|████▉     | 18622/37963 [79:48:21<83:53:23, 15.61s/it]
 49%|████▉     | 18623/37963 [79:48:36<81:44:15, 15.21s/it]
 49%|████▉     | 18624/37963 [79:48:50<80:35:05, 15.00s/it]
 49%|████▉     | 18625/37963 [79:49:11<90:36:23, 16.87s/it]
 49%|████▉     | 18626/37963 [79:49:25<85:17:41, 15.88s/it]
 49%|████▉     | 18627/37963 [79:49:39<82:46:47, 15.41s/it]
 49%|████▉     | 18628/37963 [79:49:53<80:13:18, 14.94s/it]
 49%|████▉     | 18629/37963 [79:50:07<79:17:17, 14.76s/it]
 49%|████▉     | 18630/37963 [79:50:22<78:43:21, 14.66s/it]
                                                           
{'loss': '0.1404', 'grad_norm': '0.9112', 'learning_rate': '1.079e-05', 'epoch': '0.4907'}

 49%|████▉     | 18630/37963 [79:50:22<78:43:21, 14.66s/it]
 49%|████▉     | 18631/37963 [79:50:36<78:13:31, 14.57s/it]
 49%|████▉     | 18632/37963 [79:50:51<77:52:05, 14.50s/it]
 49%|████▉     | 18633/37963 [79:51:12<88:17:22, 16.44s/it]
 49%|████▉     | 18634/37963 [79:51:26<84:48:09, 15.79s/it]
 49%|████▉     | 18635/37963 [79:51:40<82:24:07, 15.35s/it]
 49%|████▉     | 18636/37963 [79:51:55<80:54:27, 15.07s/it]
 49%|████▉     | 18637/37963 [79:52:09<79:46:33, 14.86s/it]
 49%|████▉     | 18638/37963 [79:52:23<78:42:18, 14.66s/it]
 49%|████▉     | 18639/37963 [79:52:44<88:13:50, 16.44s/it]
 49%|████▉     | 18640/37963 [79:52:58<84:51:21, 15.81s/it]
                                                           
{'loss': '0.1402', 'grad_norm': '1.164', 'learning_rate': '1.078e-05', 'epoch': '0.491'}

 49%|████▉     | 18640/37963 [79:52:58<84:51:21, 15.81s/it]
 49%|████▉     | 18641/37963 [79:53:12<82:24:53, 15.36s/it]
 49%|████▉     | 18642/37963 [79:53:27<80:41:18, 15.03s/it]
 49%|████▉     | 18643/37963 [79:53:48<90:27:26, 16.86s/it]
 49%|████▉     | 18644/37963 [79:54:02<86:43:58, 16.16s/it]
 49%|████▉     | 18645/37963 [79:54:16<83:12:10, 15.51s/it]
 49%|████▉     | 18646/37963 [79:54:31<81:26:34, 15.18s/it]
 49%|████▉     | 18647/37963 [79:54:44<79:04:27, 14.74s/it]
 49%|████▉     | 18648/37963 [79:54:59<78:20:53, 14.60s/it]
 49%|████▉     | 18649/37963 [79:55:20<88:25:08, 16.48s/it]
 49%|████▉     | 18650/37963 [79:55:34<84:53:27, 15.82s/it]
                                                           
{'loss': '0.157', 'grad_norm': '2.992', 'learning_rate': '1.077e-05', 'epoch': '0.4913'}

 49%|████▉     | 18650/37963 [79:55:34<84:53:27, 15.82s/it]
 49%|████▉     | 18651/37963 [79:55:48<82:28:19, 15.37s/it]
 49%|████▉     | 18652/37963 [79:56:02<80:32:31, 15.01s/it]
 49%|████▉     | 18653/37963 [79:56:16<78:51:53, 14.70s/it]
 49%|████▉     | 18654/37963 [79:56:30<77:25:48, 14.44s/it]
 49%|████▉     | 18655/37963 [79:56:51<88:21:45, 16.48s/it]
 49%|████▉     | 18656/37963 [79:57:06<84:40:18, 15.79s/it]
 49%|████▉     | 18657/37963 [79:57:20<82:06:22, 15.31s/it]
 49%|████▉     | 18658/37963 [79:57:34<80:15:09, 14.97s/it]
 49%|████▉     | 18659/37963 [79:57:48<79:16:14, 14.78s/it]
 49%|████▉     | 18660/37963 [79:58:03<78:48:55, 14.70s/it]
                                                           
{'loss': '0.1447', 'grad_norm': '0.9481', 'learning_rate': '1.076e-05', 'epoch': '0.4915'}

 49%|████▉     | 18660/37963 [79:58:03<78:48:55, 14.70s/it]
 49%|████▉     | 18661/37963 [79:58:17<78:15:17, 14.60s/it]
 49%|████▉     | 18662/37963 [79:58:31<77:48:18, 14.51s/it]
 49%|████▉     | 18663/37963 [79:58:46<77:22:57, 14.43s/it]
 49%|████▉     | 18664/37963 [79:59:00<77:17:40, 14.42s/it]
 49%|████▉     | 18665/37963 [79:59:14<77:15:03, 14.41s/it]
 49%|████▉     | 18666/37963 [79:59:35<87:30:12, 16.32s/it]
 49%|████▉     | 18667/37963 [79:59:55<93:45:14, 17.49s/it]
 49%|████▉     | 18668/37963 [80:00:10<88:40:11, 16.54s/it]
 49%|████▉     | 18669/37963 [80:00:24<85:13:24, 15.90s/it]
 49%|████▉     | 18670/37963 [80:00:39<82:55:41, 15.47s/it]
                                                           
{'loss': '0.1541', 'grad_norm': '2.574', 'learning_rate': '1.075e-05', 'epoch': '0.4918'}

 49%|████▉     | 18670/37963 [80:00:39<82:55:41, 15.47s/it]
 49%|████▉     | 18671/37963 [80:00:53<81:19:02, 15.17s/it]
 49%|████▉     | 18672/37963 [80:01:08<80:03:10, 14.94s/it]
 49%|████▉     | 18673/37963 [80:01:28<89:36:45, 16.72s/it]
 49%|████▉     | 18674/37963 [80:01:43<85:47:09, 16.01s/it]
 49%|████▉     | 18675/37963 [80:01:57<82:32:17, 15.41s/it]
 49%|████▉     | 18676/37963 [80:02:11<80:53:09, 15.10s/it]
 49%|████▉     | 18677/37963 [80:02:26<79:53:03, 14.91s/it]
 49%|████▉     | 18678/37963 [80:02:40<79:07:48, 14.77s/it]
 49%|████▉     | 18679/37963 [80:02:54<78:08:09, 14.59s/it]
 49%|████▉     | 18680/37963 [80:03:09<77:46:20, 14.52s/it]
                                                           
{'loss': '0.1448', 'grad_norm': '3.549', 'learning_rate': '1.074e-05', 'epoch': '0.4921'}

 49%|████▉     | 18680/37963 [80:03:09<77:46:20, 14.52s/it]
 49%|████▉     | 18681/37963 [80:03:23<77:16:23, 14.43s/it]
 49%|████▉     | 18682/37963 [80:03:45<89:11:25, 16.65s/it]
 49%|████▉     | 18683/37963 [80:03:59<85:23:55, 15.95s/it]
 49%|████▉     | 18684/37963 [80:04:13<82:53:57, 15.48s/it]
 49%|████▉     | 18685/37963 [80:04:28<81:07:49, 15.15s/it]
 49%|████▉     | 18686/37963 [80:04:49<90:35:01, 16.92s/it]
 49%|████▉     | 18687/37963 [80:05:03<86:26:04, 16.14s/it]
 49%|████▉     | 18688/37963 [80:05:17<83:34:18, 15.61s/it]
 49%|████▉     | 18689/37963 [80:05:32<81:27:15, 15.21s/it]
 49%|████▉     | 18690/37963 [80:05:46<79:53:39, 14.92s/it]
                                                           
{'loss': '0.1521', 'grad_norm': '1.775', 'learning_rate': '1.073e-05', 'epoch': '0.4923'}

 49%|████▉     | 18690/37963 [80:05:46<79:53:39, 14.92s/it]
 49%|████▉     | 18691/37963 [80:06:00<78:57:06, 14.75s/it]
 49%|████▉     | 18692/37963 [80:06:21<88:03:03, 16.45s/it]
 49%|████▉     | 18693/37963 [80:06:35<84:51:37, 15.85s/it]
 49%|████▉     | 18694/37963 [80:06:49<81:48:05, 15.28s/it]
 49%|████▉     | 18695/37963 [80:07:04<80:24:09, 15.02s/it]
 49%|████▉     | 18696/37963 [80:07:18<78:45:51, 14.72s/it]
 49%|████▉     | 18697/37963 [80:07:38<88:35:29, 16.55s/it]
 49%|████▉     | 18698/37963 [80:07:53<85:08:30, 15.91s/it]
 49%|████▉     | 18699/37963 [80:08:07<82:45:22, 15.47s/it]
 49%|████▉     | 18700/37963 [80:08:22<81:00:50, 15.14s/it]
                                                           
{'loss': '0.1403', 'grad_norm': '0.7407', 'learning_rate': '1.073e-05', 'epoch': '0.4926'}

 49%|████▉     | 18700/37963 [80:08:22<81:00:50, 15.14s/it]
 49%|████▉     | 18701/37963 [80:08:35<78:48:04, 14.73s/it]
 49%|████▉     | 18702/37963 [80:08:49<77:40:30, 14.52s/it]
 49%|████▉     | 18703/37963 [80:09:10<87:21:07, 16.33s/it]
 49%|████▉     | 18704/37963 [80:09:24<84:11:42, 15.74s/it]
 49%|████▉     | 18705/37963 [80:09:39<82:03:52, 15.34s/it]
 49%|████▉     | 18706/37963 [80:09:53<79:36:48, 14.88s/it]
 49%|████▉     | 18707/37963 [80:10:07<78:46:35, 14.73s/it]
 49%|████▉     | 18708/37963 [80:10:21<78:11:06, 14.62s/it]
 49%|████▉     | 18709/37963 [80:10:35<77:25:32, 14.48s/it]
 49%|████▉     | 18710/37963 [80:10:50<77:12:02, 14.44s/it]
                                                           
{'loss': '0.1324', 'grad_norm': '3.163', 'learning_rate': '1.072e-05', 'epoch': '0.4928'}

 49%|████▉     | 18710/37963 [80:10:50<77:12:02, 14.44s/it]
 49%|████▉     | 18711/37963 [80:11:04<76:45:42, 14.35s/it]
 49%|████▉     | 18712/37963 [80:11:18<76:43:56, 14.35s/it]
 49%|████▉     | 18713/37963 [80:11:33<76:42:10, 14.34s/it]
 49%|████▉     | 18714/37963 [80:11:47<76:35:51, 14.33s/it]
 49%|████▉     | 18715/37963 [80:12:07<86:17:53, 16.14s/it]
 49%|████▉     | 18716/37963 [80:12:21<82:32:06, 15.44s/it]
 49%|████▉     | 18717/37963 [80:12:35<80:47:02, 15.11s/it]
 49%|████▉     | 18718/37963 [80:12:50<79:39:54, 14.90s/it]
 49%|████▉     | 18719/37963 [80:13:11<89:56:48, 16.83s/it]
 49%|████▉     | 18720/37963 [80:13:26<85:57:04, 16.08s/it]
                                                           
{'loss': '0.1368', 'grad_norm': '2.795', 'learning_rate': '1.071e-05', 'epoch': '0.4931'}

 49%|████▉     | 18720/37963 [80:13:26<85:57:04, 16.08s/it]
 49%|████▉     | 18721/37963 [80:13:40<83:12:35, 15.57s/it]
 49%|████▉     | 18722/37963 [80:14:01<92:03:56, 17.23s/it]
 49%|████▉     | 18723/37963 [80:14:15<87:33:39, 16.38s/it]
 49%|████▉     | 18724/37963 [80:14:30<84:23:10, 15.79s/it]
 49%|████▉     | 18725/37963 [80:14:44<82:05:07, 15.36s/it]
 49%|████▉     | 18726/37963 [80:14:58<80:23:22, 15.04s/it]
 49%|████▉     | 18727/37963 [80:15:13<79:14:39, 14.83s/it]
 49%|████▉     | 18728/37963 [80:15:27<77:37:46, 14.53s/it]
 49%|████▉     | 18729/37963 [80:15:41<77:00:13, 14.41s/it]
 49%|████▉     | 18730/37963 [80:15:55<76:54:31, 14.40s/it]
                                                           
{'loss': '0.137', 'grad_norm': '5.041', 'learning_rate': '1.07e-05', 'epoch': '0.4934'}

 49%|████▉     | 18730/37963 [80:15:55<76:54:31, 14.40s/it]
 49%|████▉     | 18731/37963 [80:16:16<88:04:35, 16.49s/it]
 49%|████▉     | 18732/37963 [80:16:31<84:17:02, 15.78s/it]
 49%|████▉     | 18733/37963 [80:16:45<81:54:14, 15.33s/it]
 49%|████▉     | 18734/37963 [80:16:59<79:48:16, 14.94s/it]
 49%|████▉     | 18735/37963 [80:17:19<88:02:13, 16.48s/it]
 49%|████▉     | 18736/37963 [80:17:33<84:33:54, 15.83s/it]
 49%|████▉     | 18737/37963 [80:17:47<80:54:01, 15.15s/it]
 49%|████▉     | 18738/37963 [80:18:08<90:09:18, 16.88s/it]
 49%|████▉     | 18739/37963 [80:18:22<85:34:10, 16.02s/it]
 49%|████▉     | 18740/37963 [80:18:36<82:53:59, 15.53s/it]
                                                           
{'loss': '0.1562', 'grad_norm': '3.002', 'learning_rate': '1.069e-05', 'epoch': '0.4936'}

 49%|████▉     | 18740/37963 [80:18:36<82:53:59, 15.53s/it]
 49%|████▉     | 18741/37963 [80:18:50<80:56:08, 15.16s/it]
 49%|████▉     | 18742/37963 [80:19:05<79:27:13, 14.88s/it]
 49%|████▉     | 18743/37963 [80:19:19<78:33:42, 14.72s/it]
 49%|████▉     | 18744/37963 [80:19:33<78:05:03, 14.63s/it]
 49%|████▉     | 18745/37963 [80:19:54<87:32:41, 16.40s/it]
 49%|████▉     | 18746/37963 [80:20:08<84:12:54, 15.78s/it]
 49%|████▉     | 18747/37963 [80:20:22<81:28:02, 15.26s/it]
 49%|████▉     | 18748/37963 [80:20:37<79:57:39, 14.98s/it]
 49%|████▉     | 18749/37963 [80:20:51<78:25:34, 14.69s/it]
 49%|████▉     | 18750/37963 [80:21:05<77:33:22, 14.53s/it]
                                                           
{'loss': '0.1384', 'grad_norm': '1.034', 'learning_rate': '1.068e-05', 'epoch': '0.4939'}

 49%|████▉     | 18750/37963 [80:21:05<77:33:22, 14.53s/it]
 49%|████▉     | 18751/37963 [80:21:19<77:21:21, 14.50s/it]
 49%|████▉     | 18752/37963 [80:21:33<76:31:23, 14.34s/it]
 49%|████▉     | 18753/37963 [80:21:55<88:33:23, 16.60s/it]
 49%|████▉     | 18754/37963 [80:22:09<83:39:15, 15.68s/it]
 49%|████▉     | 18755/37963 [80:22:23<81:41:13, 15.31s/it]
 49%|████▉     | 18756/37963 [80:22:37<80:10:03, 15.03s/it]
 49%|████▉     | 18757/37963 [80:22:52<79:17:13, 14.86s/it]
 49%|████▉     | 18758/37963 [80:23:06<78:30:30, 14.72s/it]
 49%|████▉     | 18759/37963 [80:23:21<78:05:16, 14.64s/it]
 49%|████▉     | 18760/37963 [80:23:35<77:41:42, 14.57s/it]
                                                           
{'loss': '0.1472', 'grad_norm': '1.667', 'learning_rate': '1.068e-05', 'epoch': '0.4942'}

 49%|████▉     | 18760/37963 [80:23:35<77:41:42, 14.57s/it]
 49%|████▉     | 18761/37963 [80:23:50<77:30:04, 14.53s/it]
 49%|████▉     | 18762/37963 [80:24:03<76:17:16, 14.30s/it]
 49%|████▉     | 18763/37963 [80:24:18<76:19:49, 14.31s/it]
 49%|████▉     | 18764/37963 [80:24:32<76:22:26, 14.32s/it]
 49%|████▉     | 18765/37963 [80:24:46<76:12:20, 14.29s/it]
 49%|████▉     | 18766/37963 [80:25:07<85:39:26, 16.06s/it]
 49%|████▉     | 18767/37963 [80:25:28<93:41:14, 17.57s/it]
 49%|████▉     | 18768/37963 [80:25:42<88:37:46, 16.62s/it]
 49%|████▉     | 18769/37963 [80:25:56<85:03:01, 15.95s/it]
 49%|████▉     | 18770/37963 [80:26:18<93:31:34, 17.54s/it]
                                                           
{'loss': '0.1444', 'grad_norm': '3.731', 'learning_rate': '1.067e-05', 'epoch': '0.4944'}

 49%|████▉     | 18770/37963 [80:26:18<93:31:34, 17.54s/it]
 49%|████▉     | 18771/37963 [80:26:32<88:21:57, 16.58s/it]
 49%|████▉     | 18772/37963 [80:26:46<84:49:28, 15.91s/it]
 49%|████▉     | 18773/37963 [80:27:01<82:09:38, 15.41s/it]
 49%|████▉     | 18774/37963 [80:27:15<80:17:34, 15.06s/it]
 49%|████▉     | 18775/37963 [80:27:29<79:10:29, 14.85s/it]
 49%|████▉     | 18776/37963 [80:27:44<78:23:39, 14.71s/it]
 49%|████▉     | 18777/37963 [80:27:58<77:47:52, 14.60s/it]
 49%|████▉     | 18778/37963 [80:28:12<77:24:44, 14.53s/it]
 49%|████▉     | 18779/37963 [80:28:27<77:06:55, 14.47s/it]
 49%|████▉     | 18780/37963 [80:28:48<88:17:40, 16.57s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '3.196', 'learning_rate': '1.066e-05', 'epoch': '0.4947'}

 49%|████▉     | 18780/37963 [80:28:48<88:17:40, 16.57s/it]
 49%|████▉     | 18781/37963 [80:29:02<84:42:11, 15.90s/it]
 49%|████▉     | 18782/37963 [80:29:17<82:13:58, 15.43s/it]
 49%|████▉     | 18783/37963 [80:29:31<79:48:27, 14.98s/it]
 49%|████▉     | 18784/37963 [80:29:51<88:56:47, 16.70s/it]
 49%|████▉     | 18785/37963 [80:30:12<94:31:13, 17.74s/it]
 49%|████▉     | 18786/37963 [80:30:26<89:00:15, 16.71s/it]
 49%|████▉     | 18787/37963 [80:30:40<85:09:08, 15.99s/it]
 49%|████▉     | 18788/37963 [80:30:54<82:29:57, 15.49s/it]
 49%|████▉     | 18789/37963 [80:31:08<80:06:27, 15.04s/it]
 49%|████▉     | 18790/37963 [80:31:22<78:25:15, 14.72s/it]
                                                           
{'loss': '0.1432', 'grad_norm': '2.429', 'learning_rate': '1.065e-05', 'epoch': '0.495'}

 49%|████▉     | 18790/37963 [80:31:22<78:25:15, 14.72s/it]
 49%|████▉     | 18791/37963 [80:31:37<77:45:00, 14.60s/it]
 50%|████▉     | 18792/37963 [80:31:51<77:03:33, 14.47s/it]
 50%|████▉     | 18793/37963 [80:32:05<76:47:35, 14.42s/it]
 50%|████▉     | 18794/37963 [80:32:25<85:40:48, 16.09s/it]
 50%|████▉     | 18795/37963 [80:32:40<82:47:18, 15.55s/it]
 50%|████▉     | 18796/37963 [80:32:54<80:53:00, 15.19s/it]
 50%|████▉     | 18797/37963 [80:33:08<79:15:46, 14.89s/it]
 50%|████▉     | 18798/37963 [80:33:22<78:23:33, 14.73s/it]
 50%|████▉     | 18799/37963 [80:33:37<77:51:01, 14.62s/it]
 50%|████▉     | 18800/37963 [80:33:51<77:05:15, 14.48s/it]
                                                           
{'loss': '0.151', 'grad_norm': '0.966', 'learning_rate': '1.064e-05', 'epoch': '0.4952'}

 50%|████▉     | 18800/37963 [80:33:51<77:05:15, 14.48s/it]
 50%|████▉     | 18801/37963 [80:34:05<76:52:19, 14.44s/it]
 50%|████▉     | 18802/37963 [80:34:26<86:06:19, 16.18s/it]
 50%|████▉     | 18803/37963 [80:34:40<83:32:59, 15.70s/it]
 50%|████▉     | 18804/37963 [80:34:54<81:17:04, 15.27s/it]
 50%|████▉     | 18805/37963 [80:35:09<79:43:51, 14.98s/it]
 50%|████▉     | 18806/37963 [80:35:23<78:39:31, 14.78s/it]
 50%|████▉     | 18807/37963 [80:35:37<78:02:14, 14.67s/it]
 50%|████▉     | 18808/37963 [80:35:52<77:36:11, 14.58s/it]
 50%|████▉     | 18809/37963 [80:36:06<77:27:44, 14.56s/it]
 50%|████▉     | 18810/37963 [80:36:20<76:29:34, 14.38s/it]
                                                           
{'loss': '0.1552', 'grad_norm': '1.693', 'learning_rate': '1.063e-05', 'epoch': '0.4955'}

 50%|████▉     | 18810/37963 [80:36:20<76:29:34, 14.38s/it]
 50%|████▉     | 18811/37963 [80:36:35<76:27:50, 14.37s/it]
 50%|████▉     | 18812/37963 [80:36:48<75:37:08, 14.21s/it]
 50%|████▉     | 18813/37963 [80:37:03<76:00:07, 14.29s/it]
 50%|████▉     | 18814/37963 [80:37:17<75:53:57, 14.27s/it]
 50%|████▉     | 18815/37963 [80:37:38<86:05:50, 16.19s/it]
 50%|████▉     | 18816/37963 [80:37:59<93:23:25, 17.56s/it]
 50%|████▉     | 18817/37963 [80:38:13<87:56:56, 16.54s/it]
 50%|████▉     | 18818/37963 [80:38:27<83:37:34, 15.72s/it]
 50%|████▉     | 18819/37963 [80:38:41<81:36:16, 15.35s/it]
 50%|████▉     | 18820/37963 [80:39:03<91:39:00, 17.24s/it]
                                                           
{'loss': '0.1541', 'grad_norm': '1.944', 'learning_rate': '1.062e-05', 'epoch': '0.4957'}

 50%|████▉     | 18820/37963 [80:39:03<91:39:00, 17.24s/it]
 50%|████▉     | 18821/37963 [80:39:17<87:05:36, 16.38s/it]
 50%|████▉     | 18822/37963 [80:39:31<83:44:16, 15.75s/it]
 50%|████▉     | 18823/37963 [80:39:46<81:31:34, 15.33s/it]
 50%|████▉     | 18824/37963 [80:39:59<79:04:47, 14.87s/it]
 50%|████▉     | 18825/37963 [80:40:14<78:18:46, 14.73s/it]
 50%|████▉     | 18826/37963 [80:40:28<77:17:20, 14.54s/it]
 50%|████▉     | 18827/37963 [80:40:42<76:59:26, 14.48s/it]
 50%|████▉     | 18828/37963 [80:40:57<76:45:20, 14.44s/it]
 50%|████▉     | 18829/37963 [80:41:18<87:27:56, 16.46s/it]
 50%|████▉     | 18830/37963 [80:41:32<83:28:09, 15.71s/it]
                                                           
{'loss': '0.142', 'grad_norm': '6.93', 'learning_rate': '1.062e-05', 'epoch': '0.496'}

 50%|████▉     | 18830/37963 [80:41:32<83:28:09, 15.71s/it]
 50%|████▉     | 18831/37963 [80:41:46<81:19:01, 15.30s/it]
 50%|████▉     | 18832/37963 [80:42:07<90:02:16, 16.94s/it]
 50%|████▉     | 18833/37963 [80:42:21<86:01:12, 16.19s/it]
 50%|████▉     | 18834/37963 [80:42:42<93:22:43, 17.57s/it]
 50%|████▉     | 18835/37963 [80:42:56<87:11:52, 16.41s/it]
 50%|████▉     | 18836/37963 [80:43:10<83:51:21, 15.78s/it]
 50%|████▉     | 18837/37963 [80:43:25<81:42:49, 15.38s/it]
 50%|████▉     | 18838/37963 [80:43:39<80:03:10, 15.07s/it]
 50%|████▉     | 18839/37963 [80:43:53<78:22:33, 14.75s/it]
 50%|████▉     | 18840/37963 [80:44:07<77:41:15, 14.63s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '1.471', 'learning_rate': '1.061e-05', 'epoch': '0.4963'}

 50%|████▉     | 18840/37963 [80:44:07<77:41:15, 14.63s/it]
 50%|████▉     | 18841/37963 [80:44:22<77:28:51, 14.59s/it]
 50%|████▉     | 18842/37963 [80:44:36<77:08:16, 14.52s/it]
 50%|████▉     | 18843/37963 [80:44:57<86:50:07, 16.35s/it]
 50%|████▉     | 18844/37963 [80:45:11<83:38:07, 15.75s/it]
 50%|████▉     | 18845/37963 [80:45:25<81:25:04, 15.33s/it]
 50%|████▉     | 18846/37963 [80:45:40<79:48:31, 15.03s/it]
 50%|████▉     | 18847/37963 [80:45:54<78:38:28, 14.81s/it]
 50%|████▉     | 18848/37963 [80:46:09<78:04:33, 14.70s/it]
 50%|████▉     | 18849/37963 [80:46:23<77:25:34, 14.58s/it]
 50%|████▉     | 18850/37963 [80:46:37<76:29:24, 14.41s/it]
                                                           
{'loss': '0.1258', 'grad_norm': '2.743', 'learning_rate': '1.06e-05', 'epoch': '0.4965'}

 50%|████▉     | 18850/37963 [80:46:37<76:29:24, 14.41s/it]
 50%|████▉     | 18851/37963 [80:46:58<87:26:09, 16.47s/it]
 50%|████▉     | 18852/37963 [80:47:12<83:59:28, 15.82s/it]
 50%|████▉     | 18853/37963 [80:47:26<81:11:14, 15.29s/it]
 50%|████▉     | 18854/37963 [80:47:41<79:34:19, 14.99s/it]
 50%|████▉     | 18855/37963 [80:47:55<78:34:41, 14.80s/it]
 50%|████▉     | 18856/37963 [80:48:09<77:47:44, 14.66s/it]
 50%|████▉     | 18857/37963 [80:48:24<77:24:33, 14.59s/it]
 50%|████▉     | 18858/37963 [80:48:39<77:42:35, 14.64s/it]
 50%|████▉     | 18859/37963 [80:48:53<77:17:44, 14.57s/it]
 50%|████▉     | 18860/37963 [80:49:07<77:06:34, 14.53s/it]
                                                           
{'loss': '0.1468', 'grad_norm': '1.825', 'learning_rate': '1.059e-05', 'epoch': '0.4968'}

 50%|████▉     | 18860/37963 [80:49:07<77:06:34, 14.53s/it]
 50%|████▉     | 18861/37963 [80:49:22<76:33:41, 14.43s/it]
 50%|████▉     | 18862/37963 [80:49:36<76:00:49, 14.33s/it]
 50%|████▉     | 18863/37963 [80:49:50<75:46:18, 14.28s/it]
 50%|████▉     | 18864/37963 [80:50:04<75:51:31, 14.30s/it]
 50%|████▉     | 18865/37963 [80:50:26<87:10:16, 16.43s/it]
 50%|████▉     | 18866/37963 [80:50:40<83:01:46, 15.65s/it]
 50%|████▉     | 18867/37963 [80:50:54<80:55:41, 15.26s/it]
 50%|████▉     | 18868/37963 [80:51:15<90:26:56, 17.05s/it]
 50%|████▉     | 18869/37963 [80:51:36<96:33:42, 18.21s/it]
 50%|████▉     | 18870/37963 [80:51:50<90:20:31, 17.03s/it]
                                                           
{'loss': '0.1495', 'grad_norm': '4.535', 'learning_rate': '1.058e-05', 'epoch': '0.4971'}

 50%|████▉     | 18870/37963 [80:51:50<90:20:31, 17.03s/it]
 50%|████▉     | 18871/37963 [80:52:04<85:33:34, 16.13s/it]
 50%|████▉     | 18872/37963 [80:52:18<81:46:16, 15.42s/it]
 50%|████▉     | 18873/37963 [80:52:33<80:12:59, 15.13s/it]
 50%|████▉     | 18874/37963 [80:52:47<78:53:40, 14.88s/it]
 50%|████▉     | 18875/37963 [80:53:01<78:03:36, 14.72s/it]
 50%|████▉     | 18876/37963 [80:53:16<77:33:23, 14.63s/it]
 50%|████▉     | 18877/37963 [80:53:37<87:42:53, 16.54s/it]
 50%|████▉     | 18878/37963 [80:53:51<83:55:59, 15.83s/it]
 50%|████▉     | 18879/37963 [80:54:05<81:42:48, 15.41s/it]
 50%|████▉     | 18880/37963 [80:54:20<80:02:43, 15.10s/it]
                                                           
{'loss': '0.1584', 'grad_norm': '1.312', 'learning_rate': '1.057e-05', 'epoch': '0.4973'}

 50%|████▉     | 18880/37963 [80:54:20<80:02:43, 15.10s/it]
 50%|████▉     | 18881/37963 [80:54:41<89:30:23, 16.89s/it]
 50%|████▉     | 18882/37963 [80:55:02<95:50:52, 18.08s/it]
 50%|████▉     | 18883/37963 [80:55:16<89:49:08, 16.95s/it]
 50%|████▉     | 18884/37963 [80:55:30<85:42:35, 16.17s/it]
 50%|████▉     | 18885/37963 [80:55:44<82:44:31, 15.61s/it]
 50%|████▉     | 18886/37963 [80:55:59<80:50:22, 15.26s/it]
 50%|████▉     | 18887/37963 [80:56:13<78:34:22, 14.83s/it]
 50%|████▉     | 18888/37963 [80:56:27<77:50:56, 14.69s/it]
 50%|████▉     | 18889/37963 [80:56:42<77:23:40, 14.61s/it]
 50%|████▉     | 18890/37963 [80:56:56<77:02:12, 14.54s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '1.388', 'learning_rate': '1.056e-05', 'epoch': '0.4976'}

 50%|████▉     | 18890/37963 [80:56:56<77:02:12, 14.54s/it]
 50%|████▉     | 18891/37963 [80:57:16<86:04:45, 16.25s/it]
 50%|████▉     | 18892/37963 [80:57:31<83:04:53, 15.68s/it]
 50%|████▉     | 18893/37963 [80:57:45<81:06:00, 15.31s/it]
 50%|████▉     | 18894/37963 [80:57:59<79:46:53, 15.06s/it]
 50%|████▉     | 18895/37963 [80:58:14<78:38:29, 14.85s/it]
 50%|████▉     | 18896/37963 [80:58:28<77:53:47, 14.71s/it]
 50%|████▉     | 18897/37963 [80:58:42<77:04:32, 14.55s/it]
 50%|████▉     | 18898/37963 [80:58:57<76:41:39, 14.48s/it]
 50%|████▉     | 18899/37963 [80:59:11<76:58:52, 14.54s/it]
 50%|████▉     | 18900/37963 [80:59:32<87:26:10, 16.51s/it]
                                                           
{'loss': '0.1396', 'grad_norm': '1.577', 'learning_rate': '1.056e-05', 'epoch': '0.4979'}

 50%|████▉     | 18900/37963 [80:59:32<87:26:10, 16.51s/it]
 50%|████▉     | 18901/37963 [80:59:47<84:03:06, 15.87s/it]
 50%|████▉     | 18902/37963 [81:00:01<81:39:51, 15.42s/it]
 50%|████▉     | 18903/37963 [81:00:16<79:56:06, 15.10s/it]
 50%|████▉     | 18904/37963 [81:00:30<78:38:59, 14.86s/it]
 50%|████▉     | 18905/37963 [81:00:44<77:52:57, 14.71s/it]
 50%|████▉     | 18906/37963 [81:00:59<77:16:28, 14.60s/it]
 50%|████▉     | 18907/37963 [81:01:12<75:56:16, 14.35s/it]
 50%|████▉     | 18908/37963 [81:01:27<76:05:30, 14.38s/it]
 50%|████▉     | 18909/37963 [81:01:41<76:05:37, 14.38s/it]
 50%|████▉     | 18910/37963 [81:01:55<75:24:22, 14.25s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '2.043', 'learning_rate': '1.055e-05', 'epoch': '0.4981'}

 50%|████▉     | 18910/37963 [81:01:55<75:24:22, 14.25s/it]
 50%|████▉     | 18911/37963 [81:02:09<75:40:15, 14.30s/it]
 50%|████▉     | 18912/37963 [81:02:23<75:10:43, 14.21s/it]
 50%|████▉     | 18913/37963 [81:02:37<74:34:22, 14.09s/it]
 50%|████▉     | 18914/37963 [81:02:57<83:36:28, 15.80s/it]
 50%|████▉     | 18915/37963 [81:03:11<80:29:14, 15.21s/it]
 50%|████▉     | 18916/37963 [81:03:25<79:20:34, 15.00s/it]
 50%|████▉     | 18917/37963 [81:03:54<100:14:05, 18.95s/it]
 50%|████▉     | 18918/37963 [81:04:08<92:55:26, 17.57s/it] 
 50%|████▉     | 18919/37963 [81:04:22<87:10:10, 16.48s/it]
 50%|████▉     | 18920/37963 [81:04:36<83:43:46, 15.83s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '2.43', 'learning_rate': '1.054e-05', 'epoch': '0.4984'}

 50%|████▉     | 18920/37963 [81:04:36<83:43:46, 15.83s/it]
 50%|████▉     | 18921/37963 [81:04:50<81:11:46, 15.35s/it]
 50%|████▉     | 18922/37963 [81:05:05<79:32:38, 15.04s/it]
 50%|████▉     | 18923/37963 [81:05:19<78:07:15, 14.77s/it]
 50%|████▉     | 18924/37963 [81:05:33<77:34:18, 14.67s/it]
 50%|████▉     | 18925/37963 [81:05:48<77:15:15, 14.61s/it]
 50%|████▉     | 18926/37963 [81:06:02<76:49:57, 14.53s/it]
 50%|████▉     | 18927/37963 [81:06:16<76:32:18, 14.47s/it]
 50%|████▉     | 18928/37963 [81:06:38<87:43:33, 16.59s/it]
 50%|████▉     | 18929/37963 [81:06:52<84:23:44, 15.96s/it]
 50%|████▉     | 18930/37963 [81:07:07<81:57:55, 15.50s/it]
                                                           
{'loss': '0.146', 'grad_norm': '3.291', 'learning_rate': '1.053e-05', 'epoch': '0.4986'}

 50%|████▉     | 18930/37963 [81:07:07<81:57:55, 15.50s/it]
 50%|████▉     | 18931/37963 [81:07:34<100:09:34, 18.95s/it]
 50%|████▉     | 18932/37963 [81:07:48<92:54:14, 17.57s/it] 
 50%|████▉     | 18933/37963 [81:08:02<86:53:39, 16.44s/it]
 50%|████▉     | 18934/37963 [81:08:16<83:29:00, 15.79s/it]
 50%|████▉     | 18935/37963 [81:08:30<80:07:16, 15.16s/it]
 50%|████▉     | 18936/37963 [81:08:44<78:46:15, 14.90s/it]
 50%|████▉     | 18937/37963 [81:08:59<77:42:19, 14.70s/it]
 50%|████▉     | 18938/37963 [81:09:19<86:32:15, 16.38s/it]
 50%|████▉     | 18939/37963 [81:09:33<83:18:20, 15.76s/it]
 50%|████▉     | 18940/37963 [81:09:48<81:01:51, 15.33s/it]
                                                           
{'loss': '0.1401', 'grad_norm': '3.086', 'learning_rate': '1.052e-05', 'epoch': '0.4989'}

 50%|████▉     | 18940/37963 [81:09:48<81:01:51, 15.33s/it]
 50%|████▉     | 18941/37963 [81:10:01<78:37:25, 14.88s/it]
 50%|████▉     | 18942/37963 [81:10:16<77:42:06, 14.71s/it]
 50%|████▉     | 18943/37963 [81:10:30<77:10:43, 14.61s/it]
 50%|████▉     | 18944/37963 [81:10:44<76:03:45, 14.40s/it]
 50%|████▉     | 18945/37963 [81:10:58<76:04:03, 14.40s/it]
 50%|████▉     | 18946/37963 [81:11:13<75:59:27, 14.39s/it]
 50%|████▉     | 18947/37963 [81:11:27<75:55:06, 14.37s/it]
 50%|████▉     | 18948/37963 [81:11:41<75:49:24, 14.36s/it]
 50%|████▉     | 18949/37963 [81:12:03<87:11:08, 16.51s/it]
 50%|████▉     | 18950/37963 [81:12:17<83:31:32, 15.82s/it]
                                                           
{'loss': '0.1426', 'grad_norm': '1.646', 'learning_rate': '1.051e-05', 'epoch': '0.4992'}

 50%|████▉     | 18950/37963 [81:12:17<83:31:32, 15.82s/it]
 50%|████▉     | 18951/37963 [81:12:31<81:18:07, 15.39s/it]
 50%|████▉     | 18952/37963 [81:12:46<79:55:17, 15.13s/it]
 50%|████▉     | 18953/37963 [81:13:00<78:38:43, 14.89s/it]
 50%|████▉     | 18954/37963 [81:13:14<76:55:45, 14.57s/it]
 50%|████▉     | 18955/37963 [81:13:29<76:44:42, 14.54s/it]
 50%|████▉     | 18956/37963 [81:13:43<76:24:22, 14.47s/it]
 50%|████▉     | 18957/37963 [81:13:57<76:01:49, 14.40s/it]
 50%|████▉     | 18958/37963 [81:14:11<75:28:43, 14.30s/it]
 50%|████▉     | 18959/37963 [81:14:26<75:46:54, 14.36s/it]
 50%|████▉     | 18960/37963 [81:14:40<75:54:56, 14.38s/it]
                                                           
{'loss': '0.1423', 'grad_norm': '3.632', 'learning_rate': '1.05e-05', 'epoch': '0.4994'}

 50%|████▉     | 18960/37963 [81:14:40<75:54:56, 14.38s/it]
 50%|████▉     | 18961/37963 [81:14:55<75:56:49, 14.39s/it]
 50%|████▉     | 18962/37963 [81:15:15<85:40:24, 16.23s/it]
 50%|████▉     | 18963/37963 [81:15:29<82:42:40, 15.67s/it]
 50%|████▉     | 18964/37963 [81:15:57<101:56:51, 19.32s/it]
 50%|████▉     | 18965/37963 [81:16:12<94:13:52, 17.86s/it] 
 50%|████▉     | 18966/37963 [81:16:26<88:38:59, 16.80s/it]
 50%|████▉     | 18967/37963 [81:16:40<84:37:58, 16.04s/it]
 50%|████▉     | 18968/37963 [81:16:55<82:03:52, 15.55s/it]
 50%|████▉     | 18969/37963 [81:17:09<79:59:30, 15.16s/it]
 50%|████▉     | 18970/37963 [81:17:23<78:43:41, 14.92s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '1.845', 'learning_rate': '1.05e-05', 'epoch': '0.4997'}

 50%|████▉     | 18970/37963 [81:17:23<78:43:41, 14.92s/it]
 50%|████▉     | 18971/37963 [81:17:38<77:42:30, 14.73s/it]
 50%|████▉     | 18972/37963 [81:17:52<76:59:45, 14.60s/it]
 50%|████▉     | 18973/37963 [81:18:06<76:42:54, 14.54s/it]
 50%|████▉     | 18974/37963 [81:18:21<76:23:55, 14.48s/it]
 50%|████▉     | 18975/37963 [81:18:35<76:09:22, 14.44s/it]
 50%|████▉     | 18976/37963 [81:18:49<75:59:32, 14.41s/it]
 50%|████▉     | 18977/37963 [81:19:11<86:48:01, 16.46s/it]
 50%|████▉     | 18978/37963 [81:19:25<83:26:49, 15.82s/it]
 50%|████▉     | 18979/37963 [81:19:39<80:55:26, 15.35s/it]
 50%|████▉     | 18980/37963 [81:19:59<88:37:17, 16.81s/it]
                                                           
{'loss': '0.149', 'grad_norm': '2.162', 'learning_rate': '1.049e-05', 'epoch': '0.5'}

 50%|████▉     | 18980/37963 [81:19:59<88:37:17, 16.81s/it]
 50%|████▉     | 18981/37963 [81:20:14<84:43:22, 16.07s/it]
 50%|█████     | 18982/37963 [81:20:35<92:24:31, 17.53s/it]
 50%|█████     | 18983/37963 [81:20:49<87:29:50, 16.60s/it]
 50%|█████     | 18984/37963 [81:21:03<82:40:27, 15.68s/it]
 50%|█████     | 18985/37963 [81:21:23<90:37:12, 17.19s/it]
 50%|█████     | 18986/37963 [81:21:38<86:05:45, 16.33s/it]
 50%|█████     | 18987/37963 [81:21:52<83:00:59, 15.75s/it]
 50%|█████     | 18988/37963 [81:22:06<80:43:34, 15.32s/it]
 50%|█████     | 18989/37963 [81:22:21<79:10:58, 15.02s/it]
 50%|█████     | 18990/37963 [81:22:35<78:03:09, 14.81s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '4.531', 'learning_rate': '1.048e-05', 'epoch': '0.5002'}

 50%|█████     | 18990/37963 [81:22:35<78:03:09, 14.81s/it]
 50%|█████     | 18991/37963 [81:22:49<77:19:21, 14.67s/it]
 50%|█████     | 18992/37963 [81:23:04<76:45:06, 14.56s/it]
 50%|█████     | 18993/37963 [81:23:18<76:23:33, 14.50s/it]
 50%|█████     | 18994/37963 [81:23:32<76:09:42, 14.45s/it]
 50%|█████     | 18995/37963 [81:23:47<76:02:19, 14.43s/it]
 50%|█████     | 18996/37963 [81:24:01<75:49:34, 14.39s/it]
 50%|█████     | 18997/37963 [81:24:22<86:10:58, 16.36s/it]
 50%|█████     | 18998/37963 [81:24:36<81:40:18, 15.50s/it]
 50%|█████     | 18999/37963 [81:24:50<80:18:11, 15.24s/it]
 50%|█████     | 19000/37963 [81:25:04<78:38:03, 14.93s/it]
                                                           
{'loss': '0.1396', 'grad_norm': '2.877', 'learning_rate': '1.047e-05', 'epoch': '0.5005'}

 50%|█████     | 19000/37963 [81:25:04<78:38:03, 14.93s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.36s/it]
Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.36s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 50%|█████     | 19001/37963 [81:26:51<224:02:44, 42.54s/it]
 50%|█████     | 19002/37963 [81:27:06<179:38:08, 34.11s/it]
 50%|█████     | 19003/37963 [81:27:20<148:27:08, 28.19s/it]
 50%|█████     | 19004/37963 [81:27:34<126:30:21, 24.02s/it]
 50%|█████     | 19005/37963 [81:27:48<109:52:12, 20.86s/it]
 50%|█████     | 19006/37963 [81:28:02<99:33:40, 18.91s/it] 
 50%|█████     | 19007/37963 [81:28:17<92:25:23, 17.55s/it]
 50%|█████     | 19008/37963 [81:28:31<87:18:24, 16.58s/it]
 50%|█████     | 19009/37963 [81:28:45<83:53:25, 15.93s/it]
 50%|█████     | 19010/37963 [81:29:06<91:54:50, 17.46s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '1.837', 'learning_rate': '1.046e-05', 'epoch': '0.5008'}

 50%|█████     | 19010/37963 [81:29:06<91:54:50, 17.46s/it]
 50%|█████     | 19011/37963 [81:29:33<106:50:29, 20.29s/it]
 50%|█████     | 19012/37963 [81:29:48<97:28:36, 18.52s/it] 
 50%|█████     | 19013/37963 [81:30:02<90:58:18, 17.28s/it]
 50%|█████     | 19014/37963 [81:30:16<86:13:28, 16.38s/it]
 50%|█████     | 19015/37963 [81:30:31<83:06:25, 15.79s/it]
 50%|█████     | 19016/37963 [81:30:45<80:48:31, 15.35s/it]
 50%|█████     | 19017/37963 [81:30:59<78:40:06, 14.95s/it]
 50%|█████     | 19018/37963 [81:31:13<77:44:15, 14.77s/it]
 50%|█████     | 19019/37963 [81:31:28<76:58:34, 14.63s/it]
 50%|█████     | 19020/37963 [81:31:42<76:40:46, 14.57s/it]
                                                           
{'loss': '0.151', 'grad_norm': '1.44', 'learning_rate': '1.045e-05', 'epoch': '0.501'}

 50%|█████     | 19020/37963 [81:31:42<76:40:46, 14.57s/it]
 50%|█████     | 19021/37963 [81:31:56<76:02:25, 14.45s/it]
 50%|█████     | 19022/37963 [81:32:11<75:49:29, 14.41s/it]
 50%|█████     | 19023/37963 [81:32:25<75:52:42, 14.42s/it]
 50%|█████     | 19024/37963 [81:32:39<75:12:20, 14.30s/it]
 50%|█████     | 19025/37963 [81:33:00<86:01:01, 16.35s/it]
 50%|█████     | 19026/37963 [81:33:15<82:59:23, 15.78s/it]
 50%|█████     | 19027/37963 [81:33:29<80:05:16, 15.23s/it]
 50%|█████     | 19028/37963 [81:33:49<87:34:42, 16.65s/it]
 50%|█████     | 19029/37963 [81:34:09<93:50:10, 17.84s/it]
 50%|█████     | 19030/37963 [81:34:23<87:42:39, 16.68s/it]
                                                           
{'loss': '0.1399', 'grad_norm': '1.775', 'learning_rate': '1.045e-05', 'epoch': '0.5013'}

 50%|█████     | 19030/37963 [81:34:23<87:42:39, 16.68s/it]
 50%|█████     | 19031/37963 [81:34:37<83:52:26, 15.95s/it]
 50%|█████     | 19032/37963 [81:34:51<80:45:42, 15.36s/it]
 50%|█████     | 19033/37963 [81:35:06<78:58:20, 15.02s/it]
 50%|█████     | 19034/37963 [81:35:26<87:34:20, 16.65s/it]
 50%|█████     | 19035/37963 [81:35:41<84:07:53, 16.00s/it]
 50%|█████     | 19036/37963 [81:35:54<80:16:24, 15.27s/it]
 50%|█████     | 19037/37963 [81:36:08<78:14:54, 14.88s/it]
 50%|█████     | 19038/37963 [81:36:22<77:20:51, 14.71s/it]
 50%|█████     | 19039/37963 [81:36:37<76:52:21, 14.62s/it]
 50%|█████     | 19040/37963 [81:36:51<76:32:47, 14.56s/it]
                                                           
{'loss': '0.1473', 'grad_norm': '2.965', 'learning_rate': '1.044e-05', 'epoch': '0.5015'}

 50%|█████     | 19040/37963 [81:36:51<76:32:47, 14.56s/it]
 50%|█████     | 19041/37963 [81:37:06<76:19:39, 14.52s/it]
 50%|█████     | 19042/37963 [81:37:20<76:07:41, 14.48s/it]
 50%|█████     | 19043/37963 [81:37:34<75:30:38, 14.37s/it]
 50%|█████     | 19044/37963 [81:37:48<74:55:26, 14.26s/it]
 50%|█████     | 19045/37963 [81:38:09<85:19:40, 16.24s/it]
 50%|█████     | 19046/37963 [81:38:23<82:03:39, 15.62s/it]
 50%|█████     | 19047/37963 [81:38:38<80:08:57, 15.25s/it]
 50%|█████     | 19048/37963 [81:38:52<78:54:56, 15.02s/it]
 50%|█████     | 19049/37963 [81:39:06<77:48:40, 14.81s/it]
 50%|█████     | 19050/37963 [81:39:21<77:04:17, 14.67s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '2.024', 'learning_rate': '1.043e-05', 'epoch': '0.5018'}

 50%|█████     | 19050/37963 [81:39:21<77:04:17, 14.67s/it]
 50%|█████     | 19051/37963 [81:39:35<76:12:26, 14.51s/it]
 50%|█████     | 19052/37963 [81:39:49<75:52:04, 14.44s/it]
 50%|█████     | 19053/37963 [81:40:04<75:50:19, 14.44s/it]
 50%|█████     | 19054/37963 [81:40:17<74:17:48, 14.15s/it]
 50%|█████     | 19055/37963 [81:40:31<73:52:15, 14.06s/it]
 50%|█████     | 19056/37963 [81:40:45<74:03:04, 14.10s/it]
 50%|█████     | 19057/37963 [81:41:00<74:29:24, 14.18s/it]
 50%|█████     | 19058/37963 [81:41:14<74:47:48, 14.24s/it]
 50%|█████     | 19059/37963 [81:41:41<95:29:23, 18.18s/it]
 50%|█████     | 19060/37963 [81:41:56<89:32:28, 17.05s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '2.46', 'learning_rate': '1.042e-05', 'epoch': '0.5021'}

 50%|█████     | 19060/37963 [81:41:56<89:32:28, 17.05s/it]
 50%|█████     | 19061/37963 [81:42:17<95:33:39, 18.20s/it]
 50%|█████     | 19062/37963 [81:42:31<89:29:47, 17.05s/it]
 50%|█████     | 19063/37963 [81:42:45<84:40:46, 16.13s/it]
 50%|█████     | 19064/37963 [81:42:59<81:50:34, 15.59s/it]
 50%|█████     | 19065/37963 [81:43:14<80:02:07, 15.25s/it]
 50%|█████     | 19066/37963 [81:43:28<77:45:58, 14.81s/it]
 50%|█████     | 19067/37963 [81:43:42<77:04:16, 14.68s/it]
 50%|█████     | 19068/37963 [81:43:56<75:40:59, 14.42s/it]
 50%|█████     | 19069/37963 [81:44:10<75:48:04, 14.44s/it]
 50%|█████     | 19070/37963 [81:44:25<75:34:40, 14.40s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '4.363', 'learning_rate': '1.041e-05', 'epoch': '0.5023'}

 50%|█████     | 19070/37963 [81:44:25<75:34:40, 14.40s/it]
 50%|█████     | 19071/37963 [81:44:39<75:30:02, 14.39s/it]
 50%|█████     | 19072/37963 [81:44:53<75:41:25, 14.42s/it]
 50%|█████     | 19073/37963 [81:45:07<74:45:26, 14.25s/it]
 50%|█████     | 19074/37963 [81:45:28<85:16:02, 16.25s/it]
 50%|█████     | 19075/37963 [81:45:43<82:19:03, 15.69s/it]
 50%|█████     | 19076/37963 [81:45:56<78:46:34, 15.02s/it]
 50%|█████     | 19077/37963 [81:46:10<77:32:40, 14.78s/it]
 50%|█████     | 19078/37963 [81:46:31<86:48:55, 16.55s/it]
 50%|█████     | 19079/37963 [81:46:45<83:31:29, 15.92s/it]
 50%|█████     | 19080/37963 [81:47:06<90:55:30, 17.33s/it]
                                                           
{'loss': '0.1436', 'grad_norm': '1.829', 'learning_rate': '1.04e-05', 'epoch': '0.5026'}

 50%|█████     | 19080/37963 [81:47:06<90:55:30, 17.33s/it]
 50%|█████     | 19081/37963 [81:47:27<96:07:48, 18.33s/it]
 50%|█████     | 19082/37963 [81:47:41<90:15:44, 17.21s/it]
 50%|█████     | 19083/37963 [81:47:55<84:51:00, 16.18s/it]
 50%|█████     | 19084/37963 [81:48:09<81:54:17, 15.62s/it]
 50%|█████     | 19085/37963 [81:48:23<79:33:18, 15.17s/it]
 50%|█████     | 19086/37963 [81:48:38<78:29:51, 14.97s/it]
 50%|█████     | 19087/37963 [81:48:52<76:40:28, 14.62s/it]
 50%|█████     | 19088/37963 [81:49:06<76:14:10, 14.54s/it]
 50%|█████     | 19089/37963 [81:49:20<75:59:14, 14.49s/it]
 50%|█████     | 19090/37963 [81:49:34<74:45:01, 14.26s/it]
                                                           
{'loss': '0.1332', 'grad_norm': '1.786', 'learning_rate': '1.039e-05', 'epoch': '0.5029'}

 50%|█████     | 19090/37963 [81:49:34<74:45:01, 14.26s/it]
 50%|█████     | 19091/37963 [81:49:49<74:57:32, 14.30s/it]
 50%|█████     | 19092/37963 [81:50:03<74:51:40, 14.28s/it]
 50%|█████     | 19093/37963 [81:50:23<84:50:33, 16.19s/it]
 50%|█████     | 19094/37963 [81:50:37<81:13:11, 15.50s/it]
 50%|█████     | 19095/37963 [81:50:51<78:09:19, 14.91s/it]
 50%|█████     | 19096/37963 [81:51:05<77:25:09, 14.77s/it]
 50%|█████     | 19097/37963 [81:51:20<77:02:39, 14.70s/it]
 50%|█████     | 19098/37963 [81:51:34<76:08:09, 14.53s/it]
 50%|█████     | 19099/37963 [81:51:48<75:59:50, 14.50s/it]
 50%|█████     | 19100/37963 [81:52:02<74:43:20, 14.26s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '2.331', 'learning_rate': '1.039e-05', 'epoch': '0.5031'}

 50%|█████     | 19100/37963 [81:52:02<74:43:20, 14.26s/it]
 50%|█████     | 19101/37963 [81:52:16<74:31:05, 14.22s/it]
 50%|█████     | 19102/37963 [81:52:30<73:38:27, 14.06s/it]
 50%|█████     | 19103/37963 [81:52:44<74:21:31, 14.19s/it]
 50%|█████     | 19104/37963 [81:52:58<73:47:38, 14.09s/it]
 50%|█████     | 19105/37963 [81:53:13<74:19:19, 14.19s/it]
 50%|█████     | 19106/37963 [81:53:27<74:34:30, 14.24s/it]
 50%|█████     | 19107/37963 [81:53:41<73:46:12, 14.08s/it]
 50%|█████     | 19108/37963 [81:54:08<94:57:59, 18.13s/it]
 50%|█████     | 19109/37963 [81:54:29<98:21:05, 18.78s/it]
 50%|█████     | 19110/37963 [81:54:43<91:25:50, 17.46s/it]
                                                           
{'loss': '0.1557', 'grad_norm': '1.241', 'learning_rate': '1.038e-05', 'epoch': '0.5034'}

 50%|█████     | 19110/37963 [81:54:43<91:25:50, 17.46s/it]
 50%|█████     | 19111/37963 [81:54:57<86:01:42, 16.43s/it]
 50%|█████     | 19112/37963 [81:55:11<82:52:49, 15.83s/it]
 50%|█████     | 19113/37963 [81:55:26<80:30:55, 15.38s/it]
 50%|█████     | 19114/37963 [81:55:40<78:55:39, 15.07s/it]
 50%|█████     | 19115/37963 [81:55:54<76:45:37, 14.66s/it]
 50%|█████     | 19116/37963 [81:56:08<75:57:52, 14.51s/it]
 50%|█████     | 19117/37963 [81:56:22<75:24:35, 14.40s/it]
 50%|█████     | 19118/37963 [81:56:36<75:15:12, 14.38s/it]
 50%|█████     | 19119/37963 [81:56:51<75:16:38, 14.38s/it]
 50%|█████     | 19120/37963 [81:57:05<74:13:13, 14.18s/it]
                                                           
{'loss': '0.1358', 'grad_norm': '1.93', 'learning_rate': '1.037e-05', 'epoch': '0.5036'}

 50%|█████     | 19120/37963 [81:57:05<74:13:13, 14.18s/it]
 50%|█████     | 19121/37963 [81:57:19<74:33:52, 14.25s/it]
 50%|█████     | 19122/37963 [81:57:33<74:37:21, 14.26s/it]
 50%|█████     | 19123/37963 [81:57:54<85:24:10, 16.32s/it]
 50%|█████     | 19124/37963 [81:58:09<82:08:46, 15.70s/it]
 50%|█████     | 19125/37963 [81:58:23<79:57:32, 15.28s/it]
 50%|█████     | 19126/37963 [81:58:37<78:25:10, 14.99s/it]
 50%|█████     | 19127/37963 [81:58:58<87:30:33, 16.73s/it]
 50%|█████     | 19128/37963 [81:59:18<92:26:37, 17.67s/it]
 50%|█████     | 19129/37963 [81:59:32<87:32:18, 16.73s/it]
 50%|█████     | 19130/37963 [81:59:53<93:28:46, 17.87s/it]
                                                           
{'loss': '0.1397', 'grad_norm': '6.882', 'learning_rate': '1.036e-05', 'epoch': '0.5039'}

 50%|█████     | 19130/37963 [81:59:53<93:28:46, 17.87s/it]
 50%|█████     | 19131/37963 [82:00:07<88:04:37, 16.84s/it]
 50%|█████     | 19132/37963 [82:00:22<84:24:54, 16.14s/it]
 50%|█████     | 19133/37963 [82:00:36<80:42:03, 15.43s/it]
 50%|█████     | 19134/37963 [82:00:50<78:59:16, 15.10s/it]
 50%|█████     | 19135/37963 [82:01:04<77:45:35, 14.87s/it]
 50%|█████     | 19136/37963 [82:01:19<77:08:10, 14.75s/it]
 50%|█████     | 19137/37963 [82:01:33<76:23:37, 14.61s/it]
 50%|█████     | 19138/37963 [82:01:47<75:51:57, 14.51s/it]
 50%|█████     | 19139/37963 [82:02:02<75:24:03, 14.42s/it]
 50%|█████     | 19140/37963 [82:02:16<75:25:41, 14.43s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '1.909', 'learning_rate': '1.035e-05', 'epoch': '0.5042'}

 50%|█████     | 19140/37963 [82:02:16<75:25:41, 14.43s/it]
 50%|█████     | 19141/37963 [82:02:37<85:24:49, 16.34s/it]
 50%|█████     | 19142/37963 [82:02:51<81:45:43, 15.64s/it]
 50%|█████     | 19143/37963 [82:03:05<78:50:46, 15.08s/it]
 50%|█████     | 19144/37963 [82:03:19<77:41:39, 14.86s/it]
 50%|█████     | 19145/37963 [82:03:33<76:42:46, 14.68s/it]
 50%|█████     | 19146/37963 [82:03:48<76:28:43, 14.63s/it]
 50%|█████     | 19147/37963 [82:04:02<76:04:50, 14.56s/it]
 50%|█████     | 19148/37963 [82:04:16<75:44:38, 14.49s/it]
 50%|█████     | 19149/37963 [82:04:31<75:40:03, 14.48s/it]
 50%|█████     | 19150/37963 [82:04:45<75:38:28, 14.47s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '1.481', 'learning_rate': '1.034e-05', 'epoch': '0.5044'}

 50%|█████     | 19150/37963 [82:04:45<75:38:28, 14.47s/it]
 50%|█████     | 19151/37963 [82:05:00<75:26:59, 14.44s/it]
 50%|█████     | 19152/37963 [82:05:14<75:17:58, 14.41s/it]
 50%|█████     | 19153/37963 [82:05:28<75:11:21, 14.39s/it]
 50%|█████     | 19154/37963 [82:05:43<74:50:36, 14.32s/it]
 50%|█████     | 19155/37963 [82:05:57<75:12:09, 14.39s/it]
 50%|█████     | 19156/37963 [82:06:17<83:59:05, 16.08s/it]
 50%|█████     | 19157/37963 [82:06:32<81:20:02, 15.57s/it]
 50%|█████     | 19158/37963 [82:06:52<89:16:33, 17.09s/it]
 50%|█████     | 19159/37963 [82:07:13<95:52:38, 18.36s/it]
 50%|█████     | 19160/37963 [82:07:28<89:40:25, 17.17s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '1.493', 'learning_rate': '1.033e-05', 'epoch': '0.5047'}

 50%|█████     | 19160/37963 [82:07:28<89:40:25, 17.17s/it]
 50%|█████     | 19161/37963 [82:07:42<85:24:00, 16.35s/it]
 50%|█████     | 19162/37963 [82:07:57<82:21:36, 15.77s/it]
 50%|█████     | 19163/37963 [82:08:11<80:01:33, 15.32s/it]
 50%|█████     | 19164/37963 [82:08:25<78:31:26, 15.04s/it]
 50%|█████     | 19165/37963 [82:08:40<77:49:58, 14.91s/it]
 50%|█████     | 19166/37963 [82:08:54<77:04:12, 14.76s/it]
 50%|█████     | 19167/37963 [82:09:08<75:52:44, 14.53s/it]
 50%|█████     | 19168/37963 [82:09:23<75:31:34, 14.47s/it]
 50%|█████     | 19169/37963 [82:09:37<74:50:38, 14.34s/it]
 50%|█████     | 19170/37963 [82:09:51<74:59:51, 14.37s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '1.095', 'learning_rate': '1.033e-05', 'epoch': '0.505'}

 50%|█████     | 19170/37963 [82:09:51<74:59:51, 14.37s/it]
 50%|█████     | 19171/37963 [82:10:06<74:59:07, 14.37s/it]
 51%|█████     | 19172/37963 [82:10:27<85:32:31, 16.39s/it]
 51%|█████     | 19173/37963 [82:10:41<82:21:49, 15.78s/it]
 51%|█████     | 19174/37963 [82:10:55<80:10:15, 15.36s/it]
 51%|█████     | 19175/37963 [82:11:10<78:28:05, 15.04s/it]
 51%|█████     | 19176/37963 [82:11:31<87:44:38, 16.81s/it]
 51%|█████     | 19177/37963 [82:11:51<94:00:12, 18.01s/it]
 51%|█████     | 19178/37963 [82:12:12<98:31:42, 18.88s/it]
 51%|█████     | 19179/37963 [82:12:27<91:33:21, 17.55s/it]
 51%|█████     | 19180/37963 [82:12:41<86:34:00, 16.59s/it]
                                                           
{'loss': '0.1536', 'grad_norm': '2.047', 'learning_rate': '1.032e-05', 'epoch': '0.5052'}

 51%|█████     | 19180/37963 [82:12:41<86:34:00, 16.59s/it]
 51%|█████     | 19181/37963 [82:12:56<83:01:20, 15.91s/it]
 51%|█████     | 19182/37963 [82:13:10<80:44:35, 15.48s/it]
 51%|█████     | 19183/37963 [82:13:24<79:08:51, 15.17s/it]
 51%|█████     | 19184/37963 [82:13:39<77:55:33, 14.94s/it]
 51%|█████     | 19185/37963 [82:13:53<76:55:52, 14.75s/it]
 51%|█████     | 19186/37963 [82:14:08<76:22:47, 14.64s/it]
 51%|█████     | 19187/37963 [82:14:22<76:04:10, 14.59s/it]
 51%|█████     | 19188/37963 [82:14:36<75:36:20, 14.50s/it]
 51%|█████     | 19189/37963 [82:14:51<75:28:38, 14.47s/it]
 51%|█████     | 19190/37963 [82:15:12<85:34:53, 16.41s/it]
                                                           
{'loss': '0.1494', 'grad_norm': '1.992', 'learning_rate': '1.031e-05', 'epoch': '0.5055'}

 51%|█████     | 19190/37963 [82:15:12<85:34:53, 16.41s/it]
 51%|█████     | 19191/37963 [82:15:26<82:17:19, 15.78s/it]
 51%|█████     | 19192/37963 [82:15:40<80:03:58, 15.36s/it]
 51%|█████     | 19193/37963 [82:15:55<78:36:41, 15.08s/it]
 51%|█████     | 19194/37963 [82:16:09<77:33:58, 14.88s/it]
 51%|█████     | 19195/37963 [82:16:24<76:47:49, 14.73s/it]
 51%|█████     | 19196/37963 [82:16:38<76:05:27, 14.60s/it]
 51%|█████     | 19197/37963 [82:16:52<75:03:28, 14.40s/it]
 51%|█████     | 19198/37963 [82:17:06<74:57:12, 14.38s/it]
 51%|█████     | 19199/37963 [82:17:20<74:57:45, 14.38s/it]
 51%|█████     | 19200/37963 [82:17:35<74:50:59, 14.36s/it]
                                                           
{'loss': '0.1427', 'grad_norm': '2.265', 'learning_rate': '1.03e-05', 'epoch': '0.5058'}

 51%|█████     | 19200/37963 [82:17:35<74:50:59, 14.36s/it]
 51%|█████     | 19201/37963 [82:17:49<74:50:28, 14.36s/it]
 51%|█████     | 19202/37963 [82:18:03<74:23:07, 14.27s/it]
 51%|█████     | 19203/37963 [82:18:17<73:53:13, 14.18s/it]
 51%|█████     | 19204/37963 [82:18:38<84:15:58, 16.17s/it]
 51%|█████     | 19205/37963 [82:18:52<81:13:43, 15.59s/it]
 51%|█████     | 19206/37963 [82:19:13<89:20:52, 17.15s/it]
 51%|█████     | 19207/37963 [82:19:34<95:27:15, 18.32s/it]
 51%|█████     | 19208/37963 [82:19:48<89:18:30, 17.14s/it]
 51%|█████     | 19209/37963 [82:20:02<84:12:31, 16.16s/it]
 51%|█████     | 19210/37963 [82:20:16<80:48:39, 15.51s/it]
                                                           
{'loss': '0.1342', 'grad_norm': '1.319', 'learning_rate': '1.029e-05', 'epoch': '0.506'}

 51%|█████     | 19210/37963 [82:20:16<80:48:39, 15.51s/it]
 51%|█████     | 19211/37963 [82:20:30<78:10:36, 15.01s/it]
 51%|█████     | 19212/37963 [82:20:45<77:08:49, 14.81s/it]
 51%|█████     | 19213/37963 [82:20:59<76:21:22, 14.66s/it]
 51%|█████     | 19214/37963 [82:21:13<75:54:48, 14.58s/it]
 51%|█████     | 19215/37963 [82:21:28<75:34:16, 14.51s/it]
 51%|█████     | 19216/37963 [82:21:42<75:12:34, 14.44s/it]
 51%|█████     | 19217/37963 [82:21:56<75:00:39, 14.41s/it]
 51%|█████     | 19218/37963 [82:22:10<74:51:15, 14.38s/it]
 51%|█████     | 19219/37963 [82:22:25<74:21:26, 14.28s/it]
 51%|█████     | 19220/37963 [82:22:39<74:30:24, 14.31s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '2.061', 'learning_rate': '1.028e-05', 'epoch': '0.5063'}

 51%|█████     | 19220/37963 [82:22:39<74:30:24, 14.31s/it]
 51%|█████     | 19221/37963 [82:22:53<74:38:39, 14.34s/it]
 51%|█████     | 19222/37963 [82:23:14<84:58:37, 16.32s/it]
 51%|█████     | 19223/37963 [82:23:29<82:02:09, 15.76s/it]
 51%|█████     | 19224/37963 [82:23:50<90:03:24, 17.30s/it]
 51%|█████     | 19225/37963 [82:24:04<85:37:47, 16.45s/it]
 51%|█████     | 19226/37963 [82:24:18<82:02:38, 15.76s/it]
 51%|█████     | 19227/37963 [82:24:45<99:39:10, 19.15s/it]
 51%|█████     | 19228/37963 [82:25:00<92:05:04, 17.69s/it]
 51%|█████     | 19229/37963 [82:25:14<86:22:22, 16.60s/it]
 51%|█████     | 19230/37963 [82:25:28<82:47:53, 15.91s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '1.064', 'learning_rate': '1.027e-05', 'epoch': '0.5065'}

 51%|█████     | 19230/37963 [82:25:28<82:47:53, 15.91s/it]
 51%|█████     | 19231/37963 [82:25:42<80:32:01, 15.48s/it]
 51%|█████     | 19232/37963 [82:25:57<78:45:32, 15.14s/it]
 51%|█████     | 19233/37963 [82:26:11<77:31:03, 14.90s/it]
 51%|█████     | 19234/37963 [82:26:25<76:25:56, 14.69s/it]
 51%|█████     | 19235/37963 [82:26:40<75:55:42, 14.60s/it]
 51%|█████     | 19236/37963 [82:26:54<75:39:38, 14.54s/it]
 51%|█████     | 19237/37963 [82:27:08<75:25:55, 14.50s/it]
 51%|█████     | 19238/37963 [82:27:23<75:14:35, 14.47s/it]
 51%|█████     | 19239/37963 [82:27:37<75:17:27, 14.48s/it]
 51%|█████     | 19240/37963 [82:27:58<85:33:20, 16.45s/it]
                                                           
{'loss': '0.1486', 'grad_norm': '4.437', 'learning_rate': '1.027e-05', 'epoch': '0.5068'}

 51%|█████     | 19240/37963 [82:27:58<85:33:20, 16.45s/it]
 51%|█████     | 19241/37963 [82:28:13<82:13:20, 15.81s/it]
 51%|█████     | 19242/37963 [82:28:27<80:02:32, 15.39s/it]
 51%|█████     | 19243/37963 [82:28:41<78:12:38, 15.04s/it]
 51%|█████     | 19244/37963 [82:28:55<75:58:35, 14.61s/it]
 51%|█████     | 19245/37963 [82:29:10<75:50:40, 14.59s/it]
 51%|█████     | 19246/37963 [82:29:23<74:23:45, 14.31s/it]
 51%|█████     | 19247/37963 [82:29:38<74:31:56, 14.34s/it]
 51%|█████     | 19248/37963 [82:29:52<74:38:09, 14.36s/it]
 51%|█████     | 19249/37963 [82:30:06<74:30:19, 14.33s/it]
 51%|█████     | 19250/37963 [82:30:21<74:37:10, 14.36s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '2.891', 'learning_rate': '1.026e-05', 'epoch': '0.5071'}

 51%|█████     | 19250/37963 [82:30:21<74:37:10, 14.36s/it]
 51%|█████     | 19251/37963 [82:30:34<73:35:39, 14.16s/it]
 51%|█████     | 19252/37963 [82:30:55<84:04:58, 16.18s/it]
 51%|█████     | 19253/37963 [82:31:16<91:04:57, 17.53s/it]
 51%|█████     | 19254/37963 [82:31:30<85:24:07, 16.43s/it]
 51%|█████     | 19255/37963 [82:31:51<93:05:25, 17.91s/it]
 51%|█████     | 19256/37963 [82:32:06<87:35:17, 16.86s/it]
 51%|█████     | 19257/37963 [82:32:20<83:39:22, 16.10s/it]
 51%|█████     | 19258/37963 [82:32:34<80:01:36, 15.40s/it]
 51%|█████     | 19259/37963 [82:32:48<78:06:34, 15.03s/it]
 51%|█████     | 19260/37963 [82:33:02<77:00:53, 14.82s/it]
                                                           
{'loss': '0.1533', 'grad_norm': '2.447', 'learning_rate': '1.025e-05', 'epoch': '0.5073'}

 51%|█████     | 19260/37963 [82:33:02<77:00:53, 14.82s/it]
 51%|█████     | 19261/37963 [82:33:16<76:10:34, 14.66s/it]
 51%|█████     | 19262/37963 [82:33:31<75:43:21, 14.58s/it]
 51%|█████     | 19263/37963 [82:33:45<74:53:10, 14.42s/it]
 51%|█████     | 19264/37963 [82:33:59<74:35:14, 14.36s/it]
 51%|█████     | 19265/37963 [82:34:13<74:16:52, 14.30s/it]
 51%|█████     | 19266/37963 [82:34:28<74:38:55, 14.37s/it]
 51%|█████     | 19267/37963 [82:34:42<74:41:26, 14.38s/it]
 51%|█████     | 19268/37963 [82:34:56<74:29:43, 14.35s/it]
 51%|█████     | 19269/37963 [82:35:10<73:33:01, 14.16s/it]
 51%|█████     | 19270/37963 [82:35:25<74:04:49, 14.27s/it]
                                                           
{'loss': '0.1294', 'grad_norm': '2.295', 'learning_rate': '1.024e-05', 'epoch': '0.5076'}

 51%|█████     | 19270/37963 [82:35:25<74:04:49, 14.27s/it]
 51%|█████     | 19271/37963 [82:35:39<74:25:00, 14.33s/it]
 51%|█████     | 19272/37963 [82:36:00<83:50:31, 16.15s/it]
 51%|█████     | 19273/37963 [82:36:20<91:00:29, 17.53s/it]
 51%|█████     | 19274/37963 [82:36:34<85:20:02, 16.44s/it]
 51%|█████     | 19275/37963 [82:36:49<82:10:47, 15.83s/it]
 51%|█████     | 19276/37963 [82:37:10<90:14:58, 17.39s/it]
 51%|█████     | 19277/37963 [82:37:24<85:41:25, 16.51s/it]
 51%|█████     | 19278/37963 [82:37:39<82:21:56, 15.87s/it]
 51%|█████     | 19279/37963 [82:37:53<80:03:02, 15.42s/it]
 51%|█████     | 19280/37963 [82:38:07<77:59:42, 15.03s/it]
                                                           
{'loss': '0.1411', 'grad_norm': '1.365', 'learning_rate': '1.023e-05', 'epoch': '0.5079'}

 51%|█████     | 19280/37963 [82:38:07<77:59:42, 15.03s/it]
 51%|█████     | 19281/37963 [82:38:21<76:53:50, 14.82s/it]
 51%|█████     | 19282/37963 [82:38:36<76:09:56, 14.68s/it]
 51%|█████     | 19283/37963 [82:38:50<75:41:50, 14.59s/it]
 51%|█████     | 19284/37963 [82:39:04<75:21:18, 14.52s/it]
 51%|█████     | 19285/37963 [82:39:19<75:08:54, 14.48s/it]
 51%|█████     | 19286/37963 [82:39:33<75:05:05, 14.47s/it]
 51%|█████     | 19287/37963 [82:39:47<74:31:03, 14.36s/it]
 51%|█████     | 19288/37963 [82:40:02<74:12:18, 14.30s/it]
 51%|█████     | 19289/37963 [82:40:23<84:42:19, 16.33s/it]
 51%|█████     | 19290/37963 [82:40:37<81:36:38, 15.73s/it]
                                                           
{'loss': '0.1359', 'grad_norm': '2.173', 'learning_rate': '1.022e-05', 'epoch': '0.5081'}

 51%|█████     | 19290/37963 [82:40:37<81:36:38, 15.73s/it]
 51%|█████     | 19291/37963 [82:40:51<79:03:21, 15.24s/it]
 51%|█████     | 19292/37963 [82:41:05<77:40:34, 14.98s/it]
 51%|█████     | 19293/37963 [82:41:20<76:39:31, 14.78s/it]
 51%|█████     | 19294/37963 [82:41:34<76:00:25, 14.66s/it]
 51%|█████     | 19295/37963 [82:41:48<75:07:17, 14.49s/it]
 51%|█████     | 19296/37963 [82:42:03<74:53:19, 14.44s/it]
 51%|█████     | 19297/37963 [82:42:17<74:52:55, 14.44s/it]
 51%|█████     | 19298/37963 [82:42:31<74:43:10, 14.41s/it]
 51%|█████     | 19299/37963 [82:42:46<74:33:55, 14.38s/it]
 51%|█████     | 19300/37963 [82:43:06<83:30:24, 16.11s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '0.9184', 'learning_rate': '1.021e-05', 'epoch': '0.5084'}

 51%|█████     | 19300/37963 [82:43:06<83:30:24, 16.11s/it]
 51%|█████     | 19301/37963 [82:43:20<80:52:49, 15.60s/it]
 51%|█████     | 19302/37963 [82:43:41<88:58:16, 17.16s/it]
 51%|█████     | 19303/37963 [82:43:55<84:31:07, 16.31s/it]
 51%|█████     | 19304/37963 [82:44:17<92:56:56, 17.93s/it]
 51%|█████     | 19305/37963 [82:44:31<87:24:09, 16.86s/it]
 51%|█████     | 19306/37963 [82:44:46<83:29:54, 16.11s/it]
 51%|█████     | 19307/37963 [82:45:00<80:46:00, 15.59s/it]
 51%|█████     | 19308/37963 [82:45:14<78:26:51, 15.14s/it]
 51%|█████     | 19309/37963 [82:45:29<77:23:40, 14.94s/it]
 51%|█████     | 19310/37963 [82:45:43<76:29:40, 14.76s/it]
                                                           
{'loss': '0.1562', 'grad_norm': '2.441', 'learning_rate': '1.021e-05', 'epoch': '0.5087'}

 51%|█████     | 19310/37963 [82:45:43<76:29:40, 14.76s/it]
 51%|█████     | 19311/37963 [82:45:57<76:01:44, 14.67s/it]
 51%|█████     | 19312/37963 [82:46:12<75:34:05, 14.59s/it]
 51%|█████     | 19313/37963 [82:46:26<75:05:49, 14.50s/it]
 51%|█████     | 19314/37963 [82:46:40<74:48:38, 14.44s/it]
 51%|█████     | 19315/37963 [82:46:55<74:37:38, 14.41s/it]
 51%|█████     | 19316/37963 [82:47:09<74:32:08, 14.39s/it]
 51%|█████     | 19317/37963 [82:47:24<74:29:20, 14.38s/it]
 51%|█████     | 19318/37963 [82:47:38<74:36:17, 14.40s/it]
 51%|█████     | 19319/37963 [82:47:52<74:37:15, 14.41s/it]
 51%|█████     | 19320/37963 [82:48:06<73:59:48, 14.29s/it]
                                                           
{'loss': '0.1428', 'grad_norm': '1.803', 'learning_rate': '1.02e-05', 'epoch': '0.5089'}

 51%|█████     | 19320/37963 [82:48:06<73:59:48, 14.29s/it]
 51%|█████     | 19321/37963 [82:48:27<84:29:32, 16.32s/it]
 51%|█████     | 19322/37963 [82:48:48<91:43:19, 17.71s/it]
 51%|█████     | 19323/37963 [82:49:03<86:21:53, 16.68s/it]
 51%|█████     | 19324/37963 [82:49:24<92:58:03, 17.96s/it]
 51%|█████     | 19325/37963 [82:49:38<87:13:22, 16.85s/it]
 51%|█████     | 19326/37963 [82:49:52<82:48:11, 15.99s/it]
 51%|█████     | 19327/37963 [82:50:06<80:27:39, 15.54s/it]
 51%|█████     | 19328/37963 [82:50:20<77:14:42, 14.92s/it]
 51%|█████     | 19329/37963 [82:50:34<76:27:50, 14.77s/it]
 51%|█████     | 19330/37963 [82:50:49<75:51:19, 14.66s/it]
                                                           
{'loss': '0.1474', 'grad_norm': '2.502', 'learning_rate': '1.019e-05', 'epoch': '0.5092'}

 51%|█████     | 19330/37963 [82:50:49<75:51:19, 14.66s/it]
 51%|█████     | 19331/37963 [82:51:03<75:19:41, 14.55s/it]
 51%|█████     | 19332/37963 [82:51:17<73:59:45, 14.30s/it]
 51%|█████     | 19333/37963 [82:51:31<73:55:48, 14.29s/it]
 51%|█████     | 19334/37963 [82:51:45<73:41:23, 14.24s/it]
 51%|█████     | 19335/37963 [82:51:59<73:46:48, 14.26s/it]
 51%|█████     | 19336/37963 [82:52:14<74:07:06, 14.32s/it]
 51%|█████     | 19337/37963 [82:52:35<84:45:45, 16.38s/it]
 51%|█████     | 19338/37963 [82:52:49<81:44:30, 15.80s/it]
 51%|█████     | 19339/37963 [82:53:03<78:37:38, 15.20s/it]
 51%|█████     | 19340/37963 [82:53:18<77:22:30, 14.96s/it]
                                                           
{'loss': '0.1417', 'grad_norm': '1.21', 'learning_rate': '1.018e-05', 'epoch': '0.5094'}

 51%|█████     | 19340/37963 [82:53:18<77:22:30, 14.96s/it]
 51%|█████     | 19341/37963 [82:53:32<76:20:31, 14.76s/it]
 51%|█████     | 19342/37963 [82:53:46<75:47:21, 14.65s/it]
 51%|█████     | 19343/37963 [82:54:00<74:45:34, 14.45s/it]
 51%|█████     | 19344/37963 [82:54:15<74:21:56, 14.38s/it]
 51%|█████     | 19345/37963 [82:54:29<73:45:05, 14.26s/it]
 51%|█████     | 19346/37963 [82:54:43<73:35:55, 14.23s/it]
 51%|█████     | 19347/37963 [82:54:57<73:43:10, 14.26s/it]
 51%|█████     | 19348/37963 [82:55:18<83:57:24, 16.24s/it]
 51%|█████     | 19349/37963 [82:55:39<91:06:07, 17.62s/it]
 51%|█████     | 19350/37963 [82:55:53<86:35:23, 16.75s/it]
                                                           
{'loss': '0.143', 'grad_norm': '4.327', 'learning_rate': '1.017e-05', 'epoch': '0.5097'}

 51%|█████     | 19350/37963 [82:55:53<86:35:23, 16.75s/it]
 51%|█████     | 19351/37963 [82:56:14<92:40:03, 17.92s/it]
 51%|█████     | 19352/37963 [82:56:29<87:16:08, 16.88s/it]
 51%|█████     | 19353/37963 [82:56:43<83:19:28, 16.12s/it]
 51%|█████     | 19354/37963 [82:56:57<80:36:38, 15.59s/it]
 51%|█████     | 19355/37963 [82:57:12<78:59:33, 15.28s/it]
 51%|█████     | 19356/37963 [82:57:26<77:37:02, 15.02s/it]
 51%|█████     | 19357/37963 [82:57:41<76:39:05, 14.83s/it]
 51%|█████     | 19358/37963 [82:57:55<75:37:40, 14.63s/it]
 51%|█████     | 19359/37963 [82:58:09<75:08:27, 14.54s/it]
 51%|█████     | 19360/37963 [82:58:23<74:52:55, 14.49s/it]
                                                           
{'loss': '0.1353', 'grad_norm': '2.171', 'learning_rate': '1.016e-05', 'epoch': '0.51'}

 51%|█████     | 19360/37963 [82:58:23<74:52:55, 14.49s/it]
 51%|█████     | 19361/37963 [82:58:38<74:23:17, 14.40s/it]
 51%|█████     | 19362/37963 [82:58:52<74:22:10, 14.39s/it]
 51%|█████     | 19363/37963 [82:59:05<72:47:24, 14.09s/it]
 51%|█████     | 19364/37963 [82:59:20<73:12:36, 14.17s/it]
 51%|█████     | 19365/37963 [82:59:34<73:32:04, 14.23s/it]
 51%|█████     | 19366/37963 [82:59:49<73:45:42, 14.28s/it]
 51%|█████     | 19367/37963 [83:00:03<73:51:29, 14.30s/it]
 51%|█████     | 19368/37963 [83:00:17<73:51:53, 14.30s/it]
 51%|█████     | 19369/37963 [83:00:31<73:38:06, 14.26s/it]
 51%|█████     | 19370/37963 [83:00:52<83:44:35, 16.21s/it]
                                                           
{'loss': '0.146', 'grad_norm': '1.942', 'learning_rate': '1.016e-05', 'epoch': '0.5102'}

 51%|█████     | 19370/37963 [83:00:52<83:44:35, 16.21s/it]
 51%|█████     | 19371/37963 [83:01:13<91:08:53, 17.65s/it]
 51%|█████     | 19372/37963 [83:01:27<85:53:45, 16.63s/it]
 51%|█████     | 19373/37963 [83:01:54<100:49:35, 19.53s/it]
 51%|█████     | 19374/37963 [83:02:08<93:03:08, 18.02s/it] 
 51%|█████     | 19375/37963 [83:02:23<87:31:22, 16.95s/it]
 51%|█████     | 19376/37963 [83:02:37<83:14:52, 16.12s/it]
 51%|█████     | 19377/37963 [83:02:51<80:00:07, 15.50s/it]
 51%|█████     | 19378/37963 [83:03:05<78:03:07, 15.12s/it]
 51%|█████     | 19379/37963 [83:03:19<76:55:00, 14.90s/it]
 51%|█████     | 19380/37963 [83:03:33<75:18:59, 14.59s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '3.969', 'learning_rate': '1.015e-05', 'epoch': '0.5105'}

 51%|█████     | 19380/37963 [83:03:33<75:18:59, 14.59s/it]
 51%|█████     | 19381/37963 [83:03:48<75:01:38, 14.54s/it]
 51%|█████     | 19382/37963 [83:04:02<74:31:48, 14.44s/it]
 51%|█████     | 19383/37963 [83:04:16<74:29:20, 14.43s/it]
 51%|█████     | 19384/37963 [83:04:31<74:25:35, 14.42s/it]
 51%|█████     | 19385/37963 [83:04:52<84:10:25, 16.31s/it]
 51%|█████     | 19386/37963 [83:05:05<80:34:41, 15.62s/it]
 51%|█████     | 19387/37963 [83:05:20<78:34:37, 15.23s/it]
 51%|█████     | 19388/37963 [83:05:34<77:16:54, 14.98s/it]
 51%|█████     | 19389/37963 [83:05:49<76:19:50, 14.79s/it]
 51%|█████     | 19390/37963 [83:06:03<75:15:35, 14.59s/it]
                                                           
{'loss': '0.154', 'grad_norm': '2.446', 'learning_rate': '1.014e-05', 'epoch': '0.5108'}

 51%|█████     | 19390/37963 [83:06:03<75:15:35, 14.59s/it]
 51%|█████     | 19391/37963 [83:06:16<74:02:40, 14.35s/it]
 51%|█████     | 19392/37963 [83:06:31<73:59:25, 14.34s/it]
 51%|█████     | 19393/37963 [83:06:45<73:31:30, 14.25s/it]
 51%|█████     | 19394/37963 [83:06:59<73:32:33, 14.26s/it]
 51%|█████     | 19395/37963 [83:07:14<73:45:20, 14.30s/it]
 51%|█████     | 19396/37963 [83:07:28<73:47:03, 14.31s/it]
 51%|█████     | 19397/37963 [83:07:49<83:39:50, 16.22s/it]
 51%|█████     | 19398/37963 [83:08:09<90:44:45, 17.60s/it]
 51%|█████     | 19399/37963 [83:08:24<85:25:54, 16.57s/it]
 51%|█████     | 19400/37963 [83:08:44<92:02:57, 17.85s/it]
                                                           
{'loss': '0.148', 'grad_norm': '1.906', 'learning_rate': '1.013e-05', 'epoch': '0.511'}

 51%|█████     | 19400/37963 [83:08:44<92:02:57, 17.85s/it]
 51%|█████     | 19401/37963 [83:08:59<86:44:10, 16.82s/it]
 51%|█████     | 19402/37963 [83:09:13<82:52:29, 16.07s/it]
 51%|█████     | 19403/37963 [83:09:27<80:03:18, 15.53s/it]
 51%|█████     | 19404/37963 [83:09:42<78:20:22, 15.20s/it]
 51%|█████     | 19405/37963 [83:09:56<77:01:18, 14.94s/it]
 51%|█████     | 19406/37963 [83:10:11<76:22:46, 14.82s/it]
 51%|█████     | 19407/37963 [83:10:25<75:22:37, 14.62s/it]
 51%|█████     | 19408/37963 [83:10:39<74:50:50, 14.52s/it]
 51%|█████     | 19409/37963 [83:10:54<74:42:25, 14.50s/it]
 51%|█████     | 19410/37963 [83:11:08<74:04:10, 14.37s/it]
                                                           
{'loss': '0.1286', 'grad_norm': '3.062', 'learning_rate': '1.012e-05', 'epoch': '0.5113'}

 51%|█████     | 19410/37963 [83:11:08<74:04:10, 14.37s/it]
 51%|█████     | 19411/37963 [83:11:22<74:06:19, 14.38s/it]
 51%|█████     | 19412/37963 [83:11:37<74:17:32, 14.42s/it]
 51%|█████     | 19413/37963 [83:11:51<74:10:52, 14.40s/it]
 51%|█████     | 19414/37963 [83:12:05<74:15:41, 14.41s/it]
 51%|█████     | 19415/37963 [83:12:20<74:25:10, 14.44s/it]
 51%|█████     | 19416/37963 [83:12:34<74:00:21, 14.36s/it]
 51%|█████     | 19417/37963 [83:12:54<83:25:01, 16.19s/it]
 51%|█████     | 19418/37963 [83:13:09<80:47:38, 15.68s/it]
 51%|█████     | 19419/37963 [83:13:30<88:26:32, 17.17s/it]
 51%|█████     | 19420/37963 [83:13:44<84:09:29, 16.34s/it]
                                                           
{'loss': '0.1365', 'grad_norm': '3.067', 'learning_rate': '1.011e-05', 'epoch': '0.5116'}

 51%|█████     | 19420/37963 [83:13:44<84:09:29, 16.34s/it]
 51%|█████     | 19421/37963 [83:13:58<80:35:03, 15.65s/it]
 51%|█████     | 19422/37963 [83:14:19<88:27:30, 17.18s/it]
 51%|█████     | 19423/37963 [83:14:39<93:14:51, 18.11s/it]
 51%|█████     | 19424/37963 [83:14:54<87:40:06, 17.02s/it]
 51%|█████     | 19425/37963 [83:15:08<83:30:03, 16.22s/it]
 51%|█████     | 19426/37963 [83:15:22<80:07:40, 15.56s/it]
 51%|█████     | 19427/37963 [83:15:36<77:25:10, 15.04s/it]
 51%|█████     | 19428/37963 [83:15:50<76:20:20, 14.83s/it]
 51%|█████     | 19429/37963 [83:16:04<75:05:10, 14.58s/it]
 51%|█████     | 19430/37963 [83:16:18<74:38:01, 14.50s/it]
                                                           
{'loss': '0.1281', 'grad_norm': '1.741', 'learning_rate': '1.01e-05', 'epoch': '0.5118'}

 51%|█████     | 19430/37963 [83:16:18<74:38:01, 14.50s/it]
 51%|█████     | 19431/37963 [83:16:33<74:22:02, 14.45s/it]
 51%|█████     | 19432/37963 [83:16:46<72:53:39, 14.16s/it]
 51%|█████     | 19433/37963 [83:17:01<73:06:00, 14.20s/it]
 51%|█████     | 19434/37963 [83:17:15<73:38:49, 14.31s/it]
 51%|█████     | 19435/37963 [83:17:36<84:05:54, 16.34s/it]
 51%|█████     | 19436/37963 [83:17:50<80:56:15, 15.73s/it]
 51%|█████     | 19437/37963 [83:18:04<78:00:13, 15.16s/it]
 51%|█████     | 19438/37963 [83:18:19<76:45:23, 14.92s/it]
 51%|█████     | 19439/37963 [83:18:33<75:55:02, 14.75s/it]
 51%|█████     | 19440/37963 [83:18:47<75:20:17, 14.64s/it]
                                                           
{'loss': '0.1359', 'grad_norm': '3.069', 'learning_rate': '1.01e-05', 'epoch': '0.5121'}

 51%|█████     | 19440/37963 [83:18:47<75:20:17, 14.64s/it]
 51%|█████     | 19441/37963 [83:19:02<74:56:03, 14.56s/it]
 51%|█████     | 19442/37963 [83:19:16<74:00:04, 14.38s/it]
 51%|█████     | 19443/37963 [83:19:30<73:44:57, 14.34s/it]
 51%|█████     | 19444/37963 [83:19:44<73:38:15, 14.31s/it]
 51%|█████     | 19445/37963 [83:19:58<73:33:51, 14.30s/it]
 51%|█████     | 19446/37963 [83:20:19<82:39:12, 16.07s/it]
 51%|█████     | 19447/37963 [83:20:39<88:45:04, 17.26s/it]
 51%|█████     | 19448/37963 [83:21:00<94:59:32, 18.47s/it]
 51%|█████     | 19449/37963 [83:21:14<88:37:06, 17.23s/it]
 51%|█████     | 19450/37963 [83:21:29<84:04:30, 16.35s/it]
                                                           
{'loss': '0.149', 'grad_norm': '1.815', 'learning_rate': '1.009e-05', 'epoch': '0.5123'}

 51%|█████     | 19450/37963 [83:21:29<84:04:30, 16.35s/it]
 51%|█████     | 19451/37963 [83:21:43<80:38:47, 15.68s/it]
 51%|█████     | 19452/37963 [83:21:57<77:59:45, 15.17s/it]
 51%|█████     | 19453/37963 [83:22:11<76:17:07, 14.84s/it]
 51%|█████     | 19454/37963 [83:22:25<74:41:16, 14.53s/it]
 51%|█████     | 19455/37963 [83:22:39<74:24:25, 14.47s/it]
 51%|█████     | 19456/37963 [83:22:53<73:36:34, 14.32s/it]
 51%|█████▏    | 19457/37963 [83:23:07<73:40:21, 14.33s/it]
 51%|█████▏    | 19458/37963 [83:23:22<73:48:38, 14.36s/it]
 51%|█████▏    | 19459/37963 [83:23:36<73:38:38, 14.33s/it]
 51%|█████▏    | 19460/37963 [83:23:50<73:40:28, 14.33s/it]
                                                           
{'loss': '0.1533', 'grad_norm': '3.642', 'learning_rate': '1.008e-05', 'epoch': '0.5126'}

 51%|█████▏    | 19460/37963 [83:23:50<73:40:28, 14.33s/it]
 51%|█████▏    | 19461/37963 [83:24:05<73:43:01, 14.34s/it]
 51%|█████▏    | 19462/37963 [83:24:19<73:40:17, 14.34s/it]
 51%|█████▏    | 19463/37963 [83:24:33<73:40:37, 14.34s/it]
 51%|█████▏    | 19464/37963 [83:24:48<73:48:27, 14.36s/it]
 51%|█████▏    | 19465/37963 [83:25:02<73:38:58, 14.33s/it]
 51%|█████▏    | 19466/37963 [83:25:16<73:45:23, 14.35s/it]
 51%|█████▏    | 19467/37963 [83:25:38<84:34:22, 16.46s/it]
 51%|█████▏    | 19468/37963 [83:25:58<90:25:15, 17.60s/it]
 51%|█████▏    | 19469/37963 [83:26:12<85:27:21, 16.63s/it]
 51%|█████▏    | 19470/37963 [83:26:26<81:21:13, 15.84s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '1.179', 'learning_rate': '1.007e-05', 'epoch': '0.5129'}

 51%|█████▏    | 19470/37963 [83:26:26<81:21:13, 15.84s/it]
 51%|█████▏    | 19471/37963 [83:26:47<89:10:32, 17.36s/it]
 51%|█████▏    | 19472/37963 [83:27:02<84:31:17, 16.46s/it]
 51%|█████▏    | 19473/37963 [83:27:15<80:23:24, 15.65s/it]
 51%|█████▏    | 19474/37963 [83:27:30<78:17:11, 15.24s/it]
 51%|█████▏    | 19475/37963 [83:27:44<76:42:41, 14.94s/it]
 51%|█████▏    | 19476/37963 [83:27:58<75:47:37, 14.76s/it]
 51%|█████▏    | 19477/37963 [83:28:13<75:14:11, 14.65s/it]
 51%|█████▏    | 19478/37963 [83:28:27<74:42:29, 14.55s/it]
 51%|█████▏    | 19479/37963 [83:28:41<74:29:32, 14.51s/it]
 51%|█████▏    | 19480/37963 [83:28:56<74:15:09, 14.46s/it]
                                                           
{'loss': '0.1395', 'grad_norm': '2.786', 'learning_rate': '1.006e-05', 'epoch': '0.5131'}

 51%|█████▏    | 19480/37963 [83:28:56<74:15:09, 14.46s/it]
 51%|█████▏    | 19481/37963 [83:29:10<73:17:45, 14.28s/it]
 51%|█████▏    | 19482/37963 [83:29:24<73:31:40, 14.32s/it]
 51%|█████▏    | 19483/37963 [83:29:45<83:52:55, 16.34s/it]
 51%|█████▏    | 19484/37963 [83:30:00<81:00:27, 15.78s/it]
 51%|█████▏    | 19485/37963 [83:30:14<78:22:20, 15.27s/it]
 51%|█████▏    | 19486/37963 [83:30:28<76:45:47, 14.96s/it]
 51%|█████▏    | 19487/37963 [83:30:42<74:48:02, 14.57s/it]
 51%|█████▏    | 19488/37963 [83:30:56<73:50:49, 14.39s/it]
 51%|█████▏    | 19489/37963 [83:31:10<73:28:22, 14.32s/it]
 51%|█████▏    | 19490/37963 [83:31:24<73:09:35, 14.26s/it]
                                                           
{'loss': '0.125', 'grad_norm': '3.784', 'learning_rate': '1.005e-05', 'epoch': '0.5134'}

 51%|█████▏    | 19490/37963 [83:31:24<73:09:35, 14.26s/it]
 51%|█████▏    | 19491/37963 [83:31:38<72:55:55, 14.21s/it]
 51%|█████▏    | 19492/37963 [83:31:52<73:14:21, 14.27s/it]
 51%|█████▏    | 19493/37963 [83:32:07<73:15:56, 14.28s/it]
 51%|█████▏    | 19494/37963 [83:32:21<73:21:32, 14.30s/it]
 51%|█████▏    | 19495/37963 [83:32:35<73:27:36, 14.32s/it]
 51%|█████▏    | 19496/37963 [83:32:50<73:24:06, 14.31s/it]
 51%|█████▏    | 19497/37963 [83:33:17<93:42:24, 18.27s/it]
 51%|█████▏    | 19498/37963 [83:33:38<97:47:29, 19.07s/it]
 51%|█████▏    | 19499/37963 [83:33:52<89:50:14, 17.52s/it]
 51%|█████▏    | 19500/37963 [83:34:06<84:26:23, 16.46s/it]
                                                           
{'loss': '0.1373', 'grad_norm': '1.303', 'learning_rate': '1.004e-05', 'epoch': '0.5137'}

 51%|█████▏    | 19500/37963 [83:34:06<84:26:23, 16.46s/it]
 51%|█████▏    | 19501/37963 [83:34:20<81:10:27, 15.83s/it]
 51%|█████▏    | 19502/37963 [83:34:35<78:48:01, 15.37s/it]
 51%|█████▏    | 19503/37963 [83:34:49<77:09:38, 15.05s/it]
 51%|█████▏    | 19504/37963 [83:35:02<74:57:07, 14.62s/it]
 51%|█████▏    | 19505/37963 [83:35:17<74:02:31, 14.44s/it]
 51%|█████▏    | 19506/37963 [83:35:31<73:57:05, 14.42s/it]
 51%|█████▏    | 19507/37963 [83:35:45<74:09:20, 14.46s/it]
 51%|█████▏    | 19508/37963 [83:36:00<73:55:54, 14.42s/it]
 51%|█████▏    | 19509/37963 [83:36:14<73:51:31, 14.41s/it]
 51%|█████▏    | 19510/37963 [83:36:28<72:26:53, 14.13s/it]
                                                           
{'loss': '0.1467', 'grad_norm': '1.447', 'learning_rate': '1.004e-05', 'epoch': '0.5139'}

 51%|█████▏    | 19510/37963 [83:36:28<72:26:53, 14.13s/it]
 51%|█████▏    | 19511/37963 [83:36:42<72:44:27, 14.19s/it]
 51%|█████▏    | 19512/37963 [83:36:56<73:09:11, 14.27s/it]
 51%|█████▏    | 19513/37963 [83:37:10<71:55:27, 14.03s/it]
 51%|█████▏    | 19514/37963 [83:37:31<82:07:31, 16.03s/it]
 51%|█████▏    | 19515/37963 [83:37:45<79:08:55, 15.45s/it]
 51%|█████▏    | 19516/37963 [83:37:59<77:33:14, 15.13s/it]
 51%|█████▏    | 19517/37963 [83:38:13<76:22:18, 14.91s/it]
 51%|█████▏    | 19518/37963 [83:38:28<75:31:51, 14.74s/it]
 51%|█████▏    | 19519/37963 [83:38:48<84:35:56, 16.51s/it]
 51%|█████▏    | 19520/37963 [83:39:10<91:44:12, 17.91s/it]
                                                           
{'loss': '0.1426', 'grad_norm': '2.371', 'learning_rate': '1.003e-05', 'epoch': '0.5142'}

 51%|█████▏    | 19520/37963 [83:39:10<91:44:12, 17.91s/it]
 51%|█████▏    | 19521/37963 [83:39:24<85:58:28, 16.78s/it]
 51%|█████▏    | 19522/37963 [83:39:45<92:05:46, 17.98s/it]
 51%|█████▏    | 19523/37963 [83:39:59<86:28:58, 16.88s/it]
 51%|█████▏    | 19524/37963 [83:40:13<82:32:57, 16.12s/it]
 51%|█████▏    | 19525/37963 [83:40:28<79:50:32, 15.59s/it]
 51%|█████▏    | 19526/37963 [83:40:42<77:20:53, 15.10s/it]
 51%|█████▏    | 19527/37963 [83:40:56<76:07:56, 14.87s/it]
 51%|█████▏    | 19528/37963 [83:41:10<75:17:07, 14.70s/it]
 51%|█████▏    | 19529/37963 [83:41:25<74:43:06, 14.59s/it]
 51%|█████▏    | 19530/37963 [83:41:39<74:13:08, 14.50s/it]
                                                           
{'loss': '0.1526', 'grad_norm': '3.244', 'learning_rate': '1.002e-05', 'epoch': '0.5144'}

 51%|█████▏    | 19530/37963 [83:41:39<74:13:08, 14.50s/it]
 51%|█████▏    | 19531/37963 [83:42:00<83:54:31, 16.39s/it]
 51%|█████▏    | 19532/37963 [83:42:14<80:35:22, 15.74s/it]
 51%|█████▏    | 19533/37963 [83:42:28<77:49:12, 15.20s/it]
 51%|█████▏    | 19534/37963 [83:42:42<76:26:21, 14.93s/it]
 51%|█████▏    | 19535/37963 [83:42:57<75:43:19, 14.79s/it]
 51%|█████▏    | 19536/37963 [83:43:11<74:38:33, 14.58s/it]
 51%|█████▏    | 19537/37963 [83:43:25<74:12:36, 14.50s/it]
 51%|█████▏    | 19538/37963 [83:43:39<72:51:39, 14.24s/it]
 51%|█████▏    | 19539/37963 [83:43:53<72:57:43, 14.26s/it]
 51%|█████▏    | 19540/37963 [83:44:07<72:46:08, 14.22s/it]
                                                           
{'loss': '0.1414', 'grad_norm': '1.162', 'learning_rate': '1.001e-05', 'epoch': '0.5147'}

 51%|█████▏    | 19540/37963 [83:44:07<72:46:08, 14.22s/it]
 51%|█████▏    | 19541/37963 [83:44:21<72:00:58, 14.07s/it]
 51%|█████▏    | 19542/37963 [83:44:35<72:27:08, 14.16s/it]
 51%|█████▏    | 19543/37963 [83:44:56<82:29:13, 16.12s/it]
 51%|█████▏    | 19544/37963 [83:45:10<79:59:33, 15.63s/it]
 51%|█████▏    | 19545/37963 [83:45:25<78:01:31, 15.25s/it]
 51%|█████▏    | 19546/37963 [83:45:39<76:39:46, 14.99s/it]
 51%|█████▏    | 19547/37963 [83:46:00<85:51:47, 16.78s/it]
 51%|█████▏    | 19548/37963 [83:46:14<82:09:01, 16.06s/it]
 51%|█████▏    | 19549/37963 [83:46:29<79:33:26, 15.55s/it]
 51%|█████▏    | 19550/37963 [83:46:43<77:40:39, 15.19s/it]
                                                           
{'loss': '0.1528', 'grad_norm': '2.243', 'learning_rate': '1e-05', 'epoch': '0.515'}

 51%|█████▏    | 19550/37963 [83:46:43<77:40:39, 15.19s/it]
 52%|█████▏    | 19551/37963 [83:46:57<76:30:30, 14.96s/it]
 52%|█████▏    | 19552/37963 [83:47:12<75:32:54, 14.77s/it]
 52%|█████▏    | 19553/37963 [83:47:25<73:41:15, 14.41s/it]
 52%|█████▏    | 19554/37963 [83:47:40<73:39:53, 14.41s/it]
 52%|█████▏    | 19555/37963 [83:47:54<73:23:59, 14.35s/it]
 52%|█████▏    | 19556/37963 [83:48:08<72:41:46, 14.22s/it]
 52%|█████▏    | 19557/37963 [83:48:22<72:30:12, 14.18s/it]
 52%|█████▏    | 19558/37963 [83:48:36<72:00:52, 14.09s/it]
 52%|█████▏    | 19559/37963 [83:48:50<72:22:07, 14.16s/it]
 52%|█████▏    | 19560/37963 [83:49:04<72:31:55, 14.19s/it]
                                                           
{'loss': '0.1369', 'grad_norm': '3.119', 'learning_rate': '9.993e-06', 'epoch': '0.5152'}

 52%|█████▏    | 19560/37963 [83:49:05<72:31:55, 14.19s/it]
 52%|█████▏    | 19561/37963 [83:49:19<72:36:52, 14.21s/it]
 52%|█████▏    | 19562/37963 [83:49:40<82:57:15, 16.23s/it]
 52%|█████▏    | 19563/37963 [83:49:54<80:05:49, 15.67s/it]
 52%|█████▏    | 19564/37963 [83:50:08<77:50:13, 15.23s/it]
 52%|█████▏    | 19565/37963 [83:50:23<76:26:56, 14.96s/it]
 52%|█████▏    | 19566/37963 [83:50:43<85:26:21, 16.72s/it]
 52%|█████▏    | 19567/37963 [83:50:58<81:43:20, 15.99s/it]
 52%|█████▏    | 19568/37963 [83:51:18<89:03:02, 17.43s/it]
 52%|█████▏    | 19569/37963 [83:51:33<84:00:22, 16.44s/it]
 52%|█████▏    | 19570/37963 [83:51:47<80:45:59, 15.81s/it]
                                                           
{'loss': '0.134', 'grad_norm': '1.637', 'learning_rate': '9.985e-06', 'epoch': '0.5155'}

 52%|█████▏    | 19570/37963 [83:51:47<80:45:59, 15.81s/it]
 52%|█████▏    | 19571/37963 [83:52:07<87:26:17, 17.11s/it]
 52%|█████▏    | 19572/37963 [83:52:21<83:12:47, 16.29s/it]
 52%|█████▏    | 19573/37963 [83:52:35<79:38:38, 15.59s/it]
 52%|█████▏    | 19574/37963 [83:52:50<77:52:15, 15.24s/it]
 52%|█████▏    | 19575/37963 [83:53:04<76:28:11, 14.97s/it]
 52%|█████▏    | 19576/37963 [83:53:19<75:30:45, 14.78s/it]
 52%|█████▏    | 19577/37963 [83:53:33<74:45:17, 14.64s/it]
 52%|█████▏    | 19578/37963 [83:53:47<74:11:42, 14.53s/it]
 52%|█████▏    | 19579/37963 [83:54:02<74:04:15, 14.50s/it]
 52%|█████▏    | 19580/37963 [83:54:23<85:27:20, 16.74s/it]
                                                           
{'loss': '0.1448', 'grad_norm': '3.921', 'learning_rate': '9.976e-06', 'epoch': '0.5158'}

 52%|█████▏    | 19580/37963 [83:54:23<85:27:20, 16.74s/it]
 52%|█████▏    | 19581/37963 [83:54:38<81:44:31, 16.01s/it]
 52%|█████▏    | 19582/37963 [83:54:52<78:52:10, 15.45s/it]
 52%|█████▏    | 19583/37963 [83:55:06<76:33:33, 15.00s/it]
 52%|█████▏    | 19584/37963 [83:55:20<75:06:44, 14.71s/it]
 52%|█████▏    | 19585/37963 [83:55:35<74:56:22, 14.68s/it]
 52%|█████▏    | 19586/37963 [83:55:49<74:21:32, 14.57s/it]
 52%|█████▏    | 19587/37963 [83:56:03<74:20:18, 14.56s/it]
 52%|█████▏    | 19588/37963 [83:56:18<74:14:26, 14.55s/it]
 52%|█████▏    | 19589/37963 [83:56:32<73:54:36, 14.48s/it]
 52%|█████▏    | 19590/37963 [83:56:53<83:37:20, 16.38s/it]
                                                           
{'loss': '0.1492', 'grad_norm': '1.578', 'learning_rate': '9.968e-06', 'epoch': '0.516'}

 52%|█████▏    | 19590/37963 [83:56:53<83:37:20, 16.38s/it]
 52%|█████▏    | 19591/37963 [83:57:07<80:11:08, 15.71s/it]
 52%|█████▏    | 19592/37963 [83:57:22<78:03:05, 15.30s/it]
 52%|█████▏    | 19593/37963 [83:57:36<76:10:25, 14.93s/it]
 52%|█████▏    | 19594/37963 [83:57:50<75:12:40, 14.74s/it]
 52%|█████▏    | 19595/37963 [83:58:17<93:43:26, 18.37s/it]
 52%|█████▏    | 19596/37963 [83:58:31<87:14:34, 17.10s/it]
 52%|█████▏    | 19597/37963 [83:58:45<83:03:46, 16.28s/it]
 52%|█████▏    | 19598/37963 [83:59:00<80:03:29, 15.69s/it]
 52%|█████▏    | 19599/37963 [83:59:13<77:20:35, 15.16s/it]
 52%|█████▏    | 19600/37963 [83:59:28<76:03:33, 14.91s/it]
                                                           
{'loss': '0.1486', 'grad_norm': '1.743', 'learning_rate': '9.959e-06', 'epoch': '0.5163'}

 52%|█████▏    | 19600/37963 [83:59:28<76:03:33, 14.91s/it]
 52%|█████▏    | 19601/37963 [83:59:42<75:12:35, 14.75s/it]
 52%|█████▏    | 19602/37963 [83:59:57<74:34:25, 14.62s/it]
 52%|█████▏    | 19603/37963 [84:00:11<74:20:31, 14.58s/it]
 52%|█████▏    | 19604/37963 [84:00:25<73:36:31, 14.43s/it]
 52%|█████▏    | 19605/37963 [84:00:39<72:34:28, 14.23s/it]
 52%|█████▏    | 19606/37963 [84:00:53<72:45:13, 14.27s/it]
 52%|█████▏    | 19607/37963 [84:01:07<71:40:09, 14.06s/it]
 52%|█████▏    | 19608/37963 [84:01:21<72:25:56, 14.21s/it]
 52%|█████▏    | 19609/37963 [84:01:36<72:39:03, 14.25s/it]
 52%|█████▏    | 19610/37963 [84:01:57<83:13:12, 16.32s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '2.91', 'learning_rate': '9.951e-06', 'epoch': '0.5166'}

 52%|█████▏    | 19610/37963 [84:01:57<83:13:12, 16.32s/it]
 52%|█████▏    | 19611/37963 [84:02:10<79:09:37, 15.53s/it]
 52%|█████▏    | 19612/37963 [84:02:25<77:06:58, 15.13s/it]
 52%|█████▏    | 19613/37963 [84:02:38<74:58:08, 14.71s/it]
 52%|█████▏    | 19614/37963 [84:02:52<73:32:10, 14.43s/it]
 52%|█████▏    | 19615/37963 [84:03:07<73:38:03, 14.45s/it]
 52%|█████▏    | 19616/37963 [84:03:28<83:28:34, 16.38s/it]
 52%|█████▏    | 19617/37963 [84:03:48<89:50:36, 17.63s/it]
 52%|█████▏    | 19618/37963 [84:04:02<84:34:34, 16.60s/it]
 52%|█████▏    | 19619/37963 [84:04:22<90:03:57, 17.68s/it]
 52%|█████▏    | 19620/37963 [84:04:37<85:09:31, 16.71s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '1.157', 'learning_rate': '9.942e-06', 'epoch': '0.5168'}

 52%|█████▏    | 19620/37963 [84:04:37<85:09:31, 16.71s/it]
 52%|█████▏    | 19621/37963 [84:04:51<81:22:50, 15.97s/it]
 52%|█████▏    | 19622/37963 [84:05:06<79:01:38, 15.51s/it]
 52%|█████▏    | 19623/37963 [84:05:20<77:13:38, 15.16s/it]
 52%|█████▏    | 19624/37963 [84:05:34<76:03:47, 14.93s/it]
 52%|█████▏    | 19625/37963 [84:05:49<75:08:04, 14.75s/it]
 52%|█████▏    | 19626/37963 [84:06:03<74:29:21, 14.62s/it]
 52%|█████▏    | 19627/37963 [84:06:17<74:05:50, 14.55s/it]
 52%|█████▏    | 19628/37963 [84:06:32<73:49:30, 14.50s/it]
 52%|█████▏    | 19629/37963 [84:06:53<84:01:30, 16.50s/it]
 52%|█████▏    | 19630/37963 [84:07:07<80:32:19, 15.82s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '1.904', 'learning_rate': '9.933e-06', 'epoch': '0.5171'}

 52%|█████▏    | 19630/37963 [84:07:07<80:32:19, 15.82s/it]
 52%|█████▏    | 19631/37963 [84:07:22<78:22:54, 15.39s/it]
 52%|█████▏    | 19632/37963 [84:07:36<76:53:22, 15.10s/it]
 52%|█████▏    | 19633/37963 [84:07:50<75:28:47, 14.82s/it]
 52%|█████▏    | 19634/37963 [84:08:05<74:46:52, 14.69s/it]
 52%|█████▏    | 19635/37963 [84:08:19<74:02:40, 14.54s/it]
 52%|█████▏    | 19636/37963 [84:08:33<73:48:31, 14.50s/it]
 52%|█████▏    | 19637/37963 [84:08:54<82:46:11, 16.26s/it]
 52%|█████▏    | 19638/37963 [84:09:08<80:05:45, 15.74s/it]
 52%|█████▏    | 19639/37963 [84:09:22<78:00:41, 15.33s/it]
 52%|█████▏    | 19640/37963 [84:09:37<76:21:38, 15.00s/it]
                                                           
{'loss': '0.138', 'grad_norm': '2.894', 'learning_rate': '9.925e-06', 'epoch': '0.5173'}

 52%|█████▏    | 19640/37963 [84:09:37<76:21:38, 15.00s/it]
 52%|█████▏    | 19641/37963 [84:09:51<75:25:20, 14.82s/it]
 52%|█████▏    | 19642/37963 [84:10:12<84:45:41, 16.66s/it]
 52%|█████▏    | 19643/37963 [84:10:26<81:23:55, 16.00s/it]
 52%|█████▏    | 19644/37963 [84:10:47<89:05:56, 17.51s/it]
 52%|█████▏    | 19645/37963 [84:11:01<83:07:46, 16.34s/it]
 52%|█████▏    | 19646/37963 [84:11:15<80:02:50, 15.73s/it]
 52%|█████▏    | 19647/37963 [84:11:30<77:53:56, 15.31s/it]
 52%|█████▏    | 19648/37963 [84:11:44<76:22:17, 15.01s/it]
 52%|█████▏    | 19649/37963 [84:11:58<74:52:10, 14.72s/it]
 52%|█████▏    | 19650/37963 [84:12:12<73:44:40, 14.50s/it]
                                                           
{'loss': '0.1435', 'grad_norm': '1.143', 'learning_rate': '9.916e-06', 'epoch': '0.5176'}

 52%|█████▏    | 19650/37963 [84:12:12<73:44:40, 14.50s/it]
 52%|█████▏    | 19651/37963 [84:12:26<73:30:29, 14.45s/it]
 52%|█████▏    | 19652/37963 [84:12:41<73:26:21, 14.44s/it]
 52%|█████▏    | 19653/37963 [84:12:55<73:14:35, 14.40s/it]
 52%|█████▏    | 19654/37963 [84:13:10<73:13:17, 14.40s/it]
 52%|█████▏    | 19655/37963 [84:13:24<73:22:46, 14.43s/it]
 52%|█████▏    | 19656/37963 [84:13:38<73:22:30, 14.43s/it]
 52%|█████▏    | 19657/37963 [84:13:59<82:46:53, 16.28s/it]
 52%|█████▏    | 19658/37963 [84:14:13<79:52:34, 15.71s/it]
 52%|█████▏    | 19659/37963 [84:14:28<77:44:32, 15.29s/it]
 52%|█████▏    | 19660/37963 [84:14:42<75:56:57, 14.94s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '3.067', 'learning_rate': '9.908e-06', 'epoch': '0.5179'}

 52%|█████▏    | 19660/37963 [84:14:42<75:56:57, 14.94s/it]
 52%|█████▏    | 19661/37963 [84:14:56<75:05:07, 14.77s/it]
 52%|█████▏    | 19662/37963 [84:15:10<74:09:11, 14.59s/it]
 52%|█████▏    | 19663/37963 [84:15:25<73:34:39, 14.47s/it]
 52%|█████▏    | 19664/37963 [84:15:39<73:23:03, 14.44s/it]
 52%|█████▏    | 19665/37963 [84:15:53<72:58:22, 14.36s/it]
 52%|█████▏    | 19666/37963 [84:16:14<83:01:51, 16.34s/it]
 52%|█████▏    | 19667/37963 [84:16:35<90:04:52, 17.72s/it]
 52%|█████▏    | 19668/37963 [84:16:50<85:09:01, 16.76s/it]
 52%|█████▏    | 19669/37963 [84:17:04<81:21:31, 16.01s/it]
 52%|█████▏    | 19670/37963 [84:17:18<78:53:53, 15.53s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '2.519', 'learning_rate': '9.899e-06', 'epoch': '0.5181'}

 52%|█████▏    | 19670/37963 [84:17:18<78:53:53, 15.53s/it]
 52%|█████▏    | 19671/37963 [84:17:33<77:15:23, 15.20s/it]
 52%|█████▏    | 19672/37963 [84:17:47<75:56:51, 14.95s/it]
 52%|█████▏    | 19673/37963 [84:18:01<74:58:12, 14.76s/it]
 52%|█████▏    | 19674/37963 [84:18:16<74:28:15, 14.66s/it]
 52%|█████▏    | 19675/37963 [84:18:30<73:42:34, 14.51s/it]
 52%|█████▏    | 19676/37963 [84:18:44<72:41:21, 14.31s/it]
 52%|█████▏    | 19677/37963 [84:19:04<82:25:26, 16.23s/it]
 52%|█████▏    | 19678/37963 [84:19:19<79:45:23, 15.70s/it]
 52%|█████▏    | 19679/37963 [84:19:33<77:16:09, 15.21s/it]
 52%|█████▏    | 19680/37963 [84:19:47<75:58:42, 14.96s/it]
                                                           
{'loss': '0.1325', 'grad_norm': '1.975', 'learning_rate': '9.891e-06', 'epoch': '0.5184'}

 52%|█████▏    | 19680/37963 [84:19:47<75:58:42, 14.96s/it]
 52%|█████▏    | 19681/37963 [84:20:01<74:29:12, 14.67s/it]
 52%|█████▏    | 19682/37963 [84:20:16<73:58:25, 14.57s/it]
 52%|█████▏    | 19683/37963 [84:20:30<73:39:44, 14.51s/it]
 52%|█████▏    | 19684/37963 [84:20:44<73:24:59, 14.46s/it]
 52%|█████▏    | 19685/37963 [84:20:59<73:17:32, 14.44s/it]
 52%|█████▏    | 19686/37963 [84:21:13<73:11:50, 14.42s/it]
 52%|█████▏    | 19687/37963 [84:21:34<82:50:38, 16.32s/it]
 52%|█████▏    | 19688/37963 [84:21:48<79:52:32, 15.73s/it]
 52%|█████▏    | 19689/37963 [84:22:02<77:25:17, 15.25s/it]
 52%|█████▏    | 19690/37963 [84:22:17<76:29:21, 15.07s/it]
                                                           
{'loss': '0.1331', 'grad_norm': '3.584', 'learning_rate': '9.882e-06', 'epoch': '0.5187'}

 52%|█████▏    | 19690/37963 [84:22:17<76:29:21, 15.07s/it]
 52%|█████▏    | 19691/37963 [84:22:31<75:14:53, 14.83s/it]
 52%|█████▏    | 19692/37963 [84:22:46<74:37:18, 14.70s/it]
 52%|█████▏    | 19693/37963 [84:23:13<93:45:47, 18.48s/it]
 52%|█████▏    | 19694/37963 [84:23:27<87:20:33, 17.21s/it]
 52%|█████▏    | 19695/37963 [84:23:42<82:58:23, 16.35s/it]
 52%|█████▏    | 19696/37963 [84:23:56<79:54:06, 15.75s/it]
 52%|█████▏    | 19697/37963 [84:24:10<77:46:32, 15.33s/it]
 52%|█████▏    | 19698/37963 [84:24:24<76:01:04, 14.98s/it]
 52%|█████▏    | 19699/37963 [84:24:39<75:07:03, 14.81s/it]
 52%|█████▏    | 19700/37963 [84:24:53<74:26:17, 14.67s/it]
                                                           
{'loss': '0.1351', 'grad_norm': '1.884', 'learning_rate': '9.874e-06', 'epoch': '0.5189'}

 52%|█████▏    | 19700/37963 [84:24:53<74:26:17, 14.67s/it]
 52%|█████▏    | 19701/37963 [84:25:07<73:32:49, 14.50s/it]
 52%|█████▏    | 19702/37963 [84:25:22<73:19:00, 14.45s/it]
 52%|█████▏    | 19703/37963 [84:25:36<73:07:13, 14.42s/it]
 52%|█████▏    | 19704/37963 [84:25:50<72:59:29, 14.39s/it]
 52%|█████▏    | 19705/37963 [84:26:05<72:56:56, 14.38s/it]
 52%|█████▏    | 19706/37963 [84:26:19<72:54:12, 14.38s/it]
 52%|█████▏    | 19707/37963 [84:26:40<83:14:53, 16.42s/it]
 52%|█████▏    | 19708/37963 [84:26:55<80:00:37, 15.78s/it]
 52%|█████▏    | 19709/37963 [84:27:09<77:48:33, 15.35s/it]
 52%|█████▏    | 19710/37963 [84:27:23<75:42:55, 14.93s/it]
                                                           
{'loss': '0.157', 'grad_norm': '2.921', 'learning_rate': '9.865e-06', 'epoch': '0.5192'}

 52%|█████▏    | 19710/37963 [84:27:23<75:42:55, 14.93s/it]
 52%|█████▏    | 19711/37963 [84:27:37<74:55:21, 14.78s/it]
 52%|█████▏    | 19712/37963 [84:27:51<74:05:15, 14.61s/it]
 52%|█████▏    | 19713/37963 [84:28:06<73:34:38, 14.51s/it]
 52%|█████▏    | 19714/37963 [84:28:20<73:31:59, 14.51s/it]
 52%|█████▏    | 19715/37963 [84:28:41<83:00:23, 16.38s/it]
 52%|█████▏    | 19716/37963 [84:29:02<90:00:43, 17.76s/it]
 52%|█████▏    | 19717/37963 [84:29:16<84:57:00, 16.76s/it]
 52%|█████▏    | 19718/37963 [84:29:37<90:52:30, 17.93s/it]
 52%|█████▏    | 19719/37963 [84:29:52<85:41:52, 16.91s/it]
 52%|█████▏    | 19720/37963 [84:30:06<81:50:41, 16.15s/it]
                                                           
{'loss': '0.1342', 'grad_norm': '3.709', 'learning_rate': '9.857e-06', 'epoch': '0.5195'}

 52%|█████▏    | 19720/37963 [84:30:06<81:50:41, 16.15s/it]
 52%|█████▏    | 19721/37963 [84:30:21<79:25:16, 15.67s/it]
 52%|█████▏    | 19722/37963 [84:30:35<77:25:50, 15.28s/it]
 52%|█████▏    | 19723/37963 [84:30:49<75:54:27, 14.98s/it]
 52%|█████▏    | 19724/37963 [84:31:04<75:00:52, 14.81s/it]
 52%|█████▏    | 19725/37963 [84:31:25<84:30:49, 16.68s/it]
 52%|█████▏    | 19726/37963 [84:31:39<80:54:20, 15.97s/it]
 52%|█████▏    | 19727/37963 [84:31:53<78:26:45, 15.49s/it]
 52%|█████▏    | 19728/37963 [84:32:08<76:46:59, 15.16s/it]
 52%|█████▏    | 19729/37963 [84:32:22<75:31:33, 14.91s/it]
 52%|█████▏    | 19730/37963 [84:32:36<74:39:20, 14.74s/it]
                                                           
{'loss': '0.1409', 'grad_norm': '1.923', 'learning_rate': '9.848e-06', 'epoch': '0.5197'}

 52%|█████▏    | 19730/37963 [84:32:36<74:39:20, 14.74s/it]
 52%|█████▏    | 19731/37963 [84:32:50<73:34:25, 14.53s/it]
 52%|█████▏    | 19732/37963 [84:33:05<73:17:20, 14.47s/it]
 52%|█████▏    | 19733/37963 [84:33:19<73:16:23, 14.47s/it]
 52%|█████▏    | 19734/37963 [84:33:33<72:53:57, 14.40s/it]
 52%|█████▏    | 19735/37963 [84:33:54<82:32:27, 16.30s/it]
 52%|█████▏    | 19736/37963 [84:34:08<78:37:38, 15.53s/it]
 52%|█████▏    | 19737/37963 [84:34:22<76:30:58, 15.11s/it]
 52%|█████▏    | 19738/37963 [84:34:36<75:23:03, 14.89s/it]
 52%|█████▏    | 19739/37963 [84:34:51<74:26:19, 14.70s/it]
 52%|█████▏    | 19740/37963 [84:35:05<73:24:15, 14.50s/it]
                                                           
{'loss': '0.1432', 'grad_norm': '3.183', 'learning_rate': '9.84e-06', 'epoch': '0.52'}

 52%|█████▏    | 19740/37963 [84:35:05<73:24:15, 14.50s/it]
 52%|█████▏    | 19741/37963 [84:35:32<93:12:27, 18.41s/it]
 52%|█████▏    | 19742/37963 [84:35:47<87:05:44, 17.21s/it]
 52%|█████▏    | 19743/37963 [84:36:01<82:32:21, 16.31s/it]
 52%|█████▏    | 19744/37963 [84:36:15<79:34:19, 15.72s/it]
 52%|█████▏    | 19745/37963 [84:36:30<77:25:35, 15.30s/it]
 52%|█████▏    | 19746/37963 [84:36:44<75:56:47, 15.01s/it]
 52%|█████▏    | 19747/37963 [84:36:58<74:34:01, 14.74s/it]
 52%|█████▏    | 19748/37963 [84:37:12<74:02:02, 14.63s/it]
 52%|█████▏    | 19749/37963 [84:37:27<73:30:52, 14.53s/it]
 52%|█████▏    | 19750/37963 [84:37:41<73:24:22, 14.51s/it]
                                                           
{'loss': '0.1582', 'grad_norm': '2.099', 'learning_rate': '9.831e-06', 'epoch': '0.5202'}

 52%|█████▏    | 19750/37963 [84:37:41<73:24:22, 14.51s/it]
 52%|█████▏    | 19751/37963 [84:37:56<73:16:59, 14.49s/it]
 52%|█████▏    | 19752/37963 [84:38:09<72:20:13, 14.30s/it]
 52%|█████▏    | 19753/37963 [84:38:24<72:33:55, 14.35s/it]
 52%|█████▏    | 19754/37963 [84:38:38<72:43:29, 14.38s/it]
 52%|█████▏    | 19755/37963 [84:38:59<81:56:22, 16.20s/it]
 52%|█████▏    | 19756/37963 [84:39:13<79:14:53, 15.67s/it]
 52%|█████▏    | 19757/37963 [84:39:27<77:09:52, 15.26s/it]
 52%|█████▏    | 19758/37963 [84:39:42<75:51:00, 15.00s/it]
 52%|█████▏    | 19759/37963 [84:39:56<74:40:05, 14.77s/it]
 52%|█████▏    | 19760/37963 [84:40:10<74:01:53, 14.64s/it]
                                                           
{'loss': '0.1309', 'grad_norm': '1.838', 'learning_rate': '9.823e-06', 'epoch': '0.5205'}

 52%|█████▏    | 19760/37963 [84:40:10<74:01:53, 14.64s/it]
 52%|█████▏    | 19761/37963 [84:40:25<73:32:17, 14.54s/it]
 52%|█████▏    | 19762/37963 [84:40:46<82:57:24, 16.41s/it]
 52%|█████▏    | 19763/37963 [84:41:00<79:52:59, 15.80s/it]
 52%|█████▏    | 19764/37963 [84:41:20<86:36:43, 17.13s/it]
 52%|█████▏    | 19765/37963 [84:41:35<82:43:35, 16.37s/it]
 52%|█████▏    | 19766/37963 [84:41:49<79:59:12, 15.82s/it]
 52%|█████▏    | 19767/37963 [84:42:10<86:46:16, 17.17s/it]
 52%|█████▏    | 19768/37963 [84:42:24<82:34:09, 16.34s/it]
 52%|█████▏    | 19769/37963 [84:42:38<78:48:14, 15.59s/it]
 52%|█████▏    | 19770/37963 [84:42:52<76:59:06, 15.23s/it]
                                                           
{'loss': '0.1278', 'grad_norm': '4.315', 'learning_rate': '9.814e-06', 'epoch': '0.5208'}

 52%|█████▏    | 19770/37963 [84:42:52<76:59:06, 15.23s/it]
 52%|█████▏    | 19771/37963 [84:43:06<74:54:00, 14.82s/it]
 52%|█████▏    | 19772/37963 [84:43:20<73:32:45, 14.55s/it]
 52%|█████▏    | 19773/37963 [84:43:41<83:14:24, 16.47s/it]
 52%|█████▏    | 19774/37963 [84:43:55<80:12:43, 15.88s/it]
 52%|█████▏    | 19775/37963 [84:44:10<77:37:08, 15.36s/it]
 52%|█████▏    | 19776/37963 [84:44:24<75:58:16, 15.04s/it]
 52%|█████▏    | 19777/37963 [84:44:38<74:52:23, 14.82s/it]
 52%|█████▏    | 19778/37963 [84:44:52<73:53:25, 14.63s/it]
 52%|█████▏    | 19779/37963 [84:45:07<73:18:41, 14.51s/it]
 52%|█████▏    | 19780/37963 [84:45:21<73:04:41, 14.47s/it]
                                                           
{'loss': '0.1358', 'grad_norm': '1.296', 'learning_rate': '9.805e-06', 'epoch': '0.521'}

 52%|█████▏    | 19780/37963 [84:45:21<73:04:41, 14.47s/it]
 52%|█████▏    | 19781/37963 [84:45:35<72:51:59, 14.43s/it]
 52%|█████▏    | 19782/37963 [84:45:50<72:38:55, 14.39s/it]
 52%|█████▏    | 19783/37963 [84:46:04<72:31:39, 14.36s/it]
 52%|█████▏    | 19784/37963 [84:46:24<81:32:58, 16.15s/it]
 52%|█████▏    | 19785/37963 [84:46:38<78:11:29, 15.49s/it]
 52%|█████▏    | 19786/37963 [84:46:53<76:34:37, 15.17s/it]
 52%|█████▏    | 19787/37963 [84:47:07<75:26:38, 14.94s/it]
 52%|█████▏    | 19788/37963 [84:47:21<74:36:32, 14.78s/it]
 52%|█████▏    | 19789/37963 [84:47:35<72:58:07, 14.45s/it]
 52%|█████▏    | 19790/37963 [84:47:55<81:31:16, 16.15s/it]
                                                           
{'loss': '0.1271', 'grad_norm': '0.9617', 'learning_rate': '9.797e-06', 'epoch': '0.5213'}

 52%|█████▏    | 19790/37963 [84:47:55<81:31:16, 16.15s/it]
 52%|█████▏    | 19791/37963 [84:48:15<87:26:30, 17.32s/it]
 52%|█████▏    | 19792/37963 [84:48:29<82:06:10, 16.27s/it]
 52%|█████▏    | 19793/37963 [84:48:44<79:20:20, 15.72s/it]
 52%|█████▏    | 19794/37963 [84:48:58<77:03:49, 15.27s/it]
 52%|█████▏    | 19795/37963 [84:49:12<75:08:07, 14.89s/it]
 52%|█████▏    | 19796/37963 [84:49:26<74:13:35, 14.71s/it]
 52%|█████▏    | 19797/37963 [84:49:40<73:38:05, 14.59s/it]
 52%|█████▏    | 19798/37963 [84:49:55<73:18:36, 14.53s/it]
 52%|█████▏    | 19799/37963 [84:50:09<72:55:30, 14.45s/it]
 52%|█████▏    | 19800/37963 [84:50:23<72:44:28, 14.42s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '1.632', 'learning_rate': '9.788e-06', 'epoch': '0.5216'}

 52%|█████▏    | 19800/37963 [84:50:23<72:44:28, 14.42s/it]
 52%|█████▏    | 19801/37963 [84:50:37<71:38:44, 14.20s/it]
 52%|█████▏    | 19802/37963 [84:50:52<72:05:04, 14.29s/it]
 52%|█████▏    | 19803/37963 [84:51:06<72:16:49, 14.33s/it]
 52%|█████▏    | 19804/37963 [84:51:27<82:10:19, 16.29s/it]
 52%|█████▏    | 19805/37963 [84:51:41<79:09:34, 15.69s/it]
 52%|█████▏    | 19806/37963 [84:51:55<76:47:42, 15.23s/it]
 52%|█████▏    | 19807/37963 [84:52:09<74:55:00, 14.85s/it]
 52%|█████▏    | 19808/37963 [84:52:24<74:20:57, 14.74s/it]
 52%|█████▏    | 19809/37963 [84:52:38<73:54:13, 14.66s/it]
 52%|█████▏    | 19810/37963 [84:52:53<73:28:56, 14.57s/it]
                                                           
{'loss': '0.1331', 'grad_norm': '3.085', 'learning_rate': '9.78e-06', 'epoch': '0.5218'}

 52%|█████▏    | 19810/37963 [84:52:53<73:28:56, 14.57s/it]
 52%|█████▏    | 19811/37963 [84:53:07<73:06:30, 14.50s/it]
 52%|█████▏    | 19812/37963 [84:53:21<73:01:50, 14.48s/it]
 52%|█████▏    | 19813/37963 [84:53:36<72:52:29, 14.45s/it]
 52%|█████▏    | 19814/37963 [84:54:09<101:39:07, 20.16s/it]
 52%|█████▏    | 19815/37963 [84:54:24<92:51:28, 18.42s/it] 
 52%|█████▏    | 19816/37963 [84:54:38<86:50:06, 17.23s/it]
 52%|█████▏    | 19817/37963 [84:54:52<81:54:36, 16.25s/it]
 52%|█████▏    | 19818/37963 [84:55:06<78:27:43, 15.57s/it]
 52%|█████▏    | 19819/37963 [84:55:20<76:48:08, 15.24s/it]
 52%|█████▏    | 19820/37963 [84:55:35<75:38:14, 15.01s/it]
                                                           
{'loss': '0.1308', 'grad_norm': '2.04', 'learning_rate': '9.771e-06', 'epoch': '0.5221'}

 52%|█████▏    | 19820/37963 [84:55:35<75:38:14, 15.01s/it]
 52%|█████▏    | 19821/37963 [84:55:49<74:46:50, 14.84s/it]
 52%|█████▏    | 19822/37963 [84:56:11<84:28:18, 16.76s/it]
 52%|█████▏    | 19823/37963 [84:56:25<80:51:26, 16.05s/it]
 52%|█████▏    | 19824/37963 [84:56:39<78:19:52, 15.55s/it]
 52%|█████▏    | 19825/37963 [84:56:54<76:30:24, 15.18s/it]
 52%|█████▏    | 19826/37963 [84:57:08<75:23:07, 14.96s/it]
 52%|█████▏    | 19827/37963 [84:57:22<74:05:42, 14.71s/it]
 52%|█████▏    | 19828/37963 [84:57:37<73:33:28, 14.60s/it]
 52%|█████▏    | 19829/37963 [84:57:51<73:04:53, 14.51s/it]
 52%|█████▏    | 19830/37963 [84:58:05<72:02:30, 14.30s/it]
                                                           
{'loss': '0.151', 'grad_norm': '1.782', 'learning_rate': '9.763e-06', 'epoch': '0.5224'}

 52%|█████▏    | 19830/37963 [84:58:05<72:02:30, 14.30s/it]
 52%|█████▏    | 19831/37963 [84:58:19<72:09:41, 14.33s/it]
 52%|█████▏    | 19832/37963 [84:58:33<71:41:46, 14.24s/it]
 52%|█████▏    | 19833/37963 [84:58:54<82:05:24, 16.30s/it]
 52%|█████▏    | 19834/37963 [84:59:09<79:12:31, 15.73s/it]
 52%|█████▏    | 19835/37963 [84:59:23<76:36:14, 15.21s/it]
 52%|█████▏    | 19836/37963 [84:59:37<74:54:33, 14.88s/it]
 52%|█████▏    | 19837/37963 [84:59:51<74:13:11, 14.74s/it]
 52%|█████▏    | 19838/37963 [85:00:06<73:42:52, 14.64s/it]
 52%|█████▏    | 19839/37963 [85:00:33<93:29:19, 18.57s/it]
 52%|█████▏    | 19840/37963 [85:00:47<85:57:27, 17.07s/it]
                                                           
{'loss': '0.1385', 'grad_norm': '3.894', 'learning_rate': '9.754e-06', 'epoch': '0.5226'}

 52%|█████▏    | 19840/37963 [85:00:47<85:57:27, 17.07s/it]
 52%|█████▏    | 19841/37963 [85:01:01<82:03:05, 16.30s/it]
 52%|█████▏    | 19842/37963 [85:01:16<78:57:57, 15.69s/it]
 52%|█████▏    | 19843/37963 [85:01:30<76:31:08, 15.20s/it]
 52%|█████▏    | 19844/37963 [85:01:44<75:03:01, 14.91s/it]
 52%|█████▏    | 19845/37963 [85:01:58<74:13:24, 14.75s/it]
 52%|█████▏    | 19846/37963 [85:02:13<73:49:50, 14.67s/it]
 52%|█████▏    | 19847/37963 [85:02:27<73:24:02, 14.59s/it]
 52%|█████▏    | 19848/37963 [85:02:42<73:07:37, 14.53s/it]
 52%|█████▏    | 19849/37963 [85:02:56<72:47:14, 14.47s/it]
 52%|█████▏    | 19850/37963 [85:03:10<71:46:35, 14.27s/it]
                                                           
{'loss': '0.1369', 'grad_norm': '0.9732', 'learning_rate': '9.746e-06', 'epoch': '0.5229'}

 52%|█████▏    | 19850/37963 [85:03:10<71:46:35, 14.27s/it]
 52%|█████▏    | 19851/37963 [85:03:24<71:13:43, 14.16s/it]
 52%|█████▏    | 19852/37963 [85:03:37<70:42:22, 14.05s/it]
 52%|█████▏    | 19853/37963 [85:03:59<81:16:45, 16.16s/it]
 52%|█████▏    | 19854/37963 [85:04:13<78:05:02, 15.52s/it]
 52%|█████▏    | 19855/37963 [85:04:27<76:10:56, 15.15s/it]
 52%|█████▏    | 19856/37963 [85:04:41<74:55:31, 14.90s/it]
 52%|█████▏    | 19857/37963 [85:04:56<74:16:29, 14.77s/it]
 52%|█████▏    | 19858/37963 [85:05:10<73:50:43, 14.68s/it]
 52%|█████▏    | 19859/37963 [85:05:25<73:35:15, 14.63s/it]
 52%|█████▏    | 19860/37963 [85:05:39<72:53:40, 14.50s/it]
                                                           
{'loss': '0.1366', 'grad_norm': '1.09', 'learning_rate': '9.737e-06', 'epoch': '0.5231'}

 52%|█████▏    | 19860/37963 [85:05:39<72:53:40, 14.50s/it]
 52%|█████▏    | 19861/37963 [85:06:00<82:17:29, 16.37s/it]
 52%|█████▏    | 19862/37963 [85:06:14<78:58:41, 15.71s/it]
 52%|█████▏    | 19863/37963 [85:06:34<86:32:40, 17.21s/it]
 52%|█████▏    | 19864/37963 [85:06:55<91:08:37, 18.13s/it]
 52%|█████▏    | 19865/37963 [85:07:09<85:48:43, 17.07s/it]
 52%|█████▏    | 19866/37963 [85:07:24<81:44:51, 16.26s/it]
 52%|█████▏    | 19867/37963 [85:07:38<79:00:58, 15.72s/it]
 52%|█████▏    | 19868/37963 [85:07:53<77:03:29, 15.33s/it]
 52%|█████▏    | 19869/37963 [85:08:07<75:36:34, 15.04s/it]
 52%|█████▏    | 19870/37963 [85:08:28<84:26:10, 16.80s/it]
                                                           
{'loss': '0.1416', 'grad_norm': '1.629', 'learning_rate': '9.729e-06', 'epoch': '0.5234'}

 52%|█████▏    | 19870/37963 [85:08:28<84:26:10, 16.80s/it]
 52%|█████▏    | 19871/37963 [85:08:42<80:53:14, 16.10s/it]
 52%|█████▏    | 19872/37963 [85:08:56<77:48:30, 15.48s/it]
 52%|█████▏    | 19873/37963 [85:09:11<75:57:49, 15.12s/it]
 52%|█████▏    | 19874/37963 [85:09:25<74:56:54, 14.92s/it]
 52%|█████▏    | 19875/37963 [85:09:39<73:36:28, 14.65s/it]
 52%|█████▏    | 19876/37963 [85:09:53<72:40:06, 14.46s/it]
 52%|█████▏    | 19877/37963 [85:10:07<72:02:18, 14.34s/it]
 52%|█████▏    | 19878/37963 [85:10:21<71:59:59, 14.33s/it]
 52%|█████▏    | 19879/37963 [85:10:36<72:00:17, 14.33s/it]
 52%|█████▏    | 19880/37963 [85:10:50<71:58:45, 14.33s/it]
                                                           
{'loss': '0.1458', 'grad_norm': '2.358', 'learning_rate': '9.72e-06', 'epoch': '0.5237'}

 52%|█████▏    | 19880/37963 [85:10:50<71:58:45, 14.33s/it]
 52%|█████▏    | 19881/37963 [85:11:11<82:05:18, 16.34s/it]
 52%|█████▏    | 19882/37963 [85:11:25<78:56:07, 15.72s/it]
 52%|█████▏    | 19883/37963 [85:11:40<76:49:50, 15.30s/it]
 52%|█████▏    | 19884/37963 [85:11:54<75:33:28, 15.05s/it]
 52%|█████▏    | 19885/37963 [85:12:09<74:33:18, 14.85s/it]
 52%|█████▏    | 19886/37963 [85:12:29<83:17:19, 16.59s/it]
 52%|█████▏    | 19887/37963 [85:12:44<79:55:29, 15.92s/it]
 52%|█████▏    | 19888/37963 [85:12:58<77:32:14, 15.44s/it]
 52%|█████▏    | 19889/37963 [85:13:19<86:09:18, 17.16s/it]
 52%|█████▏    | 19890/37963 [85:13:33<81:53:31, 16.31s/it]
                                                           
{'loss': '0.1362', 'grad_norm': '1.713', 'learning_rate': '9.712e-06', 'epoch': '0.5239'}

 52%|█████▏    | 19890/37963 [85:13:33<81:53:31, 16.31s/it]
 52%|█████▏    | 19891/37963 [85:13:48<78:58:56, 15.73s/it]
 52%|█████▏    | 19892/37963 [85:14:02<76:55:35, 15.32s/it]
 52%|█████▏    | 19893/37963 [85:14:17<75:43:32, 15.09s/it]
 52%|█████▏    | 19894/37963 [85:14:31<74:45:12, 14.89s/it]
 52%|█████▏    | 19895/37963 [85:14:46<74:08:37, 14.77s/it]
 52%|█████▏    | 19896/37963 [85:15:00<73:34:18, 14.66s/it]
 52%|█████▏    | 19897/37963 [85:15:14<73:11:29, 14.58s/it]
 52%|█████▏    | 19898/37963 [85:15:29<73:09:42, 14.58s/it]
 52%|█████▏    | 19899/37963 [85:15:43<72:36:37, 14.47s/it]
 52%|█████▏    | 19900/37963 [85:15:57<71:34:13, 14.26s/it]
                                                           
{'loss': '0.1428', 'grad_norm': '2.05', 'learning_rate': '9.703e-06', 'epoch': '0.5242'}

 52%|█████▏    | 19900/37963 [85:15:57<71:34:13, 14.26s/it]
 52%|█████▏    | 19901/37963 [85:16:11<71:13:16, 14.20s/it]
 52%|█████▏    | 19902/37963 [85:16:26<71:51:36, 14.32s/it]
 52%|█████▏    | 19903/37963 [85:16:47<82:25:44, 16.43s/it]
 52%|█████▏    | 19904/37963 [85:17:01<79:10:32, 15.78s/it]
 52%|█████▏    | 19905/37963 [85:17:16<77:05:52, 15.37s/it]
 52%|█████▏    | 19906/37963 [85:17:29<74:20:03, 14.82s/it]
 52%|█████▏    | 19907/37963 [85:17:44<73:44:18, 14.70s/it]
 52%|█████▏    | 19908/37963 [85:17:58<72:44:31, 14.50s/it]
 52%|█████▏    | 19909/37963 [85:18:18<82:13:49, 16.40s/it]
 52%|█████▏    | 19910/37963 [85:18:32<78:35:41, 15.67s/it]
                                                           
{'loss': '0.1477', 'grad_norm': '1.516', 'learning_rate': '9.695e-06', 'epoch': '0.5245'}

 52%|█████▏    | 19910/37963 [85:18:32<78:35:41, 15.67s/it]
 52%|█████▏    | 19911/37963 [85:18:47<76:37:52, 15.28s/it]
 52%|█████▏    | 19912/37963 [85:19:01<75:22:05, 15.03s/it]
 52%|█████▏    | 19913/37963 [85:19:16<74:10:10, 14.79s/it]
 52%|█████▏    | 19914/37963 [85:19:36<83:07:43, 16.58s/it]
 52%|█████▏    | 19915/37963 [85:19:51<80:01:27, 15.96s/it]
 52%|█████▏    | 19916/37963 [85:20:12<87:28:13, 17.45s/it]
 52%|█████▏    | 19917/37963 [85:20:26<83:12:05, 16.60s/it]
 52%|█████▏    | 19918/37963 [85:20:41<79:53:27, 15.94s/it]
 52%|█████▏    | 19919/37963 [85:21:02<87:46:19, 17.51s/it]
 52%|█████▏    | 19920/37963 [85:21:16<83:01:05, 16.56s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '2.096', 'learning_rate': '9.686e-06', 'epoch': '0.5247'}

 52%|█████▏    | 19920/37963 [85:21:16<83:01:05, 16.56s/it]
 52%|█████▏    | 19921/37963 [85:21:30<78:22:59, 15.64s/it]
 52%|█████▏    | 19922/37963 [85:21:44<76:26:33, 15.25s/it]
 52%|█████▏    | 19923/37963 [85:21:58<75:07:26, 14.99s/it]
 52%|█████▏    | 19924/37963 [85:22:13<74:08:30, 14.80s/it]
 52%|█████▏    | 19925/37963 [85:22:27<73:22:36, 14.64s/it]
 52%|█████▏    | 19926/37963 [85:22:41<72:53:56, 14.55s/it]
 52%|█████▏    | 19927/37963 [85:23:02<81:49:42, 16.33s/it]
 52%|█████▏    | 19928/37963 [85:23:16<78:53:36, 15.75s/it]
 52%|█████▏    | 19929/37963 [85:23:31<76:44:26, 15.32s/it]
 52%|█████▏    | 19930/37963 [85:23:45<75:18:25, 15.03s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '2.426', 'learning_rate': '9.678e-06', 'epoch': '0.525'}

 52%|█████▏    | 19930/37963 [85:23:45<75:18:25, 15.03s/it]
 53%|█████▎    | 19931/37963 [85:23:59<74:17:45, 14.83s/it]
 53%|█████▎    | 19932/37963 [85:24:14<73:31:28, 14.68s/it]
 53%|█████▎    | 19933/37963 [85:24:28<73:07:17, 14.60s/it]
 53%|█████▎    | 19934/37963 [85:24:43<72:55:09, 14.56s/it]
 53%|█████▎    | 19935/37963 [85:25:03<81:55:03, 16.36s/it]
 53%|█████▎    | 19936/37963 [85:25:17<78:46:17, 15.73s/it]
 53%|█████▎    | 19937/37963 [85:25:39<88:20:43, 17.64s/it]
 53%|█████▎    | 19938/37963 [85:25:54<83:26:29, 16.67s/it]
 53%|█████▎    | 19939/37963 [85:26:08<79:57:41, 15.97s/it]
 53%|█████▎    | 19940/37963 [85:26:23<77:30:49, 15.48s/it]
                                                           
{'loss': '0.1448', 'grad_norm': '3.255', 'learning_rate': '9.669e-06', 'epoch': '0.5252'}

 53%|█████▎    | 19940/37963 [85:26:23<77:30:49, 15.48s/it]
 53%|█████▎    | 19941/37963 [85:26:37<75:49:28, 15.15s/it]
 53%|█████▎    | 19942/37963 [85:26:51<74:43:27, 14.93s/it]
 53%|█████▎    | 19943/37963 [85:27:05<73:26:46, 14.67s/it]
 53%|█████▎    | 19944/37963 [85:27:20<72:53:50, 14.56s/it]
 53%|█████▎    | 19945/37963 [85:27:33<71:29:53, 14.29s/it]
 53%|█████▎    | 19946/37963 [85:27:48<71:26:25, 14.27s/it]
 53%|█████▎    | 19947/37963 [85:28:02<70:58:56, 14.18s/it]
 53%|█████▎    | 19948/37963 [85:28:16<71:14:15, 14.24s/it]
 53%|█████▎    | 19949/37963 [85:28:31<72:01:17, 14.39s/it]
 53%|█████▎    | 19950/37963 [85:28:52<81:48:23, 16.35s/it]
                                                           
{'loss': '0.1536', 'grad_norm': '2.06', 'learning_rate': '9.661e-06', 'epoch': '0.5255'}

 53%|█████▎    | 19950/37963 [85:28:52<81:48:23, 16.35s/it]
 53%|█████▎    | 19951/37963 [85:29:06<79:00:11, 15.79s/it]
 53%|█████▎    | 19952/37963 [85:29:21<77:06:55, 15.41s/it]
 53%|█████▎    | 19953/37963 [85:29:35<75:19:29, 15.06s/it]
 53%|█████▎    | 19954/37963 [85:29:49<74:28:02, 14.89s/it]
 53%|█████▎    | 19955/37963 [85:30:04<73:46:11, 14.75s/it]
 53%|█████▎    | 19956/37963 [85:30:18<72:35:07, 14.51s/it]
 53%|█████▎    | 19957/37963 [85:30:32<72:30:57, 14.50s/it]
 53%|█████▎    | 19958/37963 [85:30:53<81:35:56, 16.32s/it]
 53%|█████▎    | 19959/37963 [85:31:07<78:40:54, 15.73s/it]
 53%|█████▎    | 19960/37963 [85:31:21<76:35:44, 15.32s/it]
                                                           
{'loss': '0.1335', 'grad_norm': '1.707', 'learning_rate': '9.652e-06', 'epoch': '0.5258'}

 53%|█████▎    | 19960/37963 [85:31:21<76:35:44, 15.32s/it]
 53%|█████▎    | 19961/37963 [85:31:36<75:06:28, 15.02s/it]
 53%|█████▎    | 19962/37963 [85:31:57<84:02:44, 16.81s/it]
 53%|█████▎    | 19963/37963 [85:32:18<89:57:18, 17.99s/it]
 53%|█████▎    | 19964/37963 [85:32:32<84:07:22, 16.83s/it]
 53%|█████▎    | 19965/37963 [85:32:46<80:22:01, 16.08s/it]
 53%|█████▎    | 19966/37963 [85:33:00<77:40:36, 15.54s/it]
 53%|█████▎    | 19967/37963 [85:33:21<85:34:18, 17.12s/it]
 53%|█████▎    | 19968/37963 [85:33:36<81:34:40, 16.32s/it]
 53%|█████▎    | 19969/37963 [85:33:50<79:00:11, 15.81s/it]
 53%|█████▎    | 19970/37963 [85:34:04<76:28:50, 15.30s/it]
                                                           
{'loss': '0.1397', 'grad_norm': '5.527', 'learning_rate': '9.643e-06', 'epoch': '0.526'}

 53%|█████▎    | 19970/37963 [85:34:04<76:28:50, 15.30s/it]
 53%|█████▎    | 19971/37963 [85:34:19<75:06:07, 15.03s/it]
 53%|█████▎    | 19972/37963 [85:34:33<74:08:20, 14.84s/it]
 53%|█████▎    | 19973/37963 [85:34:47<73:19:47, 14.67s/it]
 53%|█████▎    | 19974/37963 [85:35:07<81:19:05, 16.27s/it]
 53%|█████▎    | 19975/37963 [85:35:22<78:25:17, 15.69s/it]
 53%|█████▎    | 19976/37963 [85:35:36<76:23:09, 15.29s/it]
 53%|█████▎    | 19977/37963 [85:35:50<74:59:33, 15.01s/it]
 53%|█████▎    | 19978/37963 [85:36:05<73:59:13, 14.81s/it]
 53%|█████▎    | 19979/37963 [85:36:19<73:13:07, 14.66s/it]
 53%|█████▎    | 19980/37963 [85:36:33<72:40:34, 14.55s/it]
                                                           
{'loss': '0.157', 'grad_norm': '4.369', 'learning_rate': '9.635e-06', 'epoch': '0.5263'}

 53%|█████▎    | 19980/37963 [85:36:33<72:40:34, 14.55s/it]
 53%|█████▎    | 19981/37963 [85:36:48<72:19:59, 14.48s/it]
 53%|█████▎    | 19982/37963 [85:37:02<72:05:37, 14.43s/it]
 53%|█████▎    | 19983/37963 [85:37:16<72:13:08, 14.46s/it]
 53%|█████▎    | 19984/37963 [85:37:37<81:54:03, 16.40s/it]
 53%|█████▎    | 19985/37963 [85:37:52<78:27:05, 15.71s/it]
 53%|█████▎    | 19986/37963 [85:38:13<86:36:37, 17.34s/it]
 53%|█████▎    | 19987/37963 [85:38:27<82:11:56, 16.46s/it]
 53%|█████▎    | 19988/37963 [85:38:41<78:33:46, 15.73s/it]
 53%|█████▎    | 19989/37963 [85:38:56<76:36:34, 15.34s/it]
 53%|█████▎    | 19990/37963 [85:39:10<75:14:18, 15.07s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '1.799', 'learning_rate': '9.626e-06', 'epoch': '0.5266'}

 53%|█████▎    | 19990/37963 [85:39:10<75:14:18, 15.07s/it]
 53%|█████▎    | 19991/37963 [85:39:24<74:08:18, 14.85s/it]
 53%|█████▎    | 19992/37963 [85:39:38<72:53:47, 14.60s/it]
 53%|█████▎    | 19993/37963 [85:39:53<72:39:35, 14.56s/it]
 53%|█████▎    | 19994/37963 [85:40:07<71:25:53, 14.31s/it]
 53%|█████▎    | 19995/37963 [85:40:20<70:37:02, 14.15s/it]
 53%|█████▎    | 19996/37963 [85:40:34<70:17:13, 14.08s/it]
 53%|█████▎    | 19997/37963 [85:40:49<70:40:39, 14.16s/it]
 53%|█████▎    | 19998/37963 [85:41:03<70:19:57, 14.09s/it]
 53%|█████▎    | 19999/37963 [85:41:17<70:45:11, 14.18s/it]
 53%|█████▎    | 20000/37963 [85:41:31<71:03:37, 14.24s/it]
                                                           
{'loss': '0.1303', 'grad_norm': '3.536', 'learning_rate': '9.618e-06', 'epoch': '0.5268'}

 53%|█████▎    | 20000/37963 [85:41:31<71:03:37, 14.24s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:13<00:00, 13.99s/it]
Writing model shards: 100%|██████████| 1/1 [00:13<00:00, 13.99s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 53%|█████▎    | 20001/37963 [85:43:17<208:17:12, 41.75s/it]
 53%|█████▎    | 20002/37963 [85:43:38<176:27:54, 35.37s/it]
 53%|█████▎    | 20003/37963 [85:43:52<144:52:37, 29.04s/it]
 53%|█████▎    | 20004/37963 [85:44:06<122:10:32, 24.49s/it]
 53%|█████▎    | 20005/37963 [85:44:20<106:24:06, 21.33s/it]
 53%|█████▎    | 20006/37963 [85:44:34<96:01:24, 19.25s/it] 
 53%|█████▎    | 20007/37963 [85:44:49<89:00:35, 17.85s/it]
 53%|█████▎    | 20008/37963 [85:45:09<92:55:05, 18.63s/it]
 53%|█████▎    | 20009/37963 [85:45:23<86:24:35, 17.33s/it]
 53%|█████▎    | 20010/37963 [85:45:37<81:10:37, 16.28s/it]
                                                           
{'loss': '0.1368', 'grad_norm': '3.421', 'learning_rate': '9.609e-06', 'epoch': '0.5271'}

 53%|█████▎    | 20010/37963 [85:45:37<81:10:37, 16.28s/it]
 53%|█████▎    | 20011/37963 [85:45:52<78:17:41, 15.70s/it]
 53%|█████▎    | 20012/37963 [85:46:20<96:51:56, 19.43s/it]
 53%|█████▎    | 20013/37963 [85:46:34<89:25:57, 17.94s/it]
 53%|█████▎    | 20014/37963 [85:46:49<84:02:51, 16.86s/it]
 53%|█████▎    | 20015/37963 [85:47:03<80:22:46, 16.12s/it]
 53%|█████▎    | 20016/37963 [85:47:17<77:28:10, 15.54s/it]
 53%|█████▎    | 20017/37963 [85:47:38<86:04:37, 17.27s/it]
 53%|█████▎    | 20018/37963 [85:47:52<81:10:16, 16.28s/it]
 53%|█████▎    | 20019/37963 [85:48:07<77:54:45, 15.63s/it]
 53%|█████▎    | 20020/37963 [85:48:21<75:37:52, 15.17s/it]
                                                           
{'loss': '0.1439', 'grad_norm': '3.01', 'learning_rate': '9.601e-06', 'epoch': '0.5274'}

 53%|█████▎    | 20020/37963 [85:48:21<75:37:52, 15.17s/it]
 53%|█████▎    | 20021/37963 [85:48:35<74:24:36, 14.93s/it]
 53%|█████▎    | 20022/37963 [85:48:49<73:26:31, 14.74s/it]
 53%|█████▎    | 20023/37963 [85:49:10<82:56:15, 16.64s/it]
 53%|█████▎    | 20024/37963 [85:49:25<79:17:25, 15.91s/it]
 53%|█████▎    | 20025/37963 [85:49:39<77:03:15, 15.46s/it]
 53%|█████▎    | 20026/37963 [85:49:53<74:28:29, 14.95s/it]
 53%|█████▎    | 20027/37963 [85:50:07<73:19:02, 14.72s/it]
 53%|█████▎    | 20028/37963 [85:50:21<72:57:26, 14.64s/it]
 53%|█████▎    | 20029/37963 [85:50:36<72:34:25, 14.57s/it]
 53%|█████▎    | 20030/37963 [85:50:50<71:28:04, 14.35s/it]
                                                           
{'loss': '0.1259', 'grad_norm': '2.738', 'learning_rate': '9.592e-06', 'epoch': '0.5276'}

 53%|█████▎    | 20030/37963 [85:50:50<71:28:04, 14.35s/it]
 53%|█████▎    | 20031/37963 [85:51:04<71:16:33, 14.31s/it]
 53%|█████▎    | 20032/37963 [85:51:18<71:33:24, 14.37s/it]
 53%|█████▎    | 20033/37963 [85:51:32<71:08:55, 14.29s/it]
 53%|█████▎    | 20034/37963 [85:51:54<82:23:17, 16.54s/it]
 53%|█████▎    | 20035/37963 [85:52:15<88:38:48, 17.80s/it]
 53%|█████▎    | 20036/37963 [85:52:29<83:26:25, 16.76s/it]
 53%|█████▎    | 20037/37963 [85:52:44<80:03:02, 16.08s/it]
 53%|█████▎    | 20038/37963 [85:52:58<77:39:44, 15.60s/it]
 53%|█████▎    | 20039/37963 [85:53:13<76:12:28, 15.31s/it]
 53%|█████▎    | 20040/37963 [85:53:27<74:41:22, 15.00s/it]
                                                           
{'loss': '0.1525', 'grad_norm': '6.493', 'learning_rate': '9.584e-06', 'epoch': '0.5279'}

 53%|█████▎    | 20040/37963 [85:53:27<74:41:22, 15.00s/it]
 53%|█████▎    | 20041/37963 [85:53:41<73:14:45, 14.71s/it]
 53%|█████▎    | 20042/37963 [85:53:55<72:04:54, 14.48s/it]
 53%|█████▎    | 20043/37963 [85:54:09<71:46:06, 14.42s/it]
 53%|█████▎    | 20044/37963 [85:54:24<71:40:54, 14.40s/it]
 53%|█████▎    | 20045/37963 [85:54:38<71:04:49, 14.28s/it]
 53%|█████▎    | 20046/37963 [85:54:52<70:37:13, 14.19s/it]
 53%|█████▎    | 20047/37963 [85:55:06<70:22:36, 14.14s/it]
 53%|█████▎    | 20048/37963 [85:55:20<71:01:44, 14.27s/it]
 53%|█████▎    | 20049/37963 [85:55:35<71:07:16, 14.29s/it]
 53%|█████▎    | 20050/37963 [85:55:55<80:33:50, 16.19s/it]
                                                           
{'loss': '0.1465', 'grad_norm': '2.103', 'learning_rate': '9.575e-06', 'epoch': '0.5281'}

 53%|█████▎    | 20050/37963 [85:55:55<80:33:50, 16.19s/it]
 53%|█████▎    | 20051/37963 [85:56:10<78:05:39, 15.70s/it]
 53%|█████▎    | 20052/37963 [85:56:24<76:10:36, 15.31s/it]
 53%|█████▎    | 20053/37963 [85:56:38<74:15:28, 14.93s/it]
 53%|█████▎    | 20054/37963 [85:56:53<73:29:43, 14.77s/it]
 53%|█████▎    | 20055/37963 [85:57:07<73:13:35, 14.72s/it]
 53%|█████▎    | 20056/37963 [85:57:22<72:35:57, 14.60s/it]
 53%|█████▎    | 20057/37963 [85:57:36<72:09:02, 14.51s/it]
 53%|█████▎    | 20058/37963 [85:57:50<71:45:59, 14.43s/it]
 53%|█████▎    | 20059/37963 [85:58:17<90:20:40, 18.17s/it]
 53%|█████▎    | 20060/37963 [85:58:31<84:40:56, 17.03s/it]
                                                           
{'loss': '0.1521', 'grad_norm': '1.596', 'learning_rate': '9.567e-06', 'epoch': '0.5284'}

 53%|█████▎    | 20060/37963 [85:58:32<84:40:56, 17.03s/it]
 53%|█████▎    | 20061/37963 [85:58:46<80:38:12, 16.22s/it]
 53%|█████▎    | 20062/37963 [85:59:00<77:58:31, 15.68s/it]
 53%|█████▎    | 20063/37963 [85:59:15<75:56:59, 15.27s/it]
 53%|█████▎    | 20064/37963 [85:59:29<74:41:44, 15.02s/it]
 53%|█████▎    | 20065/37963 [85:59:43<73:47:10, 14.84s/it]
 53%|█████▎    | 20066/37963 [86:00:05<83:09:44, 16.73s/it]
 53%|█████▎    | 20067/37963 [86:00:19<79:35:03, 16.01s/it]
 53%|█████▎    | 20068/37963 [86:00:33<76:59:54, 15.49s/it]
 53%|█████▎    | 20069/37963 [86:00:54<84:43:05, 17.04s/it]
 53%|█████▎    | 20070/37963 [86:01:08<80:28:50, 16.19s/it]
                                                           
{'loss': '0.1494', 'grad_norm': '1.744', 'learning_rate': '9.558e-06', 'epoch': '0.5287'}

 53%|█████▎    | 20070/37963 [86:01:08<80:28:50, 16.19s/it]
 53%|█████▎    | 20071/37963 [86:01:22<77:44:12, 15.64s/it]
 53%|█████▎    | 20072/37963 [86:01:37<75:52:52, 15.27s/it]
 53%|█████▎    | 20073/37963 [86:01:51<74:29:25, 14.99s/it]
 53%|█████▎    | 20074/37963 [86:02:05<73:01:29, 14.70s/it]
 53%|█████▎    | 20075/37963 [86:02:20<72:31:00, 14.59s/it]
 53%|█████▎    | 20076/37963 [86:02:34<72:03:14, 14.50s/it]
 53%|█████▎    | 20077/37963 [86:02:48<71:53:15, 14.47s/it]
 53%|█████▎    | 20078/37963 [86:03:02<71:08:15, 14.32s/it]
 53%|█████▎    | 20079/37963 [86:03:17<71:18:28, 14.35s/it]
 53%|█████▎    | 20080/37963 [86:03:31<71:16:36, 14.35s/it]
                                                           
{'loss': '0.1423', 'grad_norm': '4.308', 'learning_rate': '9.55e-06', 'epoch': '0.5289'}

 53%|█████▎    | 20080/37963 [86:03:31<71:16:36, 14.35s/it]
 53%|█████▎    | 20081/37963 [86:03:45<70:28:41, 14.19s/it]
 53%|█████▎    | 20082/37963 [86:04:05<80:11:26, 16.14s/it]
 53%|█████▎    | 20083/37963 [86:04:20<77:31:31, 15.61s/it]
 53%|█████▎    | 20084/37963 [86:04:34<76:03:15, 15.31s/it]
 53%|█████▎    | 20085/37963 [86:04:55<83:29:45, 16.81s/it]
 53%|█████▎    | 20086/37963 [86:05:09<79:53:42, 16.09s/it]
 53%|█████▎    | 20087/37963 [86:05:24<77:22:58, 15.58s/it]
 53%|█████▎    | 20088/37963 [86:05:38<75:44:08, 15.25s/it]
 53%|█████▎    | 20089/37963 [86:05:52<74:28:00, 15.00s/it]
 53%|█████▎    | 20090/37963 [86:06:07<73:32:46, 14.81s/it]
                                                           
{'loss': '0.1487', 'grad_norm': '2.393', 'learning_rate': '9.541e-06', 'epoch': '0.5292'}

 53%|█████▎    | 20090/37963 [86:06:07<73:32:46, 14.81s/it]
 53%|█████▎    | 20091/37963 [86:06:21<73:03:18, 14.72s/it]
 53%|█████▎    | 20092/37963 [86:06:36<72:26:42, 14.59s/it]
 53%|█████▎    | 20093/37963 [86:06:50<71:59:22, 14.50s/it]
 53%|█████▎    | 20094/37963 [86:07:04<71:58:23, 14.50s/it]
 53%|█████▎    | 20095/37963 [86:07:19<71:54:06, 14.49s/it]
 53%|█████▎    | 20096/37963 [86:07:33<71:37:57, 14.43s/it]
 53%|█████▎    | 20097/37963 [86:07:48<71:35:36, 14.43s/it]
 53%|█████▎    | 20098/37963 [86:08:02<71:09:00, 14.34s/it]
 53%|█████▎    | 20099/37963 [86:08:23<81:07:26, 16.35s/it]
 53%|█████▎    | 20100/37963 [86:08:37<78:37:22, 15.85s/it]
                                                           
{'loss': '0.1427', 'grad_norm': '2.43', 'learning_rate': '9.533e-06', 'epoch': '0.5295'}

 53%|█████▎    | 20100/37963 [86:08:37<78:37:22, 15.85s/it]
 53%|█████▎    | 20101/37963 [86:08:52<76:26:51, 15.41s/it]
 53%|█████▎    | 20102/37963 [86:09:06<74:00:56, 14.92s/it]
 53%|█████▎    | 20103/37963 [86:09:20<73:14:13, 14.76s/it]
 53%|█████▎    | 20104/37963 [86:09:34<72:24:31, 14.60s/it]
 53%|█████▎    | 20105/37963 [86:09:48<71:09:56, 14.35s/it]
 53%|█████▎    | 20106/37963 [86:10:09<80:52:32, 16.30s/it]
 53%|█████▎    | 20107/37963 [86:10:23<78:03:48, 15.74s/it]
 53%|█████▎    | 20108/37963 [86:10:38<76:00:07, 15.32s/it]
 53%|█████▎    | 20109/37963 [86:10:59<84:25:22, 17.02s/it]
 53%|█████▎    | 20110/37963 [86:11:19<90:04:49, 18.16s/it]
                                                           
{'loss': '0.1289', 'grad_norm': '1.005', 'learning_rate': '9.524e-06', 'epoch': '0.5297'}

 53%|█████▎    | 20110/37963 [86:11:19<90:04:49, 18.16s/it]
 53%|█████▎    | 20111/37963 [86:11:34<84:34:01, 17.05s/it]
 53%|█████▎    | 20112/37963 [86:11:48<80:39:34, 16.27s/it]
 53%|█████▎    | 20113/37963 [86:12:02<77:29:00, 15.63s/it]
 53%|█████▎    | 20114/37963 [86:12:16<75:08:04, 15.15s/it]
 53%|█████▎    | 20115/37963 [86:12:37<83:45:31, 16.89s/it]
 53%|█████▎    | 20116/37963 [86:12:58<89:33:19, 18.06s/it]
 53%|█████▎    | 20117/37963 [86:13:13<84:05:50, 16.96s/it]
 53%|█████▎    | 20118/37963 [86:13:27<80:16:26, 16.19s/it]
 53%|█████▎    | 20119/37963 [86:13:41<77:35:26, 15.65s/it]
 53%|█████▎    | 20120/37963 [86:13:55<74:23:25, 15.01s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '4.84', 'learning_rate': '9.516e-06', 'epoch': '0.53'}

 53%|█████▎    | 20120/37963 [86:13:55<74:23:25, 15.01s/it]
 53%|█████▎    | 20121/37963 [86:14:09<73:27:01, 14.82s/it]
 53%|█████▎    | 20122/37963 [86:14:23<72:26:29, 14.62s/it]
 53%|█████▎    | 20123/37963 [86:14:38<72:02:55, 14.54s/it]
 53%|█████▎    | 20124/37963 [86:14:52<71:30:22, 14.43s/it]
 53%|█████▎    | 20125/37963 [86:15:07<71:41:09, 14.47s/it]
 53%|█████▎    | 20126/37963 [86:15:21<71:14:20, 14.38s/it]
 53%|█████▎    | 20127/37963 [86:15:35<71:10:30, 14.37s/it]
 53%|█████▎    | 20128/37963 [86:15:49<71:01:42, 14.34s/it]
 53%|█████▎    | 20129/37963 [86:16:04<70:52:34, 14.31s/it]
 53%|█████▎    | 20130/37963 [86:16:18<71:04:51, 14.35s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '2.736', 'learning_rate': '9.507e-06', 'epoch': '0.5303'}

 53%|█████▎    | 20130/37963 [86:16:18<71:04:51, 14.35s/it]
 53%|█████▎    | 20131/37963 [86:16:39<81:17:50, 16.41s/it]
 53%|█████▎    | 20132/37963 [86:16:54<78:16:26, 15.80s/it]
 53%|█████▎    | 20133/37963 [86:17:08<76:11:09, 15.38s/it]
 53%|█████▎    | 20134/37963 [86:17:29<84:21:35, 17.03s/it]
 53%|█████▎    | 20135/37963 [86:17:43<80:32:54, 16.27s/it]
 53%|█████▎    | 20136/37963 [86:17:57<77:08:45, 15.58s/it]
 53%|█████▎    | 20137/37963 [86:18:12<75:19:08, 15.21s/it]
 53%|█████▎    | 20138/37963 [86:18:26<74:04:10, 14.96s/it]
 53%|█████▎    | 20139/37963 [86:18:40<72:51:14, 14.71s/it]
 53%|█████▎    | 20140/37963 [86:18:54<71:43:53, 14.49s/it]
                                                           
{'loss': '0.1356', 'grad_norm': '2.426', 'learning_rate': '9.499e-06', 'epoch': '0.5305'}

 53%|█████▎    | 20140/37963 [86:18:54<71:43:53, 14.49s/it]
 53%|█████▎    | 20141/37963 [86:19:09<71:46:27, 14.50s/it]
 53%|█████▎    | 20142/37963 [86:19:23<71:33:18, 14.45s/it]
 53%|█████▎    | 20143/37963 [86:19:37<71:27:17, 14.44s/it]
 53%|█████▎    | 20144/37963 [86:19:52<71:23:37, 14.42s/it]
 53%|█████▎    | 20145/37963 [86:20:06<71:09:44, 14.38s/it]
 53%|█████▎    | 20146/37963 [86:20:21<71:11:39, 14.39s/it]
 53%|█████▎    | 20147/37963 [86:20:42<81:09:15, 16.40s/it]
 53%|█████▎    | 20148/37963 [86:20:55<77:02:02, 15.57s/it]
 53%|█████▎    | 20149/37963 [86:21:10<75:08:04, 15.18s/it]
 53%|█████▎    | 20150/37963 [86:21:24<73:53:25, 14.93s/it]
                                                           
{'loss': '0.1322', 'grad_norm': '1.526', 'learning_rate': '9.49e-06', 'epoch': '0.5308'}

 53%|█████▎    | 20150/37963 [86:21:24<73:53:25, 14.93s/it]
 53%|█████▎    | 20151/37963 [86:21:38<72:35:42, 14.67s/it]
 53%|█████▎    | 20152/37963 [86:21:52<72:03:13, 14.56s/it]
 53%|█████▎    | 20153/37963 [86:22:12<80:24:44, 16.25s/it]
 53%|█████▎    | 20154/37963 [86:22:27<77:30:59, 15.67s/it]
 53%|█████▎    | 20155/37963 [86:22:41<75:28:29, 15.26s/it]
 53%|█████▎    | 20156/37963 [86:22:55<73:21:48, 14.83s/it]
 53%|█████▎    | 20157/37963 [86:23:22<91:01:43, 18.40s/it]
 53%|█████▎    | 20158/37963 [86:23:35<84:13:17, 17.03s/it]
 53%|█████▎    | 20159/37963 [86:23:50<80:04:42, 16.19s/it]
 53%|█████▎    | 20160/37963 [86:24:04<77:19:32, 15.64s/it]
                                                           
{'loss': '0.1425', 'grad_norm': '1.496', 'learning_rate': '9.482e-06', 'epoch': '0.531'}

 53%|█████▎    | 20160/37963 [86:24:04<77:19:32, 15.64s/it]
 53%|█████▎    | 20161/37963 [86:24:18<75:30:18, 15.27s/it]
 53%|█████▎    | 20162/37963 [86:24:33<74:17:48, 15.03s/it]
 53%|█████▎    | 20163/37963 [86:24:53<82:09:24, 16.62s/it]
 53%|█████▎    | 20164/37963 [86:25:14<88:58:13, 18.00s/it]
 53%|█████▎    | 20165/37963 [86:25:29<83:45:36, 16.94s/it]
 53%|█████▎    | 20166/37963 [86:25:43<80:00:04, 16.18s/it]
 53%|█████▎    | 20167/37963 [86:25:58<77:14:45, 15.63s/it]
 53%|█████▎    | 20168/37963 [86:26:12<75:20:06, 15.24s/it]
 53%|█████▎    | 20169/37963 [86:26:26<73:40:40, 14.91s/it]
 53%|█████▎    | 20170/37963 [86:26:41<72:53:20, 14.75s/it]
                                                           
{'loss': '0.139', 'grad_norm': '3.313', 'learning_rate': '9.473e-06', 'epoch': '0.5313'}

 53%|█████▎    | 20170/37963 [86:26:41<72:53:20, 14.75s/it]
 53%|█████▎    | 20171/37963 [86:26:55<72:45:14, 14.72s/it]
 53%|█████▎    | 20172/37963 [86:27:10<72:16:20, 14.62s/it]
 53%|█████▎    | 20173/37963 [86:27:24<71:56:13, 14.56s/it]
 53%|█████▎    | 20174/37963 [86:27:38<71:05:05, 14.39s/it]
 53%|█████▎    | 20175/37963 [86:27:52<71:02:41, 14.38s/it]
 53%|█████▎    | 20176/37963 [86:28:07<71:06:27, 14.39s/it]
 53%|█████▎    | 20177/37963 [86:28:21<71:00:47, 14.37s/it]
 53%|█████▎    | 20178/37963 [86:28:35<70:55:36, 14.36s/it]
 53%|█████▎    | 20179/37963 [86:28:56<80:53:49, 16.38s/it]
 53%|█████▎    | 20180/37963 [86:29:10<77:02:38, 15.60s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '1.932', 'learning_rate': '9.464e-06', 'epoch': '0.5316'}

 53%|█████▎    | 20180/37963 [86:29:10<77:02:38, 15.60s/it]
 53%|█████▎    | 20181/37963 [86:29:25<75:20:00, 15.25s/it]
 53%|█████▎    | 20182/37963 [86:29:39<73:49:48, 14.95s/it]
 53%|█████▎    | 20183/37963 [86:29:53<72:18:30, 14.64s/it]
 53%|█████▎    | 20184/37963 [86:30:07<71:48:23, 14.54s/it]
 53%|█████▎    | 20185/37963 [86:30:28<80:53:04, 16.38s/it]
 53%|█████▎    | 20186/37963 [86:30:42<78:11:28, 15.83s/it]
 53%|█████▎    | 20187/37963 [86:30:57<76:09:38, 15.42s/it]
 53%|█████▎    | 20188/37963 [86:31:11<74:16:56, 15.04s/it]
 53%|█████▎    | 20189/37963 [86:31:26<73:27:21, 14.88s/it]
 53%|█████▎    | 20190/37963 [86:31:40<72:42:02, 14.73s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '2.305', 'learning_rate': '9.456e-06', 'epoch': '0.5318'}

 53%|█████▎    | 20190/37963 [86:31:40<72:42:02, 14.73s/it]
 53%|█████▎    | 20191/37963 [86:31:54<71:29:27, 14.48s/it]
 53%|█████▎    | 20192/37963 [86:32:08<71:11:29, 14.42s/it]
 53%|█████▎    | 20193/37963 [86:32:22<70:16:24, 14.24s/it]
 53%|█████▎    | 20194/37963 [86:32:36<69:32:35, 14.09s/it]
 53%|█████▎    | 20195/37963 [86:32:50<69:52:03, 14.16s/it]
 53%|█████▎    | 20196/37963 [86:33:11<79:30:29, 16.11s/it]
 53%|█████▎    | 20197/37963 [86:33:25<76:28:37, 15.50s/it]
 53%|█████▎    | 20198/37963 [86:33:39<75:03:39, 15.21s/it]
 53%|█████▎    | 20199/37963 [86:33:53<73:39:26, 14.93s/it]
 53%|█████▎    | 20200/37963 [86:34:08<72:27:58, 14.69s/it]
                                                           
{'loss': '0.1465', 'grad_norm': '4.208', 'learning_rate': '9.447e-06', 'epoch': '0.5321'}

 53%|█████▎    | 20200/37963 [86:34:08<72:27:58, 14.69s/it]
 53%|█████▎    | 20201/37963 [86:34:28<81:22:41, 16.49s/it]
 53%|█████▎    | 20202/37963 [86:34:43<78:03:57, 15.82s/it]
 53%|█████▎    | 20203/37963 [86:34:57<76:15:34, 15.46s/it]
 53%|█████▎    | 20204/37963 [86:35:18<83:31:35, 16.93s/it]
 53%|█████▎    | 20205/37963 [86:35:39<89:55:57, 18.23s/it]
 53%|█████▎    | 20206/37963 [86:35:53<84:03:27, 17.04s/it]
 53%|█████▎    | 20207/37963 [86:36:07<80:02:54, 16.23s/it]
 53%|█████▎    | 20208/37963 [86:36:22<77:31:57, 15.72s/it]
 53%|█████▎    | 20209/37963 [86:36:36<75:27:18, 15.30s/it]
 53%|█████▎    | 20210/37963 [86:36:51<74:03:04, 15.02s/it]
                                                           
{'loss': '0.1256', 'grad_norm': '1.544', 'learning_rate': '9.439e-06', 'epoch': '0.5324'}

 53%|█████▎    | 20210/37963 [86:36:51<74:03:04, 15.02s/it]
 53%|█████▎    | 20211/37963 [86:37:04<72:18:13, 14.66s/it]
 53%|█████▎    | 20212/37963 [86:37:26<82:32:06, 16.74s/it]
 53%|█████▎    | 20213/37963 [86:37:47<88:59:01, 18.05s/it]
 53%|█████▎    | 20214/37963 [86:38:02<83:33:30, 16.95s/it]
 53%|█████▎    | 20215/37963 [86:38:16<79:45:14, 16.18s/it]
 53%|█████▎    | 20216/37963 [86:38:30<76:50:44, 15.59s/it]
 53%|█████▎    | 20217/37963 [86:38:44<75:00:37, 15.22s/it]
 53%|█████▎    | 20218/37963 [86:38:58<73:01:24, 14.81s/it]
 53%|█████▎    | 20219/37963 [86:39:12<71:25:45, 14.49s/it]
 53%|█████▎    | 20220/37963 [86:39:27<71:26:16, 14.49s/it]
                                                           
{'loss': '0.13', 'grad_norm': '2.175', 'learning_rate': '9.43e-06', 'epoch': '0.5326'}

 53%|█████▎    | 20220/37963 [86:39:27<71:26:16, 14.49s/it]
 53%|█████▎    | 20221/37963 [86:39:41<71:15:19, 14.46s/it]
 53%|█████▎    | 20222/37963 [86:39:55<70:32:23, 14.31s/it]
 53%|█████▎    | 20223/37963 [86:40:09<70:36:59, 14.33s/it]
 53%|█████▎    | 20224/37963 [86:40:24<70:39:17, 14.34s/it]
 53%|█████▎    | 20225/37963 [86:40:38<71:10:47, 14.45s/it]
 53%|█████▎    | 20226/37963 [86:40:53<70:59:22, 14.41s/it]
 53%|█████▎    | 20227/37963 [86:41:07<70:38:01, 14.34s/it]
 53%|█████▎    | 20228/37963 [86:41:28<80:57:17, 16.43s/it]
 53%|█████▎    | 20229/37963 [86:41:43<77:58:13, 15.83s/it]
 53%|█████▎    | 20230/37963 [86:41:57<75:49:34, 15.39s/it]
                                                           
{'loss': '0.1395', 'grad_norm': '2.46', 'learning_rate': '9.422e-06', 'epoch': '0.5329'}

 53%|█████▎    | 20230/37963 [86:41:57<75:49:34, 15.39s/it]
 53%|█████▎    | 20231/37963 [86:42:11<74:15:32, 15.08s/it]
 53%|█████▎    | 20232/37963 [86:42:25<72:42:00, 14.76s/it]
 53%|█████▎    | 20233/37963 [86:42:40<72:14:27, 14.67s/it]
 53%|█████▎    | 20234/37963 [86:43:00<80:19:37, 16.31s/it]
 53%|█████▎    | 20235/37963 [86:43:14<77:23:29, 15.72s/it]
 53%|█████▎    | 20236/37963 [86:43:29<75:26:16, 15.32s/it]
 53%|█████▎    | 20237/37963 [86:43:43<74:04:50, 15.05s/it]
 53%|█████▎    | 20238/37963 [86:43:57<73:02:01, 14.83s/it]
 53%|█████▎    | 20239/37963 [86:44:12<72:18:26, 14.69s/it]
 53%|█████▎    | 20240/37963 [86:44:26<71:57:11, 14.62s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '2.62', 'learning_rate': '9.413e-06', 'epoch': '0.5332'}

 53%|█████▎    | 20240/37963 [86:44:26<71:57:11, 14.62s/it]
 53%|█████▎    | 20241/37963 [86:44:40<70:50:56, 14.39s/it]
 53%|█████▎    | 20242/37963 [86:44:54<70:51:21, 14.39s/it]
 53%|█████▎    | 20243/37963 [86:45:09<70:25:00, 14.31s/it]
 53%|█████▎    | 20244/37963 [86:45:23<70:30:30, 14.33s/it]
 53%|█████▎    | 20245/37963 [86:45:37<69:46:10, 14.18s/it]
 53%|█████▎    | 20246/37963 [86:45:51<69:49:13, 14.19s/it]
 53%|█████▎    | 20247/37963 [86:46:12<80:07:55, 16.28s/it]
 53%|█████▎    | 20248/37963 [86:46:26<75:59:48, 15.44s/it]
 53%|█████▎    | 20249/37963 [86:46:40<74:25:49, 15.13s/it]
 53%|█████▎    | 20250/37963 [86:47:01<83:02:28, 16.88s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '1.567', 'learning_rate': '9.405e-06', 'epoch': '0.5334'}

 53%|█████▎    | 20250/37963 [86:47:01<83:02:28, 16.88s/it]
 53%|█████▎    | 20251/37963 [86:47:15<79:07:13, 16.08s/it]
 53%|█████▎    | 20252/37963 [86:47:36<85:33:31, 17.39s/it]
 53%|█████▎    | 20253/37963 [86:47:50<80:48:15, 16.43s/it]
 53%|█████▎    | 20254/37963 [86:48:11<87:10:39, 17.72s/it]
 53%|█████▎    | 20255/37963 [86:48:25<82:19:38, 16.74s/it]
 53%|█████▎    | 20256/37963 [86:48:39<78:45:53, 16.01s/it]
 53%|█████▎    | 20257/37963 [86:48:54<76:18:09, 15.51s/it]
 53%|█████▎    | 20258/37963 [86:49:08<74:11:29, 15.09s/it]
 53%|█████▎    | 20259/37963 [86:49:22<73:06:50, 14.87s/it]
 53%|█████▎    | 20260/37963 [86:49:50<93:01:29, 18.92s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '2.47', 'learning_rate': '9.396e-06', 'epoch': '0.5337'}

 53%|█████▎    | 20260/37963 [86:49:50<93:01:29, 18.92s/it]
 53%|█████▎    | 20261/37963 [86:50:05<86:20:29, 17.56s/it]
 53%|█████▎    | 20262/37963 [86:50:19<81:42:28, 16.62s/it]
 53%|█████▎    | 20263/37963 [86:50:34<78:21:19, 15.94s/it]
 53%|█████▎    | 20264/37963 [86:50:48<76:00:06, 15.46s/it]
 53%|█████▎    | 20265/37963 [86:51:02<73:37:41, 14.98s/it]
 53%|█████▎    | 20266/37963 [86:51:16<72:39:12, 14.78s/it]
 53%|█████▎    | 20267/37963 [86:51:31<72:00:09, 14.65s/it]
 53%|█████▎    | 20268/37963 [86:51:45<71:26:12, 14.53s/it]
 53%|█████▎    | 20269/37963 [86:51:59<71:19:00, 14.51s/it]
 53%|█████▎    | 20270/37963 [86:52:14<71:15:41, 14.50s/it]
                                                           
{'loss': '0.1315', 'grad_norm': '4.067', 'learning_rate': '9.388e-06', 'epoch': '0.5339'}

 53%|█████▎    | 20270/37963 [86:52:14<71:15:41, 14.50s/it]
 53%|█████▎    | 20271/37963 [86:52:28<70:42:06, 14.39s/it]
 53%|█████▎    | 20272/37963 [86:52:42<70:36:44, 14.37s/it]
 53%|█████▎    | 20273/37963 [86:52:56<70:23:00, 14.32s/it]
 53%|█████▎    | 20274/37963 [86:53:10<69:36:26, 14.17s/it]
 53%|█████▎    | 20275/37963 [86:53:25<69:59:34, 14.25s/it]
 53%|█████▎    | 20276/37963 [86:53:46<79:50:44, 16.25s/it]
 53%|█████▎    | 20277/37963 [86:54:00<76:42:45, 15.61s/it]
 53%|█████▎    | 20278/37963 [86:54:14<74:48:49, 15.23s/it]
 53%|█████▎    | 20279/37963 [86:54:28<72:40:36, 14.80s/it]
 53%|█████▎    | 20280/37963 [86:54:42<72:02:54, 14.67s/it]
                                                           
{'loss': '0.1341', 'grad_norm': '6.152', 'learning_rate': '9.379e-06', 'epoch': '0.5342'}

 53%|█████▎    | 20280/37963 [86:54:42<72:02:54, 14.67s/it]
 53%|█████▎    | 20281/37963 [86:55:03<80:51:27, 16.46s/it]
 53%|█████▎    | 20282/37963 [86:55:16<76:24:17, 15.56s/it]
 53%|█████▎    | 20283/37963 [86:55:31<74:52:01, 15.24s/it]
 53%|█████▎    | 20284/37963 [86:55:45<73:35:02, 14.98s/it]
 53%|█████▎    | 20285/37963 [86:55:59<72:18:34, 14.73s/it]
 53%|█████▎    | 20286/37963 [86:56:14<71:52:19, 14.64s/it]
 53%|█████▎    | 20287/37963 [86:56:28<71:14:37, 14.51s/it]
 53%|█████▎    | 20288/37963 [86:56:42<70:33:20, 14.37s/it]
 53%|█████▎    | 20289/37963 [86:56:56<69:32:49, 14.17s/it]
 53%|█████▎    | 20290/37963 [86:57:10<69:51:22, 14.23s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '1.684', 'learning_rate': '9.371e-06', 'epoch': '0.5345'}

 53%|█████▎    | 20290/37963 [86:57:10<69:51:22, 14.23s/it]
 53%|█████▎    | 20291/37963 [86:57:24<69:49:27, 14.22s/it]
 53%|█████▎    | 20292/37963 [86:57:38<69:22:20, 14.13s/it]
 53%|█████▎    | 20293/37963 [86:57:52<69:35:21, 14.18s/it]
 53%|█████▎    | 20294/37963 [86:58:07<69:39:21, 14.19s/it]
 53%|█████▎    | 20295/37963 [86:58:27<79:12:31, 16.14s/it]
 53%|█████▎    | 20296/37963 [86:58:41<75:51:31, 15.46s/it]
 53%|█████▎    | 20297/37963 [86:58:56<74:19:38, 15.15s/it]
 53%|█████▎    | 20298/37963 [86:59:10<73:14:48, 14.93s/it]
 53%|█████▎    | 20299/37963 [86:59:24<72:24:27, 14.76s/it]
 53%|█████▎    | 20300/37963 [86:59:52<90:49:09, 18.51s/it]
                                                           
{'loss': '0.1442', 'grad_norm': '0.9473', 'learning_rate': '9.362e-06', 'epoch': '0.5347'}

 53%|█████▎    | 20300/37963 [86:59:52<90:49:09, 18.51s/it]
 53%|█████▎    | 20301/37963 [87:00:12<94:12:32, 19.20s/it]
 53%|█████▎    | 20302/37963 [87:00:27<87:05:35, 17.75s/it]
 53%|█████▎    | 20303/37963 [87:00:41<81:58:50, 16.71s/it]
 53%|█████▎    | 20304/37963 [87:00:55<78:14:46, 15.95s/it]
 53%|█████▎    | 20305/37963 [87:01:10<75:54:17, 15.47s/it]
 53%|█████▎    | 20306/37963 [87:01:24<73:56:54, 15.08s/it]
 53%|█████▎    | 20307/37963 [87:01:38<72:57:19, 14.88s/it]
 53%|█████▎    | 20308/37963 [87:01:52<72:03:44, 14.69s/it]
 53%|█████▎    | 20309/37963 [87:02:14<81:44:07, 16.67s/it]
 53%|█████▎    | 20310/37963 [87:02:34<87:40:39, 17.88s/it]
                                                           
{'loss': '0.1437', 'grad_norm': '2.775', 'learning_rate': '9.354e-06', 'epoch': '0.535'}

 53%|█████▎    | 20310/37963 [87:02:34<87:40:39, 17.88s/it]
 54%|█████▎    | 20311/37963 [87:02:49<82:07:51, 16.75s/it]
 54%|█████▎    | 20312/37963 [87:03:03<78:10:59, 15.95s/it]
 54%|█████▎    | 20313/37963 [87:03:17<75:13:24, 15.34s/it]
 54%|█████▎    | 20314/37963 [87:03:31<73:43:08, 15.04s/it]
 54%|█████▎    | 20315/37963 [87:03:45<72:41:16, 14.83s/it]
 54%|█████▎    | 20316/37963 [87:03:59<71:35:39, 14.61s/it]
 54%|█████▎    | 20317/37963 [87:04:13<70:36:50, 14.41s/it]
 54%|█████▎    | 20318/37963 [87:04:28<70:28:41, 14.38s/it]
 54%|█████▎    | 20319/37963 [87:04:42<70:29:36, 14.38s/it]
 54%|█████▎    | 20320/37963 [87:04:56<70:25:25, 14.37s/it]
                                                           
{'loss': '0.1321', 'grad_norm': '2.021', 'learning_rate': '9.345e-06', 'epoch': '0.5353'}

 54%|█████▎    | 20320/37963 [87:04:56<70:25:25, 14.37s/it]
 54%|█████▎    | 20321/37963 [87:05:11<70:31:18, 14.39s/it]
 54%|█████▎    | 20322/37963 [87:05:25<70:28:17, 14.38s/it]
 54%|█████▎    | 20323/37963 [87:05:39<70:15:06, 14.34s/it]
 54%|█████▎    | 20324/37963 [87:06:01<80:20:59, 16.40s/it]
 54%|█████▎    | 20325/37963 [87:06:15<76:54:22, 15.70s/it]
 54%|█████▎    | 20326/37963 [87:06:28<73:45:37, 15.06s/it]
 54%|█████▎    | 20327/37963 [87:06:42<72:06:34, 14.72s/it]
 54%|█████▎    | 20328/37963 [87:06:56<71:34:47, 14.61s/it]
 54%|█████▎    | 20329/37963 [87:07:11<71:12:24, 14.54s/it]
 54%|█████▎    | 20330/37963 [87:07:32<80:19:41, 16.40s/it]
                                                           
{'loss': '0.1379', 'grad_norm': '2.858', 'learning_rate': '9.337e-06', 'epoch': '0.5355'}

 54%|█████▎    | 20330/37963 [87:07:32<80:19:41, 16.40s/it]
 54%|█████▎    | 20331/37963 [87:07:46<77:17:58, 15.78s/it]
 54%|█████▎    | 20332/37963 [87:08:00<75:22:29, 15.39s/it]
 54%|█████▎    | 20333/37963 [87:08:14<73:15:43, 14.96s/it]
 54%|█████▎    | 20334/37963 [87:08:29<72:26:18, 14.79s/it]
 54%|█████▎    | 20335/37963 [87:08:43<71:15:18, 14.55s/it]
 54%|█████▎    | 20336/37963 [87:08:57<71:12:13, 14.54s/it]
 54%|█████▎    | 20337/37963 [87:09:12<71:05:46, 14.52s/it]
 54%|█████▎    | 20338/37963 [87:09:26<70:10:08, 14.33s/it]
 54%|█████▎    | 20339/37963 [87:09:40<69:43:00, 14.24s/it]
 54%|█████▎    | 20340/37963 [87:09:54<69:57:56, 14.29s/it]
                                                           
{'loss': '0.1308', 'grad_norm': '1.695', 'learning_rate': '9.328e-06', 'epoch': '0.5358'}

 54%|█████▎    | 20340/37963 [87:09:54<69:57:56, 14.29s/it]
 54%|█████▎    | 20341/37963 [87:10:08<69:32:13, 14.21s/it]
 54%|█████▎    | 20342/37963 [87:10:22<69:39:18, 14.23s/it]
 54%|█████▎    | 20343/37963 [87:10:43<79:40:28, 16.28s/it]
 54%|█████▎    | 20344/37963 [87:10:58<76:31:18, 15.64s/it]
 54%|█████▎    | 20345/37963 [87:11:12<74:43:35, 15.27s/it]
 54%|█████▎    | 20346/37963 [87:11:26<73:26:42, 15.01s/it]
 54%|█████▎    | 20347/37963 [87:11:41<72:47:56, 14.88s/it]
 54%|█████▎    | 20348/37963 [87:11:55<72:02:58, 14.72s/it]
 54%|█████▎    | 20349/37963 [87:12:16<81:01:34, 16.56s/it]
 54%|█████▎    | 20350/37963 [87:12:43<96:34:47, 19.74s/it]
                                                           
{'loss': '0.1424', 'grad_norm': '1.277', 'learning_rate': '9.32e-06', 'epoch': '0.5361'}

 54%|█████▎    | 20350/37963 [87:12:43<96:34:47, 19.74s/it]
 54%|█████▎    | 20351/37963 [87:12:57<88:19:01, 18.05s/it]
 54%|█████▎    | 20352/37963 [87:13:11<82:22:30, 16.84s/it]
 54%|█████▎    | 20353/37963 [87:13:26<78:41:08, 16.09s/it]
 54%|█████▎    | 20354/37963 [87:13:40<76:11:21, 15.58s/it]
 54%|█████▎    | 20355/37963 [87:13:54<74:20:12, 15.20s/it]
 54%|█████▎    | 20356/37963 [87:14:09<73:08:06, 14.95s/it]
 54%|█████▎    | 20357/37963 [87:14:23<72:10:57, 14.76s/it]
 54%|█████▎    | 20358/37963 [87:14:44<81:15:48, 16.62s/it]
 54%|█████▎    | 20359/37963 [87:15:06<88:28:19, 18.09s/it]
 54%|█████▎    | 20360/37963 [87:15:20<83:04:52, 16.99s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '5.703', 'learning_rate': '9.311e-06', 'epoch': '0.5363'}

 54%|█████▎    | 20360/37963 [87:15:20<83:04:52, 16.99s/it]
 54%|█████▎    | 20361/37963 [87:15:34<78:54:27, 16.14s/it]
 54%|█████▎    | 20362/37963 [87:15:48<75:48:20, 15.50s/it]
 54%|█████▎    | 20363/37963 [87:16:02<73:34:14, 15.05s/it]
 54%|█████▎    | 20364/37963 [87:16:17<72:52:53, 14.91s/it]
 54%|█████▎    | 20365/37963 [87:16:31<72:02:46, 14.74s/it]
 54%|█████▎    | 20366/37963 [87:16:45<70:24:39, 14.40s/it]
 54%|█████▎    | 20367/37963 [87:16:59<69:48:16, 14.28s/it]
 54%|█████▎    | 20368/37963 [87:17:13<69:36:45, 14.24s/it]
 54%|█████▎    | 20369/37963 [87:17:27<69:28:20, 14.22s/it]
 54%|█████▎    | 20370/37963 [87:17:42<69:49:22, 14.29s/it]
                                                           
{'loss': '0.1334', 'grad_norm': '2.44', 'learning_rate': '9.303e-06', 'epoch': '0.5366'}

 54%|█████▎    | 20370/37963 [87:17:42<69:49:22, 14.29s/it]
 54%|█████▎    | 20371/37963 [87:17:56<69:54:18, 14.31s/it]
 54%|█████▎    | 20372/37963 [87:18:10<69:59:55, 14.33s/it]
 54%|█████▎    | 20373/37963 [87:18:31<80:06:49, 16.40s/it]
 54%|█████▎    | 20374/37963 [87:18:46<77:22:23, 15.84s/it]
 54%|█████▎    | 20375/37963 [87:19:01<75:47:10, 15.51s/it]
 54%|█████▎    | 20376/37963 [87:19:15<74:13:55, 15.20s/it]
 54%|█████▎    | 20377/37963 [87:19:30<72:56:53, 14.93s/it]
 54%|█████▎    | 20378/37963 [87:19:44<72:14:34, 14.79s/it]
 54%|█████▎    | 20379/37963 [87:20:05<81:11:30, 16.62s/it]
 54%|█████▎    | 20380/37963 [87:20:19<77:58:02, 15.96s/it]
                                                           
{'loss': '0.143', 'grad_norm': '2.204', 'learning_rate': '9.294e-06', 'epoch': '0.5368'}

 54%|█████▎    | 20380/37963 [87:20:19<77:58:02, 15.96s/it]
 54%|█████▎    | 20381/37963 [87:20:33<74:48:50, 15.32s/it]
 54%|█████▎    | 20382/37963 [87:20:47<72:19:14, 14.81s/it]
 54%|█████▎    | 20383/37963 [87:21:01<71:49:23, 14.71s/it]
 54%|█████▎    | 20384/37963 [87:21:16<71:10:26, 14.58s/it]
 54%|█████▎    | 20385/37963 [87:21:30<70:46:31, 14.49s/it]
 54%|█████▎    | 20386/37963 [87:21:44<70:43:35, 14.49s/it]
 54%|█████▎    | 20387/37963 [87:21:59<70:35:57, 14.46s/it]
 54%|█████▎    | 20388/37963 [87:22:13<70:26:53, 14.43s/it]
 54%|█████▎    | 20389/37963 [87:22:27<70:19:28, 14.41s/it]
 54%|█████▎    | 20390/37963 [87:22:42<70:18:05, 14.40s/it]
                                                           
{'loss': '0.1257', 'grad_norm': '2.214', 'learning_rate': '9.286e-06', 'epoch': '0.5371'}

 54%|█████▎    | 20390/37963 [87:22:42<70:18:05, 14.40s/it]
 54%|█████▎    | 20391/37963 [87:23:03<80:09:50, 16.42s/it]
 54%|█████▎    | 20392/37963 [87:23:17<76:34:00, 15.69s/it]
 54%|█████▎    | 20393/37963 [87:23:31<74:43:21, 15.31s/it]
 54%|█████▎    | 20394/37963 [87:23:46<73:24:08, 15.04s/it]
 54%|█████▎    | 20395/37963 [87:24:00<72:27:18, 14.85s/it]
 54%|█████▎    | 20396/37963 [87:24:14<71:43:44, 14.70s/it]
 54%|█████▎    | 20397/37963 [87:24:35<79:43:29, 16.34s/it]
 54%|█████▎    | 20398/37963 [87:24:55<86:13:43, 17.67s/it]
 54%|█████▎    | 20399/37963 [87:25:10<81:14:19, 16.65s/it]
 54%|█████▎    | 20400/37963 [87:25:30<87:03:39, 17.85s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '1.347', 'learning_rate': '9.277e-06', 'epoch': '0.5374'}

 54%|█████▎    | 20400/37963 [87:25:30<87:03:39, 17.85s/it]
 54%|█████▎    | 20401/37963 [87:25:45<82:06:28, 16.83s/it]
 54%|█████▎    | 20402/37963 [87:25:59<78:23:07, 16.07s/it]
 54%|█████▎    | 20403/37963 [87:26:13<75:52:07, 15.55s/it]
 54%|█████▎    | 20404/37963 [87:26:34<83:49:26, 17.19s/it]
 54%|█████▎    | 20405/37963 [87:26:49<79:27:29, 16.29s/it]
 54%|█████▍    | 20406/37963 [87:27:03<76:19:57, 15.65s/it]
 54%|█████▍    | 20407/37963 [87:27:24<84:10:09, 17.26s/it]
 54%|█████▍    | 20408/37963 [87:27:38<79:58:52, 16.40s/it]
 54%|█████▍    | 20409/37963 [87:27:53<77:01:20, 15.80s/it]
 54%|█████▍    | 20410/37963 [87:28:06<74:08:05, 15.20s/it]
                                                           
{'loss': '0.1395', 'grad_norm': '0.6894', 'learning_rate': '9.269e-06', 'epoch': '0.5376'}

 54%|█████▍    | 20410/37963 [87:28:06<74:08:05, 15.20s/it]
 54%|█████▍    | 20411/37963 [87:28:21<72:46:57, 14.93s/it]
 54%|█████▍    | 20412/37963 [87:28:35<71:59:04, 14.77s/it]
 54%|█████▍    | 20413/37963 [87:28:50<71:40:11, 14.70s/it]
 54%|█████▍    | 20414/37963 [87:29:04<71:06:35, 14.59s/it]
 54%|█████▍    | 20415/37963 [87:29:18<70:15:16, 14.41s/it]
 54%|█████▍    | 20416/37963 [87:29:32<70:20:06, 14.43s/it]
 54%|█████▍    | 20417/37963 [87:29:46<69:36:36, 14.28s/it]
 54%|█████▍    | 20418/37963 [87:30:01<69:51:54, 14.34s/it]
 54%|█████▍    | 20419/37963 [87:30:15<69:13:31, 14.20s/it]
 54%|█████▍    | 20420/37963 [87:30:29<68:37:09, 14.08s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '1.71', 'learning_rate': '9.26e-06', 'epoch': '0.5379'}

 54%|█████▍    | 20420/37963 [87:30:29<68:37:09, 14.08s/it]
 54%|█████▍    | 20421/37963 [87:30:43<69:01:43, 14.17s/it]
 54%|█████▍    | 20422/37963 [87:31:04<79:38:32, 16.35s/it]
 54%|█████▍    | 20423/37963 [87:31:19<76:43:15, 15.75s/it]
 54%|█████▍    | 20424/37963 [87:31:33<74:51:12, 15.36s/it]
 54%|█████▍    | 20425/37963 [87:31:48<73:34:51, 15.10s/it]
 54%|█████▍    | 20426/37963 [87:32:02<72:34:33, 14.90s/it]
 54%|█████▍    | 20427/37963 [87:32:16<71:46:11, 14.73s/it]
 54%|█████▍    | 20428/37963 [87:32:31<71:12:51, 14.62s/it]
 54%|█████▍    | 20429/37963 [87:32:45<71:22:29, 14.65s/it]
 54%|█████▍    | 20430/37963 [87:33:06<80:35:57, 16.55s/it]
                                                           
{'loss': '0.146', 'grad_norm': '2.501', 'learning_rate': '9.252e-06', 'epoch': '0.5382'}

 54%|█████▍    | 20430/37963 [87:33:06<80:35:57, 16.55s/it]
 54%|█████▍    | 20431/37963 [87:33:21<77:32:28, 15.92s/it]
 54%|█████▍    | 20432/37963 [87:33:35<75:22:21, 15.48s/it]
 54%|█████▍    | 20433/37963 [87:33:50<73:35:40, 15.11s/it]
 54%|█████▍    | 20434/37963 [87:34:04<72:20:38, 14.86s/it]
 54%|█████▍    | 20435/37963 [87:34:17<70:10:45, 14.41s/it]
 54%|█████▍    | 20436/37963 [87:34:31<69:28:23, 14.27s/it]
 54%|█████▍    | 20437/37963 [87:34:46<69:41:29, 14.32s/it]
 54%|█████▍    | 20438/37963 [87:35:00<69:54:39, 14.36s/it]
 54%|█████▍    | 20439/37963 [87:35:21<79:36:02, 16.35s/it]
 54%|█████▍    | 20440/37963 [87:35:35<76:31:26, 15.72s/it]
                                                           
{'loss': '0.1325', 'grad_norm': '2.296', 'learning_rate': '9.243e-06', 'epoch': '0.5384'}

 54%|█████▍    | 20440/37963 [87:35:35<76:31:26, 15.72s/it]
 54%|█████▍    | 20441/37963 [87:35:50<74:35:16, 15.32s/it]
 54%|█████▍    | 20442/37963 [87:36:04<73:10:16, 15.03s/it]
 54%|█████▍    | 20443/37963 [87:36:18<72:07:36, 14.82s/it]
 54%|█████▍    | 20444/37963 [87:36:33<71:28:45, 14.69s/it]
 54%|█████▍    | 20445/37963 [87:36:54<80:22:41, 16.52s/it]
 54%|█████▍    | 20446/37963 [87:37:08<77:16:40, 15.88s/it]
 54%|█████▍    | 20447/37963 [87:37:29<84:49:10, 17.43s/it]
 54%|█████▍    | 20448/37963 [87:37:50<90:02:04, 18.51s/it]
 54%|█████▍    | 20449/37963 [87:38:04<84:01:05, 17.27s/it]
 54%|█████▍    | 20450/37963 [87:38:19<79:52:52, 16.42s/it]
                                                           
{'loss': '0.14', 'grad_norm': '4.654', 'learning_rate': '9.235e-06', 'epoch': '0.5387'}

 54%|█████▍    | 20450/37963 [87:38:19<79:52:52, 16.42s/it]
 54%|█████▍    | 20451/37963 [87:38:33<76:13:40, 15.67s/it]
 54%|█████▍    | 20452/37963 [87:38:54<84:10:51, 17.31s/it]
 54%|█████▍    | 20453/37963 [87:39:08<79:54:10, 16.43s/it]
 54%|█████▍    | 20454/37963 [87:39:23<76:50:01, 15.80s/it]
 54%|█████▍    | 20455/37963 [87:39:37<74:42:57, 15.36s/it]
 54%|█████▍    | 20456/37963 [87:39:51<73:17:00, 15.07s/it]
 54%|█████▍    | 20457/37963 [87:40:12<82:08:06, 16.89s/it]
 54%|█████▍    | 20458/37963 [87:40:27<77:57:01, 16.03s/it]
 54%|█████▍    | 20459/37963 [87:40:41<75:27:54, 15.52s/it]
 54%|█████▍    | 20460/37963 [87:40:55<72:57:10, 15.00s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '2.207', 'learning_rate': '9.226e-06', 'epoch': '0.5389'}

 54%|█████▍    | 20460/37963 [87:40:55<72:57:10, 15.00s/it]
 54%|█████▍    | 20461/37963 [87:41:09<72:05:33, 14.83s/it]
 54%|█████▍    | 20462/37963 [87:41:23<71:23:22, 14.69s/it]
 54%|█████▍    | 20463/37963 [87:41:38<70:47:57, 14.56s/it]
 54%|█████▍    | 20464/37963 [87:41:51<69:19:45, 14.26s/it]
 54%|█████▍    | 20465/37963 [87:42:05<69:12:38, 14.24s/it]
 54%|█████▍    | 20466/37963 [87:42:20<69:27:13, 14.29s/it]
 54%|█████▍    | 20467/37963 [87:42:34<69:35:32, 14.32s/it]
 54%|█████▍    | 20468/37963 [87:42:49<69:44:38, 14.35s/it]
 54%|█████▍    | 20469/37963 [87:43:03<69:12:43, 14.24s/it]
 54%|█████▍    | 20470/37963 [87:43:24<79:27:50, 16.35s/it]
                                                           
{'loss': '0.1416', 'grad_norm': '1.219', 'learning_rate': '9.218e-06', 'epoch': '0.5392'}

 54%|█████▍    | 20470/37963 [87:43:24<79:27:50, 16.35s/it]
 54%|█████▍    | 20471/37963 [87:43:38<75:33:10, 15.55s/it]
 54%|█████▍    | 20472/37963 [87:43:52<73:37:44, 15.15s/it]
 54%|█████▍    | 20473/37963 [87:44:06<71:38:50, 14.75s/it]
 54%|█████▍    | 20474/37963 [87:44:20<71:04:40, 14.63s/it]
 54%|█████▍    | 20475/37963 [87:44:34<70:38:26, 14.54s/it]
 54%|█████▍    | 20476/37963 [87:44:49<70:19:31, 14.48s/it]
 54%|█████▍    | 20477/37963 [87:45:03<70:06:16, 14.43s/it]
 54%|█████▍    | 20478/37963 [87:45:17<69:31:32, 14.31s/it]
 54%|█████▍    | 20479/37963 [87:45:38<79:32:53, 16.38s/it]
 54%|█████▍    | 20480/37963 [87:45:52<76:03:31, 15.66s/it]
                                                           
{'loss': '0.1299', 'grad_norm': '1.182', 'learning_rate': '9.209e-06', 'epoch': '0.5395'}

 54%|█████▍    | 20480/37963 [87:45:52<76:03:31, 15.66s/it]
 54%|█████▍    | 20481/37963 [87:46:07<74:10:06, 15.27s/it]
 54%|█████▍    | 20482/37963 [87:46:21<72:39:19, 14.96s/it]
 54%|█████▍    | 20483/37963 [87:46:35<71:45:59, 14.78s/it]
 54%|█████▍    | 20484/37963 [87:46:49<70:37:50, 14.55s/it]
 54%|█████▍    | 20485/37963 [87:47:03<70:15:31, 14.47s/it]
 54%|█████▍    | 20486/37963 [87:47:18<69:46:45, 14.37s/it]
 54%|█████▍    | 20487/37963 [87:47:39<80:02:38, 16.49s/it]
 54%|█████▍    | 20488/37963 [87:47:53<76:59:13, 15.86s/it]
 54%|█████▍    | 20489/37963 [87:48:08<74:29:53, 15.35s/it]
 54%|█████▍    | 20490/37963 [87:48:28<82:10:07, 16.93s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '1.311', 'learning_rate': '9.201e-06', 'epoch': '0.5397'}

 54%|█████▍    | 20490/37963 [87:48:28<82:10:07, 16.93s/it]
 54%|█████▍    | 20491/37963 [87:48:43<78:21:06, 16.14s/it]
 54%|█████▍    | 20492/37963 [87:48:56<74:59:08, 15.45s/it]
 54%|█████▍    | 20493/37963 [87:49:17<82:24:34, 16.98s/it]
 54%|█████▍    | 20494/37963 [87:49:31<78:34:30, 16.19s/it]
 54%|█████▍    | 20495/37963 [87:49:52<84:45:31, 17.47s/it]
 54%|█████▍    | 20496/37963 [87:50:06<80:25:33, 16.58s/it]
 54%|█████▍    | 20497/37963 [87:50:21<77:17:02, 15.93s/it]
 54%|█████▍    | 20498/37963 [87:50:35<75:02:43, 15.47s/it]
 54%|█████▍    | 20499/37963 [87:50:50<73:44:57, 15.20s/it]
 54%|█████▍    | 20500/37963 [87:51:10<81:51:55, 16.88s/it]
                                                           
{'loss': '0.1378', 'grad_norm': '2.594', 'learning_rate': '9.192e-06', 'epoch': '0.54'}

 54%|█████▍    | 20500/37963 [87:51:10<81:51:55, 16.88s/it]
 54%|█████▍    | 20501/37963 [87:51:25<77:52:22, 16.05s/it]
 54%|█████▍    | 20502/37963 [87:51:38<74:31:20, 15.36s/it]
 54%|█████▍    | 20503/37963 [87:51:52<72:48:42, 15.01s/it]
 54%|█████▍    | 20504/37963 [87:52:06<71:20:39, 14.71s/it]
 54%|█████▍    | 20505/37963 [87:52:27<79:42:23, 16.44s/it]
 54%|█████▍    | 20506/37963 [87:52:42<77:03:16, 15.89s/it]
 54%|█████▍    | 20507/37963 [87:52:56<74:49:57, 15.43s/it]
 54%|█████▍    | 20508/37963 [87:53:10<73:13:41, 15.10s/it]
 54%|█████▍    | 20509/37963 [87:53:25<72:09:17, 14.88s/it]
 54%|█████▍    | 20510/37963 [87:53:38<70:30:18, 14.54s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '4.917', 'learning_rate': '9.184e-06', 'epoch': '0.5403'}

 54%|█████▍    | 20510/37963 [87:53:38<70:30:18, 14.54s/it]
 54%|█████▍    | 20511/37963 [87:53:53<70:16:30, 14.50s/it]
 54%|█████▍    | 20512/37963 [87:54:06<68:53:23, 14.21s/it]
 54%|█████▍    | 20513/37963 [87:54:20<68:41:10, 14.17s/it]
 54%|█████▍    | 20514/37963 [87:54:35<68:42:24, 14.18s/it]
 54%|█████▍    | 20515/37963 [87:54:49<68:53:30, 14.21s/it]
 54%|█████▍    | 20516/37963 [87:55:03<69:01:02, 14.24s/it]
 54%|█████▍    | 20517/37963 [87:55:17<68:50:35, 14.21s/it]
 54%|█████▍    | 20518/37963 [87:55:32<69:03:53, 14.25s/it]
 54%|█████▍    | 20519/37963 [87:55:53<79:00:09, 16.30s/it]
 54%|█████▍    | 20520/37963 [87:56:07<75:35:13, 15.60s/it]
                                                           
{'loss': '0.1421', 'grad_norm': '1.642', 'learning_rate': '9.175e-06', 'epoch': '0.5405'}

 54%|█████▍    | 20520/37963 [87:56:07<75:35:13, 15.60s/it]
 54%|█████▍    | 20521/37963 [87:56:21<73:44:35, 15.22s/it]
 54%|█████▍    | 20522/37963 [87:56:35<72:30:32, 14.97s/it]
 54%|█████▍    | 20523/37963 [87:56:50<71:33:56, 14.77s/it]
 54%|█████▍    | 20524/37963 [87:57:04<70:53:05, 14.63s/it]
 54%|█████▍    | 20525/37963 [87:57:18<70:20:13, 14.52s/it]
 54%|█████▍    | 20526/37963 [87:57:39<79:41:14, 16.45s/it]
 54%|█████▍    | 20527/37963 [87:57:54<76:38:34, 15.82s/it]
 54%|█████▍    | 20528/37963 [87:58:08<74:35:50, 15.40s/it]
 54%|█████▍    | 20529/37963 [87:58:22<72:29:07, 14.97s/it]
 54%|█████▍    | 20530/37963 [87:58:36<71:35:34, 14.78s/it]
                                                           
{'loss': '0.1368', 'grad_norm': '2.505', 'learning_rate': '9.167e-06', 'epoch': '0.5408'}

 54%|█████▍    | 20530/37963 [87:58:36<71:35:34, 14.78s/it]
 54%|█████▍    | 20531/37963 [87:58:50<70:29:31, 14.56s/it]
 54%|█████▍    | 20532/37963 [87:59:05<70:15:59, 14.51s/it]
 54%|█████▍    | 20533/37963 [87:59:25<79:00:49, 16.32s/it]
 54%|█████▍    | 20534/37963 [87:59:39<75:25:12, 15.58s/it]
 54%|█████▍    | 20535/37963 [87:59:54<73:42:20, 15.22s/it]
 54%|█████▍    | 20536/37963 [88:00:08<72:24:37, 14.96s/it]
 54%|█████▍    | 20537/37963 [88:00:22<71:28:20, 14.77s/it]
 54%|█████▍    | 20538/37963 [88:00:37<70:56:03, 14.66s/it]
 54%|█████▍    | 20539/37963 [88:00:51<70:29:11, 14.56s/it]
 54%|█████▍    | 20540/37963 [88:01:12<80:26:53, 16.62s/it]
                                                           
{'loss': '0.1428', 'grad_norm': '2.882', 'learning_rate': '9.158e-06', 'epoch': '0.5411'}

 54%|█████▍    | 20540/37963 [88:01:12<80:26:53, 16.62s/it]
 54%|█████▍    | 20541/37963 [88:01:33<86:13:11, 17.82s/it]
 54%|█████▍    | 20542/37963 [88:01:47<81:07:11, 16.76s/it]
 54%|█████▍    | 20543/37963 [88:02:01<77:21:36, 15.99s/it]
 54%|█████▍    | 20544/37963 [88:02:16<75:02:56, 15.51s/it]
 54%|█████▍    | 20545/37963 [88:02:37<82:38:25, 17.08s/it]
 54%|█████▍    | 20546/37963 [88:02:51<78:42:03, 16.27s/it]
 54%|█████▍    | 20547/37963 [88:03:12<85:06:40, 17.59s/it]
 54%|█████▍    | 20548/37963 [88:03:26<80:28:40, 16.64s/it]
 54%|█████▍    | 20549/37963 [88:03:40<77:06:19, 15.94s/it]
 54%|█████▍    | 20550/37963 [88:03:54<74:26:35, 15.39s/it]
                                                           
{'loss': '0.1354', 'grad_norm': '1.704', 'learning_rate': '9.15e-06', 'epoch': '0.5413'}

 54%|█████▍    | 20550/37963 [88:03:54<74:26:35, 15.39s/it]
 54%|█████▍    | 20551/37963 [88:04:09<72:52:20, 15.07s/it]
 54%|█████▍    | 20552/37963 [88:04:23<71:53:47, 14.87s/it]
 54%|█████▍    | 20553/37963 [88:04:38<71:11:25, 14.72s/it]
 54%|█████▍    | 20554/37963 [88:04:52<70:28:39, 14.57s/it]
 54%|█████▍    | 20555/37963 [88:05:06<70:13:17, 14.52s/it]
 54%|█████▍    | 20556/37963 [88:05:27<79:44:34, 16.49s/it]
 54%|█████▍    | 20557/37963 [88:05:41<76:23:52, 15.80s/it]
 54%|█████▍    | 20558/37963 [88:05:56<74:17:46, 15.37s/it]
 54%|█████▍    | 20559/37963 [88:06:10<72:49:10, 15.06s/it]
 54%|█████▍    | 20560/37963 [88:06:25<71:46:50, 14.85s/it]
                                                           
{'loss': '0.138', 'grad_norm': '1.633', 'learning_rate': '9.141e-06', 'epoch': '0.5416'}

 54%|█████▍    | 20560/37963 [88:06:25<71:46:50, 14.85s/it]
 54%|█████▍    | 20561/37963 [88:06:39<70:59:27, 14.69s/it]
 54%|█████▍    | 20562/37963 [88:06:53<70:27:13, 14.58s/it]
 54%|█████▍    | 20563/37963 [88:07:07<69:26:36, 14.37s/it]
 54%|█████▍    | 20564/37963 [88:07:21<69:25:15, 14.36s/it]
 54%|█████▍    | 20565/37963 [88:07:36<69:27:12, 14.37s/it]
 54%|█████▍    | 20566/37963 [88:07:57<79:15:46, 16.40s/it]
 54%|█████▍    | 20567/37963 [88:08:11<75:11:45, 15.56s/it]
 54%|█████▍    | 20568/37963 [88:08:25<73:15:49, 15.16s/it]
 54%|█████▍    | 20569/37963 [88:08:39<71:33:56, 14.81s/it]
 54%|█████▍    | 20570/37963 [88:08:53<70:58:16, 14.69s/it]
                                                           
{'loss': '0.1351', 'grad_norm': '1.78', 'learning_rate': '9.133e-06', 'epoch': '0.5418'}

 54%|█████▍    | 20570/37963 [88:08:53<70:58:16, 14.69s/it]
 54%|█████▍    | 20571/37963 [88:09:07<70:24:38, 14.57s/it]
 54%|█████▍    | 20572/37963 [88:09:22<70:07:17, 14.52s/it]
 54%|█████▍    | 20573/37963 [88:09:36<69:54:49, 14.47s/it]
 54%|█████▍    | 20574/37963 [88:09:51<69:42:09, 14.43s/it]
 54%|█████▍    | 20575/37963 [88:10:05<69:36:32, 14.41s/it]
 54%|█████▍    | 20576/37963 [88:10:19<69:29:38, 14.39s/it]
 54%|█████▍    | 20577/37963 [88:10:33<68:35:34, 14.20s/it]
 54%|█████▍    | 20578/37963 [88:10:54<78:08:13, 16.18s/it]
 54%|█████▍    | 20579/37963 [88:11:08<75:25:28, 15.62s/it]
 54%|█████▍    | 20580/37963 [88:11:23<73:45:13, 15.27s/it]
                                                           
{'loss': '0.1369', 'grad_norm': '3.401', 'learning_rate': '9.124e-06', 'epoch': '0.5421'}

 54%|█████▍    | 20580/37963 [88:11:23<73:45:13, 15.27s/it]
 54%|█████▍    | 20581/37963 [88:11:36<71:42:56, 14.85s/it]
 54%|█████▍    | 20582/37963 [88:11:50<69:42:01, 14.44s/it]
 54%|█████▍    | 20583/37963 [88:12:04<69:30:29, 14.40s/it]
 54%|█████▍    | 20584/37963 [88:12:26<79:54:30, 16.55s/it]
 54%|█████▍    | 20585/37963 [88:12:40<76:17:15, 15.80s/it]
 54%|█████▍    | 20586/37963 [88:12:54<74:07:39, 15.36s/it]
 54%|█████▍    | 20587/37963 [88:13:15<81:41:54, 16.93s/it]
 54%|█████▍    | 20588/37963 [88:13:29<77:56:10, 16.15s/it]
 54%|█████▍    | 20589/37963 [88:13:44<75:30:47, 15.65s/it]
 54%|█████▍    | 20590/37963 [88:14:04<82:30:21, 17.10s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '1.871', 'learning_rate': '9.116e-06', 'epoch': '0.5424'}

 54%|█████▍    | 20590/37963 [88:14:04<82:30:21, 17.10s/it]
 54%|█████▍    | 20591/37963 [88:14:18<78:33:24, 16.28s/it]
 54%|█████▍    | 20592/37963 [88:14:32<74:50:07, 15.51s/it]
 54%|█████▍    | 20593/37963 [88:14:46<73:07:40, 15.16s/it]
 54%|█████▍    | 20594/37963 [88:15:01<71:55:48, 14.91s/it]
 54%|█████▍    | 20595/37963 [88:15:15<71:12:05, 14.76s/it]
 54%|█████▍    | 20596/37963 [88:15:36<79:34:25, 16.49s/it]
 54%|█████▍    | 20597/37963 [88:15:50<75:58:00, 15.75s/it]
 54%|█████▍    | 20598/37963 [88:16:04<73:58:41, 15.34s/it]
 54%|█████▍    | 20599/37963 [88:16:25<81:24:45, 16.88s/it]
 54%|█████▍    | 20600/37963 [88:16:39<77:42:06, 16.11s/it]
                                                           
{'loss': '0.1426', 'grad_norm': '1.705', 'learning_rate': '9.107e-06', 'epoch': '0.5426'}

 54%|█████▍    | 20600/37963 [88:16:39<77:42:06, 16.11s/it]
 54%|█████▍    | 20601/37963 [88:16:53<75:10:46, 15.59s/it]
 54%|█████▍    | 20602/37963 [88:17:08<73:19:03, 15.20s/it]
 54%|█████▍    | 20603/37963 [88:17:22<72:00:23, 14.93s/it]
 54%|█████▍    | 20604/37963 [88:17:43<81:11:13, 16.84s/it]
 54%|█████▍    | 20605/37963 [88:17:57<77:20:38, 16.04s/it]
 54%|█████▍    | 20606/37963 [88:18:12<74:54:04, 15.54s/it]
 54%|█████▍    | 20607/37963 [88:18:26<73:02:07, 15.15s/it]
 54%|█████▍    | 20608/37963 [88:18:40<71:19:01, 14.79s/it]
 54%|█████▍    | 20609/37963 [88:18:54<70:24:46, 14.61s/it]
 54%|█████▍    | 20610/37963 [88:19:08<69:59:18, 14.52s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '1.628', 'learning_rate': '9.099e-06', 'epoch': '0.5429'}

 54%|█████▍    | 20610/37963 [88:19:08<69:59:18, 14.52s/it]
 54%|█████▍    | 20611/37963 [88:19:23<69:40:53, 14.46s/it]
 54%|█████▍    | 20612/37963 [88:19:37<69:27:35, 14.41s/it]
 54%|█████▍    | 20613/37963 [88:19:51<69:15:47, 14.37s/it]
 54%|█████▍    | 20614/37963 [88:20:12<79:01:36, 16.40s/it]
 54%|█████▍    | 20615/37963 [88:20:26<75:08:20, 15.59s/it]
 54%|█████▍    | 20616/37963 [88:20:40<73:01:45, 15.16s/it]
 54%|█████▍    | 20617/37963 [88:20:55<71:44:44, 14.89s/it]
 54%|█████▍    | 20618/37963 [88:21:09<70:56:30, 14.72s/it]
 54%|█████▍    | 20619/37963 [88:21:23<70:29:55, 14.63s/it]
 54%|█████▍    | 20620/37963 [88:21:38<70:06:25, 14.55s/it]
                                                           
{'loss': '0.1325', 'grad_norm': '3.08', 'learning_rate': '9.09e-06', 'epoch': '0.5432'}

 54%|█████▍    | 20620/37963 [88:21:38<70:06:25, 14.55s/it]
 54%|█████▍    | 20621/37963 [88:21:52<69:48:31, 14.49s/it]
 54%|█████▍    | 20622/37963 [88:22:06<69:05:14, 14.34s/it]
 54%|█████▍    | 20623/37963 [88:22:21<69:16:01, 14.38s/it]
 54%|█████▍    | 20624/37963 [88:22:35<68:56:22, 14.31s/it]
 54%|█████▍    | 20625/37963 [88:22:49<68:45:35, 14.28s/it]
 54%|█████▍    | 20626/37963 [88:23:03<68:50:08, 14.29s/it]
 54%|█████▍    | 20627/37963 [88:23:24<78:05:59, 16.22s/it]
 54%|█████▍    | 20628/37963 [88:23:38<75:23:56, 15.66s/it]
 54%|█████▍    | 20629/37963 [88:23:53<73:37:40, 15.29s/it]
 54%|█████▍    | 20630/37963 [88:24:07<72:14:41, 15.01s/it]
                                                           
{'loss': '0.1355', 'grad_norm': '3.753', 'learning_rate': '9.082e-06', 'epoch': '0.5434'}

 54%|█████▍    | 20630/37963 [88:24:07<72:14:41, 15.01s/it]
 54%|█████▍    | 20631/37963 [88:24:21<71:00:15, 14.75s/it]
 54%|█████▍    | 20632/37963 [88:24:35<70:18:41, 14.61s/it]
 54%|█████▍    | 20633/37963 [88:24:49<69:12:59, 14.38s/it]
 54%|█████▍    | 20634/37963 [88:25:10<78:58:23, 16.41s/it]
 54%|█████▍    | 20635/37963 [88:25:31<85:13:34, 17.71s/it]
 54%|█████▍    | 20636/37963 [88:25:46<80:21:42, 16.70s/it]
 54%|█████▍    | 20637/37963 [88:25:59<76:17:26, 15.85s/it]
 54%|█████▍    | 20638/37963 [88:26:13<73:27:47, 15.27s/it]
 54%|█████▍    | 20639/37963 [88:26:34<80:56:15, 16.82s/it]
 54%|█████▍    | 20640/37963 [88:26:48<77:26:00, 16.09s/it]
                                                           
{'loss': '0.1392', 'grad_norm': '1.437', 'learning_rate': '9.073e-06', 'epoch': '0.5437'}

 54%|█████▍    | 20640/37963 [88:26:48<77:26:00, 16.09s/it]
 54%|█████▍    | 20641/37963 [88:27:03<75:00:32, 15.59s/it]
 54%|█████▍    | 20642/37963 [88:27:17<73:50:00, 15.35s/it]
 54%|█████▍    | 20643/37963 [88:27:32<72:29:54, 15.07s/it]
 54%|█████▍    | 20644/37963 [88:27:53<81:47:35, 17.00s/it]
 54%|█████▍    | 20645/37963 [88:28:14<87:11:30, 18.13s/it]
 54%|█████▍    | 20646/37963 [88:28:28<81:48:00, 17.01s/it]
 54%|█████▍    | 20647/37963 [88:28:43<77:58:44, 16.21s/it]
 54%|█████▍    | 20648/37963 [88:28:57<74:56:43, 15.58s/it]
 54%|█████▍    | 20649/37963 [88:29:11<72:37:55, 15.10s/it]
 54%|█████▍    | 20650/37963 [88:29:25<71:28:17, 14.86s/it]
                                                           
{'loss': '0.1241', 'grad_norm': '1.272', 'learning_rate': '9.065e-06', 'epoch': '0.544'}

 54%|█████▍    | 20650/37963 [88:29:25<71:28:17, 14.86s/it]
 54%|█████▍    | 20651/37963 [88:29:40<70:55:50, 14.75s/it]
 54%|█████▍    | 20652/37963 [88:29:54<70:19:43, 14.63s/it]
 54%|█████▍    | 20653/37963 [88:30:08<70:02:54, 14.57s/it]
 54%|█████▍    | 20654/37963 [88:30:29<79:25:24, 16.52s/it]
 54%|█████▍    | 20655/37963 [88:30:44<76:19:39, 15.88s/it]
 54%|█████▍    | 20656/37963 [88:30:58<74:08:59, 15.42s/it]
 54%|█████▍    | 20657/37963 [88:31:12<71:24:06, 14.85s/it]
 54%|█████▍    | 20658/37963 [88:31:26<70:43:08, 14.71s/it]
 54%|█████▍    | 20659/37963 [88:31:41<70:16:37, 14.62s/it]
 54%|█████▍    | 20660/37963 [88:31:55<70:09:56, 14.60s/it]
                                                           
{'loss': '0.1435', 'grad_norm': '2.164', 'learning_rate': '9.056e-06', 'epoch': '0.5442'}

 54%|█████▍    | 20660/37963 [88:31:55<70:09:56, 14.60s/it]
 54%|█████▍    | 20661/37963 [88:32:09<69:17:24, 14.42s/it]
 54%|█████▍    | 20662/37963 [88:32:30<77:58:50, 16.23s/it]
 54%|█████▍    | 20663/37963 [88:32:44<75:33:25, 15.72s/it]
 54%|█████▍    | 20664/37963 [88:32:58<73:28:14, 15.29s/it]
 54%|█████▍    | 20665/37963 [88:33:13<72:06:10, 15.01s/it]
 54%|█████▍    | 20666/37963 [88:33:27<70:37:13, 14.70s/it]
 54%|█████▍    | 20667/37963 [88:33:41<70:13:15, 14.62s/it]
 54%|█████▍    | 20668/37963 [88:33:56<70:04:17, 14.59s/it]
 54%|█████▍    | 20669/37963 [88:34:09<69:02:42, 14.37s/it]
 54%|█████▍    | 20670/37963 [88:34:24<68:55:53, 14.35s/it]
                                                           
{'loss': '0.1385', 'grad_norm': '3.803', 'learning_rate': '9.048e-06', 'epoch': '0.5445'}

 54%|█████▍    | 20670/37963 [88:34:24<68:55:53, 14.35s/it]
 54%|█████▍    | 20671/37963 [88:34:38<68:53:17, 14.34s/it]
 54%|█████▍    | 20672/37963 [88:34:52<68:36:32, 14.28s/it]
 54%|█████▍    | 20673/37963 [88:35:06<68:23:48, 14.24s/it]
 54%|█████▍    | 20674/37963 [88:35:21<68:39:57, 14.30s/it]
 54%|█████▍    | 20675/37963 [88:35:41<76:39:56, 15.96s/it]
 54%|█████▍    | 20676/37963 [88:35:55<73:48:17, 15.37s/it]
 54%|█████▍    | 20677/37963 [88:36:09<72:36:35, 15.12s/it]
 54%|█████▍    | 20678/37963 [88:36:23<71:22:43, 14.87s/it]
 54%|█████▍    | 20679/37963 [88:36:38<70:38:28, 14.71s/it]
 54%|█████▍    | 20680/37963 [88:36:59<79:35:10, 16.58s/it]
                                                           
{'loss': '0.1469', 'grad_norm': '1.239', 'learning_rate': '9.039e-06', 'epoch': '0.5447'}

 54%|█████▍    | 20680/37963 [88:36:59<79:35:10, 16.58s/it]
 54%|█████▍    | 20681/37963 [88:37:13<76:31:07, 15.94s/it]
 54%|█████▍    | 20682/37963 [88:37:28<74:12:20, 15.46s/it]
 54%|█████▍    | 20683/37963 [88:37:42<72:45:17, 15.16s/it]
 54%|█████▍    | 20684/37963 [88:37:56<71:30:45, 14.90s/it]
 54%|█████▍    | 20685/37963 [88:38:17<79:13:19, 16.51s/it]
 54%|█████▍    | 20686/37963 [88:38:30<75:05:31, 15.65s/it]
 54%|█████▍    | 20687/37963 [88:38:44<73:00:48, 15.21s/it]
 54%|█████▍    | 20688/37963 [88:38:59<71:49:00, 14.97s/it]
 54%|█████▍    | 20689/37963 [88:39:20<80:13:31, 16.72s/it]
 55%|█████▍    | 20690/37963 [88:39:40<85:46:11, 17.88s/it]
                                                           
{'loss': '0.1334', 'grad_norm': '2.665', 'learning_rate': '9.031e-06', 'epoch': '0.545'}

 55%|█████▍    | 20690/37963 [88:39:40<85:46:11, 17.88s/it]
 55%|█████▍    | 20691/37963 [88:39:54<80:24:11, 16.76s/it]
 55%|█████▍    | 20692/37963 [88:40:08<76:18:04, 15.90s/it]
 55%|█████▍    | 20693/37963 [88:40:30<84:21:49, 17.59s/it]
 55%|█████▍    | 20694/37963 [88:40:44<79:45:47, 16.63s/it]
 55%|█████▍    | 20695/37963 [88:40:58<76:25:04, 15.93s/it]
 55%|█████▍    | 20696/37963 [88:41:13<74:12:28, 15.47s/it]
 55%|█████▍    | 20697/37963 [88:41:27<71:50:23, 14.98s/it]
 55%|█████▍    | 20698/37963 [88:41:41<70:44:08, 14.75s/it]
 55%|█████▍    | 20699/37963 [88:41:55<70:12:15, 14.64s/it]
 55%|█████▍    | 20700/37963 [88:42:09<68:48:59, 14.35s/it]
                                                           
{'loss': '0.1316', 'grad_norm': '1.731', 'learning_rate': '9.022e-06', 'epoch': '0.5453'}

 55%|█████▍    | 20700/37963 [88:42:09<68:48:59, 14.35s/it]
 55%|█████▍    | 20701/37963 [88:42:30<78:28:29, 16.37s/it]
 55%|█████▍    | 20702/37963 [88:42:44<74:29:46, 15.54s/it]
 55%|█████▍    | 20703/37963 [88:42:58<72:48:08, 15.18s/it]
 55%|█████▍    | 20704/37963 [88:43:12<71:35:25, 14.93s/it]
 55%|█████▍    | 20705/37963 [88:43:27<70:48:09, 14.77s/it]
 55%|█████▍    | 20706/37963 [88:43:41<70:13:19, 14.65s/it]
 55%|█████▍    | 20707/37963 [88:43:55<69:48:50, 14.56s/it]
 55%|█████▍    | 20708/37963 [88:44:10<69:29:50, 14.50s/it]
 55%|█████▍    | 20709/37963 [88:44:24<69:20:37, 14.47s/it]
 55%|█████▍    | 20710/37963 [88:44:46<79:12:06, 16.53s/it]
                                                           
{'loss': '0.1379', 'grad_norm': '1.523', 'learning_rate': '9.014e-06', 'epoch': '0.5455'}

 55%|█████▍    | 20710/37963 [88:44:46<79:12:06, 16.53s/it]
 55%|█████▍    | 20711/37963 [88:45:00<76:00:20, 15.86s/it]
 55%|█████▍    | 20712/37963 [88:45:14<73:19:42, 15.30s/it]
 55%|█████▍    | 20713/37963 [88:45:28<71:57:32, 15.02s/it]
 55%|█████▍    | 20714/37963 [88:45:43<70:57:53, 14.81s/it]
 55%|█████▍    | 20715/37963 [88:45:56<69:43:00, 14.55s/it]
 55%|█████▍    | 20716/37963 [88:46:11<69:19:25, 14.47s/it]
 55%|█████▍    | 20717/37963 [88:46:25<69:04:29, 14.42s/it]
 55%|█████▍    | 20718/37963 [88:46:39<68:36:37, 14.32s/it]
 55%|█████▍    | 20719/37963 [88:46:53<68:12:11, 14.24s/it]
 55%|█████▍    | 20720/37963 [88:47:07<68:13:49, 14.25s/it]
                                                           
{'loss': '0.1342', 'grad_norm': '3.063', 'learning_rate': '9.005e-06', 'epoch': '0.5458'}

 55%|█████▍    | 20720/37963 [88:47:07<68:13:49, 14.25s/it]
 55%|█████▍    | 20721/37963 [88:47:21<67:30:42, 14.10s/it]
 55%|█████▍    | 20722/37963 [88:47:36<67:48:20, 14.16s/it]
 55%|█████▍    | 20723/37963 [88:47:50<67:57:50, 14.19s/it]
 55%|█████▍    | 20724/37963 [88:48:04<68:07:52, 14.23s/it]
 55%|█████▍    | 20725/37963 [88:48:25<77:04:26, 16.10s/it]
 55%|█████▍    | 20726/37963 [88:48:38<73:23:09, 15.33s/it]
 55%|█████▍    | 20727/37963 [88:48:52<71:56:41, 15.03s/it]
 55%|█████▍    | 20728/37963 [88:49:07<70:56:45, 14.82s/it]
 55%|█████▍    | 20729/37963 [88:49:21<69:49:16, 14.58s/it]
 55%|█████▍    | 20730/37963 [88:49:42<79:30:09, 16.61s/it]
                                                           
{'loss': '0.1402', 'grad_norm': '2.701', 'learning_rate': '8.997e-06', 'epoch': '0.5461'}

 55%|█████▍    | 20730/37963 [88:49:42<79:30:09, 16.61s/it]
 55%|█████▍    | 20731/37963 [88:49:56<76:11:04, 15.92s/it]
 55%|█████▍    | 20732/37963 [88:50:11<73:58:56, 15.46s/it]
 55%|█████▍    | 20733/37963 [88:50:25<72:23:59, 15.13s/it]
 55%|█████▍    | 20734/37963 [88:50:45<79:51:19, 16.69s/it]
 55%|█████▍    | 20735/37963 [88:51:00<76:33:09, 16.00s/it]
 55%|█████▍    | 20736/37963 [88:51:14<73:40:58, 15.40s/it]
 55%|█████▍    | 20737/37963 [88:51:28<72:10:17, 15.08s/it]
 55%|█████▍    | 20738/37963 [88:51:43<71:17:34, 14.90s/it]
 55%|█████▍    | 20739/37963 [88:52:03<79:46:15, 16.67s/it]
 55%|█████▍    | 20740/37963 [88:52:17<75:31:11, 15.79s/it]
                                                           
{'loss': '0.1351', 'grad_norm': '2.392', 'learning_rate': '8.988e-06', 'epoch': '0.5463'}

 55%|█████▍    | 20740/37963 [88:52:17<75:31:11, 15.79s/it]
 55%|█████▍    | 20741/37963 [88:52:38<82:37:50, 17.27s/it]
 55%|█████▍    | 20742/37963 [88:52:52<78:27:11, 16.40s/it]
 55%|█████▍    | 20743/37963 [88:53:13<84:52:24, 17.74s/it]
 55%|█████▍    | 20744/37963 [88:53:27<79:55:22, 16.71s/it]
 55%|█████▍    | 20745/37963 [88:53:42<76:36:07, 16.02s/it]
 55%|█████▍    | 20746/37963 [88:53:56<74:06:05, 15.49s/it]
 55%|█████▍    | 20747/37963 [88:54:10<72:25:09, 15.14s/it]
 55%|█████▍    | 20748/37963 [88:54:24<70:32:20, 14.75s/it]
 55%|█████▍    | 20749/37963 [88:54:39<69:56:14, 14.63s/it]
 55%|█████▍    | 20750/37963 [88:55:00<80:03:53, 16.75s/it]
                                                           
{'loss': '0.1498', 'grad_norm': '1.522', 'learning_rate': '8.98e-06', 'epoch': '0.5466'}

 55%|█████▍    | 20750/37963 [88:55:00<80:03:53, 16.75s/it]
 55%|█████▍    | 20751/37963 [88:55:15<76:38:13, 16.03s/it]
 55%|█████▍    | 20752/37963 [88:55:29<74:12:47, 15.52s/it]
 55%|█████▍    | 20753/37963 [88:55:43<72:17:05, 15.12s/it]
 55%|█████▍    | 20754/37963 [88:55:58<71:12:34, 14.90s/it]
 55%|█████▍    | 20755/37963 [88:56:12<69:50:43, 14.61s/it]
 55%|█████▍    | 20756/37963 [88:56:26<69:30:04, 14.54s/it]
 55%|█████▍    | 20757/37963 [88:56:40<69:07:42, 14.46s/it]
 55%|█████▍    | 20758/37963 [88:56:55<68:55:08, 14.42s/it]
 55%|█████▍    | 20759/37963 [88:57:09<68:43:28, 14.38s/it]
 55%|█████▍    | 20760/37963 [88:57:23<68:49:58, 14.40s/it]
                                                           
{'loss': '0.1325', 'grad_norm': '2.27', 'learning_rate': '8.971e-06', 'epoch': '0.5469'}

 55%|█████▍    | 20760/37963 [88:57:23<68:49:58, 14.40s/it]
 55%|█████▍    | 20761/37963 [88:57:44<78:32:22, 16.44s/it]
 55%|█████▍    | 20762/37963 [88:57:59<75:41:40, 15.84s/it]
 55%|█████▍    | 20763/37963 [88:58:13<73:34:35, 15.40s/it]
 55%|█████▍    | 20764/37963 [88:58:28<72:07:57, 15.10s/it]
 55%|█████▍    | 20765/37963 [88:58:42<71:01:33, 14.87s/it]
 55%|█████▍    | 20766/37963 [88:58:56<70:12:32, 14.70s/it]
 55%|█████▍    | 20767/37963 [88:59:10<69:05:22, 14.46s/it]
 55%|█████▍    | 20768/37963 [88:59:24<68:34:34, 14.36s/it]
 55%|█████▍    | 20769/37963 [88:59:39<68:37:32, 14.37s/it]
 55%|█████▍    | 20770/37963 [88:59:53<68:33:46, 14.36s/it]
                                                           
{'loss': '0.13', 'grad_norm': '1.712', 'learning_rate': '8.963e-06', 'epoch': '0.5471'}

 55%|█████▍    | 20770/37963 [88:59:53<68:33:46, 14.36s/it]
 55%|█████▍    | 20771/37963 [89:00:07<68:33:22, 14.36s/it]
 55%|█████▍    | 20772/37963 [89:00:21<68:06:27, 14.26s/it]
 55%|█████▍    | 20773/37963 [89:00:35<67:44:38, 14.19s/it]
 55%|█████▍    | 20774/37963 [89:00:56<77:26:22, 16.22s/it]
 55%|█████▍    | 20775/37963 [89:01:11<74:46:05, 15.66s/it]
 55%|█████▍    | 20776/37963 [89:01:25<72:41:33, 15.23s/it]
 55%|█████▍    | 20777/37963 [89:01:39<71:29:59, 14.98s/it]
 55%|█████▍    | 20778/37963 [89:02:00<80:03:28, 16.77s/it]
 55%|█████▍    | 20779/37963 [89:02:15<76:43:39, 16.07s/it]
 55%|█████▍    | 20780/37963 [89:02:29<74:27:06, 15.60s/it]
                                                           
{'loss': '0.1469', 'grad_norm': '2.473', 'learning_rate': '8.954e-06', 'epoch': '0.5474'}

 55%|█████▍    | 20780/37963 [89:02:29<74:27:06, 15.60s/it]
 55%|█████▍    | 20781/37963 [89:02:44<72:47:58, 15.25s/it]
 55%|█████▍    | 20782/37963 [89:02:58<71:47:00, 15.04s/it]
 55%|█████▍    | 20783/37963 [89:03:19<79:39:43, 16.69s/it]
 55%|█████▍    | 20784/37963 [89:03:33<76:19:02, 15.99s/it]
 55%|█████▍    | 20785/37963 [89:03:48<74:00:00, 15.51s/it]
 55%|█████▍    | 20786/37963 [89:04:02<72:04:22, 15.11s/it]
 55%|█████▍    | 20787/37963 [89:04:23<80:16:25, 16.82s/it]
 55%|█████▍    | 20788/37963 [89:04:43<85:47:37, 17.98s/it]
 55%|█████▍    | 20789/37963 [89:04:58<80:36:25, 16.90s/it]
 55%|█████▍    | 20790/37963 [89:05:12<77:04:43, 16.16s/it]
                                                           
{'loss': '0.1423', 'grad_norm': '2.223', 'learning_rate': '8.946e-06', 'epoch': '0.5476'}

 55%|█████▍    | 20790/37963 [89:05:12<77:04:43, 16.16s/it]
 55%|█████▍    | 20791/37963 [89:05:33<83:56:20, 17.60s/it]
 55%|█████▍    | 20792/37963 [89:05:47<79:21:46, 16.64s/it]
 55%|█████▍    | 20793/37963 [89:06:02<76:07:12, 15.96s/it]
 55%|█████▍    | 20794/37963 [89:06:16<74:05:37, 15.54s/it]
 55%|█████▍    | 20795/37963 [89:06:31<72:21:42, 15.17s/it]
 55%|█████▍    | 20796/37963 [89:06:45<71:12:17, 14.93s/it]
 55%|█████▍    | 20797/37963 [89:06:59<70:24:46, 14.77s/it]
 55%|█████▍    | 20798/37963 [89:07:21<79:41:39, 16.71s/it]
 55%|█████▍    | 20799/37963 [89:07:34<75:17:50, 15.79s/it]
 55%|█████▍    | 20800/37963 [89:07:49<73:23:42, 15.39s/it]
                                                           
{'loss': '0.1301', 'grad_norm': '3.908', 'learning_rate': '8.937e-06', 'epoch': '0.5479'}

 55%|█████▍    | 20800/37963 [89:07:49<73:23:42, 15.39s/it]
 55%|█████▍    | 20801/37963 [89:08:03<71:23:44, 14.98s/it]
 55%|█████▍    | 20802/37963 [89:08:17<70:27:01, 14.78s/it]
 55%|█████▍    | 20803/37963 [89:08:31<69:48:14, 14.64s/it]
 55%|█████▍    | 20804/37963 [89:08:46<69:18:23, 14.54s/it]
 55%|█████▍    | 20805/37963 [89:09:00<69:00:15, 14.48s/it]
 55%|█████▍    | 20806/37963 [89:09:14<68:56:02, 14.46s/it]
 55%|█████▍    | 20807/37963 [89:09:29<68:42:28, 14.42s/it]
 55%|█████▍    | 20808/37963 [89:09:43<68:43:48, 14.42s/it]
 55%|█████▍    | 20809/37963 [89:09:58<68:38:46, 14.41s/it]
 55%|█████▍    | 20810/37963 [89:10:18<77:47:53, 16.33s/it]
                                                           
{'loss': '0.1194', 'grad_norm': '1.556', 'learning_rate': '8.929e-06', 'epoch': '0.5482'}

 55%|█████▍    | 20810/37963 [89:10:18<77:47:53, 16.33s/it]
 55%|█████▍    | 20811/37963 [89:10:33<74:59:09, 15.74s/it]
 55%|█████▍    | 20812/37963 [89:10:47<73:07:01, 15.35s/it]
 55%|█████▍    | 20813/37963 [89:11:02<72:08:28, 15.14s/it]
 55%|█████▍    | 20814/37963 [89:11:16<71:01:51, 14.91s/it]
 55%|█████▍    | 20815/37963 [89:11:30<70:01:04, 14.70s/it]
 55%|█████▍    | 20816/37963 [89:11:45<69:27:11, 14.58s/it]
 55%|█████▍    | 20817/37963 [89:11:59<69:05:24, 14.51s/it]
 55%|█████▍    | 20818/37963 [89:12:13<67:46:29, 14.23s/it]
 55%|█████▍    | 20819/37963 [89:12:27<67:54:40, 14.26s/it]
 55%|█████▍    | 20820/37963 [89:12:41<67:07:44, 14.10s/it]
                                                           
{'loss': '0.1243', 'grad_norm': '1.485', 'learning_rate': '8.92e-06', 'epoch': '0.5484'}

 55%|█████▍    | 20820/37963 [89:12:41<67:07:44, 14.10s/it]
 55%|█████▍    | 20821/37963 [89:12:55<67:01:47, 14.08s/it]
 55%|█████▍    | 20822/37963 [89:13:09<67:22:15, 14.15s/it]
 55%|█████▍    | 20823/37963 [89:13:23<67:40:06, 14.21s/it]
 55%|█████▍    | 20824/37963 [89:13:44<76:44:09, 16.12s/it]
 55%|█████▍    | 20825/37963 [89:14:05<83:47:06, 17.60s/it]
 55%|█████▍    | 20826/37963 [89:14:19<79:17:06, 16.66s/it]
 55%|█████▍    | 20827/37963 [89:14:34<75:57:14, 15.96s/it]
 55%|█████▍    | 20828/37963 [89:14:48<73:50:28, 15.51s/it]
 55%|█████▍    | 20829/37963 [89:15:03<72:09:42, 15.16s/it]
 55%|█████▍    | 20830/37963 [89:15:17<71:02:29, 14.93s/it]
                                                           
{'loss': '0.1392', 'grad_norm': '2.408', 'learning_rate': '8.912e-06', 'epoch': '0.5487'}

 55%|█████▍    | 20830/37963 [89:15:17<71:02:29, 14.93s/it]
 55%|█████▍    | 20831/37963 [89:15:32<70:31:44, 14.82s/it]
 55%|█████▍    | 20832/37963 [89:15:52<78:00:01, 16.39s/it]
 55%|█████▍    | 20833/37963 [89:16:06<75:00:17, 15.76s/it]
 55%|█████▍    | 20834/37963 [89:16:20<73:04:20, 15.36s/it]
 55%|█████▍    | 20835/37963 [89:16:35<71:35:30, 15.05s/it]
 55%|█████▍    | 20836/37963 [89:16:55<79:42:48, 16.76s/it]
 55%|█████▍    | 20837/37963 [89:17:09<75:36:57, 15.90s/it]
 55%|█████▍    | 20838/37963 [89:17:30<82:56:21, 17.44s/it]
 55%|█████▍    | 20839/37963 [89:17:45<78:38:04, 16.53s/it]
 55%|█████▍    | 20840/37963 [89:17:59<75:42:25, 15.92s/it]
                                                           
{'loss': '0.144', 'grad_norm': '1.737', 'learning_rate': '8.903e-06', 'epoch': '0.549'}

 55%|█████▍    | 20840/37963 [89:17:59<75:42:25, 15.92s/it]
 55%|█████▍    | 20841/37963 [89:18:13<73:08:25, 15.38s/it]
 55%|█████▍    | 20842/37963 [89:18:34<80:08:59, 16.85s/it]
 55%|█████▍    | 20843/37963 [89:18:48<76:20:02, 16.05s/it]
 55%|█████▍    | 20844/37963 [89:19:02<73:53:02, 15.54s/it]
 55%|█████▍    | 20845/37963 [89:19:17<72:09:51, 15.18s/it]
 55%|█████▍    | 20846/37963 [89:19:37<80:21:39, 16.90s/it]
 55%|█████▍    | 20847/37963 [89:19:52<76:42:58, 16.14s/it]
 55%|█████▍    | 20848/37963 [89:20:06<74:10:30, 15.60s/it]
 55%|█████▍    | 20849/37963 [89:20:21<72:31:42, 15.26s/it]
 55%|█████▍    | 20850/37963 [89:20:35<71:08:05, 14.96s/it]
                                                           
{'loss': '0.1385', 'grad_norm': '1.964', 'learning_rate': '8.895e-06', 'epoch': '0.5492'}

 55%|█████▍    | 20850/37963 [89:20:35<71:08:05, 14.96s/it]
 55%|█████▍    | 20851/37963 [89:20:49<70:19:25, 14.79s/it]
 55%|█████▍    | 20852/37963 [89:21:04<69:39:11, 14.65s/it]
 55%|█████▍    | 20853/37963 [89:21:18<69:16:40, 14.58s/it]
 55%|█████▍    | 20854/37963 [89:21:32<68:11:37, 14.35s/it]
 55%|█████▍    | 20855/37963 [89:21:46<67:57:23, 14.30s/it]
 55%|█████▍    | 20856/37963 [89:22:00<68:01:09, 14.31s/it]
 55%|█████▍    | 20857/37963 [89:22:14<67:16:00, 14.16s/it]
 55%|█████▍    | 20858/37963 [89:22:35<77:20:37, 16.28s/it]
 55%|█████▍    | 20859/37963 [89:22:50<74:33:54, 15.69s/it]
 55%|█████▍    | 20860/37963 [89:23:04<72:41:11, 15.30s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '2.696', 'learning_rate': '8.886e-06', 'epoch': '0.5495'}

 55%|█████▍    | 20860/37963 [89:23:04<72:41:11, 15.30s/it]
 55%|█████▍    | 20861/37963 [89:23:18<71:25:01, 15.03s/it]
 55%|█████▍    | 20862/37963 [89:23:33<70:17:52, 14.80s/it]
 55%|█████▍    | 20863/37963 [89:23:47<69:42:14, 14.67s/it]
 55%|█████▍    | 20864/37963 [89:24:01<68:31:03, 14.43s/it]
 55%|█████▍    | 20865/37963 [89:24:15<68:26:32, 14.41s/it]
 55%|█████▍    | 20866/37963 [89:24:30<68:21:07, 14.39s/it]
 55%|█████▍    | 20867/37963 [89:24:44<68:10:23, 14.36s/it]
 55%|█████▍    | 20868/37963 [89:24:58<67:59:38, 14.32s/it]
 55%|█████▍    | 20869/37963 [89:25:13<68:08:32, 14.35s/it]
 55%|█████▍    | 20870/37963 [89:25:26<67:21:46, 14.19s/it]
                                                           
{'loss': '0.1299', 'grad_norm': '1.546', 'learning_rate': '8.878e-06', 'epoch': '0.5497'}

 55%|█████▍    | 20870/37963 [89:25:26<67:21:46, 14.19s/it]
 55%|█████▍    | 20871/37963 [89:25:41<67:32:31, 14.23s/it]
 55%|█████▍    | 20872/37963 [89:25:55<67:41:52, 14.26s/it]
 55%|█████▍    | 20873/37963 [89:26:09<67:41:19, 14.26s/it]
 55%|█████▍    | 20874/37963 [89:26:37<86:59:20, 18.33s/it]
 55%|█████▍    | 20875/37963 [89:26:51<81:18:38, 17.13s/it]
 55%|█████▍    | 20876/37963 [89:27:06<77:17:41, 16.28s/it]
 55%|█████▍    | 20877/37963 [89:27:20<74:34:34, 15.71s/it]
 55%|█████▍    | 20878/37963 [89:27:35<72:41:26, 15.32s/it]
 55%|█████▍    | 20879/37963 [89:27:48<70:34:23, 14.87s/it]
 55%|█████▌    | 20880/37963 [89:28:03<69:53:00, 14.73s/it]
                                                           
{'loss': '0.1352', 'grad_norm': '1.708', 'learning_rate': '8.869e-06', 'epoch': '0.55'}

 55%|█████▌    | 20880/37963 [89:28:03<69:53:00, 14.73s/it]
 55%|█████▌    | 20881/37963 [89:28:24<78:32:08, 16.55s/it]
 55%|█████▌    | 20882/37963 [89:28:38<75:32:18, 15.92s/it]
 55%|█████▌    | 20883/37963 [89:28:52<72:47:16, 15.34s/it]
 55%|█████▌    | 20884/37963 [89:29:07<71:34:24, 15.09s/it]
 55%|█████▌    | 20885/37963 [89:29:27<79:20:44, 16.73s/it]
 55%|█████▌    | 20886/37963 [89:29:41<75:06:29, 15.83s/it]
 55%|█████▌    | 20887/37963 [89:29:55<73:08:13, 15.42s/it]
 55%|█████▌    | 20888/37963 [89:30:16<80:43:49, 17.02s/it]
 55%|█████▌    | 20889/37963 [89:30:37<85:43:16, 18.07s/it]
 55%|█████▌    | 20890/37963 [89:30:51<80:25:31, 16.96s/it]
                                                           
{'loss': '0.1221', 'grad_norm': '3.899', 'learning_rate': '8.861e-06', 'epoch': '0.5503'}

 55%|█████▌    | 20890/37963 [89:30:51<80:25:31, 16.96s/it]
 55%|█████▌    | 20891/37963 [89:31:05<76:48:18, 16.20s/it]
 55%|█████▌    | 20892/37963 [89:31:20<74:10:12, 15.64s/it]
 55%|█████▌    | 20893/37963 [89:31:34<72:19:07, 15.25s/it]
 55%|█████▌    | 20894/37963 [89:31:55<80:53:16, 17.06s/it]
 55%|█████▌    | 20895/37963 [89:32:09<76:19:43, 16.10s/it]
 55%|█████▌    | 20896/37963 [89:32:24<73:56:56, 15.60s/it]
 55%|█████▌    | 20897/37963 [89:32:38<72:01:13, 15.19s/it]
 55%|█████▌    | 20898/37963 [89:32:52<70:41:29, 14.91s/it]
 55%|█████▌    | 20899/37963 [89:33:06<69:53:45, 14.75s/it]
 55%|█████▌    | 20900/37963 [89:33:21<69:22:36, 14.64s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '2.622', 'learning_rate': '8.853e-06', 'epoch': '0.5505'}

 55%|█████▌    | 20900/37963 [89:33:21<69:22:36, 14.64s/it]
 55%|█████▌    | 20901/37963 [89:33:35<69:00:33, 14.56s/it]
 55%|█████▌    | 20902/37963 [89:33:50<68:37:48, 14.48s/it]
 55%|█████▌    | 20903/37963 [89:34:04<68:23:04, 14.43s/it]
 55%|█████▌    | 20904/37963 [89:34:18<67:57:36, 14.34s/it]
 55%|█████▌    | 20905/37963 [89:34:32<67:21:03, 14.21s/it]
 55%|█████▌    | 20906/37963 [89:34:46<67:42:51, 14.29s/it]
 55%|█████▌    | 20907/37963 [89:35:07<77:02:23, 16.26s/it]
 55%|█████▌    | 20908/37963 [89:35:22<74:23:13, 15.70s/it]
 55%|█████▌    | 20909/37963 [89:35:36<72:47:27, 15.37s/it]
 55%|█████▌    | 20910/37963 [89:35:50<70:49:12, 14.95s/it]
                                                           
{'loss': '0.1324', 'grad_norm': '3.718', 'learning_rate': '8.844e-06', 'epoch': '0.5508'}

 55%|█████▌    | 20910/37963 [89:35:50<70:49:12, 14.95s/it]
 55%|█████▌    | 20911/37963 [89:36:04<69:53:16, 14.75s/it]
 55%|█████▌    | 20912/37963 [89:36:19<69:24:51, 14.66s/it]
 55%|█████▌    | 20913/37963 [89:36:33<68:26:51, 14.45s/it]
 55%|█████▌    | 20914/37963 [89:36:47<68:17:32, 14.42s/it]
 55%|█████▌    | 20915/37963 [89:37:01<67:34:49, 14.27s/it]
 55%|█████▌    | 20916/37963 [89:37:16<68:07:41, 14.39s/it]
 55%|█████▌    | 20917/37963 [89:37:30<68:13:10, 14.41s/it]
 55%|█████▌    | 20918/37963 [89:37:45<68:06:10, 14.38s/it]
 55%|█████▌    | 20919/37963 [89:37:59<68:09:14, 14.40s/it]
 55%|█████▌    | 20920/37963 [89:38:13<67:25:32, 14.24s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '2.35', 'learning_rate': '8.836e-06', 'epoch': '0.5511'}

 55%|█████▌    | 20920/37963 [89:38:13<67:25:32, 14.24s/it]
 55%|█████▌    | 20921/37963 [89:38:34<76:33:43, 16.17s/it]
 55%|█████▌    | 20922/37963 [89:38:55<83:23:02, 17.62s/it]
 55%|█████▌    | 20923/37963 [89:39:09<78:46:03, 16.64s/it]
 55%|█████▌    | 20924/37963 [89:39:23<75:17:11, 15.91s/it]
 55%|█████▌    | 20925/37963 [89:39:38<73:09:45, 15.46s/it]
 55%|█████▌    | 20926/37963 [89:39:52<71:30:09, 15.11s/it]
 55%|█████▌    | 20927/37963 [89:40:06<70:16:42, 14.85s/it]
 55%|█████▌    | 20928/37963 [89:40:20<68:53:51, 14.56s/it]
 55%|█████▌    | 20929/37963 [89:40:40<76:51:22, 16.24s/it]
 55%|█████▌    | 20930/37963 [89:40:54<73:37:32, 15.56s/it]
                                                           
{'loss': '0.1249', 'grad_norm': '1.752', 'learning_rate': '8.827e-06', 'epoch': '0.5513'}

 55%|█████▌    | 20930/37963 [89:40:54<73:37:32, 15.56s/it]
 55%|█████▌    | 20931/37963 [89:41:09<72:12:58, 15.26s/it]
 55%|█████▌    | 20932/37963 [89:41:23<71:19:08, 15.08s/it]
 55%|█████▌    | 20933/37963 [89:41:44<79:39:09, 16.84s/it]
 55%|█████▌    | 20934/37963 [89:41:59<76:20:20, 16.14s/it]
 55%|█████▌    | 20935/37963 [89:42:20<82:52:47, 17.52s/it]
 55%|█████▌    | 20936/37963 [89:42:34<78:34:27, 16.61s/it]
 55%|█████▌    | 20937/37963 [89:42:48<74:53:12, 15.83s/it]
 55%|█████▌    | 20938/37963 [89:43:02<72:41:21, 15.37s/it]
 55%|█████▌    | 20939/37963 [89:43:23<80:21:01, 16.99s/it]
 55%|█████▌    | 20940/37963 [89:43:37<76:37:22, 16.20s/it]
                                                           
{'loss': '0.1226', 'grad_norm': '1.499', 'learning_rate': '8.819e-06', 'epoch': '0.5516'}

 55%|█████▌    | 20940/37963 [89:43:37<76:37:22, 16.20s/it]
 55%|█████▌    | 20941/37963 [89:43:52<74:06:40, 15.67s/it]
 55%|█████▌    | 20942/37963 [89:44:13<81:45:36, 17.29s/it]
 55%|█████▌    | 20943/37963 [89:44:27<77:31:04, 16.40s/it]
 55%|█████▌    | 20944/37963 [89:44:42<74:39:53, 15.79s/it]
 55%|█████▌    | 20945/37963 [89:44:56<72:07:02, 15.26s/it]
 55%|█████▌    | 20946/37963 [89:45:10<70:58:34, 15.02s/it]
 55%|█████▌    | 20947/37963 [89:45:24<69:59:28, 14.81s/it]
 55%|█████▌    | 20948/37963 [89:45:39<69:14:43, 14.65s/it]
 55%|█████▌    | 20949/37963 [89:45:53<68:44:05, 14.54s/it]
 55%|█████▌    | 20950/37963 [89:46:07<68:30:25, 14.50s/it]
                                                           
{'loss': '0.1272', 'grad_norm': '1.635', 'learning_rate': '8.81e-06', 'epoch': '0.5519'}

 55%|█████▌    | 20950/37963 [89:46:07<68:30:25, 14.50s/it]
 55%|█████▌    | 20951/37963 [89:46:22<68:12:33, 14.43s/it]
 55%|█████▌    | 20952/37963 [89:46:36<68:08:36, 14.42s/it]
 55%|█████▌    | 20953/37963 [89:46:50<68:01:19, 14.40s/it]
 55%|█████▌    | 20954/37963 [89:47:05<67:54:26, 14.37s/it]
 55%|█████▌    | 20955/37963 [89:47:19<67:55:32, 14.38s/it]
 55%|█████▌    | 20956/37963 [89:47:41<78:15:40, 16.57s/it]
 55%|█████▌    | 20957/37963 [89:47:55<75:10:33, 15.91s/it]
 55%|█████▌    | 20958/37963 [89:48:10<73:01:36, 15.46s/it]
 55%|█████▌    | 20959/37963 [89:48:24<71:16:29, 15.09s/it]
 55%|█████▌    | 20960/37963 [89:48:38<70:12:19, 14.86s/it]
                                                           
{'loss': '0.1397', 'grad_norm': '1.957', 'learning_rate': '8.802e-06', 'epoch': '0.5521'}

 55%|█████▌    | 20960/37963 [89:48:38<70:12:19, 14.86s/it]
 55%|█████▌    | 20961/37963 [89:48:52<69:27:38, 14.71s/it]
 55%|█████▌    | 20962/37963 [89:49:07<68:40:28, 14.54s/it]
 55%|█████▌    | 20963/37963 [89:49:21<68:27:31, 14.50s/it]
 55%|█████▌    | 20964/37963 [89:49:35<68:02:19, 14.41s/it]
 55%|█████▌    | 20965/37963 [89:49:50<67:57:42, 14.39s/it]
 55%|█████▌    | 20966/37963 [89:50:04<67:50:42, 14.37s/it]
 55%|█████▌    | 20967/37963 [89:50:18<67:55:50, 14.39s/it]
 55%|█████▌    | 20968/37963 [89:50:38<76:01:42, 16.10s/it]
 55%|█████▌    | 20969/37963 [89:50:53<73:13:11, 15.51s/it]
 55%|█████▌    | 20970/37963 [89:51:06<70:37:04, 14.96s/it]
                                                           
{'loss': '0.1299', 'grad_norm': '1.811', 'learning_rate': '8.793e-06', 'epoch': '0.5524'}

 55%|█████▌    | 20970/37963 [89:51:06<70:37:04, 14.96s/it]
 55%|█████▌    | 20971/37963 [89:51:27<79:11:16, 16.78s/it]
 55%|█████▌    | 20972/37963 [89:51:42<76:01:19, 16.11s/it]
 55%|█████▌    | 20973/37963 [89:51:56<73:31:16, 15.58s/it]
 55%|█████▌    | 20974/37963 [89:52:11<71:57:13, 15.25s/it]
 55%|█████▌    | 20975/37963 [89:52:25<70:41:40, 14.98s/it]
 55%|█████▌    | 20976/37963 [89:52:39<69:41:00, 14.77s/it]
 55%|█████▌    | 20977/37963 [89:53:00<78:15:34, 16.59s/it]
 55%|█████▌    | 20978/37963 [89:53:14<75:00:14, 15.90s/it]
 55%|█████▌    | 20979/37963 [89:53:29<72:51:42, 15.44s/it]
 55%|█████▌    | 20980/37963 [89:53:43<70:49:05, 15.01s/it]
                                                           
{'loss': '0.1293', 'grad_norm': '3.691', 'learning_rate': '8.785e-06', 'epoch': '0.5526'}

 55%|█████▌    | 20980/37963 [89:53:43<70:49:05, 15.01s/it]
 55%|█████▌    | 20981/37963 [89:53:57<69:34:58, 14.75s/it]
 55%|█████▌    | 20982/37963 [89:54:25<87:46:34, 18.61s/it]
 55%|█████▌    | 20983/37963 [89:54:39<81:17:31, 17.24s/it]
 55%|█████▌    | 20984/37963 [89:54:52<76:28:13, 16.21s/it]
 55%|█████▌    | 20985/37963 [89:55:07<73:50:53, 15.66s/it]
 55%|█████▌    | 20986/37963 [89:55:21<71:18:04, 15.12s/it]
 55%|█████▌    | 20987/37963 [89:55:35<70:21:20, 14.92s/it]
 55%|█████▌    | 20988/37963 [89:55:49<69:33:37, 14.75s/it]
 55%|█████▌    | 20989/37963 [89:56:03<68:17:59, 14.49s/it]
 55%|█████▌    | 20990/37963 [89:56:24<76:31:39, 16.23s/it]
                                                           
{'loss': '0.1251', 'grad_norm': '0.9009', 'learning_rate': '8.776e-06', 'epoch': '0.5529'}

 55%|█████▌    | 20990/37963 [89:56:24<76:31:39, 16.23s/it]
 55%|█████▌    | 20991/37963 [89:56:38<73:29:33, 15.59s/it]
 55%|█████▌    | 20992/37963 [89:56:58<80:52:28, 17.16s/it]
 55%|█████▌    | 20993/37963 [89:57:13<76:41:46, 16.27s/it]
 55%|█████▌    | 20994/37963 [89:57:27<73:59:11, 15.70s/it]
 55%|█████▌    | 20995/37963 [89:57:41<71:50:02, 15.24s/it]
 55%|█████▌    | 20996/37963 [89:57:56<70:31:58, 14.97s/it]
 55%|█████▌    | 20997/37963 [89:58:10<69:21:34, 14.72s/it]
 55%|█████▌    | 20998/37963 [89:58:23<67:53:37, 14.41s/it]
 55%|█████▌    | 20999/37963 [89:58:37<67:26:17, 14.31s/it]
 55%|█████▌    | 21000/37963 [89:58:52<67:28:03, 14.32s/it]
                                                           
{'loss': '0.1357', 'grad_norm': '1.926', 'learning_rate': '8.768e-06', 'epoch': '0.5532'}

 55%|█████▌    | 21000/37963 [89:58:52<67:28:03, 14.32s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.08s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.08s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 55%|█████▌    | 21001/37963 [90:00:46<207:57:23, 44.14s/it]
 55%|█████▌    | 21002/37963 [90:01:00<166:09:36, 35.27s/it]
 55%|█████▌    | 21003/37963 [90:01:14<136:32:41, 28.98s/it]
 55%|█████▌    | 21004/37963 [90:01:28<115:27:56, 24.51s/it]
 55%|█████▌    | 21005/37963 [90:01:43<101:10:51, 21.48s/it]
 55%|█████▌    | 21006/37963 [90:01:57<91:11:04, 19.36s/it] 
 55%|█████▌    | 21007/37963 [90:02:12<84:10:25, 17.87s/it]
 55%|█████▌    | 21008/37963 [90:02:26<79:13:31, 16.82s/it]
 55%|█████▌    | 21009/37963 [90:02:40<75:46:45, 16.09s/it]
 55%|█████▌    | 21010/37963 [90:02:54<72:33:31, 15.41s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '2.763', 'learning_rate': '8.759e-06', 'epoch': '0.5534'}

 55%|█████▌    | 21010/37963 [90:02:54<72:33:31, 15.41s/it]
 55%|█████▌    | 21011/37963 [90:03:09<71:10:20, 15.11s/it]
 55%|█████▌    | 21012/37963 [90:03:23<70:07:20, 14.89s/it]
 55%|█████▌    | 21013/37963 [90:03:37<69:15:01, 14.71s/it]
 55%|█████▌    | 21014/37963 [90:03:58<77:32:44, 16.47s/it]
 55%|█████▌    | 21015/37963 [90:04:12<74:37:05, 15.85s/it]
 55%|█████▌    | 21016/37963 [90:04:27<72:33:16, 15.41s/it]
 55%|█████▌    | 21017/37963 [90:04:40<70:09:54, 14.91s/it]
 55%|█████▌    | 21018/37963 [90:04:55<69:19:49, 14.73s/it]
 55%|█████▌    | 21019/37963 [90:05:09<68:54:52, 14.64s/it]
 55%|█████▌    | 21020/37963 [90:05:30<77:51:24, 16.54s/it]
                                                           
{'loss': '0.1332', 'grad_norm': '1.423', 'learning_rate': '8.751e-06', 'epoch': '0.5537'}

 55%|█████▌    | 21020/37963 [90:05:30<77:51:24, 16.54s/it]
 55%|█████▌    | 21021/37963 [90:05:45<74:48:22, 15.90s/it]
 55%|█████▌    | 21022/37963 [90:05:59<72:41:32, 15.45s/it]
 55%|█████▌    | 21023/37963 [90:06:13<70:16:45, 14.94s/it]
 55%|█████▌    | 21024/37963 [90:06:27<69:24:25, 14.75s/it]
 55%|█████▌    | 21025/37963 [90:06:41<67:58:39, 14.45s/it]
 55%|█████▌    | 21026/37963 [90:07:02<77:02:03, 16.37s/it]
 55%|█████▌    | 21027/37963 [90:07:16<74:09:57, 15.77s/it]
 55%|█████▌    | 21028/37963 [90:07:30<72:10:44, 15.34s/it]
 55%|█████▌    | 21029/37963 [90:07:45<70:53:25, 15.07s/it]
 55%|█████▌    | 21030/37963 [90:08:05<78:40:20, 16.73s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '1.751', 'learning_rate': '8.742e-06', 'epoch': '0.554'}

 55%|█████▌    | 21030/37963 [90:08:05<78:40:20, 16.73s/it]
 55%|█████▌    | 21031/37963 [90:08:20<75:26:07, 16.04s/it]
 55%|█████▌    | 21032/37963 [90:08:34<73:02:13, 15.53s/it]
 55%|█████▌    | 21033/37963 [90:08:55<80:55:14, 17.21s/it]
 55%|█████▌    | 21034/37963 [90:09:10<76:53:59, 16.35s/it]
 55%|█████▌    | 21035/37963 [90:09:23<73:09:06, 15.56s/it]
 55%|█████▌    | 21036/37963 [90:09:38<71:31:00, 15.21s/it]
 55%|█████▌    | 21037/37963 [90:09:58<79:14:55, 16.86s/it]
 55%|█████▌    | 21038/37963 [90:10:13<75:43:26, 16.11s/it]
 55%|█████▌    | 21039/37963 [90:10:27<72:40:29, 15.46s/it]
 55%|█████▌    | 21040/37963 [90:10:48<80:52:46, 17.21s/it]
                                                           
{'loss': '0.1367', 'grad_norm': '2.205', 'learning_rate': '8.734e-06', 'epoch': '0.5542'}

 55%|█████▌    | 21040/37963 [90:10:48<80:52:46, 17.21s/it]
 55%|█████▌    | 21041/37963 [90:11:02<76:49:12, 16.34s/it]
 55%|█████▌    | 21042/37963 [90:11:17<73:59:33, 15.74s/it]
 55%|█████▌    | 21043/37963 [90:11:31<72:11:07, 15.36s/it]
 55%|█████▌    | 21044/37963 [90:11:45<70:45:04, 15.05s/it]
 55%|█████▌    | 21045/37963 [90:12:00<69:45:41, 14.84s/it]
 55%|█████▌    | 21046/37963 [90:12:14<69:02:00, 14.69s/it]
 55%|█████▌    | 21047/37963 [90:12:29<68:37:47, 14.61s/it]
 55%|█████▌    | 21048/37963 [90:12:42<67:19:56, 14.33s/it]
 55%|█████▌    | 21049/37963 [90:12:56<66:52:02, 14.23s/it]
 55%|█████▌    | 21050/37963 [90:13:11<67:04:24, 14.28s/it]
                                                           
{'loss': '0.1354', 'grad_norm': '1.221', 'learning_rate': '8.725e-06', 'epoch': '0.5545'}

 55%|█████▌    | 21050/37963 [90:13:11<67:04:24, 14.28s/it]
 55%|█████▌    | 21051/37963 [90:13:32<76:52:27, 16.36s/it]
 55%|█████▌    | 21052/37963 [90:13:46<74:01:56, 15.76s/it]
 55%|█████▌    | 21053/37963 [90:14:00<71:43:24, 15.27s/it]
 55%|█████▌    | 21054/37963 [90:14:15<70:26:55, 15.00s/it]
 55%|█████▌    | 21055/37963 [90:14:29<69:34:54, 14.82s/it]
 55%|█████▌    | 21056/37963 [90:14:44<69:02:50, 14.70s/it]
 55%|█████▌    | 21057/37963 [90:14:57<67:35:09, 14.39s/it]
 55%|█████▌    | 21058/37963 [90:15:12<67:39:08, 14.41s/it]
 55%|█████▌    | 21059/37963 [90:15:26<67:16:27, 14.33s/it]
 55%|█████▌    | 21060/37963 [90:15:40<67:19:14, 14.34s/it]
                                                           
{'loss': '0.1442', 'grad_norm': '2.997', 'learning_rate': '8.717e-06', 'epoch': '0.5548'}

 55%|█████▌    | 21060/37963 [90:15:40<67:19:14, 14.34s/it]
 55%|█████▌    | 21061/37963 [90:15:55<67:19:11, 14.34s/it]
 55%|█████▌    | 21062/37963 [90:16:09<67:07:26, 14.30s/it]
 55%|█████▌    | 21063/37963 [90:16:30<76:37:45, 16.32s/it]
 55%|█████▌    | 21064/37963 [90:16:44<73:54:59, 15.75s/it]
 55%|█████▌    | 21065/37963 [90:16:59<71:57:50, 15.33s/it]
 55%|█████▌    | 21066/37963 [90:17:13<70:46:45, 15.08s/it]
 55%|█████▌    | 21067/37963 [90:17:27<69:14:47, 14.75s/it]
 55%|█████▌    | 21068/37963 [90:17:41<68:05:26, 14.51s/it]
 55%|█████▌    | 21069/37963 [90:17:55<67:39:59, 14.42s/it]
 56%|█████▌    | 21070/37963 [90:18:17<77:24:49, 16.50s/it]
                                                           
{'loss': '0.1341', 'grad_norm': '1.858', 'learning_rate': '8.709e-06', 'epoch': '0.555'}

 56%|█████▌    | 21070/37963 [90:18:17<77:24:49, 16.50s/it]
 56%|█████▌    | 21071/37963 [90:18:31<74:26:51, 15.87s/it]
 56%|█████▌    | 21072/37963 [90:18:45<72:27:00, 15.44s/it]
 56%|█████▌    | 21073/37963 [90:19:00<71:22:47, 15.21s/it]
 56%|█████▌    | 21074/37963 [90:19:14<69:55:17, 14.90s/it]
 56%|█████▌    | 21075/37963 [90:19:35<78:10:23, 16.66s/it]
 56%|█████▌    | 21076/37963 [90:19:49<74:56:36, 15.98s/it]
 56%|█████▌    | 21077/37963 [90:20:04<72:38:40, 15.49s/it]
 56%|█████▌    | 21078/37963 [90:20:24<79:56:38, 17.04s/it]
 56%|█████▌    | 21079/37963 [90:20:39<75:54:48, 16.19s/it]
 56%|█████▌    | 21080/37963 [90:20:53<73:30:06, 15.67s/it]
                                                           
{'loss': '0.1215', 'grad_norm': '1.819', 'learning_rate': '8.7e-06', 'epoch': '0.5553'}

 56%|█████▌    | 21080/37963 [90:20:53<73:30:06, 15.67s/it]
 56%|█████▌    | 21081/37963 [90:21:14<80:43:48, 17.22s/it]
 56%|█████▌    | 21082/37963 [90:21:28<76:57:29, 16.41s/it]
 56%|█████▌    | 21083/37963 [90:21:43<74:07:37, 15.81s/it]
 56%|█████▌    | 21084/37963 [90:21:57<72:12:10, 15.40s/it]
 56%|█████▌    | 21085/37963 [90:22:12<71:04:00, 15.16s/it]
 56%|█████▌    | 21086/37963 [90:22:26<69:12:56, 14.76s/it]
 56%|█████▌    | 21087/37963 [90:22:46<77:10:29, 16.46s/it]
 56%|█████▌    | 21088/37963 [90:23:07<83:21:58, 17.78s/it]
 56%|█████▌    | 21089/37963 [90:23:21<78:23:11, 16.72s/it]
 56%|█████▌    | 21090/37963 [90:23:36<75:12:44, 16.05s/it]
                                                           
{'loss': '0.1289', 'grad_norm': '1.524', 'learning_rate': '8.692e-06', 'epoch': '0.5555'}

 56%|█████▌    | 21090/37963 [90:23:36<75:12:44, 16.05s/it]
 56%|█████▌    | 21091/37963 [90:23:50<72:06:49, 15.39s/it]
 56%|█████▌    | 21092/37963 [90:24:04<70:51:11, 15.12s/it]
 56%|█████▌    | 21093/37963 [90:24:18<69:42:58, 14.88s/it]
 56%|█████▌    | 21094/37963 [90:24:33<68:44:34, 14.67s/it]
 56%|█████▌    | 21095/37963 [90:24:47<68:22:45, 14.59s/it]
 56%|█████▌    | 21096/37963 [90:25:01<67:46:45, 14.47s/it]
 56%|█████▌    | 21097/37963 [90:25:15<67:35:36, 14.43s/it]
 56%|█████▌    | 21098/37963 [90:25:30<67:07:04, 14.33s/it]
 56%|█████▌    | 21099/37963 [90:25:44<67:06:17, 14.33s/it]
 56%|█████▌    | 21100/37963 [90:26:05<76:47:56, 16.40s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '1.66', 'learning_rate': '8.683e-06', 'epoch': '0.5558'}

 56%|█████▌    | 21100/37963 [90:26:05<76:47:56, 16.40s/it]
 56%|█████▌    | 21101/37963 [90:26:19<73:58:59, 15.80s/it]
 56%|█████▌    | 21102/37963 [90:26:34<72:00:06, 15.37s/it]
 56%|█████▌    | 21103/37963 [90:26:48<70:26:34, 15.04s/it]
 56%|█████▌    | 21104/37963 [90:27:02<69:27:03, 14.83s/it]
 56%|█████▌    | 21105/37963 [90:27:17<68:51:40, 14.71s/it]
 56%|█████▌    | 21106/37963 [90:27:31<68:22:59, 14.60s/it]
 56%|█████▌    | 21107/37963 [90:27:46<68:01:25, 14.53s/it]
 56%|█████▌    | 21108/37963 [90:28:00<67:47:16, 14.48s/it]
 56%|█████▌    | 21109/37963 [90:28:14<67:38:45, 14.45s/it]
 56%|█████▌    | 21110/37963 [90:28:29<67:44:59, 14.47s/it]
                                                           
{'loss': '0.1357', 'grad_norm': '1.599', 'learning_rate': '8.675e-06', 'epoch': '0.5561'}

 56%|█████▌    | 21110/37963 [90:28:29<67:44:59, 14.47s/it]
 56%|█████▌    | 21111/37963 [90:28:43<67:28:09, 14.41s/it]
 56%|█████▌    | 21112/37963 [90:28:57<67:19:22, 14.38s/it]
 56%|█████▌    | 21113/37963 [90:29:18<76:30:43, 16.35s/it]
 56%|█████▌    | 21114/37963 [90:29:33<73:51:40, 15.78s/it]
 56%|█████▌    | 21115/37963 [90:29:47<71:47:22, 15.34s/it]
 56%|█████▌    | 21116/37963 [90:30:01<70:14:06, 15.01s/it]
 56%|█████▌    | 21117/37963 [90:30:15<68:49:39, 14.71s/it]
 56%|█████▌    | 21118/37963 [90:30:30<68:16:29, 14.59s/it]
 56%|█████▌    | 21119/37963 [90:30:50<76:43:11, 16.40s/it]
 56%|█████▌    | 21120/37963 [90:31:05<73:58:08, 15.81s/it]
                                                           
{'loss': '0.1395', 'grad_norm': '3.569', 'learning_rate': '8.666e-06', 'epoch': '0.5563'}

 56%|█████▌    | 21120/37963 [90:31:05<73:58:08, 15.81s/it]
 56%|█████▌    | 21121/37963 [90:31:19<71:54:45, 15.37s/it]
 56%|█████▌    | 21122/37963 [90:31:33<70:29:28, 15.07s/it]
 56%|█████▌    | 21123/37963 [90:31:48<69:28:12, 14.85s/it]
 56%|█████▌    | 21124/37963 [90:32:09<78:14:04, 16.73s/it]
 56%|█████▌    | 21125/37963 [90:32:23<74:59:04, 16.03s/it]
 56%|█████▌    | 21126/37963 [90:32:38<72:49:54, 15.57s/it]
 56%|█████▌    | 21127/37963 [90:32:59<80:20:14, 17.18s/it]
 56%|█████▌    | 21128/37963 [90:33:19<84:54:51, 18.16s/it]
 56%|█████▌    | 21129/37963 [90:33:33<78:43:13, 16.83s/it]
 56%|█████▌    | 21130/37963 [90:33:47<74:29:11, 15.93s/it]
                                                           
{'loss': '0.15', 'grad_norm': '2.947', 'learning_rate': '8.658e-06', 'epoch': '0.5566'}

 56%|█████▌    | 21130/37963 [90:33:47<74:29:11, 15.93s/it]
 56%|█████▌    | 21131/37963 [90:34:01<72:13:55, 15.45s/it]
 56%|█████▌    | 21132/37963 [90:34:15<70:08:09, 15.00s/it]
 56%|█████▌    | 21133/37963 [90:34:30<69:27:52, 14.86s/it]
 56%|█████▌    | 21134/37963 [90:34:44<68:14:27, 14.60s/it]
 56%|█████▌    | 21135/37963 [90:35:04<75:50:06, 16.22s/it]
 56%|█████▌    | 21136/37963 [90:35:18<73:17:33, 15.68s/it]
 56%|█████▌    | 21137/37963 [90:35:39<80:20:40, 17.19s/it]
 56%|█████▌    | 21138/37963 [90:35:53<76:15:36, 16.32s/it]
 56%|█████▌    | 21139/37963 [90:36:07<73:26:53, 15.72s/it]
 56%|█████▌    | 21140/37963 [90:36:21<70:55:10, 15.18s/it]
                                                           
{'loss': '0.1346', 'grad_norm': '3.762', 'learning_rate': '8.649e-06', 'epoch': '0.5569'}

 56%|█████▌    | 21140/37963 [90:36:21<70:55:10, 15.18s/it]
 56%|█████▌    | 21141/37963 [90:36:36<69:55:12, 14.96s/it]
 56%|█████▌    | 21142/37963 [90:36:50<69:05:24, 14.79s/it]
 56%|█████▌    | 21143/37963 [90:37:04<68:07:30, 14.58s/it]
 56%|█████▌    | 21144/37963 [90:37:19<67:49:22, 14.52s/it]
 56%|█████▌    | 21145/37963 [90:37:33<67:40:14, 14.49s/it]
 56%|█████▌    | 21146/37963 [90:37:47<67:25:49, 14.43s/it]
 56%|█████▌    | 21147/37963 [90:38:02<67:30:15, 14.45s/it]
 56%|█████▌    | 21148/37963 [90:38:16<67:25:11, 14.43s/it]
 56%|█████▌    | 21149/37963 [90:38:37<76:56:27, 16.47s/it]
 56%|█████▌    | 21150/37963 [90:38:52<74:14:21, 15.90s/it]
                                                           
{'loss': '0.1348', 'grad_norm': '1.492', 'learning_rate': '8.641e-06', 'epoch': '0.5571'}

 56%|█████▌    | 21150/37963 [90:38:52<74:14:21, 15.90s/it]
 56%|█████▌    | 21151/37963 [90:39:07<72:21:30, 15.49s/it]
 56%|█████▌    | 21152/37963 [90:39:21<70:48:40, 15.16s/it]
 56%|█████▌    | 21153/37963 [90:39:35<69:18:48, 14.84s/it]
 56%|█████▌    | 21154/37963 [90:39:49<68:39:52, 14.71s/it]
 56%|█████▌    | 21155/37963 [90:40:03<67:49:44, 14.53s/it]
 56%|█████▌    | 21156/37963 [90:40:18<67:34:22, 14.47s/it]
 56%|█████▌    | 21157/37963 [90:40:32<67:21:27, 14.43s/it]
 56%|█████▌    | 21158/37963 [90:40:46<66:38:16, 14.28s/it]
 56%|█████▌    | 21159/37963 [90:41:00<66:38:05, 14.28s/it]
 56%|█████▌    | 21160/37963 [90:41:15<66:32:11, 14.26s/it]
                                                           
{'loss': '0.1315', 'grad_norm': '2.316', 'learning_rate': '8.632e-06', 'epoch': '0.5574'}

 56%|█████▌    | 21160/37963 [90:41:15<66:32:11, 14.26s/it]
 56%|█████▌    | 21161/37963 [90:41:28<66:04:18, 14.16s/it]
 56%|█████▌    | 21162/37963 [90:41:43<66:27:17, 14.24s/it]
 56%|█████▌    | 21163/37963 [90:41:57<66:34:55, 14.27s/it]
 56%|█████▌    | 21164/37963 [90:42:18<75:50:22, 16.25s/it]
 56%|█████▌    | 21165/37963 [90:42:33<73:11:54, 15.69s/it]
 56%|█████▌    | 21166/37963 [90:42:47<71:22:01, 15.30s/it]
 56%|█████▌    | 21167/37963 [90:43:01<70:01:15, 15.01s/it]
 56%|█████▌    | 21168/37963 [90:43:22<78:04:41, 16.74s/it]
 56%|█████▌    | 21169/37963 [90:43:36<74:41:26, 16.01s/it]
 56%|█████▌    | 21170/37963 [90:43:50<71:35:00, 15.35s/it]
                                                           
{'loss': '0.1262', 'grad_norm': '2.482', 'learning_rate': '8.624e-06', 'epoch': '0.5577'}

 56%|█████▌    | 21170/37963 [90:43:50<71:35:00, 15.35s/it]
 56%|█████▌    | 21171/37963 [90:44:11<79:10:49, 16.98s/it]
 56%|█████▌    | 21172/37963 [90:44:25<74:50:02, 16.04s/it]
 56%|█████▌    | 21173/37963 [90:44:45<81:00:23, 17.37s/it]
 56%|█████▌    | 21174/37963 [90:44:59<76:22:05, 16.38s/it]
 56%|█████▌    | 21175/37963 [90:45:20<81:55:17, 17.57s/it]
 56%|█████▌    | 21176/37963 [90:45:34<77:28:26, 16.61s/it]
 56%|█████▌    | 21177/37963 [90:45:48<73:50:49, 15.84s/it]
 56%|█████▌    | 21178/37963 [90:46:02<71:45:34, 15.39s/it]
 56%|█████▌    | 21179/37963 [90:46:17<70:23:46, 15.10s/it]
 56%|█████▌    | 21180/37963 [90:46:31<69:21:36, 14.88s/it]
                                                           
{'loss': '0.1268', 'grad_norm': '4.217', 'learning_rate': '8.616e-06', 'epoch': '0.5579'}

 56%|█████▌    | 21180/37963 [90:46:31<69:21:36, 14.88s/it]
 56%|█████▌    | 21181/37963 [90:46:45<68:09:56, 14.62s/it]
 56%|█████▌    | 21182/37963 [90:47:00<67:45:35, 14.54s/it]
 56%|█████▌    | 21183/37963 [90:47:14<67:32:48, 14.49s/it]
 56%|█████▌    | 21184/37963 [90:47:41<85:40:43, 18.38s/it]
 56%|█████▌    | 21185/37963 [90:47:56<80:02:08, 17.17s/it]
 56%|█████▌    | 21186/37963 [90:48:10<76:04:30, 16.32s/it]
 56%|█████▌    | 21187/37963 [90:48:24<72:48:40, 15.62s/it]
 56%|█████▌    | 21188/37963 [90:48:38<70:23:34, 15.11s/it]
 56%|█████▌    | 21189/37963 [90:48:52<69:26:10, 14.90s/it]
 56%|█████▌    | 21190/37963 [90:49:06<68:10:01, 14.63s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '2.784', 'learning_rate': '8.607e-06', 'epoch': '0.5582'}

 56%|█████▌    | 21190/37963 [90:49:06<68:10:01, 14.63s/it]
 56%|█████▌    | 21191/37963 [90:49:21<67:43:57, 14.54s/it]
 56%|█████▌    | 21192/37963 [90:49:35<67:32:14, 14.50s/it]
 56%|█████▌    | 21193/37963 [90:49:49<67:20:48, 14.46s/it]
 56%|█████▌    | 21194/37963 [90:50:04<67:10:45, 14.42s/it]
 56%|█████▌    | 21195/37963 [90:50:18<67:10:52, 14.42s/it]
 56%|█████▌    | 21196/37963 [90:50:33<66:59:31, 14.38s/it]
 56%|█████▌    | 21197/37963 [90:50:54<76:47:48, 16.49s/it]
 56%|█████▌    | 21198/37963 [90:51:08<73:46:01, 15.84s/it]
 56%|█████▌    | 21199/37963 [90:51:22<70:56:48, 15.24s/it]
 56%|█████▌    | 21200/37963 [90:51:36<69:27:07, 14.92s/it]
                                                           
{'loss': '0.1437', 'grad_norm': '2.247', 'learning_rate': '8.599e-06', 'epoch': '0.5584'}

 56%|█████▌    | 21200/37963 [90:51:36<69:27:07, 14.92s/it]
 56%|█████▌    | 21201/37963 [90:51:51<68:53:52, 14.80s/it]
 56%|█████▌    | 21202/37963 [90:52:05<68:29:16, 14.71s/it]
 56%|█████▌    | 21203/37963 [90:52:20<67:48:40, 14.57s/it]
 56%|█████▌    | 21204/37963 [90:52:34<67:22:59, 14.47s/it]
 56%|█████▌    | 21205/37963 [90:52:48<67:07:57, 14.42s/it]
 56%|█████▌    | 21206/37963 [90:53:02<66:22:08, 14.26s/it]
 56%|█████▌    | 21207/37963 [90:53:17<66:47:58, 14.35s/it]
 56%|█████▌    | 21208/37963 [90:53:30<66:15:47, 14.24s/it]
 56%|█████▌    | 21209/37963 [90:53:45<66:24:31, 14.27s/it]
 56%|█████▌    | 21210/37963 [90:53:59<66:36:26, 14.31s/it]
                                                           
{'loss': '0.1343', 'grad_norm': '1.38', 'learning_rate': '8.59e-06', 'epoch': '0.5587'}

 56%|█████▌    | 21210/37963 [90:53:59<66:36:26, 14.31s/it]
 56%|█████▌    | 21211/37963 [90:54:13<66:00:17, 14.18s/it]
 56%|█████▌    | 21212/37963 [90:54:34<75:18:21, 16.18s/it]
 56%|█████▌    | 21213/37963 [90:54:48<72:45:57, 15.64s/it]
 56%|█████▌    | 21214/37963 [90:55:02<70:09:48, 15.08s/it]
 56%|█████▌    | 21215/37963 [90:55:16<69:08:48, 14.86s/it]
 56%|█████▌    | 21216/37963 [90:55:31<68:27:37, 14.72s/it]
 56%|█████▌    | 21217/37963 [90:55:52<77:16:04, 16.61s/it]
 56%|█████▌    | 21218/37963 [90:56:12<82:08:43, 17.66s/it]
 56%|█████▌    | 21219/37963 [90:56:26<77:32:41, 16.67s/it]
 56%|█████▌    | 21220/37963 [90:56:41<74:12:54, 15.96s/it]
                                                           
{'loss': '0.14', 'grad_norm': '3.46', 'learning_rate': '8.582e-06', 'epoch': '0.559'}

 56%|█████▌    | 21220/37963 [90:56:41<74:12:54, 15.96s/it]
 56%|█████▌    | 21221/37963 [90:57:01<80:04:04, 17.22s/it]
 56%|█████▌    | 21222/37963 [90:57:15<75:23:46, 16.21s/it]
 56%|█████▌    | 21223/37963 [90:57:29<72:58:16, 15.69s/it]
 56%|█████▌    | 21224/37963 [90:57:44<71:16:08, 15.33s/it]
 56%|█████▌    | 21225/37963 [90:57:58<69:57:02, 15.04s/it]
 56%|█████▌    | 21226/37963 [90:58:19<77:40:50, 16.71s/it]
 56%|█████▌    | 21227/37963 [90:58:33<74:24:49, 16.01s/it]
 56%|█████▌    | 21228/37963 [90:58:47<71:47:02, 15.44s/it]
 56%|█████▌    | 21229/37963 [90:59:01<70:13:31, 15.11s/it]
 56%|█████▌    | 21230/37963 [90:59:15<68:40:03, 14.77s/it]
                                                           
{'loss': '0.1376', 'grad_norm': '1.743', 'learning_rate': '8.573e-06', 'epoch': '0.5592'}

 56%|█████▌    | 21230/37963 [90:59:15<68:40:03, 14.77s/it]
 56%|█████▌    | 21231/37963 [90:59:29<67:37:11, 14.55s/it]
 56%|█████▌    | 21232/37963 [90:59:50<76:12:28, 16.40s/it]
 56%|█████▌    | 21233/37963 [91:00:11<82:50:21, 17.83s/it]
 56%|█████▌    | 21234/37963 [91:00:26<78:16:21, 16.84s/it]
 56%|█████▌    | 21235/37963 [91:00:40<74:40:42, 16.07s/it]
 56%|█████▌    | 21236/37963 [91:00:55<72:23:30, 15.58s/it]
 56%|█████▌    | 21237/37963 [91:01:09<70:40:13, 15.21s/it]
 56%|█████▌    | 21238/37963 [91:01:23<69:18:42, 14.92s/it]
 56%|█████▌    | 21239/37963 [91:01:37<68:29:16, 14.74s/it]
 56%|█████▌    | 21240/37963 [91:01:52<67:56:41, 14.63s/it]
                                                           
{'loss': '0.1258', 'grad_norm': '1.275', 'learning_rate': '8.565e-06', 'epoch': '0.5595'}

 56%|█████▌    | 21240/37963 [91:01:52<67:56:41, 14.63s/it]
 56%|█████▌    | 21241/37963 [91:02:06<67:16:26, 14.48s/it]
 56%|█████▌    | 21242/37963 [91:02:20<67:07:35, 14.45s/it]
 56%|█████▌    | 21243/37963 [91:02:35<67:01:52, 14.43s/it]
 56%|█████▌    | 21244/37963 [91:02:49<66:54:17, 14.41s/it]
 56%|█████▌    | 21245/37963 [91:03:09<75:07:54, 16.18s/it]
 56%|█████▌    | 21246/37963 [91:03:24<72:39:41, 15.65s/it]
 56%|█████▌    | 21247/37963 [91:03:38<70:57:26, 15.28s/it]
 56%|█████▌    | 21248/37963 [91:03:53<69:45:00, 15.02s/it]
 56%|█████▌    | 21249/37963 [91:04:07<68:16:41, 14.71s/it]
 56%|█████▌    | 21250/37963 [91:04:21<68:08:14, 14.68s/it]
                                                           
{'loss': '0.1166', 'grad_norm': '1.655', 'learning_rate': '8.556e-06', 'epoch': '0.5598'}

 56%|█████▌    | 21250/37963 [91:04:21<68:08:14, 14.68s/it]
 56%|█████▌    | 21251/37963 [91:04:35<67:29:00, 14.54s/it]
 56%|█████▌    | 21252/37963 [91:04:50<67:10:32, 14.47s/it]
 56%|█████▌    | 21253/37963 [91:05:04<67:04:24, 14.45s/it]
 56%|█████▌    | 21254/37963 [91:05:18<66:26:04, 14.31s/it]
 56%|█████▌    | 21255/37963 [91:05:33<66:46:34, 14.39s/it]
 56%|█████▌    | 21256/37963 [91:05:47<66:37:44, 14.36s/it]
 56%|█████▌    | 21257/37963 [91:06:01<66:37:58, 14.36s/it]
 56%|█████▌    | 21258/37963 [91:06:16<66:35:23, 14.35s/it]
 56%|█████▌    | 21259/37963 [91:06:30<66:30:17, 14.33s/it]
 56%|█████▌    | 21260/37963 [91:06:50<74:06:09, 15.97s/it]
                                                           
{'loss': '0.146', 'grad_norm': '3.281', 'learning_rate': '8.548e-06', 'epoch': '0.56'}

 56%|█████▌    | 21260/37963 [91:06:50<74:06:09, 15.97s/it]
 56%|█████▌    | 21261/37963 [91:07:04<71:12:57, 15.35s/it]
 56%|█████▌    | 21262/37963 [91:07:18<69:51:54, 15.06s/it]
 56%|█████▌    | 21263/37963 [91:07:32<67:52:09, 14.63s/it]
 56%|█████▌    | 21264/37963 [91:07:46<67:24:57, 14.53s/it]
 56%|█████▌    | 21265/37963 [91:08:07<76:49:49, 16.56s/it]
 56%|█████▌    | 21266/37963 [91:08:22<73:47:30, 15.91s/it]
 56%|█████▌    | 21267/37963 [91:08:36<71:39:37, 15.45s/it]
 56%|█████▌    | 21268/37963 [91:08:51<70:25:16, 15.19s/it]
 56%|█████▌    | 21269/37963 [91:09:05<69:29:34, 14.99s/it]
 56%|█████▌    | 21270/37963 [91:09:32<86:35:21, 18.67s/it]
                                                           
{'loss': '0.1406', 'grad_norm': '2.69', 'learning_rate': '8.54e-06', 'epoch': '0.5603'}

 56%|█████▌    | 21270/37963 [91:09:32<86:35:21, 18.67s/it]
 56%|█████▌    | 21271/37963 [91:09:47<80:35:37, 17.38s/it]
 56%|█████▌    | 21272/37963 [91:10:01<76:35:14, 16.52s/it]
 56%|█████▌    | 21273/37963 [91:10:22<82:47:36, 17.86s/it]
 56%|█████▌    | 21274/37963 [91:10:37<77:59:11, 16.82s/it]
 56%|█████▌    | 21275/37963 [91:10:51<74:37:26, 16.10s/it]
 56%|█████▌    | 21276/37963 [91:11:05<71:55:21, 15.52s/it]
 56%|█████▌    | 21277/37963 [91:11:20<70:35:59, 15.23s/it]
 56%|█████▌    | 21278/37963 [91:11:34<69:15:29, 14.94s/it]
 56%|█████▌    | 21279/37963 [91:11:55<77:25:46, 16.71s/it]
 56%|█████▌    | 21280/37963 [91:12:09<74:05:34, 15.99s/it]
                                                           
{'loss': '0.1371', 'grad_norm': '2.601', 'learning_rate': '8.531e-06', 'epoch': '0.5605'}

 56%|█████▌    | 21280/37963 [91:12:09<74:05:34, 15.99s/it]
 56%|█████▌    | 21281/37963 [91:12:30<80:31:21, 17.38s/it]
 56%|█████▌    | 21282/37963 [91:12:44<75:47:33, 16.36s/it]
 56%|█████▌    | 21283/37963 [91:12:58<73:02:42, 15.77s/it]
 56%|█████▌    | 21284/37963 [91:13:12<70:20:38, 15.18s/it]
 56%|█████▌    | 21285/37963 [91:13:26<69:17:07, 14.96s/it]
 56%|█████▌    | 21286/37963 [91:13:41<68:30:03, 14.79s/it]
 56%|█████▌    | 21287/37963 [91:13:55<67:47:56, 14.64s/it]
 56%|█████▌    | 21288/37963 [91:14:09<66:55:49, 14.45s/it]
 56%|█████▌    | 21289/37963 [91:14:23<66:05:56, 14.27s/it]
 56%|█████▌    | 21290/37963 [91:14:37<66:16:02, 14.31s/it]
                                                           
{'loss': '0.1264', 'grad_norm': '1.011', 'learning_rate': '8.523e-06', 'epoch': '0.5608'}

 56%|█████▌    | 21290/37963 [91:14:37<66:16:02, 14.31s/it]
 56%|█████▌    | 21291/37963 [91:14:52<66:39:02, 14.39s/it]
 56%|█████▌    | 21292/37963 [91:15:06<66:33:42, 14.37s/it]
 56%|█████▌    | 21293/37963 [91:15:27<75:56:39, 16.40s/it]
 56%|█████▌    | 21294/37963 [91:15:42<73:11:52, 15.81s/it]
 56%|█████▌    | 21295/37963 [91:15:56<70:59:28, 15.33s/it]
 56%|█████▌    | 21296/37963 [91:16:10<69:22:28, 14.98s/it]
 56%|█████▌    | 21297/37963 [91:16:25<68:32:38, 14.81s/it]
 56%|█████▌    | 21298/37963 [91:16:39<67:56:31, 14.68s/it]
 56%|█████▌    | 21299/37963 [91:16:53<67:01:11, 14.48s/it]
 56%|█████▌    | 21300/37963 [91:17:07<66:56:07, 14.46s/it]
                                                           
{'loss': '0.1286', 'grad_norm': '2.57', 'learning_rate': '8.514e-06', 'epoch': '0.5611'}

 56%|█████▌    | 21300/37963 [91:17:08<66:56:07, 14.46s/it]
 56%|█████▌    | 21301/37963 [91:17:22<66:40:57, 14.41s/it]
 56%|█████▌    | 21302/37963 [91:17:36<66:42:41, 14.41s/it]
 56%|█████▌    | 21303/37963 [91:17:51<66:40:01, 14.41s/it]
 56%|█████▌    | 21304/37963 [91:18:05<66:36:27, 14.39s/it]
 56%|█████▌    | 21305/37963 [91:18:19<66:30:45, 14.37s/it]
 56%|█████▌    | 21306/37963 [91:18:33<65:47:43, 14.22s/it]
 56%|█████▌    | 21307/37963 [91:18:47<65:48:22, 14.22s/it]
 56%|█████▌    | 21308/37963 [91:19:02<65:55:34, 14.25s/it]
 56%|█████▌    | 21309/37963 [91:19:23<75:06:27, 16.24s/it]
 56%|█████▌    | 21310/37963 [91:19:37<72:13:16, 15.61s/it]
                                                           
{'loss': '0.1245', 'grad_norm': '1.024', 'learning_rate': '8.506e-06', 'epoch': '0.5613'}

 56%|█████▌    | 21310/37963 [91:19:37<72:13:16, 15.61s/it]
 56%|█████▌    | 21311/37963 [91:19:50<69:38:56, 15.06s/it]
 56%|█████▌    | 21312/37963 [91:20:05<68:38:13, 14.84s/it]
 56%|█████▌    | 21313/37963 [91:20:26<77:11:55, 16.69s/it]
 56%|█████▌    | 21314/37963 [91:20:40<73:52:38, 15.97s/it]
 56%|█████▌    | 21315/37963 [91:20:55<71:54:39, 15.55s/it]
 56%|█████▌    | 21316/37963 [91:21:09<69:56:00, 15.12s/it]
 56%|█████▌    | 21317/37963 [91:21:30<77:48:35, 16.83s/it]
 56%|█████▌    | 21318/37963 [91:21:44<74:25:07, 16.10s/it]
 56%|█████▌    | 21319/37963 [91:22:04<79:54:53, 17.29s/it]
 56%|█████▌    | 21320/37963 [91:22:18<75:50:44, 16.41s/it]
                                                           
{'loss': '0.1357', 'grad_norm': '2.993', 'learning_rate': '8.497e-06', 'epoch': '0.5616'}

 56%|█████▌    | 21320/37963 [91:22:18<75:50:44, 16.41s/it]
 56%|█████▌    | 21321/37963 [91:22:39<81:52:08, 17.71s/it]
 56%|█████▌    | 21322/37963 [91:22:54<77:12:37, 16.70s/it]
 56%|█████▌    | 21323/37963 [91:23:08<74:07:33, 16.04s/it]
 56%|█████▌    | 21324/37963 [91:23:22<71:53:05, 15.55s/it]
 56%|█████▌    | 21325/37963 [91:23:37<70:14:13, 15.20s/it]
 56%|█████▌    | 21326/37963 [91:23:51<68:44:43, 14.88s/it]
 56%|█████▌    | 21327/37963 [91:24:05<67:58:57, 14.71s/it]
 56%|█████▌    | 21328/37963 [91:24:26<76:09:33, 16.48s/it]
 56%|█████▌    | 21329/37963 [91:24:40<73:19:36, 15.87s/it]
 56%|█████▌    | 21330/37963 [91:25:01<80:37:02, 17.45s/it]
                                                           
{'loss': '0.1353', 'grad_norm': '1.067', 'learning_rate': '8.489e-06', 'epoch': '0.5619'}

 56%|█████▌    | 21330/37963 [91:25:01<80:37:02, 17.45s/it]
 56%|█████▌    | 21331/37963 [91:25:16<76:29:35, 16.56s/it]
 56%|█████▌    | 21332/37963 [91:25:30<73:25:45, 15.89s/it]
 56%|█████▌    | 21333/37963 [91:25:45<71:11:46, 15.41s/it]
 56%|█████▌    | 21334/37963 [91:25:59<69:41:03, 15.09s/it]
 56%|█████▌    | 21335/37963 [91:26:13<68:46:43, 14.89s/it]
 56%|█████▌    | 21336/37963 [91:26:28<67:59:49, 14.72s/it]
 56%|█████▌    | 21337/37963 [91:26:42<67:20:29, 14.58s/it]
 56%|█████▌    | 21338/37963 [91:26:56<66:56:16, 14.49s/it]
 56%|█████▌    | 21339/37963 [91:27:10<66:25:01, 14.38s/it]
 56%|█████▌    | 21340/37963 [91:27:25<66:14:54, 14.35s/it]
                                                           
{'loss': '0.1259', 'grad_norm': '0.9225', 'learning_rate': '8.48e-06', 'epoch': '0.5621'}

 56%|█████▌    | 21340/37963 [91:27:25<66:14:54, 14.35s/it]
 56%|█████▌    | 21341/37963 [91:27:46<75:38:06, 16.38s/it]
 56%|█████▌    | 21342/37963 [91:28:00<72:20:04, 15.67s/it]
 56%|█████▌    | 21343/37963 [91:28:13<69:11:41, 14.99s/it]
 56%|█████▌    | 21344/37963 [91:28:27<68:01:33, 14.74s/it]
 56%|█████▌    | 21345/37963 [91:28:41<67:18:55, 14.58s/it]
 56%|█████▌    | 21346/37963 [91:28:56<66:54:36, 14.50s/it]
 56%|█████▌    | 21347/37963 [91:29:10<66:39:15, 14.44s/it]
 56%|█████▌    | 21348/37963 [91:29:24<66:26:41, 14.40s/it]
 56%|█████▌    | 21349/37963 [91:29:39<66:19:01, 14.37s/it]
 56%|█████▌    | 21350/37963 [91:29:53<66:19:37, 14.37s/it]
                                                           
{'loss': '0.1328', 'grad_norm': '3.368', 'learning_rate': '8.472e-06', 'epoch': '0.5624'}

 56%|█████▌    | 21350/37963 [91:29:53<66:19:37, 14.37s/it]
 56%|█████▌    | 21351/37963 [91:30:07<65:55:13, 14.29s/it]
 56%|█████▌    | 21352/37963 [91:30:22<66:00:46, 14.31s/it]
 56%|█████▌    | 21353/37963 [91:30:36<66:13:22, 14.35s/it]
 56%|█████▌    | 21354/37963 [91:30:50<66:09:50, 14.34s/it]
 56%|█████▋    | 21355/37963 [91:31:11<74:59:31, 16.26s/it]
 56%|█████▋    | 21356/37963 [91:31:25<72:28:16, 15.71s/it]
 56%|█████▋    | 21357/37963 [91:31:40<70:37:37, 15.31s/it]
 56%|█████▋    | 21358/37963 [91:31:54<69:18:31, 15.03s/it]
 56%|█████▋    | 21359/37963 [91:32:09<68:20:33, 14.82s/it]
 56%|█████▋    | 21360/37963 [91:32:23<67:27:49, 14.63s/it]
                                                           
{'loss': '0.1361', 'grad_norm': '2.175', 'learning_rate': '8.464e-06', 'epoch': '0.5627'}

 56%|█████▋    | 21360/37963 [91:32:23<67:27:49, 14.63s/it]
 56%|█████▋    | 21361/37963 [91:32:37<66:59:43, 14.53s/it]
 56%|█████▋    | 21362/37963 [91:32:51<66:39:43, 14.46s/it]
 56%|█████▋    | 21363/37963 [91:33:12<75:53:49, 16.46s/it]
 56%|█████▋    | 21364/37963 [91:33:27<73:10:50, 15.87s/it]
 56%|█████▋    | 21365/37963 [91:33:48<79:57:05, 17.34s/it]
 56%|█████▋    | 21366/37963 [91:34:02<75:50:35, 16.45s/it]
 56%|█████▋    | 21367/37963 [91:34:23<81:32:23, 17.69s/it]
 56%|█████▋    | 21368/37963 [91:34:37<76:24:23, 16.58s/it]
 56%|█████▋    | 21369/37963 [91:34:51<73:15:52, 15.89s/it]
 56%|█████▋    | 21370/37963 [91:35:05<71:00:06, 15.40s/it]
                                                           
{'loss': '0.1308', 'grad_norm': '1.983', 'learning_rate': '8.455e-06', 'epoch': '0.5629'}

 56%|█████▋    | 21370/37963 [91:35:05<71:00:06, 15.40s/it]
 56%|█████▋    | 21371/37963 [91:35:19<69:19:33, 15.04s/it]
 56%|█████▋    | 21372/37963 [91:35:40<77:13:02, 16.76s/it]
 56%|█████▋    | 21373/37963 [91:35:54<73:25:30, 15.93s/it]
 56%|█████▋    | 21374/37963 [91:36:09<71:18:00, 15.47s/it]
 56%|█████▋    | 21375/37963 [91:36:22<69:12:07, 15.02s/it]
 56%|█████▋    | 21376/37963 [91:36:37<68:12:30, 14.80s/it]
 56%|█████▋    | 21377/37963 [91:36:51<67:32:31, 14.66s/it]
 56%|█████▋    | 21378/37963 [91:37:12<75:54:05, 16.48s/it]
 56%|█████▋    | 21379/37963 [91:37:32<81:29:20, 17.69s/it]
 56%|█████▋    | 21380/37963 [91:37:46<76:20:39, 16.57s/it]
                                                           
{'loss': '0.1382', 'grad_norm': '5.099', 'learning_rate': '8.447e-06', 'epoch': '0.5632'}

 56%|█████▋    | 21380/37963 [91:37:46<76:20:39, 16.57s/it]
 56%|█████▋    | 21381/37963 [91:38:01<73:18:24, 15.92s/it]
 56%|█████▋    | 21382/37963 [91:38:15<70:48:22, 15.37s/it]
 56%|█████▋    | 21383/37963 [91:38:29<69:34:08, 15.11s/it]
 56%|█████▋    | 21384/37963 [91:38:43<67:37:10, 14.68s/it]
 56%|█████▋    | 21385/37963 [91:38:57<67:10:56, 14.59s/it]
 56%|█████▋    | 21386/37963 [91:39:12<66:49:37, 14.51s/it]
 56%|█████▋    | 21387/37963 [91:39:26<66:35:19, 14.46s/it]
 56%|█████▋    | 21388/37963 [91:39:40<65:51:16, 14.30s/it]
 56%|█████▋    | 21389/37963 [91:39:54<65:38:34, 14.26s/it]
 56%|█████▋    | 21390/37963 [91:40:15<74:52:25, 16.26s/it]
                                                           
{'loss': '0.1292', 'grad_norm': '2.496', 'learning_rate': '8.438e-06', 'epoch': '0.5634'}

 56%|█████▋    | 21390/37963 [91:40:15<74:52:25, 16.26s/it]
 56%|█████▋    | 21391/37963 [91:40:29<72:13:00, 15.69s/it]
 56%|█████▋    | 21392/37963 [91:40:44<70:16:03, 15.27s/it]
 56%|█████▋    | 21393/37963 [91:40:58<68:59:45, 14.99s/it]
 56%|█████▋    | 21394/37963 [91:41:12<67:30:14, 14.67s/it]
 56%|█████▋    | 21395/37963 [91:41:26<67:06:35, 14.58s/it]
 56%|█████▋    | 21396/37963 [91:41:41<66:41:48, 14.49s/it]
 56%|█████▋    | 21397/37963 [91:41:55<66:25:36, 14.44s/it]
 56%|█████▋    | 21398/37963 [91:42:09<66:15:36, 14.40s/it]
 56%|█████▋    | 21399/37963 [91:42:24<66:11:19, 14.39s/it]
 56%|█████▋    | 21400/37963 [91:42:38<66:11:03, 14.39s/it]
                                                           
{'loss': '0.1453', 'grad_norm': '2.069', 'learning_rate': '8.43e-06', 'epoch': '0.5637'}

 56%|█████▋    | 21400/37963 [91:42:38<66:11:03, 14.39s/it]
 56%|█████▋    | 21401/37963 [91:42:52<65:40:11, 14.27s/it]
 56%|█████▋    | 21402/37963 [91:43:06<65:20:16, 14.20s/it]
 56%|█████▋    | 21403/37963 [91:43:21<65:45:06, 14.29s/it]
 56%|█████▋    | 21404/37963 [91:43:41<74:28:33, 16.19s/it]
 56%|█████▋    | 21405/37963 [91:43:55<71:52:10, 15.63s/it]
 56%|█████▋    | 21406/37963 [91:44:09<69:21:53, 15.08s/it]
 56%|█████▋    | 21407/37963 [91:44:23<67:38:22, 14.71s/it]
 56%|█████▋    | 21408/37963 [91:44:38<67:11:56, 14.61s/it]
 56%|█████▋    | 21409/37963 [91:44:52<66:52:50, 14.54s/it]
 56%|█████▋    | 21410/37963 [91:45:06<66:29:32, 14.46s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '1.717', 'learning_rate': '8.422e-06', 'epoch': '0.564'}

 56%|█████▋    | 21410/37963 [91:45:06<66:29:32, 14.46s/it]
 56%|█████▋    | 21411/37963 [91:45:21<66:30:20, 14.46s/it]
 56%|█████▋    | 21412/37963 [91:45:41<75:17:25, 16.38s/it]
 56%|█████▋    | 21413/37963 [91:46:02<81:14:13, 17.67s/it]
 56%|█████▋    | 21414/37963 [91:46:17<76:42:58, 16.69s/it]
 56%|█████▋    | 21415/37963 [91:46:37<82:29:07, 17.94s/it]
 56%|█████▋    | 21416/37963 [91:46:51<76:51:58, 16.72s/it]
 56%|█████▋    | 21417/37963 [91:47:06<73:22:55, 15.97s/it]
 56%|█████▋    | 21418/37963 [91:47:20<71:12:21, 15.49s/it]
 56%|█████▋    | 21419/37963 [91:47:40<78:12:09, 17.02s/it]
 56%|█████▋    | 21420/37963 [91:47:55<74:55:57, 16.31s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '3.264', 'learning_rate': '8.413e-06', 'epoch': '0.5642'}

 56%|█████▋    | 21420/37963 [91:47:55<74:55:57, 16.31s/it]
 56%|█████▋    | 21421/37963 [91:48:10<72:35:19, 15.80s/it]
 56%|█████▋    | 21422/37963 [91:48:24<70:35:52, 15.36s/it]
 56%|█████▋    | 21423/37963 [91:48:38<69:12:18, 15.06s/it]
 56%|█████▋    | 21424/37963 [91:48:53<68:13:15, 14.85s/it]
 56%|█████▋    | 21425/37963 [91:49:07<67:13:05, 14.63s/it]
 56%|█████▋    | 21426/37963 [91:49:21<66:17:43, 14.43s/it]
 56%|█████▋    | 21427/37963 [91:49:42<75:09:37, 16.36s/it]
 56%|█████▋    | 21428/37963 [91:49:56<72:20:48, 15.75s/it]
 56%|█████▋    | 21429/37963 [91:50:17<79:52:25, 17.39s/it]
 56%|█████▋    | 21430/37963 [91:50:32<75:41:51, 16.48s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '1.721', 'learning_rate': '8.405e-06', 'epoch': '0.5645'}

 56%|█████▋    | 21430/37963 [91:50:32<75:41:51, 16.48s/it]
 56%|█████▋    | 21431/37963 [91:50:46<73:01:55, 15.90s/it]
 56%|█████▋    | 21432/37963 [91:51:01<70:55:58, 15.45s/it]
 56%|█████▋    | 21433/37963 [91:51:15<69:25:29, 15.12s/it]
 56%|█████▋    | 21434/37963 [91:51:29<68:30:30, 14.92s/it]
 56%|█████▋    | 21435/37963 [91:51:43<67:12:25, 14.64s/it]
 56%|█████▋    | 21436/37963 [91:51:58<66:47:32, 14.55s/it]
 56%|█████▋    | 21437/37963 [91:52:12<66:43:14, 14.53s/it]
 56%|█████▋    | 21438/37963 [91:52:27<66:39:47, 14.52s/it]
 56%|█████▋    | 21439/37963 [91:52:48<76:10:36, 16.60s/it]
 56%|█████▋    | 21440/37963 [91:53:02<73:02:10, 15.91s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '1.781', 'learning_rate': '8.396e-06', 'epoch': '0.5648'}

 56%|█████▋    | 21440/37963 [91:53:02<73:02:10, 15.91s/it]
 56%|█████▋    | 21441/37963 [91:53:17<70:43:16, 15.41s/it]
 56%|█████▋    | 21442/37963 [91:53:31<69:05:52, 15.06s/it]
 56%|█████▋    | 21443/37963 [91:53:45<68:08:27, 14.85s/it]
 56%|█████▋    | 21444/37963 [91:54:00<67:37:09, 14.74s/it]
 56%|█████▋    | 21445/37963 [91:54:14<67:02:39, 14.61s/it]
 56%|█████▋    | 21446/37963 [91:54:28<66:06:24, 14.41s/it]
 56%|█████▋    | 21447/37963 [91:54:42<66:07:52, 14.41s/it]
 56%|█████▋    | 21448/37963 [91:54:57<66:05:08, 14.41s/it]
 56%|█████▋    | 21449/37963 [91:55:11<65:25:45, 14.26s/it]
 57%|█████▋    | 21450/37963 [91:55:25<65:15:11, 14.23s/it]
                                                           
{'loss': '0.1143', 'grad_norm': '0.9758', 'learning_rate': '8.388e-06', 'epoch': '0.565'}

 57%|█████▋    | 21450/37963 [91:55:25<65:15:11, 14.23s/it]
 57%|█████▋    | 21451/37963 [91:55:39<64:52:37, 14.14s/it]
 57%|█████▋    | 21452/37963 [91:55:53<65:03:50, 14.19s/it]
 57%|█████▋    | 21453/37963 [91:56:14<74:08:32, 16.17s/it]
 57%|█████▋    | 21454/37963 [91:56:28<71:45:34, 15.65s/it]
 57%|█████▋    | 21455/37963 [91:56:43<69:56:35, 15.25s/it]
 57%|█████▋    | 21456/37963 [91:56:57<68:12:40, 14.88s/it]
 57%|█████▋    | 21457/37963 [91:57:11<67:26:53, 14.71s/it]
 57%|█████▋    | 21458/37963 [91:57:26<67:07:22, 14.64s/it]
 57%|█████▋    | 21459/37963 [91:57:45<74:23:14, 16.23s/it]
 57%|█████▋    | 21460/37963 [91:58:00<71:35:12, 15.62s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '1.697', 'learning_rate': '8.379e-06', 'epoch': '0.5653'}

 57%|█████▋    | 21460/37963 [91:58:00<71:35:12, 15.62s/it]
 57%|█████▋    | 21461/37963 [91:58:21<79:02:02, 17.24s/it]
 57%|█████▋    | 21462/37963 [91:58:35<75:01:05, 16.37s/it]
 57%|█████▋    | 21463/37963 [91:58:49<72:11:33, 15.75s/it]
 57%|█████▋    | 21464/37963 [91:59:04<70:17:06, 15.34s/it]
 57%|█████▋    | 21465/37963 [91:59:18<68:59:46, 15.06s/it]
 57%|█████▋    | 21466/37963 [91:59:39<76:53:19, 16.78s/it]
 57%|█████▋    | 21467/37963 [91:59:54<74:01:00, 16.15s/it]
 57%|█████▋    | 21468/37963 [92:00:14<80:35:31, 17.59s/it]
 57%|█████▋    | 21469/37963 [92:00:28<75:22:14, 16.45s/it]
 57%|█████▋    | 21470/37963 [92:00:43<72:29:10, 15.82s/it]
                                                           
{'loss': '0.1387', 'grad_norm': '1.723', 'learning_rate': '8.371e-06', 'epoch': '0.5656'}

 57%|█████▋    | 21470/37963 [92:00:43<72:29:10, 15.82s/it]
 57%|█████▋    | 21471/37963 [92:00:57<70:35:18, 15.41s/it]
 57%|█████▋    | 21472/37963 [92:01:12<69:20:29, 15.14s/it]
 57%|█████▋    | 21473/37963 [92:01:26<68:49:58, 15.03s/it]
 57%|█████▋    | 21474/37963 [92:01:41<67:50:02, 14.81s/it]
 57%|█████▋    | 21475/37963 [92:01:55<67:10:01, 14.67s/it]
 57%|█████▋    | 21476/37963 [92:02:16<75:39:41, 16.52s/it]
 57%|█████▋    | 21477/37963 [92:02:30<72:29:16, 15.83s/it]
 57%|█████▋    | 21478/37963 [92:02:44<70:25:50, 15.38s/it]
 57%|█████▋    | 21479/37963 [92:03:05<77:57:43, 17.03s/it]
 57%|█████▋    | 21480/37963 [92:03:19<74:06:53, 16.19s/it]
                                                           
{'loss': '0.1226', 'grad_norm': '4.236', 'learning_rate': '8.363e-06', 'epoch': '0.5658'}

 57%|█████▋    | 21480/37963 [92:03:19<74:06:53, 16.19s/it]
 57%|█████▋    | 21481/37963 [92:03:33<71:06:31, 15.53s/it]
 57%|█████▋    | 21482/37963 [92:03:48<69:26:44, 15.17s/it]
 57%|█████▋    | 21483/37963 [92:04:02<68:24:19, 14.94s/it]
 57%|█████▋    | 21484/37963 [92:04:16<67:08:20, 14.67s/it]
 57%|█████▋    | 21485/37963 [92:04:31<66:39:17, 14.56s/it]
 57%|█████▋    | 21486/37963 [92:04:45<66:00:39, 14.42s/it]
 57%|█████▋    | 21487/37963 [92:04:59<65:52:15, 14.39s/it]
 57%|█████▋    | 21488/37963 [92:05:13<66:00:07, 14.42s/it]
 57%|█████▋    | 21489/37963 [92:05:35<75:14:45, 16.44s/it]
 57%|█████▋    | 21490/37963 [92:05:49<71:51:43, 15.70s/it]
                                                           
{'loss': '0.1395', 'grad_norm': '4.218', 'learning_rate': '8.354e-06', 'epoch': '0.5661'}

 57%|█████▋    | 21490/37963 [92:05:49<71:51:43, 15.70s/it]
 57%|█████▋    | 21491/37963 [92:06:03<69:57:01, 15.29s/it]
 57%|█████▋    | 21492/37963 [92:06:17<67:49:50, 14.83s/it]
 57%|█████▋    | 21493/37963 [92:06:31<67:20:37, 14.72s/it]
 57%|█████▋    | 21494/37963 [92:06:46<66:51:20, 14.61s/it]
 57%|█████▋    | 21495/37963 [92:07:00<66:26:40, 14.53s/it]
 57%|█████▋    | 21496/37963 [92:07:14<66:09:04, 14.46s/it]
 57%|█████▋    | 21497/37963 [92:07:29<66:18:16, 14.50s/it]
 57%|█████▋    | 21498/37963 [92:07:43<65:32:20, 14.33s/it]
 57%|█████▋    | 21499/37963 [92:07:57<65:29:55, 14.32s/it]
 57%|█████▋    | 21500/37963 [92:08:11<65:34:08, 14.34s/it]
                                                           
{'loss': '0.127', 'grad_norm': '1.074', 'learning_rate': '8.346e-06', 'epoch': '0.5663'}

 57%|█████▋    | 21500/37963 [92:08:11<65:34:08, 14.34s/it]
 57%|█████▋    | 21501/37963 [92:08:32<74:19:31, 16.25s/it]
 57%|█████▋    | 21502/37963 [92:08:46<71:41:06, 15.68s/it]
 57%|█████▋    | 21503/37963 [92:09:01<69:59:42, 15.31s/it]
 57%|█████▋    | 21504/37963 [92:09:14<67:29:06, 14.76s/it]
 57%|█████▋    | 21505/37963 [92:09:35<75:52:34, 16.60s/it]
 57%|█████▋    | 21506/37963 [92:09:50<72:57:32, 15.96s/it]
 57%|█████▋    | 21507/37963 [92:10:04<70:47:45, 15.49s/it]
 57%|█████▋    | 21508/37963 [92:10:19<69:27:03, 15.19s/it]
 57%|█████▋    | 21509/37963 [92:10:40<77:30:13, 16.96s/it]
 57%|█████▋    | 21510/37963 [92:10:54<73:53:54, 16.17s/it]
                                                           
{'loss': '0.1298', 'grad_norm': '2.604', 'learning_rate': '8.337e-06', 'epoch': '0.5666'}

 57%|█████▋    | 21510/37963 [92:10:54<73:53:54, 16.17s/it]
 57%|█████▋    | 21511/37963 [92:11:08<71:27:12, 15.64s/it]
 57%|█████▋    | 21512/37963 [92:11:23<69:35:47, 15.23s/it]
 57%|█████▋    | 21513/37963 [92:11:37<67:55:39, 14.87s/it]
 57%|█████▋    | 21514/37963 [92:11:58<76:17:00, 16.70s/it]
 57%|█████▋    | 21515/37963 [92:12:12<73:03:45, 15.99s/it]
 57%|█████▋    | 21516/37963 [92:12:26<70:47:55, 15.50s/it]
 57%|█████▋    | 21517/37963 [92:12:41<69:28:06, 15.21s/it]
 57%|█████▋    | 21518/37963 [92:13:01<76:27:03, 16.74s/it]
 57%|█████▋    | 21519/37963 [92:13:16<73:09:32, 16.02s/it]
 57%|█████▋    | 21520/37963 [92:13:30<70:36:32, 15.46s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '3.681', 'learning_rate': '8.329e-06', 'epoch': '0.5669'}

 57%|█████▋    | 21520/37963 [92:13:30<70:36:32, 15.46s/it]
 57%|█████▋    | 21521/37963 [92:13:44<68:24:53, 14.98s/it]
 57%|█████▋    | 21522/37963 [92:13:58<67:48:09, 14.85s/it]
 57%|█████▋    | 21523/37963 [92:14:12<67:06:20, 14.69s/it]
 57%|█████▋    | 21524/37963 [92:14:34<75:56:41, 16.63s/it]
 57%|█████▋    | 21525/37963 [92:14:48<72:49:10, 15.95s/it]
 57%|█████▋    | 21526/37963 [92:15:02<70:39:17, 15.47s/it]
 57%|█████▋    | 21527/37963 [92:15:17<69:10:48, 15.15s/it]
 57%|█████▋    | 21528/37963 [92:15:31<68:05:01, 14.91s/it]
 57%|█████▋    | 21529/37963 [92:15:51<75:20:16, 16.50s/it]
 57%|█████▋    | 21530/37963 [92:16:06<72:17:20, 15.84s/it]
                                                           
{'loss': '0.1308', 'grad_norm': '2.121', 'learning_rate': '8.32e-06', 'epoch': '0.5671'}

 57%|█████▋    | 21530/37963 [92:16:06<72:17:20, 15.84s/it]
 57%|█████▋    | 21531/37963 [92:16:20<70:16:55, 15.40s/it]
 57%|█████▋    | 21532/37963 [92:16:34<68:48:49, 15.08s/it]
 57%|█████▋    | 21533/37963 [92:16:49<67:48:41, 14.86s/it]
 57%|█████▋    | 21534/37963 [92:17:03<66:40:03, 14.61s/it]
 57%|█████▋    | 21535/37963 [92:17:16<65:34:20, 14.37s/it]
 57%|█████▋    | 21536/37963 [92:17:31<65:34:24, 14.37s/it]
 57%|█████▋    | 21537/37963 [92:17:45<65:33:28, 14.37s/it]
 57%|█████▋    | 21538/37963 [92:18:07<75:39:31, 16.58s/it]
 57%|█████▋    | 21539/37963 [92:18:21<72:35:30, 15.91s/it]
 57%|█████▋    | 21540/37963 [92:18:36<70:25:32, 15.44s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '4.207', 'learning_rate': '8.312e-06', 'epoch': '0.5674'}

 57%|█████▋    | 21540/37963 [92:18:36<70:25:32, 15.44s/it]
 57%|█████▋    | 21541/37963 [92:18:50<68:32:45, 15.03s/it]
 57%|█████▋    | 21542/37963 [92:19:04<67:20:37, 14.76s/it]
 57%|█████▋    | 21543/37963 [92:19:18<66:46:02, 14.64s/it]
 57%|█████▋    | 21544/37963 [92:19:32<66:21:56, 14.55s/it]
 57%|█████▋    | 21545/37963 [92:19:46<65:19:18, 14.32s/it]
 57%|█████▋    | 21546/37963 [92:20:01<65:49:36, 14.43s/it]
 57%|█████▋    | 21547/37963 [92:20:15<65:11:17, 14.30s/it]
 57%|█████▋    | 21548/37963 [92:20:29<65:22:00, 14.34s/it]
 57%|█████▋    | 21549/37963 [92:20:44<65:21:27, 14.33s/it]
 57%|█████▋    | 21550/37963 [92:20:58<65:06:06, 14.28s/it]
                                                           
{'loss': '0.1402', 'grad_norm': '1.556', 'learning_rate': '8.304e-06', 'epoch': '0.5677'}

 57%|█████▋    | 21550/37963 [92:20:58<65:06:06, 14.28s/it]
 57%|█████▋    | 21551/37963 [92:21:19<73:57:59, 16.22s/it]
 57%|█████▋    | 21552/37963 [92:21:38<78:54:23, 17.31s/it]
 57%|█████▋    | 21553/37963 [92:21:53<74:54:54, 16.43s/it]
 57%|█████▋    | 21554/37963 [92:22:07<71:15:11, 15.63s/it]
 57%|█████▋    | 21555/37963 [92:22:21<69:09:28, 15.17s/it]
 57%|█████▋    | 21556/37963 [92:22:35<68:01:38, 14.93s/it]
 57%|█████▋    | 21557/37963 [92:22:50<67:20:13, 14.78s/it]
 57%|█████▋    | 21558/37963 [92:23:04<66:43:45, 14.64s/it]
 57%|█████▋    | 21559/37963 [92:23:18<65:59:15, 14.48s/it]
 57%|█████▋    | 21560/37963 [92:23:39<74:18:59, 16.31s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '2.529', 'learning_rate': '8.295e-06', 'epoch': '0.5679'}

 57%|█████▋    | 21560/37963 [92:23:39<74:18:59, 16.31s/it]
 57%|█████▋    | 21561/37963 [92:23:53<71:14:42, 15.64s/it]
 57%|█████▋    | 21562/37963 [92:24:07<69:37:01, 15.28s/it]
 57%|█████▋    | 21563/37963 [92:24:27<76:40:29, 16.83s/it]
 57%|█████▋    | 21564/37963 [92:24:41<72:05:30, 15.83s/it]
 57%|█████▋    | 21565/37963 [92:24:55<69:17:42, 15.21s/it]
 57%|█████▋    | 21566/37963 [92:25:09<68:00:15, 14.93s/it]
 57%|█████▋    | 21567/37963 [92:25:30<76:06:15, 16.71s/it]
 57%|█████▋    | 21568/37963 [92:25:44<72:49:01, 15.99s/it]
 57%|█████▋    | 21569/37963 [92:25:58<70:04:58, 15.39s/it]
 57%|█████▋    | 21570/37963 [92:26:12<68:32:41, 15.05s/it]
                                                           
{'loss': '0.1321', 'grad_norm': '3.475', 'learning_rate': '8.287e-06', 'epoch': '0.5682'}

 57%|█████▋    | 21570/37963 [92:26:12<68:32:41, 15.05s/it]
 57%|█████▋    | 21571/37963 [92:26:27<67:39:50, 14.86s/it]
 57%|█████▋    | 21572/37963 [92:26:48<76:06:32, 16.72s/it]
 57%|█████▋    | 21573/37963 [92:27:02<72:51:51, 16.00s/it]
 57%|█████▋    | 21574/37963 [92:27:16<70:26:02, 15.47s/it]
 57%|█████▋    | 21575/37963 [92:27:31<68:49:06, 15.12s/it]
 57%|█████▋    | 21576/37963 [92:27:45<67:54:54, 14.92s/it]
 57%|█████▋    | 21577/37963 [92:28:00<67:09:14, 14.75s/it]
 57%|█████▋    | 21578/37963 [92:28:14<66:32:34, 14.62s/it]
 57%|█████▋    | 21579/37963 [92:28:28<65:38:23, 14.42s/it]
 57%|█████▋    | 21580/37963 [92:28:48<73:13:24, 16.09s/it]
                                                           
{'loss': '0.1336', 'grad_norm': '1.417', 'learning_rate': '8.278e-06', 'epoch': '0.5685'}

 57%|█████▋    | 21580/37963 [92:28:48<73:13:24, 16.09s/it]
 57%|█████▋    | 21581/37963 [92:29:02<70:54:44, 15.58s/it]
 57%|█████▋    | 21582/37963 [92:29:17<69:18:33, 15.23s/it]
 57%|█████▋    | 21583/37963 [92:29:31<68:04:00, 14.96s/it]
 57%|█████▋    | 21584/37963 [92:29:45<67:11:13, 14.77s/it]
 57%|█████▋    | 21585/37963 [92:30:00<66:39:52, 14.65s/it]
 57%|█████▋    | 21586/37963 [92:30:20<74:38:17, 16.41s/it]
 57%|█████▋    | 21587/37963 [92:30:35<71:47:14, 15.78s/it]
 57%|█████▋    | 21588/37963 [92:30:49<70:02:36, 15.40s/it]
 57%|█████▋    | 21589/37963 [92:31:03<68:41:41, 15.10s/it]
 57%|█████▋    | 21590/37963 [92:31:17<67:13:55, 14.78s/it]
                                                           
{'loss': '0.1306', 'grad_norm': '1.373', 'learning_rate': '8.27e-06', 'epoch': '0.5687'}

 57%|█████▋    | 21590/37963 [92:31:17<67:13:55, 14.78s/it]
 57%|█████▋    | 21591/37963 [92:31:32<66:41:27, 14.66s/it]
 57%|█████▋    | 21592/37963 [92:31:46<66:13:07, 14.56s/it]
 57%|█████▋    | 21593/37963 [92:32:01<65:55:21, 14.50s/it]
 57%|█████▋    | 21594/37963 [92:32:15<65:38:23, 14.44s/it]
 57%|█████▋    | 21595/37963 [92:32:29<65:30:00, 14.41s/it]
 57%|█████▋    | 21596/37963 [92:32:43<65:12:37, 14.34s/it]
 57%|█████▋    | 21597/37963 [92:32:58<65:13:27, 14.35s/it]
 57%|█████▋    | 21598/37963 [92:33:12<65:08:22, 14.33s/it]
 57%|█████▋    | 21599/37963 [92:33:26<65:07:54, 14.33s/it]
 57%|█████▋    | 21600/37963 [92:33:40<64:54:35, 14.28s/it]
                                                           
{'loss': '0.127', 'grad_norm': '1.989', 'learning_rate': '8.262e-06', 'epoch': '0.569'}

 57%|█████▋    | 21600/37963 [92:33:40<64:54:35, 14.28s/it]
 57%|█████▋    | 21601/37963 [92:34:01<73:45:22, 16.23s/it]
 57%|█████▋    | 21602/37963 [92:34:22<80:06:13, 17.63s/it]
 57%|█████▋    | 21603/37963 [92:34:37<75:40:57, 16.65s/it]
 57%|█████▋    | 21604/37963 [92:34:51<72:14:26, 15.90s/it]
 57%|█████▋    | 21605/37963 [92:35:05<70:12:31, 15.45s/it]
 57%|█████▋    | 21606/37963 [92:35:19<68:39:57, 15.11s/it]
 57%|█████▋    | 21607/37963 [92:35:34<67:22:18, 14.83s/it]
 57%|█████▋    | 21608/37963 [92:35:48<66:47:43, 14.70s/it]
 57%|█████▋    | 21609/37963 [92:36:09<75:32:06, 16.63s/it]
 57%|█████▋    | 21610/37963 [92:36:23<72:25:45, 15.94s/it]
                                                           
{'loss': '0.1317', 'grad_norm': '2.996', 'learning_rate': '8.253e-06', 'epoch': '0.5692'}

 57%|█████▋    | 21610/37963 [92:36:23<72:25:45, 15.94s/it]
 57%|█████▋    | 21611/37963 [92:36:44<78:36:33, 17.31s/it]
 57%|█████▋    | 21612/37963 [92:36:58<74:34:31, 16.42s/it]
 57%|█████▋    | 21613/37963 [92:37:13<71:48:50, 15.81s/it]
 57%|█████▋    | 21614/37963 [92:37:33<78:35:01, 17.30s/it]
 57%|█████▋    | 21615/37963 [92:37:48<74:23:27, 16.38s/it]
 57%|█████▋    | 21616/37963 [92:38:01<70:43:44, 15.58s/it]
 57%|█████▋    | 21617/37963 [92:38:16<69:07:44, 15.22s/it]
 57%|█████▋    | 21618/37963 [92:38:30<68:15:17, 15.03s/it]
 57%|█████▋    | 21619/37963 [92:38:44<66:26:07, 14.63s/it]
 57%|█████▋    | 21620/37963 [92:38:58<65:30:16, 14.43s/it]
                                                           
{'loss': '0.1268', 'grad_norm': '1.677', 'learning_rate': '8.245e-06', 'epoch': '0.5695'}

 57%|█████▋    | 21620/37963 [92:38:58<65:30:16, 14.43s/it]
 57%|█████▋    | 21621/37963 [92:39:19<74:22:26, 16.38s/it]
 57%|█████▋    | 21622/37963 [92:39:33<71:39:40, 15.79s/it]
 57%|█████▋    | 21623/37963 [92:39:47<68:37:11, 15.12s/it]
 57%|█████▋    | 21624/37963 [92:40:01<67:29:48, 14.87s/it]
 57%|█████▋    | 21625/37963 [92:40:15<66:37:11, 14.68s/it]
 57%|█████▋    | 21626/37963 [92:40:30<66:24:32, 14.63s/it]
 57%|█████▋    | 21627/37963 [92:40:44<65:35:33, 14.45s/it]
 57%|█████▋    | 21628/37963 [92:40:58<64:39:42, 14.25s/it]
 57%|█████▋    | 21629/37963 [92:41:18<73:24:14, 16.18s/it]
 57%|█████▋    | 21630/37963 [92:41:33<70:39:24, 15.57s/it]
                                                           
{'loss': '0.1366', 'grad_norm': '1.375', 'learning_rate': '8.236e-06', 'epoch': '0.5698'}

 57%|█████▋    | 21630/37963 [92:41:33<70:39:24, 15.57s/it]
 57%|█████▋    | 21631/37963 [92:41:47<69:09:41, 15.25s/it]
 57%|█████▋    | 21632/37963 [92:42:01<67:57:53, 14.98s/it]
 57%|█████▋    | 21633/37963 [92:42:16<67:04:42, 14.79s/it]
 57%|█████▋    | 21634/37963 [92:42:37<75:44:22, 16.70s/it]
 57%|█████▋    | 21635/37963 [92:42:51<72:34:31, 16.00s/it]
 57%|█████▋    | 21636/37963 [92:43:05<69:48:40, 15.39s/it]
 57%|█████▋    | 21637/37963 [92:43:19<68:07:23, 15.02s/it]
 57%|█████▋    | 21638/37963 [92:43:34<67:15:30, 14.83s/it]
 57%|█████▋    | 21639/37963 [92:43:48<65:51:43, 14.52s/it]
 57%|█████▋    | 21640/37963 [92:44:02<65:35:32, 14.47s/it]
                                                           
{'loss': '0.132', 'grad_norm': '1.653', 'learning_rate': '8.228e-06', 'epoch': '0.57'}

 57%|█████▋    | 21640/37963 [92:44:02<65:35:32, 14.47s/it]
 57%|█████▋    | 21641/37963 [92:44:16<64:58:27, 14.33s/it]
 57%|█████▋    | 21642/37963 [92:44:30<65:01:40, 14.34s/it]
 57%|█████▋    | 21643/37963 [92:44:45<64:54:53, 14.32s/it]
 57%|█████▋    | 21644/37963 [92:44:59<64:51:27, 14.31s/it]
 57%|█████▋    | 21645/37963 [92:45:13<64:51:06, 14.31s/it]
 57%|█████▋    | 21646/37963 [92:45:28<64:56:30, 14.33s/it]
 57%|█████▋    | 21647/37963 [92:45:42<64:56:04, 14.33s/it]
 57%|█████▋    | 21648/37963 [92:45:56<65:00:47, 14.35s/it]
 57%|█████▋    | 21649/37963 [92:46:16<72:49:29, 16.07s/it]
 57%|█████▋    | 21650/37963 [92:46:31<70:26:18, 15.54s/it]
                                                           
{'loss': '0.1221', 'grad_norm': '2.512', 'learning_rate': '8.22e-06', 'epoch': '0.5703'}

 57%|█████▋    | 21650/37963 [92:46:31<70:26:18, 15.54s/it]
 57%|█████▋    | 21651/37963 [92:46:51<77:31:23, 17.11s/it]
 57%|█████▋    | 21652/37963 [92:47:06<73:45:05, 16.28s/it]
 57%|█████▋    | 21653/37963 [92:47:20<71:09:03, 15.70s/it]
 57%|█████▋    | 21654/37963 [92:47:34<67:57:32, 15.00s/it]
 57%|█████▋    | 21655/37963 [92:47:48<67:03:41, 14.80s/it]
 57%|█████▋    | 21656/37963 [92:48:02<66:34:15, 14.70s/it]
 57%|█████▋    | 21657/37963 [92:48:17<66:25:08, 14.66s/it]
 57%|█████▋    | 21658/37963 [92:48:31<66:10:46, 14.61s/it]
 57%|█████▋    | 21659/37963 [92:48:46<65:55:12, 14.56s/it]
 57%|█████▋    | 21660/37963 [92:49:07<74:49:54, 16.52s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '1.948', 'learning_rate': '8.211e-06', 'epoch': '0.5706'}

 57%|█████▋    | 21660/37963 [92:49:07<74:49:54, 16.52s/it]
 57%|█████▋    | 21661/37963 [92:49:28<81:09:38, 17.92s/it]
 57%|█████▋    | 21662/37963 [92:49:43<76:27:41, 16.89s/it]
 57%|█████▋    | 21663/37963 [92:49:56<72:07:11, 15.93s/it]
 57%|█████▋    | 21664/37963 [92:50:11<69:58:00, 15.45s/it]
 57%|█████▋    | 21665/37963 [92:50:25<68:13:39, 15.07s/it]
 57%|█████▋    | 21666/37963 [92:50:46<76:23:16, 16.87s/it]
 57%|█████▋    | 21667/37963 [92:51:00<73:08:55, 16.16s/it]
 57%|█████▋    | 21668/37963 [92:51:21<79:41:48, 17.61s/it]
 57%|█████▋    | 21669/37963 [92:51:36<75:14:20, 16.62s/it]
 57%|█████▋    | 21670/37963 [92:51:50<72:09:06, 15.94s/it]
                                                           
{'loss': '0.1415', 'grad_norm': '2.965', 'learning_rate': '8.203e-06', 'epoch': '0.5708'}

 57%|█████▋    | 21670/37963 [92:51:50<72:09:06, 15.94s/it]
 57%|█████▋    | 21671/37963 [92:52:04<69:52:54, 15.44s/it]
 57%|█████▋    | 21672/37963 [92:52:19<68:42:39, 15.18s/it]
 57%|█████▋    | 21673/37963 [92:52:33<67:38:27, 14.95s/it]
 57%|█████▋    | 21674/37963 [92:52:48<66:50:34, 14.77s/it]
 57%|█████▋    | 21675/37963 [92:53:02<66:10:27, 14.63s/it]
 57%|█████▋    | 21676/37963 [92:53:16<65:44:51, 14.53s/it]
 57%|█████▋    | 21677/37963 [92:53:30<65:10:08, 14.41s/it]
 57%|█████▋    | 21678/37963 [92:53:51<73:38:09, 16.28s/it]
 57%|█████▋    | 21679/37963 [92:54:05<71:04:02, 15.71s/it]
 57%|█████▋    | 21680/37963 [92:54:20<69:17:53, 15.32s/it]
                                                           
{'loss': '0.1243', 'grad_norm': '6.976', 'learning_rate': '8.194e-06', 'epoch': '0.5711'}

 57%|█████▋    | 21680/37963 [92:54:20<69:17:53, 15.32s/it]
 57%|█████▋    | 21681/37963 [92:54:34<68:02:00, 15.04s/it]
 57%|█████▋    | 21682/37963 [92:54:56<76:48:00, 16.98s/it]
 57%|█████▋    | 21683/37963 [92:55:10<73:17:20, 16.21s/it]
 57%|█████▋    | 21684/37963 [92:55:25<70:48:55, 15.66s/it]
 57%|█████▋    | 21685/37963 [92:55:39<69:15:07, 15.32s/it]
 57%|█████▋    | 21686/37963 [92:55:53<67:47:47, 14.99s/it]
 57%|█████▋    | 21687/37963 [92:56:08<66:54:20, 14.80s/it]
 57%|█████▋    | 21688/37963 [92:56:22<66:24:31, 14.69s/it]
 57%|█████▋    | 21689/37963 [92:56:36<65:56:03, 14.59s/it]
 57%|█████▋    | 21690/37963 [92:56:50<65:00:36, 14.38s/it]
                                                           
{'loss': '0.1317', 'grad_norm': '2.315', 'learning_rate': '8.186e-06', 'epoch': '0.5713'}

 57%|█████▋    | 21690/37963 [92:56:50<65:00:36, 14.38s/it]
 57%|█████▋    | 21691/37963 [92:57:04<64:18:50, 14.23s/it]
 57%|█████▋    | 21692/37963 [92:57:19<64:26:41, 14.26s/it]
 57%|█████▋    | 21693/37963 [92:57:33<64:40:36, 14.31s/it]
 57%|█████▋    | 21694/37963 [92:57:47<64:41:30, 14.32s/it]
 57%|█████▋    | 21695/37963 [92:58:02<64:44:11, 14.33s/it]
 57%|█████▋    | 21696/37963 [92:58:16<64:39:41, 14.31s/it]
 57%|█████▋    | 21697/37963 [92:58:36<73:02:37, 16.17s/it]
 57%|█████▋    | 21698/37963 [92:58:51<70:27:54, 15.60s/it]
 57%|█████▋    | 21699/37963 [92:59:12<77:38:51, 17.19s/it]
 57%|█████▋    | 21700/37963 [92:59:26<73:43:51, 16.32s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '5.333', 'learning_rate': '8.178e-06', 'epoch': '0.5716'}

 57%|█████▋    | 21700/37963 [92:59:26<73:43:51, 16.32s/it]
 57%|█████▋    | 21701/37963 [92:59:40<70:37:29, 15.63s/it]
 57%|█████▋    | 21702/37963 [92:59:54<68:48:52, 15.23s/it]
 57%|█████▋    | 21703/37963 [93:00:08<67:29:54, 14.94s/it]
 57%|█████▋    | 21704/37963 [93:00:23<66:19:54, 14.69s/it]
 57%|█████▋    | 21705/37963 [93:00:37<65:27:02, 14.49s/it]
 57%|█████▋    | 21706/37963 [93:00:51<64:52:24, 14.37s/it]
 57%|█████▋    | 21707/37963 [93:01:05<64:19:07, 14.24s/it]
 57%|█████▋    | 21708/37963 [93:01:25<72:58:31, 16.16s/it]
 57%|█████▋    | 21709/37963 [93:01:40<70:26:50, 15.60s/it]
 57%|█████▋    | 21710/37963 [93:02:00<77:38:33, 17.20s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '1.373', 'learning_rate': '8.169e-06', 'epoch': '0.5719'}

 57%|█████▋    | 21710/37963 [93:02:00<77:38:33, 17.20s/it]
 57%|█████▋    | 21711/37963 [93:02:15<73:45:39, 16.34s/it]
 57%|█████▋    | 21712/37963 [93:02:29<70:56:12, 15.71s/it]
 57%|█████▋    | 21713/37963 [93:02:43<68:26:33, 15.16s/it]
 57%|█████▋    | 21714/37963 [93:02:57<66:50:58, 14.81s/it]
 57%|█████▋    | 21715/37963 [93:03:11<66:10:20, 14.66s/it]
 57%|█████▋    | 21716/37963 [93:03:32<74:19:34, 16.47s/it]
 57%|█████▋    | 21717/37963 [93:03:46<70:57:41, 15.72s/it]
 57%|█████▋    | 21718/37963 [93:04:07<78:29:25, 17.39s/it]
 57%|█████▋    | 21719/37963 [93:04:22<74:23:19, 16.49s/it]
 57%|█████▋    | 21720/37963 [93:04:35<70:34:45, 15.64s/it]
                                                           
{'loss': '0.1302', 'grad_norm': '1.666', 'learning_rate': '8.161e-06', 'epoch': '0.5721'}

 57%|█████▋    | 21720/37963 [93:04:35<70:34:45, 15.64s/it]
 57%|█████▋    | 21721/37963 [93:04:49<68:17:20, 15.14s/it]
 57%|█████▋    | 21722/37963 [93:05:04<67:15:05, 14.91s/it]
 57%|█████▋    | 21723/37963 [93:05:18<66:19:14, 14.70s/it]
 57%|█████▋    | 21724/37963 [93:05:32<66:04:41, 14.65s/it]
 57%|█████▋    | 21725/37963 [93:05:53<73:39:02, 16.33s/it]
 57%|█████▋    | 21726/37963 [93:06:06<70:15:50, 15.58s/it]
 57%|█████▋    | 21727/37963 [93:06:20<68:09:13, 15.11s/it]
 57%|█████▋    | 21728/37963 [93:06:34<66:10:26, 14.67s/it]
 57%|█████▋    | 21729/37963 [93:06:48<65:46:02, 14.58s/it]
 57%|█████▋    | 21730/37963 [93:07:03<65:06:46, 14.44s/it]
                                                           
{'loss': '0.1206', 'grad_norm': '2.02', 'learning_rate': '8.153e-06', 'epoch': '0.5724'}

 57%|█████▋    | 21730/37963 [93:07:03<65:06:46, 14.44s/it]
 57%|█████▋    | 21731/37963 [93:07:23<73:49:25, 16.37s/it]
 57%|█████▋    | 21732/37963 [93:07:38<71:24:36, 15.84s/it]
 57%|█████▋    | 21733/37963 [93:07:52<69:25:00, 15.40s/it]
 57%|█████▋    | 21734/37963 [93:08:06<66:49:28, 14.82s/it]
 57%|█████▋    | 21735/37963 [93:08:20<66:14:13, 14.69s/it]
 57%|█████▋    | 21736/37963 [93:08:34<65:31:44, 14.54s/it]
 57%|█████▋    | 21737/37963 [93:08:49<65:06:46, 14.45s/it]
 57%|█████▋    | 21738/37963 [93:09:03<64:58:29, 14.42s/it]
 57%|█████▋    | 21739/37963 [93:09:17<64:54:40, 14.40s/it]
 57%|█████▋    | 21740/37963 [93:09:32<64:57:18, 14.41s/it]
                                                           
{'loss': '0.1409', 'grad_norm': '1.612', 'learning_rate': '8.144e-06', 'epoch': '0.5727'}

 57%|█████▋    | 21740/37963 [93:09:32<64:57:18, 14.41s/it]
 57%|█████▋    | 21741/37963 [93:09:46<64:25:56, 14.30s/it]
 57%|█████▋    | 21742/37963 [93:10:00<64:07:58, 14.23s/it]
 57%|█████▋    | 21743/37963 [93:10:14<64:27:09, 14.31s/it]
 57%|█████▋    | 21744/37963 [93:10:29<64:32:34, 14.33s/it]
 57%|█████▋    | 21745/37963 [93:10:43<64:19:02, 14.28s/it]
 57%|█████▋    | 21746/37963 [93:11:04<72:55:57, 16.19s/it]
 57%|█████▋    | 21747/37963 [93:11:18<70:32:00, 15.66s/it]
 57%|█████▋    | 21748/37963 [93:11:32<68:44:01, 15.26s/it]
 57%|█████▋    | 21749/37963 [93:11:47<67:35:37, 15.01s/it]
 57%|█████▋    | 21750/37963 [93:12:08<75:37:11, 16.79s/it]
                                                           
{'loss': '0.1415', 'grad_norm': '1.579', 'learning_rate': '8.136e-06', 'epoch': '0.5729'}

 57%|█████▋    | 21750/37963 [93:12:08<75:37:11, 16.79s/it]
 57%|█████▋    | 21751/37963 [93:12:21<71:19:06, 15.84s/it]
 57%|█████▋    | 21752/37963 [93:12:36<69:18:16, 15.39s/it]
 57%|█████▋    | 21753/37963 [93:12:50<67:54:46, 15.08s/it]
 57%|█████▋    | 21754/37963 [93:13:04<66:56:25, 14.87s/it]
 57%|█████▋    | 21755/37963 [93:13:19<66:11:01, 14.70s/it]
 57%|█████▋    | 21756/37963 [93:13:33<65:40:13, 14.59s/it]
 57%|█████▋    | 21757/37963 [93:13:54<74:04:14, 16.45s/it]
 57%|█████▋    | 21758/37963 [93:14:15<80:37:36, 17.91s/it]
 57%|█████▋    | 21759/37963 [93:14:30<75:54:32, 16.86s/it]
 57%|█████▋    | 21760/37963 [93:14:44<72:28:54, 16.10s/it]
                                                           
{'loss': '0.1327', 'grad_norm': '1.391', 'learning_rate': '8.127e-06', 'epoch': '0.5732'}

 57%|█████▋    | 21760/37963 [93:14:44<72:28:54, 16.10s/it]
 57%|█████▋    | 21761/37963 [93:14:58<70:06:54, 15.58s/it]
 57%|█████▋    | 21762/37963 [93:15:13<68:23:44, 15.20s/it]
 57%|█████▋    | 21763/37963 [93:15:27<66:42:19, 14.82s/it]
 57%|█████▋    | 21764/37963 [93:15:40<65:28:40, 14.55s/it]
 57%|█████▋    | 21765/37963 [93:16:08<83:03:13, 18.46s/it]
 57%|█████▋    | 21766/37963 [93:16:23<77:44:10, 17.28s/it]
 57%|█████▋    | 21767/37963 [93:16:37<73:42:33, 16.38s/it]
 57%|█████▋    | 21768/37963 [93:16:51<71:05:56, 15.80s/it]
 57%|█████▋    | 21769/37963 [93:17:06<69:08:49, 15.37s/it]
 57%|█████▋    | 21770/37963 [93:17:20<67:45:30, 15.06s/it]
                                                           
{'loss': '0.133', 'grad_norm': '2.294', 'learning_rate': '8.119e-06', 'epoch': '0.5735'}

 57%|█████▋    | 21770/37963 [93:17:20<67:45:30, 15.06s/it]
 57%|█████▋    | 21771/37963 [93:17:34<66:50:00, 14.86s/it]
 57%|█████▋    | 21772/37963 [93:17:49<65:51:00, 14.64s/it]
 57%|█████▋    | 21773/37963 [93:18:03<65:16:36, 14.51s/it]
 57%|█████▋    | 21774/37963 [93:18:17<65:00:31, 14.46s/it]
 57%|█████▋    | 21775/37963 [93:18:31<64:54:19, 14.43s/it]
 57%|█████▋    | 21776/37963 [93:18:52<73:26:43, 16.33s/it]
 57%|█████▋    | 21777/37963 [93:19:07<70:55:59, 15.78s/it]
 57%|█████▋    | 21778/37963 [93:19:21<68:41:52, 15.28s/it]
 57%|█████▋    | 21779/37963 [93:19:42<76:18:45, 16.98s/it]
 57%|█████▋    | 21780/37963 [93:19:56<73:14:55, 16.29s/it]
                                                           
{'loss': '0.14', 'grad_norm': '1.576', 'learning_rate': '8.111e-06', 'epoch': '0.5737'}

 57%|█████▋    | 21780/37963 [93:19:56<73:14:55, 16.29s/it]
 57%|█████▋    | 21781/37963 [93:20:11<70:41:21, 15.73s/it]
 57%|█████▋    | 21782/37963 [93:20:25<68:54:40, 15.33s/it]
 57%|█████▋    | 21783/37963 [93:20:40<67:27:00, 15.01s/it]
 57%|█████▋    | 21784/37963 [93:20:54<66:32:18, 14.81s/it]
 57%|█████▋    | 21785/37963 [93:21:08<65:27:41, 14.57s/it]
 57%|█████▋    | 21786/37963 [93:21:22<65:11:15, 14.51s/it]
 57%|█████▋    | 21787/37963 [93:21:37<65:06:45, 14.49s/it]
 57%|█████▋    | 21788/37963 [93:21:51<64:58:37, 14.46s/it]
 57%|█████▋    | 21789/37963 [93:22:05<64:53:02, 14.44s/it]
 57%|█████▋    | 21790/37963 [93:22:20<64:45:55, 14.42s/it]
                                                           
{'loss': '0.1428', 'grad_norm': '2.264', 'learning_rate': '8.102e-06', 'epoch': '0.574'}

 57%|█████▋    | 21790/37963 [93:22:20<64:45:55, 14.42s/it]
 57%|█████▋    | 21791/37963 [93:22:34<64:37:16, 14.39s/it]
 57%|█████▋    | 21792/37963 [93:22:49<64:45:11, 14.42s/it]
 57%|█████▋    | 21793/37963 [93:23:09<73:17:11, 16.32s/it]
 57%|█████▋    | 21794/37963 [93:23:24<70:21:34, 15.67s/it]
 57%|█████▋    | 21795/37963 [93:23:38<68:33:44, 15.27s/it]
 57%|█████▋    | 21796/37963 [93:23:52<67:17:33, 14.98s/it]
 57%|█████▋    | 21797/37963 [93:24:07<66:30:21, 14.81s/it]
 57%|█████▋    | 21798/37963 [93:24:27<74:21:40, 16.56s/it]
 57%|█████▋    | 21799/37963 [93:24:42<71:23:05, 15.90s/it]
 57%|█████▋    | 21800/37963 [93:24:56<69:22:07, 15.45s/it]
                                                           
{'loss': '0.144', 'grad_norm': '2.038', 'learning_rate': '8.094e-06', 'epoch': '0.5742'}

 57%|█████▋    | 21800/37963 [93:24:56<69:22:07, 15.45s/it]
 57%|█████▋    | 21801/37963 [93:25:10<67:04:52, 14.94s/it]
 57%|█████▋    | 21802/37963 [93:25:24<66:13:35, 14.75s/it]
 57%|█████▋    | 21803/37963 [93:25:38<64:57:58, 14.47s/it]
 57%|█████▋    | 21804/37963 [93:25:52<64:45:47, 14.43s/it]
 57%|█████▋    | 21805/37963 [93:26:07<64:50:04, 14.45s/it]
 57%|█████▋    | 21806/37963 [93:26:21<64:46:49, 14.43s/it]
 57%|█████▋    | 21807/37963 [93:26:41<72:49:16, 16.23s/it]
 57%|█████▋    | 21808/37963 [93:27:03<79:54:29, 17.81s/it]
 57%|█████▋    | 21809/37963 [93:27:17<74:58:34, 16.71s/it]
 57%|█████▋    | 21810/37963 [93:27:32<71:52:29, 16.02s/it]
                                                           
{'loss': '0.1328', 'grad_norm': '3.123', 'learning_rate': '8.086e-06', 'epoch': '0.5745'}

 57%|█████▋    | 21810/37963 [93:27:32<71:52:29, 16.02s/it]
 57%|█████▋    | 21811/37963 [93:27:46<69:33:33, 15.50s/it]
 57%|█████▋    | 21812/37963 [93:28:00<68:00:06, 15.16s/it]
 57%|█████▋    | 21813/37963 [93:28:27<83:58:59, 18.72s/it]
 57%|█████▋    | 21814/37963 [93:28:42<78:16:40, 17.45s/it]
 57%|█████▋    | 21815/37963 [93:28:56<73:59:03, 16.49s/it]
 57%|█████▋    | 21816/37963 [93:29:10<70:19:51, 15.68s/it]
 57%|█████▋    | 21817/37963 [93:29:24<68:33:08, 15.28s/it]
 57%|█████▋    | 21818/37963 [93:29:38<66:59:03, 14.94s/it]
 57%|█████▋    | 21819/37963 [93:29:53<66:13:38, 14.77s/it]
 57%|█████▋    | 21820/37963 [93:30:07<65:37:59, 14.64s/it]
                                                           
{'loss': '0.1282', 'grad_norm': '2.104', 'learning_rate': '8.077e-06', 'epoch': '0.5748'}

 57%|█████▋    | 21820/37963 [93:30:07<65:37:59, 14.64s/it]
 57%|█████▋    | 21821/37963 [93:30:27<73:06:37, 16.31s/it]
 57%|█████▋    | 21822/37963 [93:30:42<70:32:53, 15.73s/it]
 57%|█████▋    | 21823/37963 [93:30:56<68:48:44, 15.35s/it]
 57%|█████▋    | 21824/37963 [93:31:10<67:12:18, 14.99s/it]
 57%|█████▋    | 21825/37963 [93:31:24<66:15:00, 14.78s/it]
 57%|█████▋    | 21826/37963 [93:31:39<65:42:15, 14.66s/it]
 57%|█████▋    | 21827/37963 [93:32:00<74:17:05, 16.57s/it]
 57%|█████▋    | 21828/37963 [93:32:14<70:39:06, 15.76s/it]
 58%|█████▊    | 21829/37963 [93:32:28<68:46:52, 15.35s/it]
 58%|█████▊    | 21830/37963 [93:32:43<67:35:54, 15.08s/it]
                                                           
{'loss': '0.1411', 'grad_norm': '3.072', 'learning_rate': '8.069e-06', 'epoch': '0.575'}

 58%|█████▊    | 21830/37963 [93:32:43<67:35:54, 15.08s/it]
 58%|█████▊    | 21831/37963 [93:32:57<66:25:27, 14.82s/it]
 58%|█████▊    | 21832/37963 [93:33:11<65:41:26, 14.66s/it]
 58%|█████▊    | 21833/37963 [93:33:25<65:20:09, 14.58s/it]
 58%|█████▊    | 21834/37963 [93:33:40<65:07:31, 14.54s/it]
 58%|█████▊    | 21835/37963 [93:33:54<64:10:04, 14.32s/it]
 58%|█████▊    | 21836/37963 [93:34:08<64:10:45, 14.33s/it]
 58%|█████▊    | 21837/37963 [93:34:22<64:15:48, 14.35s/it]
 58%|█████▊    | 21838/37963 [93:34:37<64:43:12, 14.45s/it]
 58%|█████▊    | 21839/37963 [93:34:51<63:38:56, 14.21s/it]
 58%|█████▊    | 21840/37963 [93:35:05<64:00:51, 14.29s/it]
                                                           
{'loss': '0.1267', 'grad_norm': '2.726', 'learning_rate': '8.06e-06', 'epoch': '0.5753'}

 58%|█████▊    | 21840/37963 [93:35:05<64:00:51, 14.29s/it]
 58%|█████▊    | 21841/37963 [93:35:20<64:10:32, 14.33s/it]
 58%|█████▊    | 21842/37963 [93:35:40<72:40:24, 16.23s/it]
 58%|█████▊    | 21843/37963 [93:35:55<70:09:52, 15.67s/it]
 58%|█████▊    | 21844/37963 [93:36:09<68:23:55, 15.28s/it]
 58%|█████▊    | 21845/37963 [93:36:23<67:10:43, 15.00s/it]
 58%|█████▊    | 21846/37963 [93:36:38<66:11:07, 14.78s/it]
 58%|█████▊    | 21847/37963 [93:36:52<65:30:57, 14.63s/it]
 58%|█████▊    | 21848/37963 [93:37:13<73:55:14, 16.51s/it]
 58%|█████▊    | 21849/37963 [93:37:27<71:00:31, 15.86s/it]
 58%|█████▊    | 21850/37963 [93:37:41<68:49:22, 15.38s/it]
                                                           
{'loss': '0.1303', 'grad_norm': '1.365', 'learning_rate': '8.052e-06', 'epoch': '0.5756'}

 58%|█████▊    | 21850/37963 [93:37:42<68:49:22, 15.38s/it]
 58%|█████▊    | 21851/37963 [93:37:56<67:32:19, 15.09s/it]
 58%|█████▊    | 21852/37963 [93:38:10<66:36:59, 14.89s/it]
 58%|█████▊    | 21853/37963 [93:38:25<65:57:16, 14.74s/it]
 58%|█████▊    | 21854/37963 [93:38:39<65:34:10, 14.65s/it]
 58%|█████▊    | 21855/37963 [93:38:54<65:11:46, 14.57s/it]
 58%|█████▊    | 21856/37963 [93:39:15<73:47:00, 16.49s/it]
 58%|█████▊    | 21857/37963 [93:39:35<79:20:40, 17.74s/it]
 58%|█████▊    | 21858/37963 [93:39:50<74:58:35, 16.76s/it]
 58%|█████▊    | 21859/37963 [93:40:04<71:51:14, 16.06s/it]
 58%|█████▊    | 21860/37963 [93:40:18<69:37:40, 15.57s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '1.573', 'learning_rate': '8.044e-06', 'epoch': '0.5758'}

 58%|█████▊    | 21860/37963 [93:40:18<69:37:40, 15.57s/it]
 58%|█████▊    | 21861/37963 [93:40:33<68:00:36, 15.21s/it]
 58%|█████▊    | 21862/37963 [93:40:54<75:36:42, 16.91s/it]
 58%|█████▊    | 21863/37963 [93:41:08<72:09:09, 16.13s/it]
 58%|█████▊    | 21864/37963 [93:41:22<69:49:52, 15.62s/it]
 58%|█████▊    | 21865/37963 [93:41:37<68:15:25, 15.26s/it]
 58%|█████▊    | 21866/37963 [93:41:51<66:52:57, 14.96s/it]
 58%|█████▊    | 21867/37963 [93:42:06<66:03:32, 14.77s/it]
 58%|█████▊    | 21868/37963 [93:42:20<65:27:10, 14.64s/it]
 58%|█████▊    | 21869/37963 [93:42:34<65:02:20, 14.55s/it]
 58%|█████▊    | 21870/37963 [93:42:49<64:47:33, 14.49s/it]
                                                           
{'loss': '0.1266', 'grad_norm': '2.097', 'learning_rate': '8.035e-06', 'epoch': '0.5761'}

 58%|█████▊    | 21870/37963 [93:42:49<64:47:33, 14.49s/it]
 58%|█████▊    | 21871/37963 [93:43:10<73:33:13, 16.45s/it]
 58%|█████▊    | 21872/37963 [93:43:24<70:49:52, 15.85s/it]
 58%|█████▊    | 21873/37963 [93:43:38<68:53:59, 15.42s/it]
 58%|█████▊    | 21874/37963 [93:43:59<75:16:35, 16.84s/it]
 58%|█████▊    | 21875/37963 [93:44:13<72:09:48, 16.15s/it]
 58%|█████▊    | 21876/37963 [93:44:27<68:42:14, 15.37s/it]
 58%|█████▊    | 21877/37963 [93:44:41<67:25:03, 15.09s/it]
 58%|█████▊    | 21878/37963 [93:44:56<66:30:48, 14.89s/it]
 58%|█████▊    | 21879/37963 [93:45:10<65:46:59, 14.72s/it]
 58%|█████▊    | 21880/37963 [93:45:24<65:16:42, 14.61s/it]
                                                           
{'loss': '0.1276', 'grad_norm': '2.226', 'learning_rate': '8.027e-06', 'epoch': '0.5764'}

 58%|█████▊    | 21880/37963 [93:45:24<65:16:42, 14.61s/it]
 58%|█████▊    | 21881/37963 [93:45:39<64:57:14, 14.54s/it]
 58%|█████▊    | 21882/37963 [93:45:53<64:35:10, 14.46s/it]
 58%|█████▊    | 21883/37963 [93:46:07<64:07:55, 14.36s/it]
 58%|█████▊    | 21884/37963 [93:46:21<64:17:18, 14.39s/it]
 58%|█████▊    | 21885/37963 [93:46:36<64:12:03, 14.38s/it]
 58%|█████▊    | 21886/37963 [93:46:50<64:06:51, 14.36s/it]
 58%|█████▊    | 21887/37963 [93:47:04<63:19:57, 14.18s/it]
 58%|█████▊    | 21888/37963 [93:47:18<63:31:57, 14.23s/it]
 58%|█████▊    | 21889/37963 [93:47:33<63:39:01, 14.26s/it]
 58%|█████▊    | 21890/37963 [93:47:47<63:49:43, 14.30s/it]
                                                           
{'loss': '0.1464', 'grad_norm': '2.656', 'learning_rate': '8.019e-06', 'epoch': '0.5766'}

 58%|█████▊    | 21890/37963 [93:47:47<63:49:43, 14.30s/it]
 58%|█████▊    | 21891/37963 [93:48:08<72:27:20, 16.23s/it]
 58%|█████▊    | 21892/37963 [93:48:22<69:58:08, 15.67s/it]
 58%|█████▊    | 21893/37963 [93:48:36<68:11:40, 15.28s/it]
 58%|█████▊    | 21894/37963 [93:48:51<66:52:04, 14.98s/it]
 58%|█████▊    | 21895/37963 [93:49:05<66:01:08, 14.79s/it]
 58%|█████▊    | 21896/37963 [93:49:19<65:31:21, 14.68s/it]
 58%|█████▊    | 21897/37963 [93:49:34<65:19:38, 14.64s/it]
 58%|█████▊    | 21898/37963 [93:49:55<73:45:30, 16.53s/it]
 58%|█████▊    | 21899/37963 [93:50:09<70:53:47, 15.89s/it]
 58%|█████▊    | 21900/37963 [93:50:24<68:45:26, 15.41s/it]
                                                           
{'loss': '0.1302', 'grad_norm': '1.37', 'learning_rate': '8.01e-06', 'epoch': '0.5769'}

 58%|█████▊    | 21900/37963 [93:50:24<68:45:26, 15.41s/it]
 58%|█████▊    | 21901/37963 [93:50:38<67:17:37, 15.08s/it]
 58%|█████▊    | 21902/37963 [93:50:52<66:16:21, 14.85s/it]
 58%|█████▊    | 21903/37963 [93:51:07<65:41:46, 14.73s/it]
 58%|█████▊    | 21904/37963 [93:51:21<65:27:28, 14.67s/it]
 58%|█████▊    | 21905/37963 [93:51:42<73:51:06, 16.56s/it]
 58%|█████▊    | 21906/37963 [93:51:57<70:52:48, 15.89s/it]
 58%|█████▊    | 21907/37963 [93:52:17<77:19:11, 17.34s/it]
 58%|█████▊    | 21908/37963 [93:52:31<73:12:24, 16.42s/it]
 58%|█████▊    | 21909/37963 [93:52:46<70:06:04, 15.72s/it]
 58%|█████▊    | 21910/37963 [93:53:06<76:47:55, 17.22s/it]
                                                           
{'loss': '0.1345', 'grad_norm': '2.919', 'learning_rate': '8.002e-06', 'epoch': '0.5771'}

 58%|█████▊    | 21910/37963 [93:53:06<76:47:55, 17.22s/it]
 58%|█████▊    | 21911/37963 [93:53:27<82:04:26, 18.41s/it]
 58%|█████▊    | 21912/37963 [93:53:42<76:47:43, 17.22s/it]
 58%|█████▊    | 21913/37963 [93:53:56<73:01:10, 16.38s/it]
 58%|█████▊    | 21914/37963 [93:54:11<70:22:26, 15.79s/it]
 58%|█████▊    | 21915/37963 [93:54:25<68:25:47, 15.35s/it]
 58%|█████▊    | 21916/37963 [93:54:39<67:03:49, 15.05s/it]
 58%|█████▊    | 21917/37963 [93:54:54<66:05:13, 14.83s/it]
 58%|█████▊    | 21918/37963 [93:55:08<64:55:47, 14.57s/it]
 58%|█████▊    | 21919/37963 [93:55:28<72:54:33, 16.36s/it]
 58%|█████▊    | 21920/37963 [93:55:43<70:19:41, 15.78s/it]
                                                           
{'loss': '0.1343', 'grad_norm': '2.417', 'learning_rate': '7.993e-06', 'epoch': '0.5774'}

 58%|█████▊    | 21920/37963 [93:55:43<70:19:41, 15.78s/it]
 58%|█████▊    | 21921/37963 [93:55:57<68:27:43, 15.36s/it]
 58%|█████▊    | 21922/37963 [93:56:12<67:25:33, 15.13s/it]
 58%|█████▊    | 21923/37963 [93:56:33<75:15:20, 16.89s/it]
 58%|█████▊    | 21924/37963 [93:56:47<72:00:47, 16.16s/it]
 58%|█████▊    | 21925/37963 [93:57:01<69:36:40, 15.63s/it]
 58%|█████▊    | 21926/37963 [93:57:16<67:30:25, 15.15s/it]
 58%|█████▊    | 21927/37963 [93:57:30<66:32:42, 14.94s/it]
 58%|█████▊    | 21928/37963 [93:57:44<65:40:33, 14.74s/it]
 58%|█████▊    | 21929/37963 [93:57:58<64:49:21, 14.55s/it]
 58%|█████▊    | 21930/37963 [93:58:12<63:50:25, 14.33s/it]
                                                           
{'loss': '0.1198', 'grad_norm': '2.23', 'learning_rate': '7.985e-06', 'epoch': '0.5777'}

 58%|█████▊    | 21930/37963 [93:58:12<63:50:25, 14.33s/it]
 58%|█████▊    | 21931/37963 [93:58:26<63:09:14, 14.18s/it]
 58%|█████▊    | 21932/37963 [93:58:40<62:18:10, 13.99s/it]
 58%|█████▊    | 21933/37963 [93:58:54<62:59:37, 14.15s/it]
 58%|█████▊    | 21934/37963 [93:59:09<63:25:12, 14.24s/it]
 58%|█████▊    | 21935/37963 [93:59:23<63:36:11, 14.29s/it]
 58%|█████▊    | 21936/37963 [93:59:37<63:40:35, 14.30s/it]
 58%|█████▊    | 21937/37963 [93:59:51<63:29:10, 14.26s/it]
 58%|█████▊    | 21938/37963 [94:00:06<63:35:37, 14.29s/it]
 58%|█████▊    | 21939/37963 [94:00:20<63:38:21, 14.30s/it]
 58%|█████▊    | 21940/37963 [94:00:40<71:34:17, 16.08s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '1.156', 'learning_rate': '7.977e-06', 'epoch': '0.5779'}

 58%|█████▊    | 21940/37963 [94:00:40<71:34:17, 16.08s/it]
 58%|█████▊    | 21941/37963 [94:00:55<69:31:16, 15.62s/it]
 58%|█████▊    | 21942/37963 [94:01:09<67:24:19, 15.15s/it]
 58%|█████▊    | 21943/37963 [94:01:23<66:20:04, 14.91s/it]
 58%|█████▊    | 21944/37963 [94:01:38<65:37:46, 14.75s/it]
 58%|█████▊    | 21945/37963 [94:01:58<73:24:48, 16.50s/it]
 58%|█████▊    | 21946/37963 [94:02:13<70:29:46, 15.84s/it]
 58%|█████▊    | 21947/37963 [94:02:27<68:16:14, 15.35s/it]
 58%|█████▊    | 21948/37963 [94:02:41<66:56:07, 15.05s/it]
 58%|█████▊    | 21949/37963 [94:02:55<66:02:42, 14.85s/it]
 58%|█████▊    | 21950/37963 [94:03:09<64:46:32, 14.56s/it]
                                                           
{'loss': '0.123', 'grad_norm': '1.508', 'learning_rate': '7.968e-06', 'epoch': '0.5782'}

 58%|█████▊    | 21950/37963 [94:03:09<64:46:32, 14.56s/it]
 58%|█████▊    | 21951/37963 [94:03:24<64:38:50, 14.53s/it]
 58%|█████▊    | 21952/37963 [94:03:45<73:18:22, 16.48s/it]
 58%|█████▊    | 21953/37963 [94:03:59<70:22:18, 15.82s/it]
 58%|█████▊    | 21954/37963 [94:04:13<68:08:44, 15.32s/it]
 58%|█████▊    | 21955/37963 [94:04:28<66:45:38, 15.01s/it]
 58%|█████▊    | 21956/37963 [94:04:49<74:46:43, 16.82s/it]
 58%|█████▊    | 21957/37963 [94:05:03<71:24:24, 16.06s/it]
 58%|█████▊    | 21958/37963 [94:05:24<77:56:36, 17.53s/it]
 58%|█████▊    | 21959/37963 [94:05:38<73:43:30, 16.58s/it]
 58%|█████▊    | 21960/37963 [94:05:52<70:15:20, 15.80s/it]
                                                           
{'loss': '0.1306', 'grad_norm': '4.258', 'learning_rate': '7.96e-06', 'epoch': '0.5785'}

 58%|█████▊    | 21960/37963 [94:05:52<70:15:20, 15.80s/it]
 58%|█████▊    | 21961/37963 [94:06:14<77:39:24, 17.47s/it]
 58%|█████▊    | 21962/37963 [94:06:28<73:27:36, 16.53s/it]
 58%|█████▊    | 21963/37963 [94:06:42<70:39:48, 15.90s/it]
 58%|█████▊    | 21964/37963 [94:06:57<68:36:59, 15.44s/it]
 58%|█████▊    | 21965/37963 [94:07:11<67:05:18, 15.10s/it]
 58%|█████▊    | 21966/37963 [94:07:25<65:54:31, 14.83s/it]
 58%|█████▊    | 21967/37963 [94:07:39<63:56:38, 14.39s/it]
 58%|█████▊    | 21968/37963 [94:07:53<63:47:33, 14.36s/it]
 58%|█████▊    | 21969/37963 [94:08:14<72:37:15, 16.35s/it]
 58%|█████▊    | 21970/37963 [94:08:28<70:07:56, 15.79s/it]
                                                           
{'loss': '0.1448', 'grad_norm': '1.555', 'learning_rate': '7.952e-06', 'epoch': '0.5787'}

 58%|█████▊    | 21970/37963 [94:08:28<70:07:56, 15.79s/it]
 58%|█████▊    | 21971/37963 [94:08:43<68:12:19, 15.35s/it]
 58%|█████▊    | 21972/37963 [94:09:04<75:42:15, 17.04s/it]
 58%|█████▊    | 21973/37963 [94:09:18<72:01:42, 16.22s/it]
 58%|█████▊    | 21974/37963 [94:09:32<69:29:06, 15.64s/it]
 58%|█████▊    | 21975/37963 [94:09:47<67:43:02, 15.25s/it]
 58%|█████▊    | 21976/37963 [94:10:01<66:31:44, 14.98s/it]
 58%|█████▊    | 21977/37963 [94:10:15<65:37:07, 14.78s/it]
 58%|█████▊    | 21978/37963 [94:10:29<64:39:08, 14.56s/it]
 58%|█████▊    | 21979/37963 [94:10:44<64:23:49, 14.50s/it]
 58%|█████▊    | 21980/37963 [94:10:58<64:01:02, 14.42s/it]
                                                           
{'loss': '0.1316', 'grad_norm': '2.64', 'learning_rate': '7.943e-06', 'epoch': '0.579'}

 58%|█████▊    | 21980/37963 [94:10:58<64:01:02, 14.42s/it]
 58%|█████▊    | 21981/37963 [94:11:12<63:21:09, 14.27s/it]
 58%|█████▊    | 21982/37963 [94:11:26<63:29:41, 14.30s/it]
 58%|█████▊    | 21983/37963 [94:11:40<63:12:45, 14.24s/it]
 58%|█████▊    | 21984/37963 [94:11:54<62:26:24, 14.07s/it]
 58%|█████▊    | 21985/37963 [94:12:08<62:22:45, 14.05s/it]
 58%|█████▊    | 21986/37963 [94:12:22<62:38:25, 14.11s/it]
 58%|█████▊    | 21987/37963 [94:12:37<62:52:15, 14.17s/it]
 58%|█████▊    | 21988/37963 [94:12:57<71:42:55, 16.16s/it]
 58%|█████▊    | 21989/37963 [94:13:12<69:16:19, 15.61s/it]
 58%|█████▊    | 21990/37963 [94:13:26<67:39:55, 15.25s/it]
                                                           
{'loss': '0.1334', 'grad_norm': '2.724', 'learning_rate': '7.935e-06', 'epoch': '0.5793'}

 58%|█████▊    | 21990/37963 [94:13:26<67:39:55, 15.25s/it]
 58%|█████▊    | 21991/37963 [94:13:41<66:32:44, 15.00s/it]
 58%|█████▊    | 21992/37963 [94:13:55<65:43:28, 14.81s/it]
 58%|█████▊    | 21993/37963 [94:14:09<65:13:16, 14.70s/it]
 58%|█████▊    | 21994/37963 [94:14:30<73:19:40, 16.53s/it]
 58%|█████▊    | 21995/37963 [94:14:45<70:27:36, 15.89s/it]
 58%|█████▊    | 21996/37963 [94:14:59<68:25:28, 15.43s/it]
 58%|█████▊    | 21997/37963 [94:15:13<66:54:33, 15.09s/it]
 58%|█████▊    | 21998/37963 [94:15:28<65:58:05, 14.88s/it]
 58%|█████▊    | 21999/37963 [94:15:42<65:11:51, 14.70s/it]
 58%|█████▊    | 22000/37963 [94:16:03<73:41:23, 16.62s/it]
                                                           
{'loss': '0.1322', 'grad_norm': '1.666', 'learning_rate': '7.927e-06', 'epoch': '0.5795'}

 58%|█████▊    | 22000/37963 [94:16:03<73:41:23, 16.62s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.57s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.58s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 58%|█████▊    | 22001/37963 [94:17:49<193:17:07, 43.59s/it]
 58%|█████▊    | 22002/37963 [94:18:04<154:13:16, 34.78s/it]
 58%|█████▊    | 22003/37963 [94:18:18<126:59:25, 28.64s/it]
 58%|█████▊    | 22004/37963 [94:18:39<116:54:18, 26.37s/it]
 58%|█████▊    | 22005/37963 [94:18:53<100:21:46, 22.64s/it]
 58%|█████▊    | 22006/37963 [94:19:07<89:16:05, 20.14s/it] 
 58%|█████▊    | 22007/37963 [94:19:29<90:39:43, 20.46s/it]
 58%|█████▊    | 22008/37963 [94:19:43<82:42:45, 18.66s/it]
 58%|█████▊    | 22009/37963 [94:20:04<85:42:46, 19.34s/it]
 58%|█████▊    | 22010/37963 [94:20:18<79:06:51, 17.85s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '2.427', 'learning_rate': '7.918e-06', 'epoch': '0.5798'}

 58%|█████▊    | 22010/37963 [94:20:18<79:06:51, 17.85s/it]
 58%|█████▊    | 22011/37963 [94:20:33<74:28:25, 16.81s/it]
 58%|█████▊    | 22012/37963 [94:20:47<70:56:09, 16.01s/it]
 58%|█████▊    | 22013/37963 [94:21:01<68:30:48, 15.46s/it]
 58%|█████▊    | 22014/37963 [94:21:16<67:13:21, 15.17s/it]
 58%|█████▊    | 22015/37963 [94:21:30<66:02:36, 14.91s/it]
 58%|█████▊    | 22016/37963 [94:21:44<65:14:53, 14.73s/it]
 58%|█████▊    | 22017/37963 [94:21:58<64:44:06, 14.61s/it]
 58%|█████▊    | 22018/37963 [94:22:13<64:25:23, 14.55s/it]
 58%|█████▊    | 22019/37963 [94:22:34<72:47:41, 16.44s/it]
 58%|█████▊    | 22020/37963 [94:22:54<78:09:31, 17.65s/it]
                                                           
{'loss': '0.1348', 'grad_norm': '2.268', 'learning_rate': '7.91e-06', 'epoch': '0.58'}

 58%|█████▊    | 22020/37963 [94:22:54<78:09:31, 17.65s/it]
 58%|█████▊    | 22021/37963 [94:23:08<73:44:43, 16.65s/it]
 58%|█████▊    | 22022/37963 [94:23:23<70:37:25, 15.95s/it]
 58%|█████▊    | 22023/37963 [94:23:37<68:39:32, 15.51s/it]
 58%|█████▊    | 22024/37963 [94:23:52<67:14:52, 15.19s/it]
 58%|█████▊    | 22025/37963 [94:24:06<65:56:57, 14.90s/it]
 58%|█████▊    | 22026/37963 [94:24:20<65:03:32, 14.70s/it]
 58%|█████▊    | 22027/37963 [94:24:34<64:34:29, 14.59s/it]
 58%|█████▊    | 22028/37963 [94:24:49<64:22:59, 14.55s/it]
 58%|█████▊    | 22029/37963 [94:25:04<64:31:22, 14.58s/it]
 58%|█████▊    | 22030/37963 [94:25:18<64:10:50, 14.50s/it]
                                                           
{'loss': '0.1257', 'grad_norm': '1.602', 'learning_rate': '7.902e-06', 'epoch': '0.5803'}

 58%|█████▊    | 22030/37963 [94:25:18<64:10:50, 14.50s/it]
 58%|█████▊    | 22031/37963 [94:25:32<64:01:11, 14.47s/it]
 58%|█████▊    | 22032/37963 [94:25:47<63:50:49, 14.43s/it]
 58%|█████▊    | 22033/37963 [94:26:01<63:42:24, 14.40s/it]
 58%|█████▊    | 22034/37963 [94:26:15<63:38:25, 14.38s/it]
 58%|█████▊    | 22035/37963 [94:26:29<63:09:59, 14.28s/it]
 58%|█████▊    | 22036/37963 [94:26:50<71:51:06, 16.24s/it]
 58%|█████▊    | 22037/37963 [94:27:04<69:04:25, 15.61s/it]
 58%|█████▊    | 22038/37963 [94:27:18<66:44:18, 15.09s/it]
 58%|█████▊    | 22039/37963 [94:27:32<65:16:26, 14.76s/it]
 58%|█████▊    | 22040/37963 [94:27:47<64:47:19, 14.65s/it]
                                                           
{'loss': '0.1333', 'grad_norm': '1.298', 'learning_rate': '7.893e-06', 'epoch': '0.5806'}

 58%|█████▊    | 22040/37963 [94:27:47<64:47:19, 14.65s/it]
 58%|█████▊    | 22041/37963 [94:28:01<64:26:32, 14.57s/it]
 58%|█████▊    | 22042/37963 [94:28:15<64:03:36, 14.49s/it]
 58%|█████▊    | 22043/37963 [94:28:37<73:23:45, 16.60s/it]
 58%|█████▊    | 22044/37963 [94:28:51<70:18:55, 15.90s/it]
 58%|█████▊    | 22045/37963 [94:29:05<68:13:47, 15.43s/it]
 58%|█████▊    | 22046/37963 [94:29:20<66:56:35, 15.14s/it]
 58%|█████▊    | 22047/37963 [94:29:34<65:50:32, 14.89s/it]
 58%|█████▊    | 22048/37963 [94:29:48<64:41:37, 14.63s/it]
 58%|█████▊    | 22049/37963 [94:30:08<71:59:24, 16.29s/it]
 58%|█████▊    | 22050/37963 [94:30:22<68:56:15, 15.60s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '2.445', 'learning_rate': '7.885e-06', 'epoch': '0.5808'}

 58%|█████▊    | 22050/37963 [94:30:22<68:56:15, 15.60s/it]
 58%|█████▊    | 22051/37963 [94:30:36<66:17:47, 15.00s/it]
 58%|█████▊    | 22052/37963 [94:30:57<73:45:06, 16.69s/it]
 58%|█████▊    | 22053/37963 [94:31:11<70:34:27, 15.97s/it]
 58%|█████▊    | 22054/37963 [94:31:25<68:24:50, 15.48s/it]
 58%|█████▊    | 22055/37963 [94:31:39<66:52:19, 15.13s/it]
 58%|█████▊    | 22056/37963 [94:32:00<73:48:00, 16.70s/it]
 58%|█████▊    | 22057/37963 [94:32:14<70:46:04, 16.02s/it]
 58%|█████▊    | 22058/37963 [94:32:35<77:32:02, 17.55s/it]
 58%|█████▊    | 22059/37963 [94:32:50<73:23:32, 16.61s/it]
 58%|█████▊    | 22060/37963 [94:33:04<70:20:17, 15.92s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '2.069', 'learning_rate': '7.877e-06', 'epoch': '0.5811'}

 58%|█████▊    | 22060/37963 [94:33:04<70:20:17, 15.92s/it]
 58%|█████▊    | 22061/37963 [94:33:18<68:04:03, 15.41s/it]
 58%|█████▊    | 22062/37963 [94:33:33<66:35:08, 15.08s/it]
 58%|█████▊    | 22063/37963 [94:33:47<65:37:47, 14.86s/it]
 58%|█████▊    | 22064/37963 [94:34:01<64:52:26, 14.69s/it]
 58%|█████▊    | 22065/37963 [94:34:16<64:19:38, 14.57s/it]
 58%|█████▊    | 22066/37963 [94:34:29<63:03:50, 14.28s/it]
 58%|█████▊    | 22067/37963 [94:34:50<72:10:57, 16.35s/it]
 58%|█████▊    | 22068/37963 [94:35:04<68:52:03, 15.60s/it]
 58%|█████▊    | 22069/37963 [94:35:18<66:56:27, 15.16s/it]
 58%|█████▊    | 22070/37963 [94:35:40<74:53:31, 16.96s/it]
                                                           
{'loss': '0.139', 'grad_norm': '1.918', 'learning_rate': '7.868e-06', 'epoch': '0.5814'}

 58%|█████▊    | 22070/37963 [94:35:40<74:53:31, 16.96s/it]
 58%|█████▊    | 22071/37963 [94:35:54<70:56:47, 16.07s/it]
 58%|█████▊    | 22072/37963 [94:36:08<68:47:30, 15.58s/it]
 58%|█████▊    | 22073/37963 [94:36:22<66:43:55, 15.12s/it]
 58%|█████▊    | 22074/37963 [94:36:36<65:02:28, 14.74s/it]
 58%|█████▊    | 22075/37963 [94:36:50<64:46:01, 14.68s/it]
 58%|█████▊    | 22076/37963 [94:37:05<64:22:21, 14.59s/it]
 58%|█████▊    | 22077/37963 [94:37:19<64:00:59, 14.51s/it]
 58%|█████▊    | 22078/37963 [94:37:33<63:53:12, 14.48s/it]
 58%|█████▊    | 22079/37963 [94:37:48<63:44:07, 14.45s/it]
 58%|█████▊    | 22080/37963 [94:38:02<63:36:01, 14.42s/it]
                                                           
{'loss': '0.1287', 'grad_norm': '0.9674', 'learning_rate': '7.86e-06', 'epoch': '0.5816'}

 58%|█████▊    | 22080/37963 [94:38:02<63:36:01, 14.42s/it]
 58%|█████▊    | 22081/37963 [94:38:17<63:30:34, 14.40s/it]
 58%|█████▊    | 22082/37963 [94:38:31<63:12:40, 14.33s/it]
 58%|█████▊    | 22083/37963 [94:38:52<72:01:42, 16.33s/it]
 58%|█████▊    | 22084/37963 [94:39:06<69:20:38, 15.72s/it]
 58%|█████▊    | 22085/37963 [94:39:20<67:02:15, 15.20s/it]
 58%|█████▊    | 22086/37963 [94:39:34<65:55:42, 14.95s/it]
 58%|█████▊    | 22087/37963 [94:39:49<65:10:58, 14.78s/it]
 58%|█████▊    | 22088/37963 [94:40:03<64:16:34, 14.58s/it]
 58%|█████▊    | 22089/37963 [94:40:17<63:07:37, 14.32s/it]
 58%|█████▊    | 22090/37963 [94:40:38<72:55:54, 16.54s/it]
                                                           
{'loss': '0.1351', 'grad_norm': '1.179', 'learning_rate': '7.852e-06', 'epoch': '0.5819'}

 58%|█████▊    | 22090/37963 [94:40:38<72:55:54, 16.54s/it]
 58%|█████▊    | 22091/37963 [94:40:52<69:49:26, 15.84s/it]
 58%|█████▊    | 22092/37963 [94:41:07<67:46:22, 15.37s/it]
 58%|█████▊    | 22093/37963 [94:41:21<66:12:37, 15.02s/it]
 58%|█████▊    | 22094/37963 [94:41:35<65:18:10, 14.81s/it]
 58%|█████▊    | 22095/37963 [94:41:50<64:29:58, 14.63s/it]
 58%|█████▊    | 22096/37963 [94:42:04<64:04:08, 14.54s/it]
 58%|█████▊    | 22097/37963 [94:42:18<63:25:50, 14.39s/it]
 58%|█████▊    | 22098/37963 [94:42:39<71:59:47, 16.34s/it]
 58%|█████▊    | 22099/37963 [94:42:59<76:45:19, 17.42s/it]
 58%|█████▊    | 22100/37963 [94:43:13<72:32:06, 16.46s/it]
                                                           
{'loss': '0.135', 'grad_norm': '3.096', 'learning_rate': '7.843e-06', 'epoch': '0.5821'}

 58%|█████▊    | 22100/37963 [94:43:13<72:32:06, 16.46s/it]
 58%|█████▊    | 22101/37963 [94:43:27<69:49:00, 15.85s/it]
 58%|█████▊    | 22102/37963 [94:43:42<67:50:06, 15.40s/it]
 58%|█████▊    | 22103/37963 [94:43:56<66:33:55, 15.11s/it]
 58%|█████▊    | 22104/37963 [94:44:11<65:35:34, 14.89s/it]
 58%|█████▊    | 22105/37963 [94:44:31<72:55:48, 16.56s/it]
 58%|█████▊    | 22106/37963 [94:44:45<70:10:01, 15.93s/it]
 58%|█████▊    | 22107/37963 [94:45:06<76:07:10, 17.28s/it]
 58%|█████▊    | 22108/37963 [94:45:20<72:12:45, 16.40s/it]
 58%|█████▊    | 22109/37963 [94:45:34<69:15:56, 15.73s/it]
 58%|█████▊    | 22110/37963 [94:45:48<66:40:55, 15.14s/it]
                                                           
{'loss': '0.1294', 'grad_norm': '1.003', 'learning_rate': '7.835e-06', 'epoch': '0.5824'}

 58%|█████▊    | 22110/37963 [94:45:48<66:40:55, 15.14s/it]
 58%|█████▊    | 22111/37963 [94:46:02<65:13:08, 14.81s/it]
 58%|█████▊    | 22112/37963 [94:46:17<64:39:28, 14.68s/it]
 58%|█████▊    | 22113/37963 [94:46:30<63:19:39, 14.38s/it]
 58%|█████▊    | 22114/37963 [94:46:45<63:11:08, 14.35s/it]
 58%|█████▊    | 22115/37963 [94:46:59<63:07:50, 14.34s/it]
 58%|█████▊    | 22116/37963 [94:47:20<71:41:58, 16.29s/it]
 58%|█████▊    | 22117/37963 [94:47:34<69:06:54, 15.70s/it]
 58%|█████▊    | 22118/37963 [94:47:48<67:19:46, 15.30s/it]
 58%|█████▊    | 22119/37963 [94:48:10<75:51:28, 17.24s/it]
 58%|█████▊    | 22120/37963 [94:48:25<72:17:47, 16.43s/it]
                                                           
{'loss': '0.1421', 'grad_norm': '1.799', 'learning_rate': '7.827e-06', 'epoch': '0.5827'}

 58%|█████▊    | 22120/37963 [94:48:25<72:17:47, 16.43s/it]
 58%|█████▊    | 22121/37963 [94:48:39<69:38:11, 15.82s/it]
 58%|█████▊    | 22122/37963 [94:48:53<67:30:31, 15.34s/it]
 58%|█████▊    | 22123/37963 [94:49:08<66:17:02, 15.06s/it]
 58%|█████▊    | 22124/37963 [94:49:22<65:17:26, 14.84s/it]
 58%|█████▊    | 22125/37963 [94:49:36<64:34:08, 14.68s/it]
 58%|█████▊    | 22126/37963 [94:49:51<64:06:14, 14.57s/it]
 58%|█████▊    | 22127/37963 [94:50:05<63:48:35, 14.51s/it]
 58%|█████▊    | 22128/37963 [94:50:19<62:55:47, 14.31s/it]
 58%|█████▊    | 22129/37963 [94:50:33<62:25:23, 14.19s/it]
 58%|█████▊    | 22130/37963 [94:50:47<62:41:03, 14.25s/it]
                                                           
{'loss': '0.1332', 'grad_norm': '1.385', 'learning_rate': '7.818e-06', 'epoch': '0.5829'}

 58%|█████▊    | 22130/37963 [94:50:47<62:41:03, 14.25s/it]
 58%|█████▊    | 22131/37963 [94:51:02<62:48:38, 14.28s/it]
 58%|█████▊    | 22132/37963 [94:51:22<71:04:28, 16.16s/it]
 58%|█████▊    | 22133/37963 [94:51:36<67:57:51, 15.46s/it]
 58%|█████▊    | 22134/37963 [94:51:50<66:36:00, 15.15s/it]
 58%|█████▊    | 22135/37963 [94:52:04<64:55:10, 14.77s/it]
 58%|█████▊    | 22136/37963 [94:52:19<64:21:24, 14.64s/it]
 58%|█████▊    | 22137/37963 [94:52:33<63:58:53, 14.55s/it]
 58%|█████▊    | 22138/37963 [94:52:54<72:08:39, 16.41s/it]
 58%|█████▊    | 22139/37963 [94:53:08<69:25:04, 15.79s/it]
 58%|█████▊    | 22140/37963 [94:53:22<67:28:37, 15.35s/it]
                                                           
{'loss': '0.1326', 'grad_norm': '2.893', 'learning_rate': '7.81e-06', 'epoch': '0.5832'}

 58%|█████▊    | 22140/37963 [94:53:22<67:28:37, 15.35s/it]
 58%|█████▊    | 22141/37963 [94:53:37<66:06:49, 15.04s/it]
 58%|█████▊    | 22142/37963 [94:53:51<65:11:55, 14.84s/it]
 58%|█████▊    | 22143/37963 [94:54:05<64:28:58, 14.67s/it]
 58%|█████▊    | 22144/37963 [94:54:20<63:57:41, 14.56s/it]
 58%|█████▊    | 22145/37963 [94:54:34<63:45:25, 14.51s/it]
 58%|█████▊    | 22146/37963 [94:54:48<62:42:23, 14.27s/it]
 58%|█████▊    | 22147/37963 [94:55:01<62:01:19, 14.12s/it]
 58%|█████▊    | 22148/37963 [94:55:29<79:30:43, 18.10s/it]
 58%|█████▊    | 22149/37963 [94:55:43<74:41:35, 17.00s/it]
 58%|█████▊    | 22150/37963 [94:55:58<71:15:02, 16.22s/it]
                                                           
{'loss': '0.1414', 'grad_norm': '3.055', 'learning_rate': '7.802e-06', 'epoch': '0.5835'}

 58%|█████▊    | 22150/37963 [94:55:58<71:15:02, 16.22s/it]
 58%|█████▊    | 22151/37963 [94:56:12<68:47:48, 15.66s/it]
 58%|█████▊    | 22152/37963 [94:56:26<67:00:56, 15.26s/it]
 58%|█████▊    | 22153/37963 [94:56:41<65:46:07, 14.98s/it]
 58%|█████▊    | 22154/37963 [94:57:01<73:08:57, 16.66s/it]
 58%|█████▊    | 22155/37963 [94:57:22<78:50:31, 17.95s/it]
 58%|█████▊    | 22156/37963 [94:57:37<74:10:39, 16.89s/it]
 58%|█████▊    | 22157/37963 [94:57:51<70:44:51, 16.11s/it]
 58%|█████▊    | 22158/37963 [94:58:05<68:25:39, 15.59s/it]
 58%|█████▊    | 22159/37963 [94:58:20<66:45:13, 15.21s/it]
 58%|█████▊    | 22160/37963 [94:58:34<65:40:02, 14.96s/it]
                                                           
{'loss': '0.1243', 'grad_norm': '2.728', 'learning_rate': '7.793e-06', 'epoch': '0.5837'}

 58%|█████▊    | 22160/37963 [94:58:34<65:40:02, 14.96s/it]
 58%|█████▊    | 22161/37963 [94:58:48<64:34:06, 14.71s/it]
 58%|█████▊    | 22162/37963 [94:59:03<64:11:30, 14.63s/it]
 58%|█████▊    | 22163/37963 [94:59:17<63:49:27, 14.54s/it]
 58%|█████▊    | 22164/37963 [94:59:31<63:20:46, 14.43s/it]
 58%|█████▊    | 22165/37963 [94:59:45<63:15:43, 14.42s/it]
 58%|█████▊    | 22166/37963 [95:00:06<71:43:32, 16.35s/it]
 58%|█████▊    | 22167/37963 [95:00:20<68:53:50, 15.70s/it]
 58%|█████▊    | 22168/37963 [95:00:42<76:07:01, 17.35s/it]
 58%|█████▊    | 22169/37963 [95:00:56<72:10:45, 16.45s/it]
 58%|█████▊    | 22170/37963 [95:01:10<69:25:00, 15.82s/it]
                                                           
{'loss': '0.1325', 'grad_norm': '2.065', 'learning_rate': '7.785e-06', 'epoch': '0.584'}

 58%|█████▊    | 22170/37963 [95:01:10<69:25:00, 15.82s/it]
 58%|█████▊    | 22171/37963 [95:01:25<67:24:27, 15.37s/it]
 58%|█████▊    | 22172/37963 [95:01:39<65:48:42, 15.00s/it]
 58%|█████▊    | 22173/37963 [95:01:53<64:24:26, 14.68s/it]
 58%|█████▊    | 22174/37963 [95:02:07<63:27:35, 14.47s/it]
 58%|█████▊    | 22175/37963 [95:02:21<63:19:13, 14.44s/it]
 58%|█████▊    | 22176/37963 [95:02:35<63:10:10, 14.40s/it]
 58%|█████▊    | 22177/37963 [95:02:50<63:16:40, 14.43s/it]
 58%|█████▊    | 22178/37963 [95:03:04<63:17:36, 14.44s/it]
 58%|█████▊    | 22179/37963 [95:03:19<63:09:45, 14.41s/it]
 58%|█████▊    | 22180/37963 [95:03:33<63:08:13, 14.40s/it]
                                                           
{'loss': '0.1229', 'grad_norm': '3.738', 'learning_rate': '7.777e-06', 'epoch': '0.5843'}

 58%|█████▊    | 22180/37963 [95:03:33<63:08:13, 14.40s/it]
 58%|█████▊    | 22181/37963 [95:03:47<63:02:25, 14.38s/it]
 58%|█████▊    | 22182/37963 [95:04:08<70:53:52, 16.17s/it]
 58%|█████▊    | 22183/37963 [95:04:22<68:30:13, 15.63s/it]
 58%|█████▊    | 22184/37963 [95:04:36<66:44:06, 15.23s/it]
 58%|█████▊    | 22185/37963 [95:04:51<65:38:36, 14.98s/it]
 58%|█████▊    | 22186/37963 [95:05:11<72:42:09, 16.59s/it]
 58%|█████▊    | 22187/37963 [95:05:26<69:44:30, 15.91s/it]
 58%|█████▊    | 22188/37963 [95:05:40<67:36:55, 15.43s/it]
 58%|█████▊    | 22189/37963 [95:05:54<66:11:55, 15.11s/it]
 58%|█████▊    | 22190/37963 [95:06:09<65:20:54, 14.92s/it]
                                                           
{'loss': '0.1353', 'grad_norm': '2.602', 'learning_rate': '7.768e-06', 'epoch': '0.5845'}

 58%|█████▊    | 22190/37963 [95:06:09<65:20:54, 14.92s/it]
 58%|█████▊    | 22191/37963 [95:06:23<64:15:38, 14.67s/it]
 58%|█████▊    | 22192/37963 [95:06:37<63:53:04, 14.58s/it]
 58%|█████▊    | 22193/37963 [95:06:51<63:24:58, 14.48s/it]
 58%|█████▊    | 22194/37963 [95:07:06<63:12:30, 14.43s/it]
 58%|█████▊    | 22195/37963 [95:07:26<71:29:07, 16.32s/it]
 58%|█████▊    | 22196/37963 [95:07:41<68:51:47, 15.72s/it]
 58%|█████▊    | 22197/37963 [95:07:55<67:02:47, 15.31s/it]
 58%|█████▊    | 22198/37963 [95:08:16<74:20:24, 16.98s/it]
 58%|█████▊    | 22199/37963 [95:08:30<70:18:18, 16.06s/it]
 58%|█████▊    | 22200/37963 [95:08:44<68:08:52, 15.56s/it]
                                                           
{'loss': '0.1255', 'grad_norm': '3.946', 'learning_rate': '7.76e-06', 'epoch': '0.5848'}

 58%|█████▊    | 22200/37963 [95:08:44<68:08:52, 15.56s/it]
 58%|█████▊    | 22201/37963 [95:08:59<66:53:54, 15.28s/it]
 58%|█████▊    | 22202/37963 [95:09:13<65:40:52, 15.00s/it]
 58%|█████▊    | 22203/37963 [95:09:34<73:20:12, 16.75s/it]
 58%|█████▊    | 22204/37963 [95:09:55<79:01:24, 18.05s/it]
 58%|█████▊    | 22205/37963 [95:10:09<73:10:29, 16.72s/it]
 58%|█████▊    | 22206/37963 [95:10:23<70:18:53, 16.06s/it]
 58%|█████▊    | 22207/37963 [95:10:38<68:02:19, 15.55s/it]
 58%|█████▊    | 22208/37963 [95:10:52<66:02:16, 15.09s/it]
 59%|█████▊    | 22209/37963 [95:11:06<65:02:50, 14.86s/it]
 59%|█████▊    | 22210/37963 [95:11:20<64:20:57, 14.71s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '4.102', 'learning_rate': '7.752e-06', 'epoch': '0.585'}

 59%|█████▊    | 22210/37963 [95:11:20<64:20:57, 14.71s/it]
 59%|█████▊    | 22211/37963 [95:11:34<63:34:34, 14.53s/it]
 59%|█████▊    | 22212/37963 [95:11:49<63:16:33, 14.46s/it]
 59%|█████▊    | 22213/37963 [95:12:03<62:32:30, 14.30s/it]
 59%|█████▊    | 22214/37963 [95:12:16<61:37:32, 14.09s/it]
 59%|█████▊    | 22215/37963 [95:12:37<70:11:20, 16.05s/it]
 59%|█████▊    | 22216/37963 [95:12:58<76:41:45, 17.53s/it]
 59%|█████▊    | 22217/37963 [95:13:12<72:28:16, 16.57s/it]
 59%|█████▊    | 22218/37963 [95:13:27<69:36:03, 15.91s/it]
 59%|█████▊    | 22219/37963 [95:13:41<67:37:12, 15.46s/it]
 59%|█████▊    | 22220/37963 [95:13:55<66:10:17, 15.13s/it]
                                                           
{'loss': '0.1293', 'grad_norm': '2.464', 'learning_rate': '7.743e-06', 'epoch': '0.5853'}

 59%|█████▊    | 22220/37963 [95:13:55<66:10:17, 15.13s/it]
 59%|█████▊    | 22221/37963 [95:14:10<65:08:38, 14.90s/it]
 59%|█████▊    | 22222/37963 [95:14:24<64:24:22, 14.73s/it]
 59%|█████▊    | 22223/37963 [95:14:38<63:44:49, 14.58s/it]
 59%|█████▊    | 22224/37963 [95:14:53<63:23:34, 14.50s/it]
 59%|█████▊    | 22225/37963 [95:15:07<63:12:48, 14.46s/it]
 59%|█████▊    | 22226/37963 [95:15:21<62:55:34, 14.40s/it]
 59%|█████▊    | 22227/37963 [95:15:36<63:06:39, 14.44s/it]
 59%|█████▊    | 22228/37963 [95:15:50<62:50:17, 14.38s/it]
 59%|█████▊    | 22229/37963 [95:16:04<62:27:58, 14.29s/it]
 59%|█████▊    | 22230/37963 [95:16:24<70:13:55, 16.07s/it]
                                                           
{'loss': '0.1292', 'grad_norm': '3.207', 'learning_rate': '7.735e-06', 'epoch': '0.5856'}

 59%|█████▊    | 22230/37963 [95:16:24<70:13:55, 16.07s/it]
 59%|█████▊    | 22231/37963 [95:16:39<68:22:52, 15.65s/it]
 59%|█████▊    | 22232/37963 [95:16:53<66:40:22, 15.26s/it]
 59%|█████▊    | 22233/37963 [95:17:14<74:00:14, 16.94s/it]
 59%|█████▊    | 22234/37963 [95:17:29<70:50:15, 16.21s/it]
 59%|█████▊    | 22235/37963 [95:17:43<68:22:58, 15.65s/it]
 59%|█████▊    | 22236/37963 [95:17:57<66:06:19, 15.13s/it]
 59%|█████▊    | 22237/37963 [95:18:11<65:01:13, 14.88s/it]
 59%|█████▊    | 22238/37963 [95:18:26<64:13:27, 14.70s/it]
 59%|█████▊    | 22239/37963 [95:18:40<63:47:40, 14.61s/it]
 59%|█████▊    | 22240/37963 [95:18:54<63:33:40, 14.55s/it]
                                                           
{'loss': '0.1227', 'grad_norm': '1.682', 'learning_rate': '7.727e-06', 'epoch': '0.5858'}

 59%|█████▊    | 22240/37963 [95:18:54<63:33:40, 14.55s/it]
 59%|█████▊    | 22241/37963 [95:19:08<62:47:13, 14.38s/it]
 59%|█████▊    | 22242/37963 [95:19:22<62:28:39, 14.31s/it]
 59%|█████▊    | 22243/37963 [95:19:43<70:25:40, 16.13s/it]
 59%|█████▊    | 22244/37963 [95:19:57<68:01:11, 15.58s/it]
 59%|█████▊    | 22245/37963 [95:20:12<66:29:33, 15.23s/it]
 59%|█████▊    | 22246/37963 [95:20:26<65:27:02, 14.99s/it]
 59%|█████▊    | 22247/37963 [95:20:46<72:38:20, 16.64s/it]
 59%|█████▊    | 22248/37963 [95:21:01<69:33:52, 15.94s/it]
 59%|█████▊    | 22249/37963 [95:21:15<67:30:50, 15.47s/it]
 59%|█████▊    | 22250/37963 [95:21:29<65:59:47, 15.12s/it]
                                                           
{'loss': '0.1239', 'grad_norm': '3.496', 'learning_rate': '7.719e-06', 'epoch': '0.5861'}

 59%|█████▊    | 22250/37963 [95:21:29<65:59:47, 15.12s/it]
 59%|█████▊    | 22251/37963 [95:21:51<73:52:22, 16.93s/it]
 59%|█████▊    | 22252/37963 [95:22:12<79:22:45, 18.19s/it]
 59%|█████▊    | 22253/37963 [95:22:26<74:24:07, 17.05s/it]
 59%|█████▊    | 22254/37963 [95:22:40<70:38:18, 16.19s/it]
 59%|█████▊    | 22255/37963 [95:22:55<68:23:59, 15.68s/it]
 59%|█████▊    | 22256/37963 [95:23:09<66:14:53, 15.18s/it]
 59%|█████▊    | 22257/37963 [95:23:23<64:55:22, 14.88s/it]
 59%|█████▊    | 22258/37963 [95:23:37<63:27:13, 14.55s/it]
 59%|█████▊    | 22259/37963 [95:23:51<62:45:12, 14.39s/it]
 59%|█████▊    | 22260/37963 [95:24:05<62:29:42, 14.33s/it]
                                                           
{'loss': '0.1297', 'grad_norm': '2.444', 'learning_rate': '7.71e-06', 'epoch': '0.5864'}

 59%|█████▊    | 22260/37963 [95:24:05<62:29:42, 14.33s/it]
 59%|█████▊    | 22261/37963 [95:24:19<62:38:28, 14.36s/it]
 59%|█████▊    | 22262/37963 [95:24:33<62:04:43, 14.23s/it]
 59%|█████▊    | 22263/37963 [95:24:54<70:00:34, 16.05s/it]
 59%|█████▊    | 22264/37963 [95:25:07<66:57:39, 15.36s/it]
 59%|█████▊    | 22265/37963 [95:25:29<75:21:15, 17.28s/it]
 59%|█████▊    | 22266/37963 [95:25:43<70:46:26, 16.23s/it]
 59%|█████▊    | 22267/37963 [95:25:57<68:14:22, 15.65s/it]
 59%|█████▊    | 22268/37963 [95:26:11<65:48:18, 15.09s/it]
 59%|█████▊    | 22269/37963 [95:26:25<63:57:39, 14.67s/it]
 59%|█████▊    | 22270/37963 [95:26:39<63:28:26, 14.56s/it]
                                                           
{'loss': '0.1266', 'grad_norm': '1.125', 'learning_rate': '7.702e-06', 'epoch': '0.5866'}

 59%|█████▊    | 22270/37963 [95:26:39<63:28:26, 14.56s/it]
 59%|█████▊    | 22271/37963 [95:26:53<63:08:35, 14.49s/it]
 59%|█████▊    | 22272/37963 [95:27:08<62:48:07, 14.41s/it]
 59%|█████▊    | 22273/37963 [95:27:21<62:14:35, 14.28s/it]
 59%|█████▊    | 22274/37963 [95:27:36<62:35:54, 14.36s/it]
 59%|█████▊    | 22275/37963 [95:27:50<62:40:45, 14.38s/it]
 59%|█████▊    | 22276/37963 [95:28:11<71:11:35, 16.34s/it]
 59%|█████▊    | 22277/37963 [95:28:26<68:35:21, 15.74s/it]
 59%|█████▊    | 22278/37963 [95:28:40<67:00:34, 15.38s/it]
 59%|█████▊    | 22279/37963 [95:28:54<65:18:21, 14.99s/it]
 59%|█████▊    | 22280/37963 [95:29:09<64:17:12, 14.76s/it]
                                                           
{'loss': '0.1354', 'grad_norm': '2.223', 'learning_rate': '7.694e-06', 'epoch': '0.5869'}

 59%|█████▊    | 22280/37963 [95:29:09<64:17:12, 14.76s/it]
 59%|█████▊    | 22281/37963 [95:29:23<63:42:21, 14.62s/it]
 59%|█████▊    | 22282/37963 [95:29:37<63:29:24, 14.58s/it]
 59%|█████▊    | 22283/37963 [95:29:51<62:50:00, 14.43s/it]
 59%|█████▊    | 22284/37963 [95:30:12<71:03:41, 16.32s/it]
 59%|█████▊    | 22285/37963 [95:30:26<68:26:38, 15.72s/it]
 59%|█████▊    | 22286/37963 [95:30:41<66:22:36, 15.24s/it]
 59%|█████▊    | 22287/37963 [95:30:54<64:28:48, 14.81s/it]
 59%|█████▊    | 22288/37963 [95:31:09<64:10:17, 14.74s/it]
 59%|█████▊    | 22289/37963 [95:31:30<72:29:29, 16.65s/it]
 59%|█████▊    | 22290/37963 [95:31:44<69:32:04, 15.97s/it]
                                                           
{'loss': '0.126', 'grad_norm': '1.139', 'learning_rate': '7.685e-06', 'epoch': '0.5872'}

 59%|█████▊    | 22290/37963 [95:31:44<69:32:04, 15.97s/it]
 59%|█████▊    | 22291/37963 [95:31:59<67:11:36, 15.43s/it]
 59%|█████▊    | 22292/37963 [95:32:13<65:24:17, 15.03s/it]
 59%|█████▊    | 22293/37963 [95:32:27<64:28:46, 14.81s/it]
 59%|█████▊    | 22294/37963 [95:32:47<71:42:07, 16.47s/it]
 59%|█████▊    | 22295/37963 [95:33:02<68:39:18, 15.77s/it]
 59%|█████▊    | 22296/37963 [95:33:16<66:23:16, 15.25s/it]
 59%|█████▊    | 22297/37963 [95:33:30<65:17:44, 15.00s/it]
 59%|█████▊    | 22298/37963 [95:33:44<63:49:51, 14.67s/it]
 59%|█████▊    | 22299/37963 [95:33:58<63:35:32, 14.62s/it]
 59%|█████▊    | 22300/37963 [95:34:19<70:53:13, 16.29s/it]
                                                           
{'loss': '0.129', 'grad_norm': '2.702', 'learning_rate': '7.677e-06', 'epoch': '0.5874'}

 59%|█████▊    | 22300/37963 [95:34:19<70:53:13, 16.29s/it]
 59%|█████▊    | 22301/37963 [95:34:33<68:24:33, 15.72s/it]
 59%|█████▊    | 22302/37963 [95:34:54<75:05:27, 17.26s/it]
 59%|█████▊    | 22303/37963 [95:35:08<71:03:21, 16.33s/it]
 59%|█████▉    | 22304/37963 [95:35:23<68:44:00, 15.80s/it]
 59%|█████▉    | 22305/37963 [95:35:37<66:32:57, 15.30s/it]
 59%|█████▉    | 22306/37963 [95:35:51<65:21:17, 15.03s/it]
 59%|█████▉    | 22307/37963 [95:36:05<64:16:22, 14.78s/it]
 59%|█████▉    | 22308/37963 [95:36:20<63:42:14, 14.65s/it]
 59%|█████▉    | 22309/37963 [95:36:34<63:31:33, 14.61s/it]
 59%|█████▉    | 22310/37963 [95:36:48<62:20:05, 14.34s/it]
                                                           
{'loss': '0.1224', 'grad_norm': '2.609', 'learning_rate': '7.669e-06', 'epoch': '0.5877'}

 59%|█████▉    | 22310/37963 [95:36:48<62:20:05, 14.34s/it]
 59%|█████▉    | 22311/37963 [95:37:02<62:06:08, 14.28s/it]
 59%|█████▉    | 22312/37963 [95:37:30<79:24:27, 18.27s/it]
 59%|█████▉    | 22313/37963 [95:37:44<74:26:00, 17.12s/it]
 59%|█████▉    | 22314/37963 [95:37:59<71:04:47, 16.35s/it]
 59%|█████▉    | 22315/37963 [95:38:13<68:32:40, 15.77s/it]
 59%|█████▉    | 22316/37963 [95:38:27<66:40:35, 15.34s/it]
 59%|█████▉    | 22317/37963 [95:38:42<65:24:06, 15.05s/it]
 59%|█████▉    | 22318/37963 [95:38:56<64:17:09, 14.79s/it]
 59%|█████▉    | 22319/37963 [95:39:10<63:02:27, 14.51s/it]
 59%|█████▉    | 22320/37963 [95:39:24<62:53:07, 14.47s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '1.429', 'learning_rate': '7.66e-06', 'epoch': '0.5879'}

 59%|█████▉    | 22320/37963 [95:39:24<62:53:07, 14.47s/it]
 59%|█████▉    | 22321/37963 [95:39:39<63:03:31, 14.51s/it]
 59%|█████▉    | 22322/37963 [95:39:53<63:07:42, 14.53s/it]
 59%|█████▉    | 22323/37963 [95:40:07<62:05:53, 14.29s/it]
 59%|█████▉    | 22324/37963 [95:40:21<62:14:09, 14.33s/it]
 59%|█████▉    | 22325/37963 [95:40:42<69:48:43, 16.07s/it]
 59%|█████▉    | 22326/37963 [95:40:56<67:30:10, 15.54s/it]
 59%|█████▉    | 22327/37963 [95:41:10<65:57:37, 15.19s/it]
 59%|█████▉    | 22328/37963 [95:41:24<64:45:07, 14.91s/it]
 59%|█████▉    | 22329/37963 [95:41:39<64:01:26, 14.74s/it]
 59%|█████▉    | 22330/37963 [95:41:53<63:36:37, 14.65s/it]
                                                           
{'loss': '0.1296', 'grad_norm': '1.05', 'learning_rate': '7.652e-06', 'epoch': '0.5882'}

 59%|█████▉    | 22330/37963 [95:41:53<63:36:37, 14.65s/it]
 59%|█████▉    | 22331/37963 [95:42:08<63:26:29, 14.61s/it]
 59%|█████▉    | 22332/37963 [95:42:22<63:03:50, 14.52s/it]
 59%|█████▉    | 22333/37963 [95:42:43<71:28:33, 16.46s/it]
 59%|█████▉    | 22334/37963 [95:42:57<68:45:04, 15.84s/it]
 59%|█████▉    | 22335/37963 [95:43:12<66:52:40, 15.41s/it]
 59%|█████▉    | 22336/37963 [95:43:26<65:26:23, 15.08s/it]
 59%|█████▉    | 22337/37963 [95:43:47<73:12:10, 16.86s/it]
 59%|█████▉    | 22338/37963 [95:44:01<69:25:18, 15.99s/it]
 59%|█████▉    | 22339/37963 [95:44:15<67:03:32, 15.45s/it]
 59%|█████▉    | 22340/37963 [95:44:29<64:53:33, 14.95s/it]
                                                           
{'loss': '0.117', 'grad_norm': '0.9849', 'learning_rate': '7.644e-06', 'epoch': '0.5885'}

 59%|█████▉    | 22340/37963 [95:44:29<64:53:33, 14.95s/it]
 59%|█████▉    | 22341/37963 [95:44:43<63:39:22, 14.67s/it]
 59%|█████▉    | 22342/37963 [95:44:57<63:03:54, 14.53s/it]
 59%|█████▉    | 22343/37963 [95:45:19<71:37:28, 16.51s/it]
 59%|█████▉    | 22344/37963 [95:45:33<68:47:21, 15.86s/it]
 59%|█████▉    | 22345/37963 [95:45:47<66:54:06, 15.42s/it]
 59%|█████▉    | 22346/37963 [95:46:02<65:29:13, 15.10s/it]
 59%|█████▉    | 22347/37963 [95:46:16<64:31:44, 14.88s/it]
 59%|█████▉    | 22348/37963 [95:46:30<63:51:21, 14.72s/it]
 59%|█████▉    | 22349/37963 [95:46:51<71:37:40, 16.51s/it]
 59%|█████▉    | 22350/37963 [95:47:05<68:47:38, 15.86s/it]
                                                           
{'loss': '0.1266', 'grad_norm': '2.37', 'learning_rate': '7.636e-06', 'epoch': '0.5887'}

 59%|█████▉    | 22350/37963 [95:47:05<68:47:38, 15.86s/it]
 59%|█████▉    | 22351/37963 [95:47:26<75:27:56, 17.40s/it]
 59%|█████▉    | 22352/37963 [95:47:41<71:23:49, 16.46s/it]
 59%|█████▉    | 22353/37963 [95:47:55<68:33:00, 15.81s/it]
 59%|█████▉    | 22354/37963 [95:48:09<66:35:28, 15.36s/it]
 59%|█████▉    | 22355/37963 [95:48:23<64:49:14, 14.95s/it]
 59%|█████▉    | 22356/37963 [95:48:37<63:56:55, 14.75s/it]
 59%|█████▉    | 22357/37963 [95:48:52<63:27:23, 14.64s/it]
 59%|█████▉    | 22358/37963 [95:49:06<62:38:24, 14.45s/it]
 59%|█████▉    | 22359/37963 [95:49:20<62:28:38, 14.41s/it]
 59%|█████▉    | 22360/37963 [95:49:35<62:19:56, 14.38s/it]
                                                           
{'loss': '0.1325', 'grad_norm': '2.155', 'learning_rate': '7.627e-06', 'epoch': '0.589'}

 59%|█████▉    | 22360/37963 [95:49:35<62:19:56, 14.38s/it]
 59%|█████▉    | 22361/37963 [95:49:56<71:01:16, 16.39s/it]
 59%|█████▉    | 22362/37963 [95:50:16<76:53:11, 17.74s/it]
 59%|█████▉    | 22363/37963 [95:50:31<72:26:28, 16.72s/it]
 59%|█████▉    | 22364/37963 [95:50:45<69:29:14, 16.04s/it]
 59%|█████▉    | 22365/37963 [95:51:00<67:21:54, 15.55s/it]
 59%|█████▉    | 22366/37963 [95:51:14<65:44:17, 15.17s/it]
 59%|█████▉    | 22367/37963 [95:51:28<64:15:43, 14.83s/it]
 59%|█████▉    | 22368/37963 [95:51:42<63:40:52, 14.70s/it]
 59%|█████▉    | 22369/37963 [95:51:57<63:16:35, 14.61s/it]
 59%|█████▉    | 22370/37963 [95:52:11<62:51:36, 14.51s/it]
                                                           
{'loss': '0.1242', 'grad_norm': '1.477', 'learning_rate': '7.619e-06', 'epoch': '0.5893'}

 59%|█████▉    | 22370/37963 [95:52:11<62:51:36, 14.51s/it]
 59%|█████▉    | 22371/37963 [95:52:25<62:34:59, 14.45s/it]
 59%|█████▉    | 22372/37963 [95:52:40<62:21:21, 14.40s/it]
 59%|█████▉    | 22373/37963 [95:52:54<62:12:28, 14.36s/it]
 59%|█████▉    | 22374/37963 [95:53:08<62:10:53, 14.36s/it]
 59%|█████▉    | 22375/37963 [95:53:23<62:06:50, 14.35s/it]
 59%|█████▉    | 22376/37963 [95:53:43<70:02:04, 16.18s/it]
 59%|█████▉    | 22377/37963 [95:53:58<67:48:48, 15.66s/it]
 59%|█████▉    | 22378/37963 [95:54:12<66:06:14, 15.27s/it]
 59%|█████▉    | 22379/37963 [95:54:26<65:02:18, 15.02s/it]
 59%|█████▉    | 22380/37963 [95:54:41<64:03:16, 14.80s/it]
                                                           
{'loss': '0.1105', 'grad_norm': '1.289', 'learning_rate': '7.611e-06', 'epoch': '0.5895'}

 59%|█████▉    | 22380/37963 [95:54:41<64:03:16, 14.80s/it]
 59%|█████▉    | 22381/37963 [95:54:55<63:25:41, 14.65s/it]
 59%|█████▉    | 22382/37963 [95:55:09<62:27:58, 14.43s/it]
 59%|█████▉    | 22383/37963 [95:55:23<61:56:18, 14.31s/it]
 59%|█████▉    | 22384/37963 [95:55:44<70:26:43, 16.28s/it]
 59%|█████▉    | 22385/37963 [95:55:58<67:37:24, 15.63s/it]
 59%|█████▉    | 22386/37963 [95:56:19<74:44:46, 17.27s/it]
 59%|█████▉    | 22387/37963 [95:56:33<70:05:25, 16.20s/it]
 59%|█████▉    | 22388/37963 [95:56:47<67:31:22, 15.61s/it]
 59%|█████▉    | 22389/37963 [95:57:01<65:03:04, 15.04s/it]
 59%|█████▉    | 22390/37963 [95:57:15<64:04:07, 14.81s/it]
                                                           
{'loss': '0.1214', 'grad_norm': '1.674', 'learning_rate': '7.602e-06', 'epoch': '0.5898'}

 59%|█████▉    | 22390/37963 [95:57:15<64:04:07, 14.81s/it]
 59%|█████▉    | 22391/37963 [95:57:29<63:31:24, 14.69s/it]
 59%|█████▉    | 22392/37963 [95:57:50<71:19:16, 16.49s/it]
 59%|█████▉    | 22393/37963 [95:58:04<68:38:56, 15.87s/it]
 59%|█████▉    | 22394/37963 [95:58:19<66:47:24, 15.44s/it]
 59%|█████▉    | 22395/37963 [95:58:33<65:33:58, 15.16s/it]
 59%|█████▉    | 22396/37963 [95:58:48<64:32:51, 14.93s/it]
 59%|█████▉    | 22397/37963 [95:59:08<71:37:25, 16.56s/it]
 59%|█████▉    | 22398/37963 [95:59:22<67:51:49, 15.70s/it]
 59%|█████▉    | 22399/37963 [95:59:36<66:04:52, 15.28s/it]
 59%|█████▉    | 22400/37963 [95:59:57<73:41:51, 17.05s/it]
                                                           
{'loss': '0.118', 'grad_norm': '4.308', 'learning_rate': '7.594e-06', 'epoch': '0.5901'}

 59%|█████▉    | 22400/37963 [95:59:57<73:41:51, 17.05s/it]
 59%|█████▉    | 22401/37963 [96:00:12<70:24:13, 16.29s/it]
 59%|█████▉    | 22402/37963 [96:00:26<67:58:02, 15.72s/it]
 59%|█████▉    | 22403/37963 [96:00:41<66:29:01, 15.38s/it]
 59%|█████▉    | 22404/37963 [96:00:55<65:03:43, 15.05s/it]
 59%|█████▉    | 22405/37963 [96:01:09<64:14:23, 14.86s/it]
 59%|█████▉    | 22406/37963 [96:01:23<62:59:26, 14.58s/it]
 59%|█████▉    | 22407/37963 [96:01:38<62:49:46, 14.54s/it]
 59%|█████▉    | 22408/37963 [96:01:52<62:33:57, 14.48s/it]
 59%|█████▉    | 22409/37963 [96:02:07<62:22:53, 14.44s/it]
 59%|█████▉    | 22410/37963 [96:02:28<70:54:04, 16.41s/it]
                                                           
{'loss': '0.1293', 'grad_norm': '3.538', 'learning_rate': '7.586e-06', 'epoch': '0.5903'}

 59%|█████▉    | 22410/37963 [96:02:28<70:54:04, 16.41s/it]
 59%|█████▉    | 22411/37963 [96:02:48<76:28:40, 17.70s/it]
 59%|█████▉    | 22412/37963 [96:03:03<72:03:49, 16.68s/it]
 59%|█████▉    | 22413/37963 [96:03:17<69:05:03, 15.99s/it]
 59%|█████▉    | 22414/37963 [96:03:31<66:26:37, 15.38s/it]
 59%|█████▉    | 22415/37963 [96:03:45<65:07:25, 15.08s/it]
 59%|█████▉    | 22416/37963 [96:03:59<63:13:14, 14.64s/it]
 59%|█████▉    | 22417/37963 [96:04:13<62:45:38, 14.53s/it]
 59%|█████▉    | 22418/37963 [96:04:27<62:29:51, 14.47s/it]
 59%|█████▉    | 22419/37963 [96:04:42<62:19:14, 14.43s/it]
 59%|█████▉    | 22420/37963 [96:04:56<61:21:08, 14.21s/it]
                                                           
{'loss': '0.127', 'grad_norm': '3.41', 'learning_rate': '7.578e-06', 'epoch': '0.5906'}

 59%|█████▉    | 22420/37963 [96:04:56<61:21:08, 14.21s/it]
 59%|█████▉    | 22421/37963 [96:05:10<61:36:06, 14.27s/it]
 59%|█████▉    | 22422/37963 [96:05:24<61:52:17, 14.33s/it]
 59%|█████▉    | 22423/37963 [96:05:39<61:55:25, 14.35s/it]
 59%|█████▉    | 22424/37963 [96:05:59<69:12:22, 16.03s/it]
 59%|█████▉    | 22425/37963 [96:06:13<67:04:40, 15.54s/it]
 59%|█████▉    | 22426/37963 [96:06:27<65:07:11, 15.09s/it]
 59%|█████▉    | 22427/37963 [96:06:41<64:03:37, 14.84s/it]
 59%|█████▉    | 22428/37963 [96:06:56<63:20:30, 14.68s/it]
 59%|█████▉    | 22429/37963 [96:07:10<62:57:19, 14.59s/it]
 59%|█████▉    | 22430/37963 [96:07:24<62:20:51, 14.45s/it]
                                                           
{'loss': '0.1238', 'grad_norm': '4.944', 'learning_rate': '7.569e-06', 'epoch': '0.5908'}

 59%|█████▉    | 22430/37963 [96:07:24<62:20:51, 14.45s/it]
 59%|█████▉    | 22431/37963 [96:07:45<70:55:08, 16.44s/it]
 59%|█████▉    | 22432/37963 [96:08:00<68:08:33, 15.80s/it]
 59%|█████▉    | 22433/37963 [96:08:14<66:19:55, 15.38s/it]
 59%|█████▉    | 22434/37963 [96:08:35<73:56:08, 17.14s/it]
 59%|█████▉    | 22435/37963 [96:08:50<70:27:38, 16.34s/it]
 59%|█████▉    | 22436/37963 [96:09:04<68:01:23, 15.77s/it]
 59%|█████▉    | 22437/37963 [96:09:19<66:22:19, 15.39s/it]
 59%|█████▉    | 22438/37963 [96:09:33<65:09:12, 15.11s/it]
 59%|█████▉    | 22439/37963 [96:09:48<64:23:47, 14.93s/it]
 59%|█████▉    | 22440/37963 [96:10:08<71:48:44, 16.65s/it]
                                                           
{'loss': '0.142', 'grad_norm': '1.845', 'learning_rate': '7.561e-06', 'epoch': '0.5911'}

 59%|█████▉    | 22440/37963 [96:10:08<71:48:44, 16.65s/it]
 59%|█████▉    | 22441/37963 [96:10:23<68:49:08, 15.96s/it]
 59%|█████▉    | 22442/37963 [96:10:37<66:46:39, 15.49s/it]
 59%|█████▉    | 22443/37963 [96:10:52<65:27:00, 15.18s/it]
 59%|█████▉    | 22444/37963 [96:11:06<64:26:32, 14.95s/it]
 59%|█████▉    | 22445/37963 [96:11:26<71:16:43, 16.54s/it]
 59%|█████▉    | 22446/37963 [96:11:40<68:14:57, 15.83s/it]
 59%|█████▉    | 22447/37963 [96:12:02<75:10:27, 17.44s/it]
 59%|█████▉    | 22448/37963 [96:12:16<70:39:42, 16.40s/it]
 59%|█████▉    | 22449/37963 [96:12:30<68:00:15, 15.78s/it]
 59%|█████▉    | 22450/37963 [96:12:44<66:11:51, 15.36s/it]
                                                           
{'loss': '0.1303', 'grad_norm': '1.216', 'learning_rate': '7.553e-06', 'epoch': '0.5914'}

 59%|█████▉    | 22450/37963 [96:12:44<66:11:51, 15.36s/it]
 59%|█████▉    | 22451/37963 [96:12:59<65:00:54, 15.09s/it]
 59%|█████▉    | 22452/37963 [96:13:13<63:58:58, 14.85s/it]
 59%|█████▉    | 22453/37963 [96:13:27<63:26:00, 14.72s/it]
 59%|█████▉    | 22454/37963 [96:13:41<62:13:49, 14.45s/it]
 59%|█████▉    | 22455/37963 [96:13:56<62:06:27, 14.42s/it]
 59%|█████▉    | 22456/37963 [96:14:09<61:18:40, 14.23s/it]
 59%|█████▉    | 22457/37963 [96:14:24<61:34:55, 14.30s/it]
 59%|█████▉    | 22458/37963 [96:14:45<70:31:29, 16.37s/it]
 59%|█████▉    | 22459/37963 [96:15:05<75:34:38, 17.55s/it]
 59%|█████▉    | 22460/37963 [96:15:20<71:27:07, 16.59s/it]
                                                           
{'loss': '0.1336', 'grad_norm': '1.192', 'learning_rate': '7.544e-06', 'epoch': '0.5916'}

 59%|█████▉    | 22460/37963 [96:15:20<71:27:07, 16.59s/it]
 59%|█████▉    | 22461/37963 [96:15:34<68:31:45, 15.91s/it]
 59%|█████▉    | 22462/37963 [96:15:48<66:34:20, 15.46s/it]
 59%|█████▉    | 22463/37963 [96:16:03<65:05:32, 15.12s/it]
 59%|█████▉    | 22464/37963 [96:16:17<64:09:37, 14.90s/it]
 59%|█████▉    | 22465/37963 [96:16:32<63:28:26, 14.74s/it]
 59%|█████▉    | 22466/37963 [96:16:46<62:32:53, 14.53s/it]
 59%|█████▉    | 22467/37963 [96:16:59<61:36:40, 14.31s/it]
 59%|█████▉    | 22468/37963 [96:17:14<61:40:55, 14.33s/it]
 59%|█████▉    | 22469/37963 [96:17:28<61:06:44, 14.20s/it]
 59%|█████▉    | 22470/37963 [96:17:42<61:28:04, 14.28s/it]
                                                           
{'loss': '0.1361', 'grad_norm': '1.395', 'learning_rate': '7.536e-06', 'epoch': '0.5919'}

 59%|█████▉    | 22470/37963 [96:17:42<61:28:04, 14.28s/it]
 59%|█████▉    | 22471/37963 [96:17:57<61:44:32, 14.35s/it]
 59%|█████▉    | 22472/37963 [96:18:11<61:49:19, 14.37s/it]
 59%|█████▉    | 22473/37963 [96:18:25<61:47:15, 14.36s/it]
 59%|█████▉    | 22474/37963 [96:18:46<70:27:12, 16.37s/it]
 59%|█████▉    | 22475/37963 [96:19:01<67:57:48, 15.80s/it]
 59%|█████▉    | 22476/37963 [96:19:15<66:04:46, 15.36s/it]
 59%|█████▉    | 22477/37963 [96:19:30<64:42:52, 15.04s/it]
 59%|█████▉    | 22478/37963 [96:19:44<63:52:55, 14.85s/it]
 59%|█████▉    | 22479/37963 [96:20:06<72:39:26, 16.89s/it]
 59%|█████▉    | 22480/37963 [96:20:20<69:21:17, 16.13s/it]
                                                           
{'loss': '0.1333', 'grad_norm': '2.742', 'learning_rate': '7.528e-06', 'epoch': '0.5922'}

 59%|█████▉    | 22480/37963 [96:20:20<69:21:17, 16.13s/it]
 59%|█████▉    | 22481/37963 [96:20:34<66:59:02, 15.58s/it]
 59%|█████▉    | 22482/37963 [96:20:48<65:17:49, 15.18s/it]
 59%|█████▉    | 22483/37963 [96:21:10<73:14:06, 17.03s/it]
 59%|█████▉    | 22484/37963 [96:21:24<68:57:28, 16.04s/it]
 59%|█████▉    | 22485/37963 [96:21:38<66:29:00, 15.46s/it]
 59%|█████▉    | 22486/37963 [96:21:52<65:08:58, 15.15s/it]
 59%|█████▉    | 22487/37963 [96:22:07<64:25:16, 14.99s/it]
 59%|█████▉    | 22488/37963 [96:22:21<63:44:47, 14.83s/it]
 59%|█████▉    | 22489/37963 [96:22:42<71:24:52, 16.61s/it]
 59%|█████▉    | 22490/37963 [96:22:56<68:33:32, 15.95s/it]
                                                           
{'loss': '0.1382', 'grad_norm': '2.404', 'learning_rate': '7.52e-06', 'epoch': '0.5924'}

 59%|█████▉    | 22490/37963 [96:22:56<68:33:32, 15.95s/it]
 59%|█████▉    | 22491/37963 [96:23:11<66:30:48, 15.48s/it]
 59%|█████▉    | 22492/37963 [96:23:25<65:12:23, 15.17s/it]
 59%|█████▉    | 22493/37963 [96:23:40<64:10:49, 14.94s/it]
 59%|█████▉    | 22494/37963 [96:24:00<71:37:40, 16.67s/it]
 59%|█████▉    | 22495/37963 [96:24:15<68:33:36, 15.96s/it]
 59%|█████▉    | 22496/37963 [96:24:36<75:27:20, 17.56s/it]
 59%|█████▉    | 22497/37963 [96:24:50<71:20:32, 16.61s/it]
 59%|█████▉    | 22498/37963 [96:25:04<68:16:52, 15.89s/it]
 59%|█████▉    | 22499/37963 [96:25:19<66:24:34, 15.46s/it]
 59%|█████▉    | 22500/37963 [96:25:33<64:59:40, 15.13s/it]
                                                           
{'loss': '0.1262', 'grad_norm': '2.232', 'learning_rate': '7.511e-06', 'epoch': '0.5927'}

 59%|█████▉    | 22500/37963 [96:25:33<64:59:40, 15.13s/it]
 59%|█████▉    | 22501/37963 [96:25:48<64:00:28, 14.90s/it]
 59%|█████▉    | 22502/37963 [96:26:02<63:27:11, 14.77s/it]
 59%|█████▉    | 22503/37963 [96:26:16<62:49:13, 14.63s/it]
 59%|█████▉    | 22504/37963 [96:26:31<62:27:00, 14.54s/it]
 59%|█████▉    | 22505/37963 [96:26:45<62:08:56, 14.47s/it]
 59%|█████▉    | 22506/37963 [96:26:59<62:03:07, 14.45s/it]
 59%|█████▉    | 22507/37963 [96:27:14<61:49:53, 14.40s/it]
 59%|█████▉    | 22508/37963 [96:27:42<79:06:30, 18.43s/it]
 59%|█████▉    | 22509/37963 [96:27:56<73:57:12, 17.23s/it]
 59%|█████▉    | 22510/37963 [96:28:10<70:14:04, 16.36s/it]
                                                           
{'loss': '0.1282', 'grad_norm': '2.67', 'learning_rate': '7.503e-06', 'epoch': '0.5929'}

 59%|█████▉    | 22510/37963 [96:28:10<70:14:04, 16.36s/it]
 59%|█████▉    | 22511/37963 [96:28:25<67:38:56, 15.76s/it]
 59%|█████▉    | 22512/37963 [96:28:38<65:02:21, 15.15s/it]
 59%|█████▉    | 22513/37963 [96:28:52<63:23:06, 14.77s/it]
 59%|█████▉    | 22514/37963 [96:29:07<62:52:20, 14.65s/it]
 59%|█████▉    | 22515/37963 [96:29:20<61:41:34, 14.38s/it]
 59%|█████▉    | 22516/37963 [96:29:35<61:38:59, 14.37s/it]
 59%|█████▉    | 22517/37963 [96:29:49<61:39:31, 14.37s/it]
 59%|█████▉    | 22518/37963 [96:30:04<61:38:23, 14.37s/it]
 59%|█████▉    | 22519/37963 [96:30:18<61:10:32, 14.26s/it]
 59%|█████▉    | 22520/37963 [96:30:32<61:21:06, 14.30s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '1.279', 'learning_rate': '7.495e-06', 'epoch': '0.5932'}

 59%|█████▉    | 22520/37963 [96:30:32<61:21:06, 14.30s/it]
 59%|█████▉    | 22521/37963 [96:30:46<61:25:54, 14.32s/it]
 59%|█████▉    | 22522/37963 [96:31:01<61:26:46, 14.33s/it]
 59%|█████▉    | 22523/37963 [96:31:15<61:33:01, 14.35s/it]
 59%|█████▉    | 22524/37963 [96:31:36<69:26:55, 16.19s/it]
 59%|█████▉    | 22525/37963 [96:31:50<67:04:54, 15.64s/it]
 59%|█████▉    | 22526/37963 [96:32:04<65:24:34, 15.25s/it]
 59%|█████▉    | 22527/37963 [96:32:19<64:16:12, 14.99s/it]
 59%|█████▉    | 22528/37963 [96:32:33<63:10:51, 14.74s/it]
 59%|█████▉    | 22529/37963 [96:32:47<62:29:51, 14.58s/it]
 59%|█████▉    | 22530/37963 [96:33:08<70:16:10, 16.39s/it]
                                                           
{'loss': '0.1295', 'grad_norm': '1.221', 'learning_rate': '7.487e-06', 'epoch': '0.5935'}

 59%|█████▉    | 22530/37963 [96:33:08<70:16:10, 16.39s/it]
 59%|█████▉    | 22531/37963 [96:33:29<76:44:41, 17.90s/it]
 59%|█████▉    | 22532/37963 [96:33:43<72:16:46, 16.86s/it]
 59%|█████▉    | 22533/37963 [96:33:58<69:05:55, 16.12s/it]
 59%|█████▉    | 22534/37963 [96:34:12<66:44:06, 15.57s/it]
 59%|█████▉    | 22535/37963 [96:34:27<65:26:08, 15.27s/it]
 59%|█████▉    | 22536/37963 [96:34:41<64:30:52, 15.05s/it]
 59%|█████▉    | 22537/37963 [96:35:02<71:28:54, 16.68s/it]
 59%|█████▉    | 22538/37963 [96:35:16<68:14:19, 15.93s/it]
 59%|█████▉    | 22539/37963 [96:35:30<66:15:21, 15.46s/it]
 59%|█████▉    | 22540/37963 [96:35:45<64:48:41, 15.13s/it]
                                                           
{'loss': '0.1227', 'grad_norm': '1.901', 'learning_rate': '7.478e-06', 'epoch': '0.5937'}

 59%|█████▉    | 22540/37963 [96:35:45<64:48:41, 15.13s/it]
 59%|█████▉    | 22541/37963 [96:35:59<63:56:47, 14.93s/it]
 59%|█████▉    | 22542/37963 [96:36:14<63:20:02, 14.79s/it]
 59%|█████▉    | 22543/37963 [96:36:28<62:47:01, 14.66s/it]
 59%|█████▉    | 22544/37963 [96:36:42<62:21:22, 14.56s/it]
 59%|█████▉    | 22545/37963 [96:37:03<70:03:31, 16.36s/it]
 59%|█████▉    | 22546/37963 [96:37:24<76:40:10, 17.90s/it]
 59%|█████▉    | 22547/37963 [96:37:39<72:17:30, 16.88s/it]
 59%|█████▉    | 22548/37963 [96:37:53<68:22:12, 15.97s/it]
 59%|█████▉    | 22549/37963 [96:38:06<65:36:28, 15.32s/it]
 59%|█████▉    | 22550/37963 [96:38:21<64:09:46, 14.99s/it]
                                                           
{'loss': '0.138', 'grad_norm': '2.354', 'learning_rate': '7.47e-06', 'epoch': '0.594'}

 59%|█████▉    | 22550/37963 [96:38:21<64:09:46, 14.99s/it]
 59%|█████▉    | 22551/37963 [96:38:35<63:27:12, 14.82s/it]
 59%|█████▉    | 22552/37963 [96:38:49<62:09:19, 14.52s/it]
 59%|█████▉    | 22553/37963 [96:39:03<62:05:31, 14.51s/it]
 59%|█████▉    | 22554/37963 [96:39:18<62:01:34, 14.49s/it]
 59%|█████▉    | 22555/37963 [96:39:45<78:25:43, 18.32s/it]
 59%|█████▉    | 22556/37963 [96:40:00<73:24:55, 17.15s/it]
 59%|█████▉    | 22557/37963 [96:40:14<69:47:20, 16.31s/it]
 59%|█████▉    | 22558/37963 [96:40:28<67:14:12, 15.71s/it]
 59%|█████▉    | 22559/37963 [96:40:43<65:30:38, 15.31s/it]
 59%|█████▉    | 22560/37963 [96:40:57<64:08:47, 14.99s/it]
                                                           
{'loss': '0.1405', 'grad_norm': '2.916', 'learning_rate': '7.462e-06', 'epoch': '0.5943'}

 59%|█████▉    | 22560/37963 [96:40:57<64:08:47, 14.99s/it]
 59%|█████▉    | 22561/37963 [96:41:11<63:18:50, 14.80s/it]
 59%|█████▉    | 22562/37963 [96:41:25<62:40:10, 14.65s/it]
 59%|█████▉    | 22563/37963 [96:41:39<61:49:22, 14.45s/it]
 59%|█████▉    | 22564/37963 [96:41:54<61:36:00, 14.40s/it]
 59%|█████▉    | 22565/37963 [96:42:08<61:35:10, 14.40s/it]
 59%|█████▉    | 22566/37963 [96:42:23<61:34:50, 14.40s/it]
 59%|█████▉    | 22567/37963 [96:42:37<61:35:50, 14.40s/it]
 59%|█████▉    | 22568/37963 [96:42:51<61:26:49, 14.37s/it]
 59%|█████▉    | 22569/37963 [96:43:05<61:08:37, 14.30s/it]
 59%|█████▉    | 22570/37963 [96:43:20<61:13:13, 14.32s/it]
                                                           
{'loss': '0.1226', 'grad_norm': '1.9', 'learning_rate': '7.454e-06', 'epoch': '0.5945'}

 59%|█████▉    | 22570/37963 [96:43:20<61:13:13, 14.32s/it]
 59%|█████▉    | 22571/37963 [96:43:34<61:17:30, 14.34s/it]
 59%|█████▉    | 22572/37963 [96:43:48<61:00:09, 14.27s/it]
 59%|█████▉    | 22573/37963 [96:44:03<61:04:46, 14.29s/it]
 59%|█████▉    | 22574/37963 [96:44:23<69:25:26, 16.24s/it]
 59%|█████▉    | 22575/37963 [96:44:38<66:57:37, 15.67s/it]
 59%|█████▉    | 22576/37963 [96:44:52<64:38:34, 15.12s/it]
 59%|█████▉    | 22577/37963 [96:45:06<63:52:53, 14.95s/it]
 59%|█████▉    | 22578/37963 [96:45:21<63:21:32, 14.83s/it]
 59%|█████▉    | 22579/37963 [96:45:48<79:34:28, 18.62s/it]
 59%|█████▉    | 22580/37963 [96:46:03<74:13:54, 17.37s/it]
                                                           
{'loss': '0.1287', 'grad_norm': '1.842', 'learning_rate': '7.445e-06', 'epoch': '0.5948'}

 59%|█████▉    | 22580/37963 [96:46:03<74:13:54, 17.37s/it]
 59%|█████▉    | 22581/37963 [96:46:17<70:34:01, 16.52s/it]
 59%|█████▉    | 22582/37963 [96:46:31<67:42:54, 15.85s/it]
 59%|█████▉    | 22583/37963 [96:46:46<65:43:26, 15.38s/it]
 59%|█████▉    | 22584/37963 [96:47:00<64:11:04, 15.02s/it]
 59%|█████▉    | 22585/37963 [96:47:21<71:41:43, 16.78s/it]
 59%|█████▉    | 22586/37963 [96:47:35<68:09:44, 15.96s/it]
 59%|█████▉    | 22587/37963 [96:47:49<66:02:32, 15.46s/it]
 60%|█████▉    | 22588/37963 [96:48:03<64:29:32, 15.10s/it]
 60%|█████▉    | 22589/37963 [96:48:18<63:25:16, 14.85s/it]
 60%|█████▉    | 22590/37963 [96:48:32<62:33:07, 14.65s/it]
                                                           
{'loss': '0.1402', 'grad_norm': '1.514', 'learning_rate': '7.437e-06', 'epoch': '0.5951'}

 60%|█████▉    | 22590/37963 [96:48:32<62:33:07, 14.65s/it]
 60%|█████▉    | 22591/37963 [96:48:46<62:10:14, 14.56s/it]
 60%|█████▉    | 22592/37963 [96:49:00<61:48:10, 14.47s/it]
 60%|█████▉    | 22593/37963 [96:49:21<69:40:34, 16.32s/it]
 60%|█████▉    | 22594/37963 [96:49:35<67:00:29, 15.70s/it]
 60%|█████▉    | 22595/37963 [96:49:56<73:32:15, 17.23s/it]
 60%|█████▉    | 22596/37963 [96:50:10<69:48:30, 16.35s/it]
 60%|█████▉    | 22597/37963 [96:50:24<66:47:20, 15.65s/it]
 60%|█████▉    | 22598/37963 [96:50:38<64:49:21, 15.19s/it]
 60%|█████▉    | 22599/37963 [96:50:53<63:44:06, 14.93s/it]
 60%|█████▉    | 22600/37963 [96:51:07<63:00:21, 14.76s/it]
                                                           
{'loss': '0.1302', 'grad_norm': '3.935', 'learning_rate': '7.429e-06', 'epoch': '0.5953'}

 60%|█████▉    | 22600/37963 [96:51:07<63:00:21, 14.76s/it]
 60%|█████▉    | 22601/37963 [96:51:21<62:01:17, 14.53s/it]
 60%|█████▉    | 22602/37963 [96:51:35<61:44:20, 14.47s/it]
 60%|█████▉    | 22603/37963 [96:51:56<68:58:31, 16.17s/it]
 60%|█████▉    | 22604/37963 [96:52:17<75:42:48, 17.75s/it]
 60%|█████▉    | 22605/37963 [96:52:31<70:54:43, 16.62s/it]
 60%|█████▉    | 22606/37963 [96:52:45<67:20:51, 15.79s/it]
 60%|█████▉    | 22607/37963 [96:52:59<65:35:09, 15.38s/it]
 60%|█████▉    | 22608/37963 [96:53:14<64:32:47, 15.13s/it]
 60%|█████▉    | 22609/37963 [96:53:28<63:18:22, 14.84s/it]
 60%|█████▉    | 22610/37963 [96:53:43<62:58:58, 14.77s/it]
                                                           
{'loss': '0.1301', 'grad_norm': '1.685', 'learning_rate': '7.421e-06', 'epoch': '0.5956'}

 60%|█████▉    | 22610/37963 [96:53:43<62:58:58, 14.77s/it]
 60%|█████▉    | 22611/37963 [96:53:57<62:26:58, 14.64s/it]
 60%|█████▉    | 22612/37963 [96:54:11<61:42:15, 14.47s/it]
 60%|█████▉    | 22613/37963 [96:54:25<61:34:33, 14.44s/it]
 60%|█████▉    | 22614/37963 [96:54:40<61:31:30, 14.43s/it]
 60%|█████▉    | 22615/37963 [96:54:54<61:13:18, 14.36s/it]
 60%|█████▉    | 22616/37963 [96:55:08<60:29:54, 14.19s/it]
 60%|█████▉    | 22617/37963 [96:55:22<60:24:41, 14.17s/it]
 60%|█████▉    | 22618/37963 [96:55:36<60:44:33, 14.25s/it]
 60%|█████▉    | 22619/37963 [96:55:51<60:59:29, 14.31s/it]
 60%|█████▉    | 22620/37963 [96:56:05<61:00:22, 14.31s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '1.678', 'learning_rate': '7.412e-06', 'epoch': '0.5958'}

 60%|█████▉    | 22620/37963 [96:56:05<61:00:22, 14.31s/it]
 60%|█████▉    | 22621/37963 [96:56:20<61:14:12, 14.37s/it]
 60%|█████▉    | 22622/37963 [96:56:41<69:36:15, 16.33s/it]
 60%|█████▉    | 22623/37963 [96:56:55<67:07:33, 15.75s/it]
 60%|█████▉    | 22624/37963 [96:57:09<65:20:19, 15.33s/it]
 60%|█████▉    | 22625/37963 [96:57:24<64:05:47, 15.04s/it]
 60%|█████▉    | 22626/37963 [96:57:45<71:30:04, 16.78s/it]
 60%|█████▉    | 22627/37963 [96:57:59<68:24:36, 16.06s/it]
 60%|█████▉    | 22628/37963 [96:58:20<74:23:48, 17.47s/it]
 60%|█████▉    | 22629/37963 [96:58:34<69:53:09, 16.41s/it]
 60%|█████▉    | 22630/37963 [96:58:48<67:11:57, 15.78s/it]
                                                           
{'loss': '0.1267', 'grad_norm': '0.9521', 'learning_rate': '7.404e-06', 'epoch': '0.5961'}

 60%|█████▉    | 22630/37963 [96:58:48<67:11:57, 15.78s/it]
 60%|█████▉    | 22631/37963 [96:59:02<65:20:18, 15.34s/it]
 60%|█████▉    | 22632/37963 [96:59:17<64:12:20, 15.08s/it]
 60%|█████▉    | 22633/37963 [96:59:37<71:25:28, 16.77s/it]
 60%|█████▉    | 22634/37963 [96:59:52<68:25:32, 16.07s/it]
 60%|█████▉    | 22635/37963 [97:00:06<66:21:34, 15.59s/it]
 60%|█████▉    | 22636/37963 [97:00:20<63:54:50, 15.01s/it]
 60%|█████▉    | 22637/37963 [97:00:34<63:01:56, 14.81s/it]
 60%|█████▉    | 22638/37963 [97:00:49<62:29:11, 14.68s/it]
 60%|█████▉    | 22639/37963 [97:01:03<62:09:13, 14.60s/it]
 60%|█████▉    | 22640/37963 [97:01:17<61:14:41, 14.39s/it]
                                                           
{'loss': '0.129', 'grad_norm': '1.366', 'learning_rate': '7.396e-06', 'epoch': '0.5964'}

 60%|█████▉    | 22640/37963 [97:01:17<61:14:41, 14.39s/it]
 60%|█████▉    | 22641/37963 [97:01:31<60:58:18, 14.33s/it]
 60%|█████▉    | 22642/37963 [97:01:52<69:00:29, 16.21s/it]
 60%|█████▉    | 22643/37963 [97:02:06<66:39:28, 15.66s/it]
 60%|█████▉    | 22644/37963 [97:02:27<73:02:50, 17.17s/it]
 60%|█████▉    | 22645/37963 [97:02:41<68:56:04, 16.20s/it]
 60%|█████▉    | 22646/37963 [97:02:55<66:35:36, 15.65s/it]
 60%|█████▉    | 22647/37963 [97:03:09<64:52:32, 15.25s/it]
 60%|█████▉    | 22648/37963 [97:03:24<63:27:08, 14.92s/it]
 60%|█████▉    | 22649/37963 [97:03:38<62:42:26, 14.74s/it]
 60%|█████▉    | 22650/37963 [97:03:52<62:14:02, 14.63s/it]
                                                           
{'loss': '0.1153', 'grad_norm': '2.356', 'learning_rate': '7.388e-06', 'epoch': '0.5966'}

 60%|█████▉    | 22650/37963 [97:03:52<62:14:02, 14.63s/it]
 60%|█████▉    | 22651/37963 [97:04:07<61:53:13, 14.55s/it]
 60%|█████▉    | 22652/37963 [97:04:28<69:56:51, 16.45s/it]
 60%|█████▉    | 22653/37963 [97:04:48<75:37:03, 17.78s/it]
 60%|█████▉    | 22654/37963 [97:05:03<71:16:38, 16.76s/it]
 60%|█████▉    | 22655/37963 [97:05:17<68:11:24, 16.04s/it]
 60%|█████▉    | 22656/37963 [97:05:32<66:00:56, 15.53s/it]
 60%|█████▉    | 22657/37963 [97:05:46<64:36:33, 15.20s/it]
 60%|█████▉    | 22658/37963 [97:06:00<62:59:12, 14.82s/it]
 60%|█████▉    | 22659/37963 [97:06:14<62:17:25, 14.65s/it]
 60%|█████▉    | 22660/37963 [97:06:28<61:52:18, 14.56s/it]
                                                           
{'loss': '0.1268', 'grad_norm': '2.619', 'learning_rate': '7.379e-06', 'epoch': '0.5969'}

 60%|█████▉    | 22660/37963 [97:06:28<61:52:18, 14.56s/it]
 60%|█████▉    | 22661/37963 [97:06:43<61:41:43, 14.51s/it]
 60%|█████▉    | 22662/37963 [97:06:57<61:10:12, 14.39s/it]
 60%|█████▉    | 22663/37963 [97:07:11<61:09:52, 14.39s/it]
 60%|█████▉    | 22664/37963 [97:07:26<61:19:03, 14.43s/it]
 60%|█████▉    | 22665/37963 [97:07:40<60:29:51, 14.24s/it]
 60%|█████▉    | 22666/37963 [97:07:54<60:00:07, 14.12s/it]
 60%|█████▉    | 22667/37963 [97:08:08<60:13:49, 14.18s/it]
 60%|█████▉    | 22668/37963 [97:08:22<60:16:23, 14.19s/it]
 60%|█████▉    | 22669/37963 [97:08:36<60:28:18, 14.23s/it]
 60%|█████▉    | 22670/37963 [97:08:51<60:36:51, 14.27s/it]
                                                           
{'loss': '0.1329', 'grad_norm': '1.836', 'learning_rate': '7.371e-06', 'epoch': '0.5972'}

 60%|█████▉    | 22670/37963 [97:08:51<60:36:51, 14.27s/it]
 60%|█████▉    | 22671/37963 [97:09:05<60:40:23, 14.28s/it]
 60%|█████▉    | 22672/37963 [97:09:26<69:10:44, 16.29s/it]
 60%|█████▉    | 22673/37963 [97:09:40<66:07:06, 15.57s/it]
 60%|█████▉    | 22674/37963 [97:09:54<64:31:41, 15.19s/it]
 60%|█████▉    | 22675/37963 [97:10:09<63:33:22, 14.97s/it]
 60%|█████▉    | 22676/37963 [97:10:29<71:01:28, 16.73s/it]
 60%|█████▉    | 22677/37963 [97:10:51<76:42:30, 18.07s/it]
 60%|█████▉    | 22678/37963 [97:11:05<71:30:59, 16.84s/it]
 60%|█████▉    | 22679/37963 [97:11:19<68:15:06, 16.08s/it]
 60%|█████▉    | 22680/37963 [97:11:33<66:01:08, 15.55s/it]
                                                           
{'loss': '0.1161', 'grad_norm': '1.965', 'learning_rate': '7.363e-06', 'epoch': '0.5974'}

 60%|█████▉    | 22680/37963 [97:11:33<66:01:08, 15.55s/it]
 60%|█████▉    | 22681/37963 [97:11:48<64:28:32, 15.19s/it]
 60%|█████▉    | 22682/37963 [97:12:02<62:58:11, 14.83s/it]
 60%|█████▉    | 22683/37963 [97:12:23<70:42:48, 16.66s/it]
 60%|█████▉    | 22684/37963 [97:12:37<67:49:37, 15.98s/it]
 60%|█████▉    | 22685/37963 [97:12:51<65:41:43, 15.48s/it]
 60%|█████▉    | 22686/37963 [97:13:06<64:21:26, 15.17s/it]
 60%|█████▉    | 22687/37963 [97:13:20<63:10:02, 14.89s/it]
 60%|█████▉    | 22688/37963 [97:13:34<62:03:28, 14.63s/it]
 60%|█████▉    | 22689/37963 [97:13:48<61:45:35, 14.56s/it]
 60%|█████▉    | 22690/37963 [97:14:02<60:39:38, 14.30s/it]
                                                           
{'loss': '0.136', 'grad_norm': '2.629', 'learning_rate': '7.355e-06', 'epoch': '0.5977'}

 60%|█████▉    | 22690/37963 [97:14:02<60:39:38, 14.30s/it]
 60%|█████▉    | 22691/37963 [97:14:23<68:51:08, 16.23s/it]
 60%|█████▉    | 22692/37963 [97:14:37<66:14:11, 15.61s/it]
 60%|█████▉    | 22693/37963 [97:14:58<73:06:51, 17.24s/it]
 60%|█████▉    | 22694/37963 [97:15:12<69:33:04, 16.40s/it]
 60%|█████▉    | 22695/37963 [97:15:27<66:57:21, 15.79s/it]
 60%|█████▉    | 22696/37963 [97:15:41<65:11:50, 15.37s/it]
 60%|█████▉    | 22697/37963 [97:15:56<63:53:25, 15.07s/it]
 60%|█████▉    | 22698/37963 [97:16:10<62:56:33, 14.84s/it]
 60%|█████▉    | 22699/37963 [97:16:24<62:20:57, 14.71s/it]
 60%|█████▉    | 22700/37963 [97:16:39<61:56:51, 14.61s/it]
                                                           
{'loss': '0.1196', 'grad_norm': '5.448', 'learning_rate': '7.346e-06', 'epoch': '0.598'}

 60%|█████▉    | 22700/37963 [97:16:39<61:56:51, 14.61s/it]
 60%|█████▉    | 22701/37963 [97:17:00<70:02:07, 16.52s/it]
 60%|█████▉    | 22702/37963 [97:17:21<75:47:50, 17.88s/it]
 60%|█████▉    | 22703/37963 [97:17:35<71:15:02, 16.81s/it]
 60%|█████▉    | 22704/37963 [97:17:49<68:13:46, 16.10s/it]
 60%|█████▉    | 22705/37963 [97:18:03<65:14:18, 15.39s/it]
 60%|█████▉    | 22706/37963 [97:18:17<63:49:29, 15.06s/it]
 60%|█████▉    | 22707/37963 [97:18:32<62:53:07, 14.84s/it]
 60%|█████▉    | 22708/37963 [97:18:46<62:11:21, 14.68s/it]
 60%|█████▉    | 22709/37963 [97:19:00<61:23:35, 14.49s/it]
 60%|█████▉    | 22710/37963 [97:19:14<60:08:35, 14.19s/it]
                                                           
{'loss': '0.1304', 'grad_norm': '2.405', 'learning_rate': '7.338e-06', 'epoch': '0.5982'}

 60%|█████▉    | 22710/37963 [97:19:14<60:08:35, 14.19s/it]
 60%|█████▉    | 22711/37963 [97:19:28<60:22:16, 14.25s/it]
 60%|█████▉    | 22712/37963 [97:19:42<60:37:16, 14.31s/it]
 60%|█████▉    | 22713/37963 [97:19:57<60:38:51, 14.32s/it]
 60%|█████▉    | 22714/37963 [97:20:11<61:06:52, 14.43s/it]
 60%|█████▉    | 22715/37963 [97:20:26<60:38:45, 14.32s/it]
 60%|█████▉    | 22716/37963 [97:20:40<60:40:49, 14.33s/it]
 60%|█████▉    | 22717/37963 [97:20:54<60:43:01, 14.34s/it]
 60%|█████▉    | 22718/37963 [97:21:08<60:24:17, 14.26s/it]
 60%|█████▉    | 22719/37963 [97:21:23<60:38:37, 14.32s/it]
 60%|█████▉    | 22720/37963 [97:21:37<60:38:27, 14.32s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '4.745', 'learning_rate': '7.33e-06', 'epoch': '0.5985'}

 60%|█████▉    | 22720/37963 [97:21:37<60:38:27, 14.32s/it]
 60%|█████▉    | 22721/37963 [97:21:58<68:45:55, 16.24s/it]
 60%|█████▉    | 22722/37963 [97:22:12<66:03:11, 15.60s/it]
 60%|█████▉    | 22723/37963 [97:22:26<64:29:42, 15.24s/it]
 60%|█████▉    | 22724/37963 [97:22:41<63:11:33, 14.93s/it]
 60%|█████▉    | 22725/37963 [97:22:55<62:31:40, 14.77s/it]
 60%|█████▉    | 22726/37963 [97:23:16<70:20:17, 16.62s/it]
 60%|█████▉    | 22727/37963 [97:23:30<67:29:43, 15.95s/it]
 60%|█████▉    | 22728/37963 [97:23:58<82:01:40, 19.38s/it]
 60%|█████▉    | 22729/37963 [97:24:12<75:20:08, 17.80s/it]
 60%|█████▉    | 22730/37963 [97:24:26<70:35:55, 16.68s/it]
                                                           
{'loss': '0.116', 'grad_norm': '2.657', 'learning_rate': '7.322e-06', 'epoch': '0.5987'}

 60%|█████▉    | 22730/37963 [97:24:26<70:35:55, 16.68s/it]
 60%|█████▉    | 22731/37963 [97:24:40<67:17:14, 15.90s/it]
 60%|█████▉    | 22732/37963 [97:24:54<65:18:52, 15.44s/it]
 60%|█████▉    | 22733/37963 [97:25:09<64:02:01, 15.14s/it]
 60%|█████▉    | 22734/37963 [97:25:23<63:00:40, 14.90s/it]
 60%|█████▉    | 22735/37963 [97:25:37<62:16:42, 14.72s/it]
 60%|█████▉    | 22736/37963 [97:25:52<61:49:30, 14.62s/it]
 60%|█████▉    | 22737/37963 [97:26:06<61:23:24, 14.51s/it]
 60%|█████▉    | 22738/37963 [97:26:20<61:16:37, 14.49s/it]
 60%|█████▉    | 22739/37963 [97:26:41<69:13:07, 16.37s/it]
 60%|█████▉    | 22740/37963 [97:26:56<66:39:40, 15.76s/it]
                                                           
{'loss': '0.1117', 'grad_norm': '1.694', 'learning_rate': '7.314e-06', 'epoch': '0.599'}

 60%|█████▉    | 22740/37963 [97:26:56<66:39:40, 15.76s/it]
 60%|█████▉    | 22741/37963 [97:27:10<65:06:23, 15.40s/it]
 60%|█████▉    | 22742/37963 [97:27:31<72:19:27, 17.11s/it]
 60%|█████▉    | 22743/37963 [97:27:45<68:44:15, 16.26s/it]
 60%|█████▉    | 22744/37963 [97:28:00<66:02:30, 15.62s/it]
 60%|█████▉    | 22745/37963 [97:28:14<64:24:05, 15.23s/it]
 60%|█████▉    | 22746/37963 [97:28:28<62:44:08, 14.84s/it]
 60%|█████▉    | 22747/37963 [97:28:42<62:04:13, 14.69s/it]
 60%|█████▉    | 22748/37963 [97:28:56<61:34:15, 14.57s/it]
 60%|█████▉    | 22749/37963 [97:29:17<68:39:45, 16.25s/it]
 60%|█████▉    | 22750/37963 [97:29:38<74:35:24, 17.65s/it]
                                                           
{'loss': '0.1164', 'grad_norm': '1.974', 'learning_rate': '7.305e-06', 'epoch': '0.5993'}

 60%|█████▉    | 22750/37963 [97:29:38<74:35:24, 17.65s/it]
 60%|█████▉    | 22751/37963 [97:29:52<70:23:13, 16.66s/it]
 60%|█████▉    | 22752/37963 [97:30:06<67:10:10, 15.90s/it]
 60%|█████▉    | 22753/37963 [97:30:20<65:15:05, 15.44s/it]
 60%|█████▉    | 22754/37963 [97:30:35<63:54:32, 15.13s/it]
 60%|█████▉    | 22755/37963 [97:30:49<62:51:26, 14.88s/it]
 60%|█████▉    | 22756/37963 [97:31:03<62:13:20, 14.73s/it]
 60%|█████▉    | 22757/37963 [97:31:18<61:49:37, 14.64s/it]
 60%|█████▉    | 22758/37963 [97:31:32<61:25:25, 14.54s/it]
 60%|█████▉    | 22759/37963 [97:31:46<60:36:12, 14.35s/it]
 60%|█████▉    | 22760/37963 [97:32:01<60:39:58, 14.37s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '4.75', 'learning_rate': '7.297e-06', 'epoch': '0.5995'}

 60%|█████▉    | 22760/37963 [97:32:01<60:39:58, 14.37s/it]
 60%|█████▉    | 22761/37963 [97:32:15<60:43:15, 14.38s/it]
 60%|█████▉    | 22762/37963 [97:32:29<60:36:37, 14.35s/it]
 60%|█████▉    | 22763/37963 [97:32:43<59:32:23, 14.10s/it]
 60%|█████▉    | 22764/37963 [97:32:57<59:53:48, 14.19s/it]
 60%|█████▉    | 22765/37963 [97:33:11<60:06:36, 14.24s/it]
 60%|█████▉    | 22766/37963 [97:33:26<60:12:22, 14.26s/it]
 60%|█████▉    | 22767/37963 [97:33:40<60:10:49, 14.26s/it]
 60%|█████▉    | 22768/37963 [97:33:55<60:24:51, 14.31s/it]
 60%|█████▉    | 22769/37963 [97:34:09<60:31:09, 14.34s/it]
 60%|█████▉    | 22770/37963 [97:34:29<68:05:43, 16.14s/it]
                                                           
{'loss': '0.1256', 'grad_norm': '1.76', 'learning_rate': '7.289e-06', 'epoch': '0.5998'}

 60%|█████▉    | 22770/37963 [97:34:29<68:05:43, 16.14s/it]
 60%|█████▉    | 22771/37963 [97:34:44<65:55:52, 15.62s/it]
 60%|█████▉    | 22772/37963 [97:34:58<64:16:10, 15.23s/it]
 60%|█████▉    | 22773/37963 [97:35:12<63:19:11, 15.01s/it]
 60%|█████▉    | 22774/37963 [97:35:27<62:24:05, 14.79s/it]
 60%|█████▉    | 22775/37963 [97:35:54<78:39:03, 18.64s/it]
 60%|█████▉    | 22776/37963 [97:36:15<80:39:43, 19.12s/it]
 60%|█████▉    | 22777/37963 [97:36:29<74:35:49, 17.68s/it]
 60%|██████    | 22778/37963 [97:36:43<70:21:20, 16.68s/it]
 60%|██████    | 22779/37963 [97:36:57<66:41:53, 15.81s/it]
 60%|██████    | 22780/37963 [97:37:12<65:11:53, 15.46s/it]
                                                           
{'loss': '0.1281', 'grad_norm': '2.136', 'learning_rate': '7.281e-06', 'epoch': '0.6001'}

 60%|██████    | 22780/37963 [97:37:12<65:11:53, 15.46s/it]
 60%|██████    | 22781/37963 [97:37:25<62:54:36, 14.92s/it]
 60%|██████    | 22782/37963 [97:37:40<62:19:18, 14.78s/it]
 60%|██████    | 22783/37963 [97:37:54<61:41:38, 14.63s/it]
 60%|██████    | 22784/37963 [97:38:08<61:19:35, 14.54s/it]
 60%|██████    | 22785/37963 [97:38:23<61:11:17, 14.51s/it]
 60%|██████    | 22786/37963 [97:38:37<61:04:37, 14.49s/it]
 60%|██████    | 22787/37963 [97:38:52<60:56:48, 14.46s/it]
 60%|██████    | 22788/37963 [97:39:12<68:44:20, 16.31s/it]
 60%|██████    | 22789/37963 [97:39:26<65:49:22, 15.62s/it]
 60%|██████    | 22790/37963 [97:39:40<63:33:15, 15.08s/it]
                                                           
{'loss': '0.1249', 'grad_norm': '2.759', 'learning_rate': '7.273e-06', 'epoch': '0.6003'}

 60%|██████    | 22790/37963 [97:39:40<63:33:15, 15.08s/it]
 60%|██████    | 22791/37963 [97:40:02<72:15:46, 17.15s/it]
 60%|██████    | 22792/37963 [97:40:16<68:10:25, 16.18s/it]
 60%|██████    | 22793/37963 [97:40:30<65:18:32, 15.50s/it]
 60%|██████    | 22794/37963 [97:40:44<63:50:25, 15.15s/it]
 60%|██████    | 22795/37963 [97:40:59<62:47:15, 14.90s/it]
 60%|██████    | 22796/37963 [97:41:13<62:12:02, 14.76s/it]
 60%|██████    | 22797/37963 [97:41:27<61:38:10, 14.63s/it]
 60%|██████    | 22798/37963 [97:41:48<69:09:13, 16.42s/it]
 60%|██████    | 22799/37963 [97:42:02<66:19:14, 15.74s/it]
 60%|██████    | 22800/37963 [97:42:23<72:56:21, 17.32s/it]
                                                           
{'loss': '0.1378', 'grad_norm': '4.912', 'learning_rate': '7.264e-06', 'epoch': '0.6006'}

 60%|██████    | 22800/37963 [97:42:23<72:56:21, 17.32s/it]
 60%|██████    | 22801/37963 [97:42:37<68:43:32, 16.32s/it]
 60%|██████    | 22802/37963 [97:42:51<66:13:28, 15.73s/it]
 60%|██████    | 22803/37963 [97:43:06<64:11:30, 15.24s/it]
 60%|██████    | 22804/37963 [97:43:20<63:05:10, 14.98s/it]
 60%|██████    | 22805/37963 [97:43:34<62:17:29, 14.79s/it]
 60%|██████    | 22806/37963 [97:43:49<61:46:00, 14.67s/it]
 60%|██████    | 22807/37963 [97:44:02<60:29:13, 14.37s/it]
 60%|██████    | 22808/37963 [97:44:16<60:12:04, 14.30s/it]
 60%|██████    | 22809/37963 [97:44:31<60:26:12, 14.36s/it]
 60%|██████    | 22810/37963 [97:44:45<60:28:59, 14.37s/it]
                                                           
{'loss': '0.1265', 'grad_norm': '2.037', 'learning_rate': '7.256e-06', 'epoch': '0.6009'}

 60%|██████    | 22810/37963 [97:44:45<60:28:59, 14.37s/it]
 60%|██████    | 22811/37963 [97:45:00<60:39:14, 14.41s/it]
 60%|██████    | 22812/37963 [97:45:14<60:40:54, 14.42s/it]
 60%|██████    | 22813/37963 [97:45:28<60:07:08, 14.29s/it]
 60%|██████    | 22814/37963 [97:45:43<60:11:03, 14.30s/it]
 60%|██████    | 22815/37963 [97:45:57<60:20:17, 14.34s/it]
 60%|██████    | 22816/37963 [97:46:12<60:28:32, 14.37s/it]
 60%|██████    | 22817/37963 [97:46:26<60:23:18, 14.35s/it]
 60%|██████    | 22818/37963 [97:46:40<60:28:37, 14.38s/it]
 60%|██████    | 22819/37963 [97:47:01<68:20:41, 16.25s/it]
 60%|██████    | 22820/37963 [97:47:15<65:58:40, 15.69s/it]
                                                           
{'loss': '0.1279', 'grad_norm': '2.234', 'learning_rate': '7.248e-06', 'epoch': '0.6011'}

 60%|██████    | 22820/37963 [97:47:15<65:58:40, 15.69s/it]
 60%|██████    | 22821/37963 [97:47:29<63:32:34, 15.11s/it]
 60%|██████    | 22822/37963 [97:47:43<62:32:23, 14.87s/it]
 60%|██████    | 22823/37963 [97:48:11<78:25:51, 18.65s/it]
 60%|██████    | 22824/37963 [97:48:32<81:42:36, 19.43s/it]
 60%|██████    | 22825/37963 [97:48:46<75:24:14, 17.93s/it]
 60%|██████    | 22826/37963 [97:49:01<70:39:42, 16.81s/it]
 60%|██████    | 22827/37963 [97:49:15<67:44:22, 16.11s/it]
 60%|██████    | 22828/37963 [97:49:29<65:30:20, 15.58s/it]
 60%|██████    | 22829/37963 [97:49:44<63:54:56, 15.20s/it]
 60%|██████    | 22830/37963 [97:49:58<62:35:19, 14.89s/it]
                                                           
{'loss': '0.1358', 'grad_norm': '4.834', 'learning_rate': '7.24e-06', 'epoch': '0.6014'}

 60%|██████    | 22830/37963 [97:49:58<62:35:19, 14.89s/it]
 60%|██████    | 22831/37963 [97:50:12<61:52:38, 14.72s/it]
 60%|██████    | 22832/37963 [97:50:27<61:40:55, 14.68s/it]
 60%|██████    | 22833/37963 [97:50:41<60:51:55, 14.48s/it]
 60%|██████    | 22834/37963 [97:50:55<60:09:27, 14.31s/it]
 60%|██████    | 22835/37963 [97:51:09<60:15:38, 14.34s/it]
 60%|██████    | 22836/37963 [97:51:24<60:20:23, 14.36s/it]
 60%|██████    | 22837/37963 [97:51:38<60:19:04, 14.36s/it]
 60%|██████    | 22838/37963 [97:51:59<68:51:16, 16.39s/it]
 60%|██████    | 22839/37963 [97:52:20<74:31:29, 17.74s/it]
 60%|██████    | 22840/37963 [97:52:34<70:21:08, 16.75s/it]
                                                           
{'loss': '0.1097', 'grad_norm': '1', 'learning_rate': '7.232e-06', 'epoch': '0.6016'}

 60%|██████    | 22840/37963 [97:52:34<70:21:08, 16.75s/it]
 60%|██████    | 22841/37963 [97:52:49<67:16:58, 16.02s/it]
 60%|██████    | 22842/37963 [97:53:03<64:43:57, 15.41s/it]
 60%|██████    | 22843/37963 [97:53:17<63:26:48, 15.11s/it]
 60%|██████    | 22844/37963 [97:53:31<61:42:03, 14.69s/it]
 60%|██████    | 22845/37963 [97:53:45<61:14:49, 14.58s/it]
 60%|██████    | 22846/37963 [97:54:00<61:03:25, 14.54s/it]
 60%|██████    | 22847/37963 [97:54:20<68:33:41, 16.33s/it]
 60%|██████    | 22848/37963 [97:54:42<74:59:25, 17.86s/it]
 60%|██████    | 22849/37963 [97:54:56<70:29:12, 16.79s/it]
 60%|██████    | 22850/37963 [97:55:10<66:38:10, 15.87s/it]
                                                           
{'loss': '0.126', 'grad_norm': '2.298', 'learning_rate': '7.223e-06', 'epoch': '0.6019'}

 60%|██████    | 22850/37963 [97:55:10<66:38:10, 15.87s/it]
 60%|██████    | 22851/37963 [97:55:23<63:43:50, 15.18s/it]
 60%|██████    | 22852/37963 [97:55:37<62:15:38, 14.83s/it]
 60%|██████    | 22853/37963 [97:55:52<61:46:13, 14.72s/it]
 60%|██████    | 22854/37963 [97:56:06<61:18:24, 14.61s/it]
 60%|██████    | 22855/37963 [97:56:20<61:04:14, 14.55s/it]
 60%|██████    | 22856/37963 [97:56:35<60:54:02, 14.51s/it]
 60%|██████    | 22857/37963 [97:56:49<60:47:22, 14.49s/it]
 60%|██████    | 22858/37963 [97:57:04<60:47:28, 14.49s/it]
 60%|██████    | 22859/37963 [97:57:18<60:05:16, 14.32s/it]
 60%|██████    | 22860/37963 [97:57:32<59:50:47, 14.27s/it]
                                                           
{'loss': '0.1288', 'grad_norm': '1.972', 'learning_rate': '7.215e-06', 'epoch': '0.6022'}

 60%|██████    | 22860/37963 [97:57:32<59:50:47, 14.27s/it]
 60%|██████    | 22861/37963 [97:57:46<59:55:52, 14.29s/it]
 60%|██████    | 22862/37963 [97:58:00<59:59:02, 14.30s/it]
 60%|██████    | 22863/37963 [97:58:15<60:01:17, 14.31s/it]
 60%|██████    | 22864/37963 [97:58:28<59:03:55, 14.08s/it]
 60%|██████    | 22865/37963 [97:58:42<59:08:49, 14.10s/it]
 60%|██████    | 22866/37963 [97:58:57<59:28:10, 14.18s/it]
 60%|██████    | 22867/37963 [97:59:11<59:47:56, 14.26s/it]
 60%|██████    | 22868/37963 [97:59:32<67:29:39, 16.10s/it]
 60%|██████    | 22869/37963 [97:59:46<65:22:40, 15.59s/it]
 60%|██████    | 22870/37963 [98:00:01<63:53:00, 15.24s/it]
                                                           
{'loss': '0.1196', 'grad_norm': '2.838', 'learning_rate': '7.207e-06', 'epoch': '0.6024'}

 60%|██████    | 22870/37963 [98:00:01<63:53:00, 15.24s/it]
 60%|██████    | 22871/37963 [98:00:28<78:48:24, 18.80s/it]
 60%|██████    | 22872/37963 [98:00:42<73:21:40, 17.50s/it]
 60%|██████    | 22873/37963 [98:00:56<69:13:29, 16.51s/it]
 60%|██████    | 22874/37963 [98:01:17<74:26:24, 17.76s/it]
 60%|██████    | 22875/37963 [98:01:31<69:57:29, 16.69s/it]
 60%|██████    | 22876/37963 [98:01:45<66:43:53, 15.92s/it]
 60%|██████    | 22877/37963 [98:02:00<64:43:09, 15.44s/it]
 60%|██████    | 22878/37963 [98:02:14<63:21:33, 15.12s/it]
 60%|██████    | 22879/37963 [98:02:28<62:14:05, 14.85s/it]
 60%|██████    | 22880/37963 [98:02:43<61:43:25, 14.73s/it]
                                                           
{'loss': '0.1245', 'grad_norm': '2.362', 'learning_rate': '7.199e-06', 'epoch': '0.6027'}

 60%|██████    | 22880/37963 [98:02:43<61:43:25, 14.73s/it]
 60%|██████    | 22881/37963 [98:02:57<61:15:20, 14.62s/it]
 60%|██████    | 22882/37963 [98:03:11<60:54:58, 14.54s/it]
 60%|██████    | 22883/37963 [98:03:25<59:56:34, 14.31s/it]
 60%|██████    | 22884/37963 [98:03:39<59:09:59, 14.13s/it]
 60%|██████    | 22885/37963 [98:03:53<59:24:55, 14.19s/it]
 60%|██████    | 22886/37963 [98:04:07<58:54:41, 14.07s/it]
 60%|██████    | 22887/37963 [98:04:27<66:47:25, 15.95s/it]
 60%|██████    | 22888/37963 [98:04:42<64:54:57, 15.50s/it]
 60%|██████    | 22889/37963 [98:04:56<63:38:28, 15.20s/it]
 60%|██████    | 22890/37963 [98:05:18<71:51:48, 17.16s/it]
                                                           
{'loss': '0.1234', 'grad_norm': '1.229', 'learning_rate': '7.191e-06', 'epoch': '0.603'}

 60%|██████    | 22890/37963 [98:05:18<71:51:48, 17.16s/it]
 60%|██████    | 22891/37963 [98:05:33<68:33:21, 16.37s/it]
 60%|██████    | 22892/37963 [98:05:47<66:05:55, 15.79s/it]
 60%|██████    | 22893/37963 [98:06:01<64:02:44, 15.30s/it]
 60%|██████    | 22894/37963 [98:06:16<62:58:13, 15.04s/it]
 60%|██████    | 22895/37963 [98:06:36<69:07:25, 16.51s/it]
 60%|██████    | 22896/37963 [98:06:50<66:26:50, 15.88s/it]
 60%|██████    | 22897/37963 [98:07:11<72:24:07, 17.30s/it]
 60%|██████    | 22898/37963 [98:07:25<68:41:19, 16.41s/it]
 60%|██████    | 22899/37963 [98:07:39<66:09:26, 15.81s/it]
 60%|██████    | 22900/37963 [98:07:54<64:37:11, 15.44s/it]
                                                           
{'loss': '0.1244', 'grad_norm': '2.242', 'learning_rate': '7.182e-06', 'epoch': '0.6032'}

 60%|██████    | 22900/37963 [98:07:54<64:37:11, 15.44s/it]
 60%|██████    | 22901/37963 [98:08:08<62:55:49, 15.04s/it]
 60%|██████    | 22902/37963 [98:08:22<61:09:27, 14.62s/it]
 60%|██████    | 22903/37963 [98:08:36<60:44:14, 14.52s/it]
 60%|██████    | 22904/37963 [98:08:49<59:31:26, 14.23s/it]
 60%|██████    | 22905/37963 [98:09:04<59:38:00, 14.26s/it]
 60%|██████    | 22906/37963 [98:09:18<59:47:39, 14.30s/it]
 60%|██████    | 22907/37963 [98:09:32<59:46:59, 14.29s/it]
 60%|██████    | 22908/37963 [98:09:47<59:45:47, 14.29s/it]
 60%|██████    | 22909/37963 [98:10:01<59:50:46, 14.31s/it]
 60%|██████    | 22910/37963 [98:10:15<59:55:55, 14.33s/it]
                                                           
{'loss': '0.1312', 'grad_norm': '2.784', 'learning_rate': '7.174e-06', 'epoch': '0.6035'}

 60%|██████    | 22910/37963 [98:10:15<59:55:55, 14.33s/it]
 60%|██████    | 22911/37963 [98:10:30<59:56:26, 14.34s/it]
 60%|██████    | 22912/37963 [98:10:44<60:00:24, 14.35s/it]
 60%|██████    | 22913/37963 [98:10:59<60:06:18, 14.38s/it]
 60%|██████    | 22914/37963 [98:11:13<59:48:16, 14.31s/it]
 60%|██████    | 22915/37963 [98:11:27<59:55:57, 14.34s/it]
 60%|██████    | 22916/37963 [98:11:41<59:39:30, 14.27s/it]
 60%|██████    | 22917/37963 [98:12:02<67:44:15, 16.21s/it]
 60%|██████    | 22918/37963 [98:12:17<65:37:17, 15.70s/it]
 60%|██████    | 22919/37963 [98:12:31<63:54:15, 15.29s/it]
 60%|██████    | 22920/37963 [98:12:45<62:24:33, 14.94s/it]
                                                           
{'loss': '0.1127', 'grad_norm': '1.293', 'learning_rate': '7.166e-06', 'epoch': '0.6037'}

 60%|██████    | 22920/37963 [98:12:45<62:24:33, 14.94s/it]
 60%|██████    | 22921/37963 [98:13:05<69:13:15, 16.57s/it]
 60%|██████    | 22922/37963 [98:13:19<66:09:46, 15.84s/it]
 60%|██████    | 22923/37963 [98:13:40<72:37:11, 17.38s/it]
 60%|██████    | 22924/37963 [98:14:01<76:55:13, 18.41s/it]
 60%|██████    | 22925/37963 [98:14:16<71:46:57, 17.18s/it]
 60%|██████    | 22926/37963 [98:14:30<68:10:36, 16.32s/it]
 60%|██████    | 22927/37963 [98:14:44<65:40:53, 15.73s/it]
 60%|██████    | 22928/37963 [98:14:59<64:18:11, 15.40s/it]
 60%|██████    | 22929/37963 [98:15:13<62:54:34, 15.06s/it]
 60%|██████    | 22930/37963 [98:15:28<62:10:58, 14.89s/it]
                                                           
{'loss': '0.117', 'grad_norm': '1.814', 'learning_rate': '7.158e-06', 'epoch': '0.604'}

 60%|██████    | 22930/37963 [98:15:28<62:10:58, 14.89s/it]
 60%|██████    | 22931/37963 [98:15:42<61:26:19, 14.71s/it]
 60%|██████    | 22932/37963 [98:15:56<61:05:11, 14.63s/it]
 60%|██████    | 22933/37963 [98:16:11<60:40:30, 14.53s/it]
 60%|██████    | 22934/37963 [98:16:25<60:25:16, 14.47s/it]
 60%|██████    | 22935/37963 [98:16:39<60:11:25, 14.42s/it]
 60%|██████    | 22936/37963 [98:17:00<67:51:45, 16.26s/it]
 60%|██████    | 22937/37963 [98:17:14<65:29:57, 15.69s/it]
 60%|██████    | 22938/37963 [98:17:36<72:27:01, 17.36s/it]
 60%|██████    | 22939/37963 [98:17:50<68:16:40, 16.36s/it]
 60%|██████    | 22940/37963 [98:18:04<65:46:25, 15.76s/it]
                                                           
{'loss': '0.1222', 'grad_norm': '2.944', 'learning_rate': '7.15e-06', 'epoch': '0.6043'}

 60%|██████    | 22940/37963 [98:18:04<65:46:25, 15.76s/it]
 60%|██████    | 22941/37963 [98:18:18<64:08:32, 15.37s/it]
 60%|██████    | 22942/37963 [98:18:33<62:55:46, 15.08s/it]
 60%|██████    | 22943/37963 [98:18:47<61:41:29, 14.79s/it]
 60%|██████    | 22944/37963 [98:19:07<68:02:37, 16.31s/it]
 60%|██████    | 22945/37963 [98:19:21<65:38:28, 15.74s/it]
 60%|██████    | 22946/37963 [98:19:35<63:32:12, 15.23s/it]
 60%|██████    | 22947/37963 [98:19:56<71:06:32, 17.05s/it]
 60%|██████    | 22948/37963 [98:20:11<67:41:54, 16.23s/it]
 60%|██████    | 22949/37963 [98:20:25<64:40:56, 15.51s/it]
 60%|██████    | 22950/37963 [98:20:39<63:07:11, 15.14s/it]
                                                           
{'loss': '0.1212', 'grad_norm': '1.646', 'learning_rate': '7.141e-06', 'epoch': '0.6045'}

 60%|██████    | 22950/37963 [98:20:39<63:07:11, 15.14s/it]
 60%|██████    | 22951/37963 [98:20:53<62:06:12, 14.89s/it]
 60%|██████    | 22952/37963 [98:21:08<61:24:39, 14.73s/it]
 60%|██████    | 22953/37963 [98:21:22<60:39:31, 14.55s/it]
 60%|██████    | 22954/37963 [98:21:36<60:33:49, 14.53s/it]
 60%|██████    | 22955/37963 [98:21:51<60:28:20, 14.51s/it]
 60%|██████    | 22956/37963 [98:22:04<59:35:54, 14.30s/it]
 60%|██████    | 22957/37963 [98:22:19<59:37:15, 14.30s/it]
 60%|██████    | 22958/37963 [98:22:33<59:38:43, 14.31s/it]
 60%|██████    | 22959/37963 [98:22:47<59:16:25, 14.22s/it]
 60%|██████    | 22960/37963 [98:23:01<59:26:30, 14.26s/it]
                                                           
{'loss': '0.1349', 'grad_norm': '2.036', 'learning_rate': '7.133e-06', 'epoch': '0.6048'}

 60%|██████    | 22960/37963 [98:23:01<59:26:30, 14.26s/it]
 60%|██████    | 22961/37963 [98:23:16<59:38:20, 14.31s/it]
 60%|██████    | 22962/37963 [98:23:30<59:45:46, 14.34s/it]
 60%|██████    | 22963/37963 [98:23:45<59:47:27, 14.35s/it]
 60%|██████    | 22964/37963 [98:24:05<67:09:48, 16.12s/it]
 60%|██████    | 22965/37963 [98:24:19<65:05:15, 15.62s/it]
 60%|██████    | 22966/37963 [98:24:34<63:42:51, 15.29s/it]
 60%|██████    | 22967/37963 [98:24:48<62:37:40, 15.03s/it]
 61%|██████    | 22968/37963 [98:25:03<61:39:18, 14.80s/it]
 61%|██████    | 22969/37963 [98:25:17<60:39:43, 14.56s/it]
 61%|██████    | 22970/37963 [98:25:31<60:21:43, 14.49s/it]
                                                           
{'loss': '0.1226', 'grad_norm': '4.745', 'learning_rate': '7.125e-06', 'epoch': '0.6051'}

 61%|██████    | 22970/37963 [98:25:31<60:21:43, 14.49s/it]
 61%|██████    | 22971/37963 [98:25:52<68:56:25, 16.55s/it]
 61%|██████    | 22972/37963 [98:26:13<74:31:01, 17.89s/it]
 61%|██████    | 22973/37963 [98:26:28<70:06:48, 16.84s/it]
 61%|██████    | 22974/37963 [98:26:49<75:28:15, 18.13s/it]
 61%|██████    | 22975/37963 [98:27:03<70:44:40, 16.99s/it]
 61%|██████    | 22976/37963 [98:27:17<67:22:41, 16.18s/it]
 61%|██████    | 22977/37963 [98:27:32<65:03:20, 15.63s/it]
 61%|██████    | 22978/37963 [98:27:46<63:25:26, 15.24s/it]
 61%|██████    | 22979/37963 [98:28:00<62:08:20, 14.93s/it]
 61%|██████    | 22980/37963 [98:28:14<60:40:02, 14.58s/it]
                                                           
{'loss': '0.1382', 'grad_norm': '2.348', 'learning_rate': '7.117e-06', 'epoch': '0.6053'}

 61%|██████    | 22980/37963 [98:28:14<60:40:02, 14.58s/it]
 61%|██████    | 22981/37963 [98:28:28<60:25:02, 14.52s/it]
 61%|██████    | 22982/37963 [98:28:43<60:10:06, 14.46s/it]
 61%|██████    | 22983/37963 [98:28:57<59:56:31, 14.41s/it]
 61%|██████    | 22984/37963 [98:29:12<60:06:31, 14.45s/it]
 61%|██████    | 22985/37963 [98:29:33<68:29:38, 16.46s/it]
 61%|██████    | 22986/37963 [98:29:47<66:00:17, 15.87s/it]
 61%|██████    | 22987/37963 [98:30:02<64:08:22, 15.42s/it]
 61%|██████    | 22988/37963 [98:30:23<71:23:21, 17.16s/it]
 61%|██████    | 22989/37963 [98:30:37<67:49:30, 16.31s/it]
 61%|██████    | 22990/37963 [98:30:58<72:54:06, 17.53s/it]
                                                           
{'loss': '0.1235', 'grad_norm': '2.05', 'learning_rate': '7.109e-06', 'epoch': '0.6056'}

 61%|██████    | 22990/37963 [98:30:58<72:54:06, 17.53s/it]
 61%|██████    | 22991/37963 [98:31:12<69:01:31, 16.60s/it]
 61%|██████    | 22992/37963 [98:31:26<66:06:39, 15.90s/it]
 61%|██████    | 22993/37963 [98:31:40<63:56:51, 15.38s/it]
 61%|██████    | 22994/37963 [98:31:55<62:36:32, 15.06s/it]
 61%|██████    | 22995/37963 [98:32:16<70:20:58, 16.92s/it]
 61%|██████    | 22996/37963 [98:32:30<66:42:37, 16.05s/it]
 61%|██████    | 22997/37963 [98:32:44<64:15:53, 15.46s/it]
 61%|██████    | 22998/37963 [98:32:58<62:54:12, 15.13s/it]
 61%|██████    | 22999/37963 [98:33:13<61:49:19, 14.87s/it]
 61%|██████    | 23000/37963 [98:33:27<60:59:03, 14.67s/it]
                                                           
{'loss': '0.1194', 'grad_norm': '0.9066', 'learning_rate': '7.101e-06', 'epoch': '0.6059'}

 61%|██████    | 23000/37963 [98:33:27<60:59:03, 14.67s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.11s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.11s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 61%|██████    | 23001/37963 [98:35:10<171:48:20, 41.34s/it]
 61%|██████    | 23002/37963 [98:35:25<137:45:50, 33.15s/it]
 61%|██████    | 23003/37963 [98:35:41<116:25:07, 28.02s/it]
 61%|██████    | 23004/37963 [98:35:55<99:31:46, 23.95s/it] 
 61%|██████    | 23005/37963 [98:36:09<87:39:52, 21.10s/it]
 61%|██████    | 23006/37963 [98:36:24<79:23:57, 19.11s/it]
 61%|██████    | 23007/37963 [98:36:38<73:37:45, 17.72s/it]
 61%|██████    | 23008/37963 [98:36:53<69:27:24, 16.72s/it]
 61%|██████    | 23009/37963 [98:37:07<65:44:33, 15.83s/it]
 61%|██████    | 23010/37963 [98:37:21<63:54:45, 15.39s/it]
                                                           
{'loss': '0.1248', 'grad_norm': '2.412', 'learning_rate': '7.092e-06', 'epoch': '0.6061'}

 61%|██████    | 23010/37963 [98:37:21<63:54:45, 15.39s/it]
 61%|██████    | 23011/37963 [98:37:42<70:53:29, 17.07s/it]
 61%|██████    | 23012/37963 [98:37:56<67:33:13, 16.27s/it]
 61%|██████    | 23013/37963 [98:38:11<65:11:40, 15.70s/it]
 61%|██████    | 23014/37963 [98:38:25<63:33:57, 15.31s/it]
 61%|██████    | 23015/37963 [98:38:39<62:20:28, 15.01s/it]
 61%|██████    | 23016/37963 [98:38:54<61:23:19, 14.79s/it]
 61%|██████    | 23017/37963 [98:39:14<68:49:26, 16.58s/it]
 61%|██████    | 23018/37963 [98:39:29<66:15:55, 15.96s/it]
 61%|██████    | 23019/37963 [98:39:43<64:14:52, 15.48s/it]
 61%|██████    | 23020/37963 [98:40:04<71:08:17, 17.14s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '2.261', 'learning_rate': '7.084e-06', 'epoch': '0.6064'}

 61%|██████    | 23020/37963 [98:40:04<71:08:17, 17.14s/it]
 61%|██████    | 23021/37963 [98:40:18<67:02:20, 16.15s/it]
 61%|██████    | 23022/37963 [98:40:39<72:28:51, 17.46s/it]
 61%|██████    | 23023/37963 [98:40:53<68:33:35, 16.52s/it]
 61%|██████    | 23024/37963 [98:41:07<65:48:29, 15.86s/it]
 61%|██████    | 23025/37963 [98:41:21<63:44:58, 15.36s/it]
 61%|██████    | 23026/37963 [98:41:36<62:33:54, 15.08s/it]
 61%|██████    | 23027/37963 [98:41:50<61:40:12, 14.86s/it]
 61%|██████    | 23028/37963 [98:42:05<61:06:33, 14.73s/it]
 61%|██████    | 23029/37963 [98:42:19<60:36:17, 14.61s/it]
 61%|██████    | 23030/37963 [98:42:33<60:16:54, 14.53s/it]
                                                           
{'loss': '0.1234', 'grad_norm': '2.282', 'learning_rate': '7.076e-06', 'epoch': '0.6066'}

 61%|██████    | 23030/37963 [98:42:33<60:16:54, 14.53s/it]
 61%|██████    | 23031/37963 [98:42:48<60:06:36, 14.49s/it]
 61%|██████    | 23032/37963 [98:43:02<59:47:34, 14.42s/it]
 61%|██████    | 23033/37963 [98:43:23<68:25:35, 16.50s/it]
 61%|██████    | 23034/37963 [98:43:38<65:43:19, 15.85s/it]
 61%|██████    | 23035/37963 [98:43:51<63:06:13, 15.22s/it]
 61%|██████    | 23036/37963 [98:44:06<62:07:15, 14.98s/it]
 61%|██████    | 23037/37963 [98:44:27<69:43:59, 16.82s/it]
 61%|██████    | 23038/37963 [98:44:41<66:29:40, 16.04s/it]
 61%|██████    | 23039/37963 [98:45:02<72:29:14, 17.49s/it]
 61%|██████    | 23040/37963 [98:45:16<68:32:47, 16.54s/it]
                                                           
{'loss': '0.124', 'grad_norm': '2.652', 'learning_rate': '7.068e-06', 'epoch': '0.6069'}

 61%|██████    | 23040/37963 [98:45:16<68:32:47, 16.54s/it]
 61%|██████    | 23041/37963 [98:45:31<66:01:11, 15.93s/it]
 61%|██████    | 23042/37963 [98:45:52<72:15:53, 17.44s/it]
 61%|██████    | 23043/37963 [98:46:06<68:23:34, 16.50s/it]
 61%|██████    | 23044/37963 [98:46:21<66:03:05, 15.94s/it]
 61%|██████    | 23045/37963 [98:46:35<63:23:10, 15.30s/it]
 61%|██████    | 23046/37963 [98:46:49<62:06:56, 14.99s/it]
 61%|██████    | 23047/37963 [98:47:03<61:15:59, 14.79s/it]
 61%|██████    | 23048/37963 [98:47:17<60:38:54, 14.64s/it]
 61%|██████    | 23049/37963 [98:47:32<60:17:28, 14.55s/it]
 61%|██████    | 23050/37963 [98:47:46<59:58:38, 14.48s/it]
                                                           
{'loss': '0.1333', 'grad_norm': '3.541', 'learning_rate': '7.06e-06', 'epoch': '0.6072'}

 61%|██████    | 23050/37963 [98:47:46<59:58:38, 14.48s/it]
 61%|██████    | 23051/37963 [98:48:00<59:07:59, 14.28s/it]
 61%|██████    | 23052/37963 [98:48:14<59:22:05, 14.33s/it]
 61%|██████    | 23053/37963 [98:48:29<59:30:20, 14.37s/it]
 61%|██████    | 23054/37963 [98:48:43<59:09:19, 14.28s/it]
 61%|██████    | 23055/37963 [98:48:56<58:13:02, 14.06s/it]
 61%|██████    | 23056/37963 [98:49:11<58:37:03, 14.16s/it]
 61%|██████    | 23057/37963 [98:49:25<58:52:08, 14.22s/it]
 61%|██████    | 23058/37963 [98:49:39<58:16:17, 14.07s/it]
 61%|██████    | 23059/37963 [98:50:00<66:27:27, 16.05s/it]
 61%|██████    | 23060/37963 [98:50:14<64:17:50, 15.53s/it]
                                                           
{'loss': '0.1319', 'grad_norm': '2.169', 'learning_rate': '7.052e-06', 'epoch': '0.6074'}

 61%|██████    | 23060/37963 [98:50:14<64:17:50, 15.53s/it]
 61%|██████    | 23061/37963 [98:50:28<62:18:37, 15.05s/it]
 61%|██████    | 23062/37963 [98:50:42<61:25:23, 14.84s/it]
 61%|██████    | 23063/37963 [98:50:57<60:49:08, 14.69s/it]
 61%|██████    | 23064/37963 [98:51:11<60:25:01, 14.60s/it]
 61%|██████    | 23065/37963 [98:51:25<59:29:11, 14.37s/it]
 61%|██████    | 23066/37963 [98:51:39<59:26:21, 14.36s/it]
 61%|██████    | 23067/37963 [98:52:00<67:17:01, 16.26s/it]
 61%|██████    | 23068/37963 [98:52:14<64:48:51, 15.67s/it]
 61%|██████    | 23069/37963 [98:52:28<62:14:23, 15.04s/it]
 61%|██████    | 23070/37963 [98:52:49<69:26:13, 16.78s/it]
                                                           
{'loss': '0.1231', 'grad_norm': '1.065', 'learning_rate': '7.044e-06', 'epoch': '0.6077'}

 61%|██████    | 23070/37963 [98:52:49<69:26:13, 16.78s/it]
 61%|██████    | 23071/37963 [98:53:02<65:43:26, 15.89s/it]
 61%|██████    | 23072/37963 [98:53:23<71:26:29, 17.27s/it]
 61%|██████    | 23073/37963 [98:53:37<67:51:52, 16.41s/it]
 61%|██████    | 23074/37963 [98:53:52<65:15:53, 15.78s/it]
 61%|██████    | 23075/37963 [98:54:06<63:42:15, 15.40s/it]
 61%|██████    | 23076/37963 [98:54:21<62:33:53, 15.13s/it]
 61%|██████    | 23077/37963 [98:54:35<61:34:28, 14.89s/it]
 61%|██████    | 23078/37963 [98:54:49<61:01:32, 14.76s/it]
 61%|██████    | 23079/37963 [98:55:04<60:42:15, 14.68s/it]
 61%|██████    | 23080/37963 [98:55:18<60:12:57, 14.57s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '1.236', 'learning_rate': '7.035e-06', 'epoch': '0.608'}

 61%|██████    | 23080/37963 [98:55:18<60:12:57, 14.57s/it]
 61%|██████    | 23081/37963 [98:55:32<59:54:27, 14.49s/it]
 61%|██████    | 23082/37963 [98:55:47<59:24:29, 14.37s/it]
 61%|██████    | 23083/37963 [98:56:07<67:09:45, 16.25s/it]
 61%|██████    | 23084/37963 [98:56:22<64:51:09, 15.69s/it]
 61%|██████    | 23085/37963 [98:56:43<71:32:44, 17.31s/it]
 61%|██████    | 23086/37963 [98:56:57<67:48:51, 16.41s/it]
 61%|██████    | 23087/37963 [98:57:17<72:47:57, 17.62s/it]
 61%|██████    | 23088/37963 [98:57:32<68:44:39, 16.64s/it]
 61%|██████    | 23089/37963 [98:57:46<65:54:30, 15.95s/it]
 61%|██████    | 23090/37963 [98:58:08<72:41:42, 17.60s/it]
                                                           
{'loss': '0.1239', 'grad_norm': '4.332', 'learning_rate': '7.027e-06', 'epoch': '0.6082'}

 61%|██████    | 23090/37963 [98:58:08<72:41:42, 17.60s/it]
 61%|██████    | 23091/37963 [98:58:22<68:20:55, 16.54s/it]
 61%|██████    | 23092/37963 [98:58:36<65:50:49, 15.94s/it]
 61%|██████    | 23093/37963 [98:58:50<63:31:01, 15.38s/it]
 61%|██████    | 23094/37963 [98:59:04<62:04:13, 15.03s/it]
 61%|██████    | 23095/37963 [98:59:19<61:00:26, 14.77s/it]
 61%|██████    | 23096/37963 [98:59:33<60:36:40, 14.68s/it]
 61%|██████    | 23097/37963 [98:59:47<60:09:22, 14.57s/it]
 61%|██████    | 23098/37963 [99:00:01<59:35:21, 14.43s/it]
 61%|██████    | 23099/37963 [99:00:16<59:24:37, 14.39s/it]
 61%|██████    | 23100/37963 [99:00:30<58:58:02, 14.28s/it]
                                                           
{'loss': '0.1301', 'grad_norm': '1.568', 'learning_rate': '7.019e-06', 'epoch': '0.6085'}

 61%|██████    | 23100/37963 [99:00:30<58:58:02, 14.28s/it]
 61%|██████    | 23101/37963 [99:00:44<59:00:42, 14.29s/it]
 61%|██████    | 23102/37963 [99:00:58<59:04:29, 14.31s/it]
 61%|██████    | 23103/37963 [99:01:13<59:07:18, 14.32s/it]
 61%|██████    | 23104/37963 [99:01:27<59:10:35, 14.34s/it]
 61%|██████    | 23105/37963 [99:01:41<58:53:44, 14.27s/it]
 61%|██████    | 23106/37963 [99:02:02<66:55:51, 16.22s/it]
 61%|██████    | 23107/37963 [99:02:16<64:32:03, 15.64s/it]
 61%|██████    | 23108/37963 [99:02:31<62:58:36, 15.26s/it]
 61%|██████    | 23109/37963 [99:02:45<61:43:41, 14.96s/it]
 61%|██████    | 23110/37963 [99:02:59<60:55:05, 14.77s/it]
                                                           
{'loss': '0.1275', 'grad_norm': '1.399', 'learning_rate': '7.011e-06', 'epoch': '0.6088'}

 61%|██████    | 23110/37963 [99:02:59<60:55:05, 14.77s/it]
 61%|██████    | 23111/37963 [99:03:14<60:19:31, 14.62s/it]
 61%|██████    | 23112/37963 [99:03:28<59:46:03, 14.49s/it]
 61%|██████    | 23113/37963 [99:03:42<59:33:40, 14.44s/it]
 61%|██████    | 23114/37963 [99:03:56<59:12:05, 14.35s/it]
 61%|██████    | 23115/37963 [99:04:17<66:48:37, 16.20s/it]
 61%|██████    | 23116/37963 [99:04:31<64:17:42, 15.59s/it]
 61%|██████    | 23117/37963 [99:04:45<62:18:43, 15.11s/it]
 61%|██████    | 23118/37963 [99:04:59<61:17:17, 14.86s/it]
 61%|██████    | 23119/37963 [99:05:14<60:39:30, 14.71s/it]
 61%|██████    | 23120/37963 [99:05:35<68:42:28, 16.66s/it]
                                                           
{'loss': '0.1162', 'grad_norm': '1.294', 'learning_rate': '7.003e-06', 'epoch': '0.609'}

 61%|██████    | 23120/37963 [99:05:35<68:42:28, 16.66s/it]
 61%|██████    | 23121/37963 [99:05:56<73:54:17, 17.93s/it]
 61%|██████    | 23122/37963 [99:06:10<69:32:05, 16.87s/it]
 61%|██████    | 23123/37963 [99:06:24<66:11:54, 16.06s/it]
 61%|██████    | 23124/37963 [99:06:39<64:12:19, 15.58s/it]
 61%|██████    | 23125/37963 [99:06:53<62:40:55, 15.21s/it]
 61%|██████    | 23126/37963 [99:07:07<61:37:08, 14.95s/it]
 61%|██████    | 23127/37963 [99:07:22<60:48:24, 14.75s/it]
 61%|██████    | 23128/37963 [99:07:36<60:03:22, 14.57s/it]
 61%|██████    | 23129/37963 [99:07:50<59:44:00, 14.50s/it]
 61%|██████    | 23130/37963 [99:08:04<59:30:50, 14.44s/it]
                                                           
{'loss': '0.1274', 'grad_norm': '1.859', 'learning_rate': '6.995e-06', 'epoch': '0.6093'}

 61%|██████    | 23130/37963 [99:08:04<59:30:50, 14.44s/it]
 61%|██████    | 23131/37963 [99:08:25<67:16:29, 16.33s/it]
 61%|██████    | 23132/37963 [99:08:40<65:00:05, 15.78s/it]
 61%|██████    | 23133/37963 [99:08:54<63:21:45, 15.38s/it]
 61%|██████    | 23134/37963 [99:09:16<71:34:06, 17.37s/it]
 61%|██████    | 23135/37963 [99:09:31<67:49:49, 16.47s/it]
 61%|██████    | 23136/37963 [99:09:45<64:58:05, 15.77s/it]
 61%|██████    | 23137/37963 [99:10:04<69:57:39, 16.99s/it]
 61%|██████    | 23138/37963 [99:10:26<75:12:46, 18.26s/it]
 61%|██████    | 23139/37963 [99:10:40<69:59:46, 17.00s/it]
 61%|██████    | 23140/37963 [99:10:54<66:33:52, 16.17s/it]
                                                           
{'loss': '0.1355', 'grad_norm': '2.419', 'learning_rate': '6.987e-06', 'epoch': '0.6095'}

 61%|██████    | 23140/37963 [99:10:54<66:33:52, 16.17s/it]
 61%|██████    | 23141/37963 [99:11:08<63:51:14, 15.51s/it]
 61%|██████    | 23142/37963 [99:11:22<62:34:27, 15.20s/it]
 61%|██████    | 23143/37963 [99:11:37<61:30:13, 14.94s/it]
 61%|██████    | 23144/37963 [99:11:52<61:20:47, 14.90s/it]
 61%|██████    | 23145/37963 [99:12:06<60:31:17, 14.70s/it]
 61%|██████    | 23146/37963 [99:12:20<59:49:58, 14.54s/it]
 61%|██████    | 23147/37963 [99:12:34<59:20:45, 14.42s/it]
 61%|██████    | 23148/37963 [99:12:48<59:13:38, 14.39s/it]
 61%|██████    | 23149/37963 [99:13:03<59:15:59, 14.40s/it]
 61%|██████    | 23150/37963 [99:13:17<59:20:43, 14.42s/it]
                                                           
{'loss': '0.1411', 'grad_norm': '1.997', 'learning_rate': '6.978e-06', 'epoch': '0.6098'}

 61%|██████    | 23150/37963 [99:13:17<59:20:43, 14.42s/it]
 61%|██████    | 23151/37963 [99:13:32<59:13:09, 14.39s/it]
 61%|██████    | 23152/37963 [99:13:46<58:57:23, 14.33s/it]
 61%|██████    | 23153/37963 [99:14:07<66:50:28, 16.25s/it]
 61%|██████    | 23154/37963 [99:14:21<64:40:17, 15.72s/it]
 61%|██████    | 23155/37963 [99:14:35<62:05:29, 15.10s/it]
 61%|██████    | 23156/37963 [99:14:49<61:10:01, 14.87s/it]
 61%|██████    | 23157/37963 [99:15:04<60:49:46, 14.79s/it]
 61%|██████    | 23158/37963 [99:15:17<59:25:59, 14.45s/it]
 61%|██████    | 23159/37963 [99:15:32<59:21:57, 14.44s/it]
 61%|██████    | 23160/37963 [99:15:46<58:51:40, 14.31s/it]
                                                           
{'loss': '0.1321', 'grad_norm': '3.536', 'learning_rate': '6.97e-06', 'epoch': '0.6101'}

 61%|██████    | 23160/37963 [99:15:46<58:51:40, 14.31s/it]
 61%|██████    | 23161/37963 [99:16:00<58:52:53, 14.32s/it]
 61%|██████    | 23162/37963 [99:16:14<58:57:11, 14.34s/it]
 61%|██████    | 23163/37963 [99:16:35<66:42:40, 16.23s/it]
 61%|██████    | 23164/37963 [99:16:50<64:29:52, 15.69s/it]
 61%|██████    | 23165/37963 [99:17:04<62:49:41, 15.28s/it]
 61%|██████    | 23166/37963 [99:17:18<61:50:03, 15.04s/it]
 61%|██████    | 23167/37963 [99:17:33<60:56:36, 14.83s/it]
 61%|██████    | 23168/37963 [99:17:47<59:57:34, 14.59s/it]
 61%|██████    | 23169/37963 [99:18:14<76:04:37, 18.51s/it]
 61%|██████    | 23170/37963 [99:18:28<70:05:46, 17.06s/it]
                                                           
{'loss': '0.1218', 'grad_norm': '2.482', 'learning_rate': '6.962e-06', 'epoch': '0.6103'}

 61%|██████    | 23170/37963 [99:18:28<70:05:46, 17.06s/it]
 61%|██████    | 23171/37963 [99:18:42<66:33:21, 16.20s/it]
 61%|██████    | 23172/37963 [99:18:56<63:36:35, 15.48s/it]
 61%|██████    | 23173/37963 [99:19:10<62:14:47, 15.15s/it]
 61%|██████    | 23174/37963 [99:19:25<61:24:36, 14.95s/it]
 61%|██████    | 23175/37963 [99:19:39<60:22:36, 14.70s/it]
 61%|██████    | 23176/37963 [99:19:53<59:08:26, 14.40s/it]
 61%|██████    | 23177/37963 [99:20:07<59:05:50, 14.39s/it]
 61%|██████    | 23178/37963 [99:20:21<58:55:00, 14.35s/it]
 61%|██████    | 23179/37963 [99:20:42<66:57:26, 16.30s/it]
 61%|██████    | 23180/37963 [99:20:57<64:43:42, 15.76s/it]
                                                           
{'loss': '0.1193', 'grad_norm': '1.339', 'learning_rate': '6.954e-06', 'epoch': '0.6106'}

 61%|██████    | 23180/37963 [99:20:57<64:43:42, 15.76s/it]
 61%|██████    | 23181/37963 [99:21:11<62:59:36, 15.34s/it]
 61%|██████    | 23182/37963 [99:21:32<70:02:26, 17.06s/it]
 61%|██████    | 23183/37963 [99:21:47<66:46:12, 16.26s/it]
 61%|██████    | 23184/37963 [99:22:01<64:33:16, 15.72s/it]
 61%|██████    | 23185/37963 [99:22:15<62:52:02, 15.31s/it]
 61%|██████    | 23186/37963 [99:22:30<61:41:58, 15.03s/it]
 61%|██████    | 23187/37963 [99:22:44<60:55:52, 14.85s/it]
 61%|██████    | 23188/37963 [99:23:05<68:04:22, 16.59s/it]
 61%|██████    | 23189/37963 [99:23:26<73:47:46, 17.98s/it]
 61%|██████    | 23190/37963 [99:23:40<68:49:16, 16.77s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '2.85', 'learning_rate': '6.946e-06', 'epoch': '0.6109'}

 61%|██████    | 23190/37963 [99:23:40<68:49:16, 16.77s/it]
 61%|██████    | 23191/37963 [99:23:54<66:01:15, 16.09s/it]
 61%|██████    | 23192/37963 [99:24:09<63:50:21, 15.56s/it]
 61%|██████    | 23193/37963 [99:24:23<62:23:41, 15.21s/it]
 61%|██████    | 23194/37963 [99:24:37<61:15:42, 14.93s/it]
 61%|██████    | 23195/37963 [99:24:52<60:46:03, 14.81s/it]
 61%|██████    | 23196/37963 [99:25:06<60:10:52, 14.67s/it]
 61%|██████    | 23197/37963 [99:25:20<59:16:55, 14.45s/it]
 61%|██████    | 23198/37963 [99:25:34<58:46:04, 14.33s/it]
 61%|██████    | 23199/37963 [99:25:49<58:57:04, 14.37s/it]
 61%|██████    | 23200/37963 [99:26:03<59:09:14, 14.42s/it]
                                                           
{'loss': '0.1356', 'grad_norm': '1.347', 'learning_rate': '6.938e-06', 'epoch': '0.6111'}

 61%|██████    | 23200/37963 [99:26:03<59:09:14, 14.42s/it]
 61%|██████    | 23201/37963 [99:26:23<65:51:11, 16.06s/it]
 61%|██████    | 23202/37963 [99:26:38<63:47:15, 15.56s/it]
 61%|██████    | 23203/37963 [99:26:52<62:16:34, 15.19s/it]
 61%|██████    | 23204/37963 [99:27:06<61:22:48, 14.97s/it]
 61%|██████    | 23205/37963 [99:27:21<60:41:16, 14.80s/it]
 61%|██████    | 23206/37963 [99:27:35<60:07:51, 14.67s/it]
 61%|██████    | 23207/37963 [99:27:50<59:47:18, 14.59s/it]
 61%|██████    | 23208/37963 [99:28:03<58:28:37, 14.27s/it]
 61%|██████    | 23209/37963 [99:28:18<58:46:07, 14.34s/it]
 61%|██████    | 23210/37963 [99:28:32<58:41:02, 14.32s/it]
                                                           
{'loss': '0.1317', 'grad_norm': '2.569', 'learning_rate': '6.93e-06', 'epoch': '0.6114'}

 61%|██████    | 23210/37963 [99:28:32<58:41:02, 14.32s/it]
 61%|██████    | 23211/37963 [99:28:52<66:16:43, 16.17s/it]
 61%|██████    | 23212/37963 [99:29:07<63:59:38, 15.62s/it]
 61%|██████    | 23213/37963 [99:29:21<62:23:25, 15.23s/it]
 61%|██████    | 23214/37963 [99:29:35<61:11:22, 14.94s/it]
 61%|██████    | 23215/37963 [99:29:50<60:33:36, 14.78s/it]
 61%|██████    | 23216/37963 [99:30:03<59:19:14, 14.48s/it]
 61%|██████    | 23217/37963 [99:30:30<74:32:37, 18.20s/it]
 61%|██████    | 23218/37963 [99:30:45<69:50:41, 17.05s/it]
 61%|██████    | 23219/37963 [99:30:59<66:28:50, 16.23s/it]
 61%|██████    | 23220/37963 [99:31:13<64:11:03, 15.67s/it]
                                                           
{'loss': '0.1326', 'grad_norm': '2.565', 'learning_rate': '6.922e-06', 'epoch': '0.6117'}

 61%|██████    | 23220/37963 [99:31:13<64:11:03, 15.67s/it]
 61%|██████    | 23221/37963 [99:31:28<62:41:36, 15.31s/it]
 61%|██████    | 23222/37963 [99:31:42<61:30:57, 15.02s/it]
 61%|██████    | 23223/37963 [99:31:57<60:42:21, 14.83s/it]
 61%|██████    | 23224/37963 [99:32:11<60:10:00, 14.70s/it]
 61%|██████    | 23225/37963 [99:32:25<59:42:43, 14.59s/it]
 61%|██████    | 23226/37963 [99:32:40<59:29:54, 14.53s/it]
 61%|██████    | 23227/37963 [99:32:54<58:39:51, 14.33s/it]
 61%|██████    | 23228/37963 [99:33:14<66:36:41, 16.27s/it]
 61%|██████    | 23229/37963 [99:33:29<64:16:10, 15.70s/it]
 61%|██████    | 23230/37963 [99:33:50<71:00:51, 17.35s/it]
                                                           
{'loss': '0.1317', 'grad_norm': '2.881', 'learning_rate': '6.913e-06', 'epoch': '0.6119'}

 61%|██████    | 23230/37963 [99:33:50<71:00:51, 17.35s/it]
 61%|██████    | 23231/37963 [99:34:04<67:18:17, 16.45s/it]
 61%|██████    | 23232/37963 [99:34:19<64:52:21, 15.85s/it]
 61%|██████    | 23233/37963 [99:34:33<62:52:34, 15.37s/it]
 61%|██████    | 23234/37963 [99:34:47<61:42:51, 15.08s/it]
 61%|██████    | 23235/37963 [99:35:01<59:55:19, 14.65s/it]
 61%|██████    | 23236/37963 [99:35:15<59:33:08, 14.56s/it]
 61%|██████    | 23237/37963 [99:35:36<66:25:39, 16.24s/it]
 61%|██████    | 23238/37963 [99:35:57<72:21:35, 17.69s/it]
 61%|██████    | 23239/37963 [99:36:11<68:22:01, 16.72s/it]
 61%|██████    | 23240/37963 [99:36:25<65:25:50, 16.00s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '1.82', 'learning_rate': '6.905e-06', 'epoch': '0.6122'}

 61%|██████    | 23240/37963 [99:36:25<65:25:50, 16.00s/it]
 61%|██████    | 23241/37963 [99:36:39<62:35:40, 15.31s/it]
 61%|██████    | 23242/37963 [99:36:53<61:26:35, 15.03s/it]
 61%|██████    | 23243/37963 [99:37:08<60:34:44, 14.82s/it]
 61%|██████    | 23244/37963 [99:37:22<60:01:08, 14.68s/it]
 61%|██████    | 23245/37963 [99:37:37<59:36:28, 14.58s/it]
 61%|██████    | 23246/37963 [99:37:51<59:32:13, 14.56s/it]
 61%|██████    | 23247/37963 [99:38:05<59:13:49, 14.49s/it]
 61%|██████    | 23248/37963 [99:38:20<58:56:34, 14.42s/it]
 61%|██████    | 23249/37963 [99:38:34<58:58:48, 14.43s/it]
 61%|██████    | 23250/37963 [99:38:48<58:05:37, 14.21s/it]
                                                           
{'loss': '0.1198', 'grad_norm': '3.048', 'learning_rate': '6.897e-06', 'epoch': '0.6124'}

 61%|██████    | 23250/37963 [99:38:48<58:05:37, 14.21s/it]
 61%|██████    | 23251/37963 [99:39:09<66:31:20, 16.28s/it]
 61%|██████    | 23252/37963 [99:39:23<63:51:10, 15.63s/it]
 61%|██████▏   | 23253/37963 [99:39:37<61:37:24, 15.08s/it]
 61%|██████▏   | 23254/37963 [99:39:51<60:48:02, 14.88s/it]
 61%|██████▏   | 23255/37963 [99:40:05<59:39:01, 14.60s/it]
 61%|██████▏   | 23256/37963 [99:40:19<58:53:04, 14.41s/it]
 61%|██████▏   | 23257/37963 [99:40:34<58:52:00, 14.41s/it]
 61%|██████▏   | 23258/37963 [99:40:48<58:21:06, 14.29s/it]
 61%|██████▏   | 23259/37963 [99:41:02<58:25:05, 14.30s/it]
 61%|██████▏   | 23260/37963 [99:41:16<58:26:58, 14.31s/it]
                                                           
{'loss': '0.1284', 'grad_norm': '2.281', 'learning_rate': '6.889e-06', 'epoch': '0.6127'}

 61%|██████▏   | 23260/37963 [99:41:16<58:26:58, 14.31s/it]
 61%|██████▏   | 23261/37963 [99:41:37<66:52:43, 16.38s/it]
 61%|██████▏   | 23262/37963 [99:41:52<64:11:18, 15.72s/it]
 61%|██████▏   | 23263/37963 [99:42:06<62:27:47, 15.30s/it]
 61%|██████▏   | 23264/37963 [99:42:20<61:19:11, 15.02s/it]
 61%|██████▏   | 23265/37963 [99:42:35<60:27:19, 14.81s/it]
 61%|██████▏   | 23266/37963 [99:42:48<59:02:37, 14.46s/it]
 61%|██████▏   | 23267/37963 [99:43:02<58:32:52, 14.34s/it]
 61%|██████▏   | 23268/37963 [99:43:30<75:14:56, 18.43s/it]
 61%|██████▏   | 23269/37963 [99:43:44<69:46:11, 17.09s/it]
 61%|██████▏   | 23270/37963 [99:43:59<66:23:19, 16.27s/it]
                                                           
{'loss': '0.133', 'grad_norm': '2.411', 'learning_rate': '6.881e-06', 'epoch': '0.613'}

 61%|██████▏   | 23270/37963 [99:43:59<66:23:19, 16.27s/it]
 61%|██████▏   | 23271/37963 [99:44:13<63:47:55, 15.63s/it]
 61%|██████▏   | 23272/37963 [99:44:26<61:24:06, 15.05s/it]
 61%|██████▏   | 23273/37963 [99:44:41<60:31:11, 14.83s/it]
 61%|██████▏   | 23274/37963 [99:44:55<59:43:28, 14.64s/it]
 61%|██████▏   | 23275/37963 [99:45:09<59:29:16, 14.58s/it]
 61%|██████▏   | 23276/37963 [99:45:24<59:11:55, 14.51s/it]
 61%|██████▏   | 23277/37963 [99:45:38<59:06:21, 14.49s/it]
 61%|██████▏   | 23278/37963 [99:46:06<74:59:25, 18.38s/it]
 61%|██████▏   | 23279/37963 [99:46:20<70:05:08, 17.18s/it]
 61%|██████▏   | 23280/37963 [99:46:34<66:33:13, 16.32s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '1.794', 'learning_rate': '6.873e-06', 'epoch': '0.6132'}

 61%|██████▏   | 23280/37963 [99:46:34<66:33:13, 16.32s/it]
 61%|██████▏   | 23281/37963 [99:46:49<64:19:45, 15.77s/it]
 61%|██████▏   | 23282/37963 [99:47:03<62:36:06, 15.35s/it]
 61%|██████▏   | 23283/37963 [99:47:17<61:17:09, 15.03s/it]
 61%|██████▏   | 23284/37963 [99:47:32<60:24:06, 14.81s/it]
 61%|██████▏   | 23285/37963 [99:47:53<67:59:03, 16.67s/it]
 61%|██████▏   | 23286/37963 [99:48:13<72:25:56, 17.77s/it]
 61%|██████▏   | 23287/37963 [99:48:28<68:19:55, 16.76s/it]
 61%|██████▏   | 23288/37963 [99:48:42<65:23:56, 16.04s/it]
 61%|██████▏   | 23289/37963 [99:48:56<62:44:53, 15.39s/it]
 61%|██████▏   | 23290/37963 [99:49:10<60:59:25, 14.96s/it]
                                                           
{'loss': '0.1213', 'grad_norm': '3.479', 'learning_rate': '6.865e-06', 'epoch': '0.6135'}

 61%|██████▏   | 23290/37963 [99:49:10<60:59:25, 14.96s/it]
 61%|██████▏   | 23291/37963 [99:49:24<60:16:44, 14.79s/it]
 61%|██████▏   | 23292/37963 [99:49:39<59:57:51, 14.71s/it]
 61%|██████▏   | 23293/37963 [99:49:53<59:26:56, 14.59s/it]
 61%|██████▏   | 23294/37963 [99:50:07<58:53:52, 14.45s/it]
 61%|██████▏   | 23295/37963 [99:50:21<58:18:48, 14.31s/it]
 61%|██████▏   | 23296/37963 [99:50:35<58:17:20, 14.31s/it]
 61%|██████▏   | 23297/37963 [99:50:50<58:11:53, 14.29s/it]
 61%|██████▏   | 23298/37963 [99:51:04<58:28:05, 14.35s/it]
 61%|██████▏   | 23299/37963 [99:51:25<66:33:15, 16.34s/it]
 61%|██████▏   | 23300/37963 [99:51:40<64:16:29, 15.78s/it]
                                                           
{'loss': '0.1284', 'grad_norm': '1.534', 'learning_rate': '6.857e-06', 'epoch': '0.6138'}

 61%|██████▏   | 23300/37963 [99:51:40<64:16:29, 15.78s/it]
 61%|██████▏   | 23301/37963 [99:51:54<62:34:13, 15.36s/it]
 61%|██████▏   | 23302/37963 [99:52:08<61:26:48, 15.09s/it]
 61%|██████▏   | 23303/37963 [99:52:23<60:35:23, 14.88s/it]
 61%|██████▏   | 23304/37963 [99:52:37<59:54:40, 14.71s/it]
 61%|██████▏   | 23305/37963 [99:52:51<59:14:19, 14.55s/it]
 61%|██████▏   | 23306/37963 [99:53:05<58:12:25, 14.30s/it]
 61%|██████▏   | 23307/37963 [99:53:19<58:18:29, 14.32s/it]
 61%|██████▏   | 23308/37963 [99:53:34<58:31:19, 14.38s/it]
 61%|██████▏   | 23309/37963 [99:53:54<65:49:42, 16.17s/it]
 61%|██████▏   | 23310/37963 [99:54:09<63:37:25, 15.63s/it]
                                                           
{'loss': '0.1162', 'grad_norm': '1.204', 'learning_rate': '6.849e-06', 'epoch': '0.614'}

 61%|██████▏   | 23310/37963 [99:54:09<63:37:25, 15.63s/it]
 61%|██████▏   | 23311/37963 [99:54:23<62:07:08, 15.26s/it]
 61%|██████▏   | 23312/37963 [99:54:37<61:01:25, 14.99s/it]
 61%|██████▏   | 23313/37963 [99:54:52<60:14:20, 14.80s/it]
 61%|██████▏   | 23314/37963 [99:55:06<59:38:38, 14.66s/it]
 61%|██████▏   | 23315/37963 [99:55:20<59:16:08, 14.57s/it]
 61%|██████▏   | 23316/37963 [99:55:35<58:57:50, 14.49s/it]
 61%|██████▏   | 23317/37963 [99:56:03<75:16:08, 18.50s/it]
 61%|██████▏   | 23318/37963 [99:56:17<70:18:00, 17.28s/it]
 61%|██████▏   | 23319/37963 [99:56:31<66:42:38, 16.40s/it]
 61%|██████▏   | 23320/37963 [99:56:46<64:13:22, 15.79s/it]
                                                           
{'loss': '0.118', 'grad_norm': '1.407', 'learning_rate': '6.84e-06', 'epoch': '0.6143'}

 61%|██████▏   | 23320/37963 [99:56:46<64:13:22, 15.79s/it]
 61%|██████▏   | 23321/37963 [99:57:00<62:25:21, 15.35s/it]
 61%|██████▏   | 23322/37963 [99:57:14<61:13:36, 15.05s/it]
 61%|██████▏   | 23323/37963 [99:57:29<60:22:35, 14.85s/it]
 61%|██████▏   | 23324/37963 [99:57:43<59:46:11, 14.70s/it]
 61%|██████▏   | 23325/37963 [99:58:04<66:49:47, 16.44s/it]
 61%|██████▏   | 23326/37963 [99:58:18<64:15:04, 15.80s/it]
 61%|██████▏   | 23327/37963 [99:58:39<70:46:59, 17.41s/it]
 61%|██████▏   | 23328/37963 [99:58:53<67:04:11, 16.50s/it]
 61%|██████▏   | 23329/37963 [99:59:08<64:27:34, 15.86s/it]
 61%|██████▏   | 23330/37963 [99:59:22<62:43:11, 15.43s/it]
                                                           
{'loss': '0.1398', 'grad_norm': '1.722', 'learning_rate': '6.832e-06', 'epoch': '0.6145'}

 61%|██████▏   | 23330/37963 [99:59:22<62:43:11, 15.43s/it]
 61%|██████▏   | 23331/37963 [99:59:37<61:20:40, 15.09s/it]
 61%|██████▏   | 23332/37963 [99:59:51<60:30:23, 14.89s/it]
 61%|██████▏   | 23333/37963 [100:00:05<59:49:35, 14.72s/it]
 61%|██████▏   | 23334/37963 [100:00:20<59:30:58, 14.65s/it]
 61%|██████▏   | 23335/37963 [100:00:41<67:32:41, 16.62s/it]
 61%|██████▏   | 23336/37963 [100:00:55<63:52:46, 15.72s/it]
 61%|██████▏   | 23337/37963 [100:01:09<62:09:14, 15.30s/it]
 61%|██████▏   | 23338/37963 [100:01:23<60:57:31, 15.01s/it]
 61%|██████▏   | 23339/37963 [100:01:37<59:58:45, 14.77s/it]
 61%|██████▏   | 23340/37963 [100:01:52<59:28:20, 14.64s/it]
                                                            
{'loss': '0.1316', 'grad_norm': '2.373', 'learning_rate': '6.824e-06', 'epoch': '0.6148'}

 61%|██████▏   | 23340/37963 [100:01:52<59:28:20, 14.64s/it]
 61%|██████▏   | 23341/37963 [100:02:06<59:09:23, 14.56s/it]
 61%|██████▏   | 23342/37963 [100:02:20<58:38:55, 14.44s/it]
 61%|██████▏   | 23343/37963 [100:02:35<58:32:17, 14.41s/it]
 61%|██████▏   | 23344/37963 [100:02:49<58:27:52, 14.40s/it]
 61%|██████▏   | 23345/37963 [100:03:03<58:20:21, 14.37s/it]
 61%|██████▏   | 23346/37963 [100:03:18<58:21:51, 14.37s/it]
 61%|██████▏   | 23347/37963 [100:03:39<66:08:02, 16.29s/it]
 62%|██████▏   | 23348/37963 [100:03:53<63:47:05, 15.71s/it]
 62%|██████▏   | 23349/37963 [100:04:07<62:04:01, 15.29s/it]
 62%|██████▏   | 23350/37963 [100:04:22<61:03:08, 15.04s/it]
                                                            
{'loss': '0.1319', 'grad_norm': '2.883', 'learning_rate': '6.816e-06', 'epoch': '0.6151'}

 62%|██████▏   | 23350/37963 [100:04:22<61:03:08, 15.04s/it]
 62%|██████▏   | 23351/37963 [100:04:36<59:58:08, 14.77s/it]
 62%|██████▏   | 23352/37963 [100:04:50<59:31:24, 14.67s/it]
 62%|██████▏   | 23353/37963 [100:05:04<58:41:36, 14.46s/it]
 62%|██████▏   | 23354/37963 [100:05:19<58:37:29, 14.45s/it]
 62%|██████▏   | 23355/37963 [100:05:33<58:32:56, 14.43s/it]
 62%|██████▏   | 23356/37963 [100:05:47<58:34:27, 14.44s/it]
 62%|██████▏   | 23357/37963 [100:06:08<65:51:16, 16.23s/it]
 62%|██████▏   | 23358/37963 [100:06:22<63:37:13, 15.68s/it]
 62%|██████▏   | 23359/37963 [100:06:37<62:07:31, 15.31s/it]
 62%|██████▏   | 23360/37963 [100:06:51<60:54:51, 15.02s/it]
                                                            
{'loss': '0.1381', 'grad_norm': '6', 'learning_rate': '6.808e-06', 'epoch': '0.6153'}

 62%|██████▏   | 23360/37963 [100:06:51<60:54:51, 15.02s/it]
 62%|██████▏   | 23361/37963 [100:07:05<59:49:43, 14.75s/it]
 62%|██████▏   | 23362/37963 [100:07:20<59:18:55, 14.62s/it]
 62%|██████▏   | 23363/37963 [100:07:34<59:02:44, 14.56s/it]
 62%|██████▏   | 23364/37963 [100:07:48<58:40:09, 14.47s/it]
 62%|██████▏   | 23365/37963 [100:08:02<57:50:31, 14.26s/it]
 62%|██████▏   | 23366/37963 [100:08:23<65:59:49, 16.28s/it]
 62%|██████▏   | 23367/37963 [100:08:43<70:46:05, 17.45s/it]
 62%|██████▏   | 23368/37963 [100:08:57<66:48:05, 16.48s/it]
 62%|██████▏   | 23369/37963 [100:09:12<64:15:42, 15.85s/it]
 62%|██████▏   | 23370/37963 [100:09:26<62:10:09, 15.34s/it]
                                                            
{'loss': '0.1275', 'grad_norm': '2.589', 'learning_rate': '6.8e-06', 'epoch': '0.6156'}

 62%|██████▏   | 23370/37963 [100:09:26<62:10:09, 15.34s/it]
 62%|██████▏   | 23371/37963 [100:09:40<60:29:48, 14.93s/it]
 62%|██████▏   | 23372/37963 [100:09:54<59:51:00, 14.77s/it]
 62%|██████▏   | 23373/37963 [100:10:15<67:13:32, 16.59s/it]
 62%|██████▏   | 23374/37963 [100:10:29<64:30:09, 15.92s/it]
 62%|██████▏   | 23375/37963 [100:10:50<69:52:14, 17.24s/it]
 62%|██████▏   | 23376/37963 [100:11:04<66:28:58, 16.41s/it]
 62%|██████▏   | 23377/37963 [100:11:18<63:34:09, 15.69s/it]
 62%|██████▏   | 23378/37963 [100:11:32<61:30:53, 15.18s/it]
 62%|██████▏   | 23379/37963 [100:11:46<60:16:11, 14.88s/it]
 62%|██████▏   | 23380/37963 [100:12:01<59:39:39, 14.73s/it]
                                                            
{'loss': '0.129', 'grad_norm': '1.682', 'learning_rate': '6.792e-06', 'epoch': '0.6159'}

 62%|██████▏   | 23380/37963 [100:12:01<59:39:39, 14.73s/it]
 62%|██████▏   | 23381/37963 [100:12:15<58:59:41, 14.56s/it]
 62%|██████▏   | 23382/37963 [100:12:36<66:38:36, 16.45s/it]
 62%|██████▏   | 23383/37963 [100:12:49<63:14:55, 15.62s/it]
 62%|██████▏   | 23384/37963 [100:13:04<61:44:16, 15.25s/it]
 62%|██████▏   | 23385/37963 [100:13:25<68:53:13, 17.01s/it]
 62%|██████▏   | 23386/37963 [100:13:39<65:35:52, 16.20s/it]
 62%|██████▏   | 23387/37963 [100:13:54<63:23:10, 15.66s/it]
 62%|██████▏   | 23388/37963 [100:14:08<61:27:02, 15.18s/it]
 62%|██████▏   | 23389/37963 [100:14:22<60:28:15, 14.94s/it]
 62%|██████▏   | 23390/37963 [100:14:36<59:44:08, 14.76s/it]
                                                            
{'loss': '0.1307', 'grad_norm': '4.76', 'learning_rate': '6.784e-06', 'epoch': '0.6161'}

 62%|██████▏   | 23390/37963 [100:14:36<59:44:08, 14.76s/it]
 62%|██████▏   | 23391/37963 [100:14:51<59:17:25, 14.65s/it]
 62%|██████▏   | 23392/37963 [100:15:05<58:57:57, 14.57s/it]
 62%|██████▏   | 23393/37963 [100:15:19<57:58:36, 14.33s/it]
 62%|██████▏   | 23394/37963 [100:15:33<57:57:22, 14.32s/it]
 62%|██████▏   | 23395/37963 [100:15:48<57:56:52, 14.32s/it]
 62%|██████▏   | 23396/37963 [100:16:02<57:27:06, 14.20s/it]
 62%|██████▏   | 23397/37963 [100:16:22<65:00:16, 16.07s/it]
 62%|██████▏   | 23398/37963 [100:16:36<62:17:51, 15.40s/it]
 62%|██████▏   | 23399/37963 [100:16:50<61:15:20, 15.14s/it]
 62%|██████▏   | 23400/37963 [100:17:05<60:15:00, 14.89s/it]
                                                            
{'loss': '0.1369', 'grad_norm': '2.16', 'learning_rate': '6.776e-06', 'epoch': '0.6164'}

 62%|██████▏   | 23400/37963 [100:17:05<60:15:00, 14.89s/it]
 62%|██████▏   | 23401/37963 [100:17:19<59:33:55, 14.73s/it]
 62%|██████▏   | 23402/37963 [100:17:33<59:07:34, 14.62s/it]
 62%|██████▏   | 23403/37963 [100:17:48<58:56:06, 14.57s/it]
 62%|██████▏   | 23404/37963 [100:18:02<58:45:37, 14.53s/it]
 62%|██████▏   | 23405/37963 [100:18:17<58:38:55, 14.50s/it]
 62%|██████▏   | 23406/37963 [100:18:31<58:41:40, 14.52s/it]
 62%|██████▏   | 23407/37963 [100:18:52<66:13:28, 16.38s/it]
 62%|██████▏   | 23408/37963 [100:19:06<63:50:48, 15.79s/it]
 62%|██████▏   | 23409/37963 [100:19:21<61:57:52, 15.33s/it]
 62%|██████▏   | 23410/37963 [100:19:35<60:25:46, 14.95s/it]
                                                            
{'loss': '0.1259', 'grad_norm': '2.839', 'learning_rate': '6.768e-06', 'epoch': '0.6167'}

 62%|██████▏   | 23410/37963 [100:19:35<60:25:46, 14.95s/it]
 62%|██████▏   | 23411/37963 [100:19:49<59:37:03, 14.75s/it]
 62%|██████▏   | 23412/37963 [100:20:03<59:02:44, 14.61s/it]
 62%|██████▏   | 23413/37963 [100:20:18<58:40:23, 14.52s/it]
 62%|██████▏   | 23414/37963 [100:20:39<66:36:56, 16.48s/it]
 62%|██████▏   | 23415/37963 [100:21:00<72:09:51, 17.86s/it]
 62%|██████▏   | 23416/37963 [100:21:14<67:56:21, 16.81s/it]
 62%|██████▏   | 23417/37963 [100:21:28<64:54:12, 16.06s/it]
 62%|██████▏   | 23418/37963 [100:21:43<62:51:17, 15.56s/it]
 62%|██████▏   | 23419/37963 [100:21:57<61:18:49, 15.18s/it]
 62%|██████▏   | 23420/37963 [100:22:11<60:19:27, 14.93s/it]
                                                            
{'loss': '0.1266', 'grad_norm': '4.98', 'learning_rate': '6.76e-06', 'epoch': '0.6169'}

 62%|██████▏   | 23420/37963 [100:22:11<60:19:27, 14.93s/it]
 62%|██████▏   | 23421/37963 [100:22:32<67:27:08, 16.70s/it]
 62%|██████▏   | 23422/37963 [100:22:47<64:35:34, 15.99s/it]
 62%|██████▏   | 23423/37963 [100:23:01<62:34:53, 15.49s/it]
 62%|██████▏   | 23424/37963 [100:23:23<70:06:48, 17.36s/it]
 62%|██████▏   | 23425/37963 [100:23:37<66:26:04, 16.45s/it]
 62%|██████▏   | 23426/37963 [100:23:51<63:26:34, 15.71s/it]
 62%|██████▏   | 23427/37963 [100:24:05<61:47:43, 15.30s/it]
 62%|██████▏   | 23428/37963 [100:24:19<60:26:31, 14.97s/it]
 62%|██████▏   | 23429/37963 [100:24:33<58:51:47, 14.58s/it]
 62%|██████▏   | 23430/37963 [100:24:47<58:20:27, 14.45s/it]
                                                            
{'loss': '0.1271', 'grad_norm': '3.179', 'learning_rate': '6.752e-06', 'epoch': '0.6172'}

 62%|██████▏   | 23430/37963 [100:24:47<58:20:27, 14.45s/it]
 62%|██████▏   | 23431/37963 [100:25:02<58:07:08, 14.40s/it]
 62%|██████▏   | 23432/37963 [100:25:22<65:48:35, 16.30s/it]
 62%|██████▏   | 23433/37963 [100:25:43<71:38:01, 17.75s/it]
 62%|██████▏   | 23434/37963 [100:25:58<67:35:40, 16.75s/it]
 62%|██████▏   | 23435/37963 [100:26:12<64:35:49, 16.01s/it]
 62%|██████▏   | 23436/37963 [100:26:26<62:18:48, 15.44s/it]
 62%|██████▏   | 23437/37963 [100:26:41<61:02:43, 15.13s/it]
 62%|██████▏   | 23438/37963 [100:26:55<59:51:13, 14.83s/it]
 62%|██████▏   | 23439/37963 [100:27:09<59:29:50, 14.75s/it]
 62%|██████▏   | 23440/37963 [100:27:24<59:05:19, 14.65s/it]
                                                            
{'loss': '0.1259', 'grad_norm': '2.071', 'learning_rate': '6.743e-06', 'epoch': '0.6174'}

 62%|██████▏   | 23440/37963 [100:27:24<59:05:19, 14.65s/it]
 62%|██████▏   | 23441/37963 [100:27:38<58:47:29, 14.57s/it]
 62%|██████▏   | 23442/37963 [100:27:53<58:32:04, 14.51s/it]
 62%|██████▏   | 23443/37963 [100:28:07<58:20:15, 14.46s/it]
 62%|██████▏   | 23444/37963 [100:28:21<58:13:02, 14.44s/it]
 62%|██████▏   | 23445/37963 [100:28:36<58:03:11, 14.40s/it]
 62%|██████▏   | 23446/37963 [100:28:56<65:47:25, 16.32s/it]
 62%|██████▏   | 23447/37963 [100:29:11<63:20:32, 15.71s/it]
 62%|██████▏   | 23448/37963 [100:29:25<61:17:49, 15.20s/it]
 62%|██████▏   | 23449/37963 [100:29:39<59:56:47, 14.87s/it]
 62%|██████▏   | 23450/37963 [100:29:53<59:14:47, 14.70s/it]
                                                            
{'loss': '0.1263', 'grad_norm': '3.092', 'learning_rate': '6.735e-06', 'epoch': '0.6177'}

 62%|██████▏   | 23450/37963 [100:29:53<59:14:47, 14.70s/it]
 62%|██████▏   | 23451/37963 [100:30:07<58:47:42, 14.59s/it]
 62%|██████▏   | 23452/37963 [100:30:22<58:20:46, 14.47s/it]
 62%|██████▏   | 23453/37963 [100:30:36<57:51:30, 14.35s/it]
 62%|██████▏   | 23454/37963 [100:30:50<57:35:59, 14.29s/it]
 62%|██████▏   | 23455/37963 [100:31:04<57:41:35, 14.32s/it]
 62%|██████▏   | 23456/37963 [100:31:19<57:44:53, 14.33s/it]
 62%|██████▏   | 23457/37963 [100:31:39<64:51:45, 16.10s/it]
 62%|██████▏   | 23458/37963 [100:31:53<62:47:36, 15.58s/it]
 62%|██████▏   | 23459/37963 [100:32:14<68:53:43, 17.10s/it]
 62%|██████▏   | 23460/37963 [100:32:28<65:33:47, 16.27s/it]
                                                            
{'loss': '0.1264', 'grad_norm': '1.438', 'learning_rate': '6.727e-06', 'epoch': '0.618'}

 62%|██████▏   | 23460/37963 [100:32:28<65:33:47, 16.27s/it]
 62%|██████▏   | 23461/37963 [100:32:43<63:19:17, 15.72s/it]
 62%|██████▏   | 23462/37963 [100:32:57<61:15:23, 15.21s/it]
 62%|██████▏   | 23463/37963 [100:33:18<68:22:31, 16.98s/it]
 62%|██████▏   | 23464/37963 [100:33:32<65:18:49, 16.22s/it]
 62%|██████▏   | 23465/37963 [100:33:47<63:09:17, 15.68s/it]
 62%|██████▏   | 23466/37963 [100:34:01<61:30:58, 15.28s/it]
 62%|██████▏   | 23467/37963 [100:34:15<60:07:14, 14.93s/it]
 62%|██████▏   | 23468/37963 [100:34:36<67:13:02, 16.69s/it]
 62%|██████▏   | 23469/37963 [100:34:50<64:20:22, 15.98s/it]
 62%|██████▏   | 23470/37963 [100:35:04<62:15:47, 15.47s/it]
                                                            
{'loss': '0.1245', 'grad_norm': '1.942', 'learning_rate': '6.719e-06', 'epoch': '0.6182'}

 62%|██████▏   | 23470/37963 [100:35:04<62:15:47, 15.47s/it]
 62%|██████▏   | 23471/37963 [100:35:25<68:15:08, 16.95s/it]
 62%|██████▏   | 23472/37963 [100:35:39<64:55:02, 16.13s/it]
 62%|██████▏   | 23473/37963 [100:35:53<62:34:14, 15.55s/it]
 62%|██████▏   | 23474/37963 [100:36:08<61:05:41, 15.18s/it]
 62%|██████▏   | 23475/37963 [100:36:22<60:09:18, 14.95s/it]
 62%|██████▏   | 23476/37963 [100:36:36<59:23:25, 14.76s/it]
 62%|██████▏   | 23477/37963 [100:36:50<58:24:10, 14.51s/it]
 62%|██████▏   | 23478/37963 [100:37:05<58:09:02, 14.45s/it]
 62%|██████▏   | 23479/37963 [100:37:25<65:38:57, 16.32s/it]
 62%|██████▏   | 23480/37963 [100:37:40<63:15:45, 15.73s/it]
                                                            
{'loss': '0.1225', 'grad_norm': '2.702', 'learning_rate': '6.711e-06', 'epoch': '0.6185'}

 62%|██████▏   | 23480/37963 [100:37:40<63:15:45, 15.73s/it]
 62%|██████▏   | 23481/37963 [100:37:54<61:40:02, 15.33s/it]
 62%|██████▏   | 23482/37963 [100:38:15<68:59:24, 17.15s/it]
 62%|██████▏   | 23483/37963 [100:38:30<65:35:26, 16.31s/it]
 62%|██████▏   | 23484/37963 [100:38:44<63:05:04, 15.69s/it]
 62%|██████▏   | 23485/37963 [100:38:58<61:09:38, 15.21s/it]
 62%|██████▏   | 23486/37963 [100:39:12<60:05:28, 14.94s/it]
 62%|██████▏   | 23487/37963 [100:39:26<58:48:22, 14.62s/it]
 62%|██████▏   | 23488/37963 [100:39:41<58:30:09, 14.55s/it]
 62%|██████▏   | 23489/37963 [100:39:54<57:40:14, 14.34s/it]
 62%|██████▏   | 23490/37963 [100:40:09<57:49:19, 14.38s/it]
                                                            
{'loss': '0.1216', 'grad_norm': '1.682', 'learning_rate': '6.703e-06', 'epoch': '0.6188'}

 62%|██████▏   | 23490/37963 [100:40:09<57:49:19, 14.38s/it]
 62%|██████▏   | 23491/37963 [100:40:23<57:44:21, 14.36s/it]
 62%|██████▏   | 23492/37963 [100:40:38<57:44:39, 14.37s/it]
 62%|██████▏   | 23493/37963 [100:40:58<64:35:24, 16.07s/it]
 62%|██████▏   | 23494/37963 [100:41:12<62:33:53, 15.57s/it]
 62%|██████▏   | 23495/37963 [100:41:26<61:09:34, 15.22s/it]
 62%|██████▏   | 23496/37963 [100:41:41<60:16:04, 15.00s/it]
 62%|██████▏   | 23497/37963 [100:41:55<59:38:15, 14.84s/it]
 62%|██████▏   | 23498/37963 [100:42:10<59:05:27, 14.71s/it]
 62%|██████▏   | 23499/37963 [100:42:24<58:40:57, 14.61s/it]
 62%|██████▏   | 23500/37963 [100:42:39<58:24:01, 14.54s/it]
                                                            
{'loss': '0.1159', 'grad_norm': '2.171', 'learning_rate': '6.695e-06', 'epoch': '0.619'}

 62%|██████▏   | 23500/37963 [100:42:39<58:24:01, 14.54s/it]
 62%|██████▏   | 23501/37963 [100:42:53<58:02:52, 14.45s/it]
 62%|██████▏   | 23502/37963 [100:43:07<57:58:01, 14.43s/it]
 62%|██████▏   | 23503/37963 [100:43:21<57:49:35, 14.40s/it]
 62%|██████▏   | 23504/37963 [100:43:36<57:49:53, 14.40s/it]
 62%|██████▏   | 23505/37963 [100:43:50<57:49:56, 14.40s/it]
 62%|██████▏   | 23506/37963 [100:44:11<65:24:06, 16.29s/it]
 62%|██████▏   | 23507/37963 [100:44:25<63:09:34, 15.73s/it]
 62%|██████▏   | 23508/37963 [100:44:46<69:23:31, 17.28s/it]
 62%|██████▏   | 23509/37963 [100:45:01<65:54:33, 16.42s/it]
 62%|██████▏   | 23510/37963 [100:45:22<71:35:50, 17.83s/it]
                                                            
{'loss': '0.1273', 'grad_norm': '1.698', 'learning_rate': '6.687e-06', 'epoch': '0.6193'}

 62%|██████▏   | 23510/37963 [100:45:22<71:35:50, 17.83s/it]
 62%|██████▏   | 23511/37963 [100:45:36<67:21:44, 16.78s/it]
 62%|██████▏   | 23512/37963 [100:45:51<64:28:27, 16.06s/it]
 62%|██████▏   | 23513/37963 [100:46:05<62:11:39, 15.49s/it]
 62%|██████▏   | 23514/37963 [100:46:19<60:20:41, 15.04s/it]
 62%|██████▏   | 23515/37963 [100:46:33<59:25:31, 14.81s/it]
 62%|██████▏   | 23516/37963 [100:46:47<58:47:10, 14.65s/it]
 62%|██████▏   | 23517/37963 [100:47:02<58:30:17, 14.58s/it]
 62%|██████▏   | 23518/37963 [100:47:22<65:30:22, 16.33s/it]
 62%|██████▏   | 23519/37963 [100:47:36<63:04:30, 15.72s/it]
 62%|██████▏   | 23520/37963 [100:47:58<69:35:47, 17.35s/it]
                                                            
{'loss': '0.1327', 'grad_norm': '2.57', 'learning_rate': '6.679e-06', 'epoch': '0.6196'}

 62%|██████▏   | 23520/37963 [100:47:58<69:35:47, 17.35s/it]
 62%|██████▏   | 23521/37963 [100:48:12<65:35:56, 16.35s/it]
 62%|██████▏   | 23522/37963 [100:48:26<63:08:27, 15.74s/it]
 62%|██████▏   | 23523/37963 [100:48:40<61:25:12, 15.31s/it]
 62%|██████▏   | 23524/37963 [100:48:54<59:56:33, 14.95s/it]
 62%|██████▏   | 23525/37963 [100:49:08<58:03:43, 14.48s/it]
 62%|██████▏   | 23526/37963 [100:49:22<57:53:07, 14.43s/it]
 62%|██████▏   | 23527/37963 [100:49:43<65:12:39, 16.26s/it]
 62%|██████▏   | 23528/37963 [100:49:57<62:51:07, 15.67s/it]
 62%|██████▏   | 23529/37963 [100:50:11<61:10:33, 15.26s/it]
 62%|██████▏   | 23530/37963 [100:50:25<59:59:11, 14.96s/it]
                                                            
{'loss': '0.1224', 'grad_norm': '1.379', 'learning_rate': '6.671e-06', 'epoch': '0.6198'}

 62%|██████▏   | 23530/37963 [100:50:25<59:59:11, 14.96s/it]
 62%|██████▏   | 23531/37963 [100:50:47<67:38:50, 16.87s/it]
 62%|██████▏   | 23532/37963 [100:51:01<64:39:55, 16.13s/it]
 62%|██████▏   | 23533/37963 [100:51:15<62:32:38, 15.60s/it]
 62%|██████▏   | 23534/37963 [100:51:30<60:51:33, 15.18s/it]
 62%|██████▏   | 23535/37963 [100:51:44<59:48:05, 14.92s/it]
 62%|██████▏   | 23536/37963 [100:51:58<59:05:05, 14.74s/it]
 62%|██████▏   | 23537/37963 [100:52:13<58:34:02, 14.62s/it]
 62%|██████▏   | 23538/37963 [100:52:27<58:16:00, 14.54s/it]
 62%|██████▏   | 23539/37963 [100:52:41<57:22:27, 14.32s/it]
 62%|██████▏   | 23540/37963 [100:52:55<57:02:30, 14.24s/it]
                                                            
{'loss': '0.1139', 'grad_norm': '3.043', 'learning_rate': '6.663e-06', 'epoch': '0.6201'}

 62%|██████▏   | 23540/37963 [100:52:55<57:02:30, 14.24s/it]
 62%|██████▏   | 23541/37963 [100:53:09<57:05:53, 14.25s/it]
 62%|██████▏   | 23542/37963 [100:53:23<56:35:30, 14.13s/it]
 62%|██████▏   | 23543/37963 [100:53:44<64:31:34, 16.11s/it]
 62%|██████▏   | 23544/37963 [100:53:58<62:34:05, 15.62s/it]
 62%|██████▏   | 23545/37963 [100:54:13<61:06:23, 15.26s/it]
 62%|██████▏   | 23546/37963 [100:54:27<60:09:13, 15.02s/it]
 62%|██████▏   | 23547/37963 [100:54:41<59:24:53, 14.84s/it]
 62%|██████▏   | 23548/37963 [100:54:56<58:41:35, 14.66s/it]
 62%|██████▏   | 23549/37963 [100:55:10<58:17:32, 14.56s/it]
 62%|██████▏   | 23550/37963 [100:55:25<58:16:02, 14.55s/it]
                                                            
{'loss': '0.1335', 'grad_norm': '1.622', 'learning_rate': '6.655e-06', 'epoch': '0.6203'}

 62%|██████▏   | 23550/37963 [100:55:25<58:16:02, 14.55s/it]
 62%|██████▏   | 23551/37963 [100:55:38<57:13:11, 14.29s/it]
 62%|██████▏   | 23552/37963 [100:55:53<57:18:16, 14.32s/it]
 62%|██████▏   | 23553/37963 [100:56:13<65:01:34, 16.25s/it]
 62%|██████▏   | 23554/37963 [100:56:34<70:01:12, 17.49s/it]
 62%|██████▏   | 23555/37963 [100:56:48<65:43:20, 16.42s/it]
 62%|██████▏   | 23556/37963 [100:57:02<63:09:47, 15.78s/it]
 62%|██████▏   | 23557/37963 [100:57:16<60:46:06, 15.19s/it]
 62%|██████▏   | 23558/37963 [100:57:30<59:46:04, 14.94s/it]
 62%|██████▏   | 23559/37963 [100:57:51<66:58:25, 16.74s/it]
 62%|██████▏   | 23560/37963 [100:58:05<64:07:11, 16.03s/it]
                                                            
{'loss': '0.1183', 'grad_norm': '3.662', 'learning_rate': '6.647e-06', 'epoch': '0.6206'}

 62%|██████▏   | 23560/37963 [100:58:05<64:07:11, 16.03s/it]
 62%|██████▏   | 23561/37963 [100:58:20<62:02:55, 15.51s/it]
 62%|██████▏   | 23562/37963 [100:58:34<60:43:44, 15.18s/it]
 62%|██████▏   | 23563/37963 [100:58:49<59:44:37, 14.94s/it]
 62%|██████▏   | 23564/37963 [100:59:03<59:02:55, 14.76s/it]
 62%|██████▏   | 23565/37963 [100:59:17<58:19:02, 14.58s/it]
 62%|██████▏   | 23566/37963 [100:59:31<57:58:27, 14.50s/it]
 62%|██████▏   | 23567/37963 [100:59:52<64:44:08, 16.19s/it]
 62%|██████▏   | 23568/37963 [101:00:12<69:53:17, 17.48s/it]
 62%|██████▏   | 23569/37963 [101:00:26<66:09:19, 16.55s/it]
 62%|██████▏   | 23570/37963 [101:00:41<63:32:32, 15.89s/it]
                                                            
{'loss': '0.1331', 'grad_norm': '1.519', 'learning_rate': '6.639e-06', 'epoch': '0.6209'}

 62%|██████▏   | 23570/37963 [101:00:41<63:32:32, 15.89s/it]
 62%|██████▏   | 23571/37963 [101:00:55<61:15:14, 15.32s/it]
 62%|██████▏   | 23572/37963 [101:01:09<60:01:09, 15.01s/it]
 62%|██████▏   | 23573/37963 [101:01:23<59:16:13, 14.83s/it]
 62%|██████▏   | 23574/37963 [101:01:44<66:01:02, 16.52s/it]
 62%|██████▏   | 23575/37963 [101:01:58<63:08:44, 15.80s/it]
 62%|██████▏   | 23576/37963 [101:02:12<61:23:39, 15.36s/it]
 62%|██████▏   | 23577/37963 [101:02:27<60:09:29, 15.05s/it]
 62%|██████▏   | 23578/37963 [101:02:40<58:37:21, 14.67s/it]
 62%|██████▏   | 23579/37963 [101:02:55<57:59:03, 14.51s/it]
 62%|██████▏   | 23580/37963 [101:03:15<65:36:36, 16.42s/it]
                                                            
{'loss': '0.1185', 'grad_norm': '3.245', 'learning_rate': '6.631e-06', 'epoch': '0.6211'}

 62%|██████▏   | 23580/37963 [101:03:15<65:36:36, 16.42s/it]
 62%|██████▏   | 23581/37963 [101:03:30<63:06:36, 15.80s/it]
 62%|██████▏   | 23582/37963 [101:03:44<60:42:04, 15.20s/it]
 62%|██████▏   | 23583/37963 [101:03:58<59:52:49, 14.99s/it]
 62%|██████▏   | 23584/37963 [101:04:12<59:00:17, 14.77s/it]
 62%|██████▏   | 23585/37963 [101:04:27<58:31:33, 14.65s/it]
 62%|██████▏   | 23586/37963 [101:04:41<58:27:48, 14.64s/it]
 62%|██████▏   | 23587/37963 [101:04:56<58:13:52, 14.58s/it]
 62%|██████▏   | 23588/37963 [101:05:10<57:56:49, 14.51s/it]
 62%|██████▏   | 23589/37963 [101:05:24<57:35:28, 14.42s/it]
 62%|██████▏   | 23590/37963 [101:05:39<57:29:40, 14.40s/it]
                                                            
{'loss': '0.1144', 'grad_norm': '1.475', 'learning_rate': '6.623e-06', 'epoch': '0.6214'}

 62%|██████▏   | 23590/37963 [101:05:39<57:29:40, 14.40s/it]
 62%|██████▏   | 23591/37963 [101:06:00<65:09:17, 16.32s/it]
 62%|██████▏   | 23592/37963 [101:06:14<62:56:19, 15.77s/it]
 62%|██████▏   | 23593/37963 [101:06:28<61:17:57, 15.36s/it]
 62%|██████▏   | 23594/37963 [101:06:43<60:24:13, 15.13s/it]
 62%|██████▏   | 23595/37963 [101:06:57<59:19:16, 14.86s/it]
 62%|██████▏   | 23596/37963 [101:07:12<58:44:16, 14.72s/it]
 62%|██████▏   | 23597/37963 [101:07:26<58:29:09, 14.66s/it]
 62%|██████▏   | 23598/37963 [101:07:40<57:59:14, 14.53s/it]
 62%|██████▏   | 23599/37963 [101:07:55<57:47:56, 14.49s/it]
 62%|██████▏   | 23600/37963 [101:08:09<57:20:00, 14.37s/it]
                                                            
{'loss': '0.1341', 'grad_norm': '3.394', 'learning_rate': '6.615e-06', 'epoch': '0.6217'}

 62%|██████▏   | 23600/37963 [101:08:09<57:20:00, 14.37s/it]
 62%|██████▏   | 23601/37963 [101:08:23<57:17:00, 14.36s/it]
 62%|██████▏   | 23602/37963 [101:08:44<64:35:58, 16.19s/it]
 62%|██████▏   | 23603/37963 [101:09:04<70:04:04, 17.57s/it]
 62%|██████▏   | 23604/37963 [101:09:18<65:50:22, 16.51s/it]
 62%|██████▏   | 23605/37963 [101:09:33<63:19:38, 15.88s/it]
 62%|██████▏   | 23606/37963 [101:09:47<60:50:35, 15.26s/it]
 62%|██████▏   | 23607/37963 [101:10:07<67:15:23, 16.87s/it]
 62%|██████▏   | 23608/37963 [101:10:22<64:24:31, 16.15s/it]
 62%|██████▏   | 23609/37963 [101:10:36<62:16:34, 15.62s/it]
 62%|██████▏   | 23610/37963 [101:10:50<60:32:29, 15.18s/it]
                                                            
{'loss': '0.1293', 'grad_norm': '4.446', 'learning_rate': '6.607e-06', 'epoch': '0.6219'}

 62%|██████▏   | 23610/37963 [101:10:50<60:32:29, 15.18s/it]
 62%|██████▏   | 23611/37963 [101:11:05<59:33:35, 14.94s/it]
 62%|██████▏   | 23612/37963 [101:11:19<58:27:57, 14.67s/it]
 62%|██████▏   | 23613/37963 [101:11:32<57:18:09, 14.38s/it]
 62%|██████▏   | 23614/37963 [101:11:47<57:06:04, 14.33s/it]
 62%|██████▏   | 23615/37963 [101:12:07<64:48:06, 16.26s/it]
 62%|██████▏   | 23616/37963 [101:12:22<62:32:12, 15.69s/it]
 62%|██████▏   | 23617/37963 [101:12:43<69:31:37, 17.45s/it]
 62%|██████▏   | 23618/37963 [101:12:58<65:51:58, 16.53s/it]
 62%|██████▏   | 23619/37963 [101:13:12<63:13:24, 15.87s/it]
 62%|██████▏   | 23620/37963 [101:13:26<61:22:34, 15.41s/it]
                                                            
{'loss': '0.1205', 'grad_norm': '4.028', 'learning_rate': '6.599e-06', 'epoch': '0.6222'}

 62%|██████▏   | 23620/37963 [101:13:26<61:22:34, 15.41s/it]
 62%|██████▏   | 23621/37963 [101:13:47<67:46:50, 17.01s/it]
 62%|██████▏   | 23622/37963 [101:14:01<64:19:01, 16.15s/it]
 62%|██████▏   | 23623/37963 [101:14:16<62:06:41, 15.59s/it]
 62%|██████▏   | 23624/37963 [101:14:30<60:09:24, 15.10s/it]
 62%|██████▏   | 23625/37963 [101:14:44<59:21:19, 14.90s/it]
 62%|██████▏   | 23626/37963 [101:14:58<58:46:24, 14.76s/it]
 62%|██████▏   | 23627/37963 [101:15:13<58:11:49, 14.61s/it]
 62%|██████▏   | 23628/37963 [101:15:27<57:50:41, 14.53s/it]
 62%|██████▏   | 23629/37963 [101:15:48<65:50:53, 16.54s/it]
 62%|██████▏   | 23630/37963 [101:16:02<62:47:17, 15.77s/it]
                                                            
{'loss': '0.1225', 'grad_norm': '1.913', 'learning_rate': '6.591e-06', 'epoch': '0.6225'}

 62%|██████▏   | 23630/37963 [101:16:02<62:47:17, 15.77s/it]
 62%|██████▏   | 23631/37963 [101:16:17<61:03:41, 15.34s/it]
 62%|██████▏   | 23632/37963 [101:16:31<60:04:36, 15.09s/it]
 62%|██████▏   | 23633/37963 [101:16:45<59:09:34, 14.86s/it]
 62%|██████▏   | 23634/37963 [101:17:00<58:23:25, 14.67s/it]
 62%|██████▏   | 23635/37963 [101:17:14<58:00:30, 14.58s/it]
 62%|██████▏   | 23636/37963 [101:17:28<57:33:55, 14.46s/it]
 62%|██████▏   | 23637/37963 [101:17:42<57:25:36, 14.43s/it]
 62%|██████▏   | 23638/37963 [101:17:57<57:20:22, 14.41s/it]
 62%|██████▏   | 23639/37963 [101:18:18<64:56:45, 16.32s/it]
 62%|██████▏   | 23640/37963 [101:18:32<62:09:31, 15.62s/it]
                                                            
{'loss': '0.123', 'grad_norm': '3.342', 'learning_rate': '6.583e-06', 'epoch': '0.6227'}

 62%|██████▏   | 23640/37963 [101:18:32<62:09:31, 15.62s/it]
 62%|██████▏   | 23641/37963 [101:18:45<59:49:34, 15.04s/it]
 62%|██████▏   | 23642/37963 [101:19:00<58:56:14, 14.82s/it]
 62%|██████▏   | 23643/37963 [101:19:14<58:08:34, 14.62s/it]
 62%|██████▏   | 23644/37963 [101:19:28<57:50:41, 14.54s/it]
 62%|██████▏   | 23645/37963 [101:19:42<57:38:10, 14.49s/it]
 62%|██████▏   | 23646/37963 [101:19:57<57:30:28, 14.46s/it]
 62%|██████▏   | 23647/37963 [101:20:11<57:37:56, 14.49s/it]
 62%|██████▏   | 23648/37963 [101:20:26<57:31:26, 14.47s/it]
 62%|██████▏   | 23649/37963 [101:20:40<57:26:51, 14.45s/it]
 62%|██████▏   | 23650/37963 [101:21:00<64:10:28, 16.14s/it]
                                                            
{'loss': '0.1186', 'grad_norm': '1.343', 'learning_rate': '6.575e-06', 'epoch': '0.623'}

 62%|██████▏   | 23650/37963 [101:21:00<64:10:28, 16.14s/it]
 62%|██████▏   | 23651/37963 [101:21:15<61:58:48, 15.59s/it]
 62%|██████▏   | 23652/37963 [101:21:29<60:22:13, 15.19s/it]
 62%|██████▏   | 23653/37963 [101:21:49<66:32:57, 16.74s/it]
 62%|██████▏   | 23654/37963 [101:22:04<63:40:07, 16.02s/it]
 62%|██████▏   | 23655/37963 [101:22:18<61:47:55, 15.55s/it]
 62%|██████▏   | 23656/37963 [101:22:32<60:19:56, 15.18s/it]
 62%|██████▏   | 23657/37963 [101:22:53<67:12:35, 16.91s/it]
 62%|██████▏   | 23658/37963 [101:23:08<64:21:02, 16.19s/it]
 62%|██████▏   | 23659/37963 [101:23:22<62:03:59, 15.62s/it]
 62%|██████▏   | 23660/37963 [101:23:36<60:14:08, 15.16s/it]
                                                            
{'loss': '0.1178', 'grad_norm': '1.458', 'learning_rate': '6.567e-06', 'epoch': '0.6232'}

 62%|██████▏   | 23660/37963 [101:23:36<60:14:08, 15.16s/it]
 62%|██████▏   | 23661/37963 [101:23:50<58:13:04, 14.65s/it]
 62%|██████▏   | 23662/37963 [101:24:04<57:15:09, 14.41s/it]
 62%|██████▏   | 23663/37963 [101:24:24<64:53:06, 16.33s/it]
 62%|██████▏   | 23664/37963 [101:24:39<62:37:49, 15.77s/it]
 62%|██████▏   | 23665/37963 [101:25:00<68:53:32, 17.35s/it]
 62%|██████▏   | 23666/37963 [101:25:14<64:49:37, 16.32s/it]
 62%|██████▏   | 23667/37963 [101:25:28<62:30:39, 15.74s/it]
 62%|██████▏   | 23668/37963 [101:25:42<60:39:58, 15.28s/it]
 62%|██████▏   | 23669/37963 [101:25:57<59:33:35, 15.00s/it]
 62%|██████▏   | 23670/37963 [101:26:11<58:47:29, 14.81s/it]
                                                            
{'loss': '0.1157', 'grad_norm': '2.3', 'learning_rate': '6.559e-06', 'epoch': '0.6235'}

 62%|██████▏   | 23670/37963 [101:26:11<58:47:29, 14.81s/it]
 62%|██████▏   | 23671/37963 [101:26:32<65:56:42, 16.61s/it]
 62%|██████▏   | 23672/37963 [101:26:46<63:22:40, 15.97s/it]
 62%|██████▏   | 23673/37963 [101:27:00<61:09:30, 15.41s/it]
 62%|██████▏   | 23674/37963 [101:27:14<59:10:07, 14.91s/it]
 62%|██████▏   | 23675/37963 [101:27:28<58:03:42, 14.63s/it]
 62%|██████▏   | 23676/37963 [101:27:42<57:32:13, 14.50s/it]
 62%|██████▏   | 23677/37963 [101:28:04<65:43:23, 16.56s/it]
 62%|██████▏   | 23678/37963 [101:28:18<63:18:06, 15.95s/it]
 62%|██████▏   | 23679/37963 [101:28:33<61:24:14, 15.48s/it]
 62%|██████▏   | 23680/37963 [101:28:47<60:19:42, 15.21s/it]
                                                            
{'loss': '0.1182', 'grad_norm': '2.64', 'learning_rate': '6.551e-06', 'epoch': '0.6238'}

 62%|██████▏   | 23680/37963 [101:28:47<60:19:42, 15.21s/it]
 62%|██████▏   | 23681/37963 [101:29:02<59:16:05, 14.94s/it]
 62%|██████▏   | 23682/37963 [101:29:16<58:52:13, 14.84s/it]
 62%|██████▏   | 23683/37963 [101:29:30<58:15:53, 14.69s/it]
 62%|██████▏   | 23684/37963 [101:29:45<57:53:13, 14.59s/it]
 62%|██████▏   | 23685/37963 [101:29:59<57:32:15, 14.51s/it]
 62%|██████▏   | 23686/37963 [101:30:13<57:16:45, 14.44s/it]
 62%|██████▏   | 23687/37963 [101:30:33<63:22:57, 15.98s/it]
 62%|██████▏   | 23688/37963 [101:30:47<61:21:55, 15.48s/it]
 62%|██████▏   | 23689/37963 [101:31:02<60:01:22, 15.14s/it]
 62%|██████▏   | 23690/37963 [101:31:16<59:13:38, 14.94s/it]
                                                            
{'loss': '0.1378', 'grad_norm': '6.472', 'learning_rate': '6.543e-06', 'epoch': '0.624'}

 62%|██████▏   | 23690/37963 [101:31:16<59:13:38, 14.94s/it]
 62%|██████▏   | 23691/37963 [101:31:30<57:35:30, 14.53s/it]
 62%|██████▏   | 23692/37963 [101:31:44<57:21:40, 14.47s/it]
 62%|██████▏   | 23693/37963 [101:31:58<57:09:25, 14.42s/it]
 62%|██████▏   | 23694/37963 [101:32:12<56:50:05, 14.34s/it]
 62%|██████▏   | 23695/37963 [101:32:27<56:50:52, 14.34s/it]
 62%|██████▏   | 23696/37963 [101:32:41<56:54:39, 14.36s/it]
 62%|██████▏   | 23697/37963 [101:32:56<56:52:56, 14.35s/it]
 62%|██████▏   | 23698/37963 [101:33:10<56:56:06, 14.37s/it]
 62%|██████▏   | 23699/37963 [101:33:24<56:56:30, 14.37s/it]
 62%|██████▏   | 23700/37963 [101:33:45<64:35:41, 16.30s/it]
                                                            
{'loss': '0.1242', 'grad_norm': '1.699', 'learning_rate': '6.535e-06', 'epoch': '0.6243'}

 62%|██████▏   | 23700/37963 [101:33:45<64:35:41, 16.30s/it]
 62%|██████▏   | 23701/37963 [101:34:06<70:09:53, 17.71s/it]
 62%|██████▏   | 23702/37963 [101:34:20<66:03:49, 16.68s/it]
 62%|██████▏   | 23703/37963 [101:34:35<63:23:51, 16.01s/it]
 62%|██████▏   | 23704/37963 [101:34:49<61:29:50, 15.53s/it]
 62%|██████▏   | 23705/37963 [101:35:04<60:09:40, 15.19s/it]
 62%|██████▏   | 23706/37963 [101:35:24<66:36:56, 16.82s/it]
 62%|██████▏   | 23707/37963 [101:35:39<63:39:06, 16.07s/it]
 62%|██████▏   | 23708/37963 [101:35:53<61:36:41, 15.56s/it]
 62%|██████▏   | 23709/37963 [101:36:07<59:55:20, 15.13s/it]
 62%|██████▏   | 23710/37963 [101:36:21<58:57:43, 14.89s/it]
                                                            
{'loss': '0.1331', 'grad_norm': '1.563', 'learning_rate': '6.527e-06', 'epoch': '0.6246'}

 62%|██████▏   | 23710/37963 [101:36:21<58:57:43, 14.89s/it]
 62%|██████▏   | 23711/37963 [101:36:36<58:15:03, 14.71s/it]
 62%|██████▏   | 23712/37963 [101:36:50<58:07:07, 14.68s/it]
 62%|██████▏   | 23713/37963 [101:37:11<65:26:57, 16.53s/it]
 62%|██████▏   | 23714/37963 [101:37:32<70:55:38, 17.92s/it]
 62%|██████▏   | 23715/37963 [101:37:47<66:28:23, 16.80s/it]
 62%|██████▏   | 23716/37963 [101:38:01<63:48:29, 16.12s/it]
 62%|██████▏   | 23717/37963 [101:38:16<61:53:23, 15.64s/it]
 62%|██████▏   | 23718/37963 [101:38:30<60:24:36, 15.27s/it]
 62%|██████▏   | 23719/37963 [101:38:44<59:09:51, 14.95s/it]
 62%|██████▏   | 23720/37963 [101:38:58<58:07:28, 14.69s/it]
                                                            
{'loss': '0.1229', 'grad_norm': '2.803', 'learning_rate': '6.519e-06', 'epoch': '0.6248'}

 62%|██████▏   | 23720/37963 [101:38:58<58:07:28, 14.69s/it]
 62%|██████▏   | 23721/37963 [101:39:13<57:44:27, 14.60s/it]
 62%|██████▏   | 23722/37963 [101:39:34<65:10:12, 16.47s/it]
 62%|██████▏   | 23723/37963 [101:39:48<62:43:36, 15.86s/it]
 62%|██████▏   | 23724/37963 [101:40:02<60:53:22, 15.39s/it]
 62%|██████▏   | 23725/37963 [101:40:17<59:39:29, 15.08s/it]
 62%|██████▏   | 23726/37963 [101:40:38<67:14:50, 17.00s/it]
 63%|██████▎   | 23727/37963 [101:40:52<64:07:18, 16.22s/it]
 63%|██████▎   | 23728/37963 [101:41:07<61:47:20, 15.63s/it]
 63%|██████▎   | 23729/37963 [101:41:21<59:39:28, 15.09s/it]
 63%|██████▎   | 23730/37963 [101:41:35<59:04:11, 14.94s/it]
                                                            
{'loss': '0.1137', 'grad_norm': '2.607', 'learning_rate': '6.511e-06', 'epoch': '0.6251'}

 63%|██████▎   | 23730/37963 [101:41:35<59:04:11, 14.94s/it]
 63%|██████▎   | 23731/37963 [101:41:50<58:35:03, 14.82s/it]
 63%|██████▎   | 23732/37963 [101:42:04<58:02:15, 14.68s/it]
 63%|██████▎   | 23733/37963 [101:42:18<57:38:20, 14.58s/it]
 63%|██████▎   | 23734/37963 [101:42:32<56:49:52, 14.38s/it]
 63%|██████▎   | 23735/37963 [101:42:53<64:11:18, 16.24s/it]
 63%|██████▎   | 23736/37963 [101:43:07<61:23:41, 15.54s/it]
 63%|██████▎   | 23737/37963 [101:43:21<60:00:30, 15.19s/it]
 63%|██████▎   | 23738/37963 [101:43:36<59:01:03, 14.94s/it]
 63%|██████▎   | 23739/37963 [101:43:50<58:18:32, 14.76s/it]
 63%|██████▎   | 23740/37963 [101:44:04<57:47:23, 14.63s/it]
                                                            
{'loss': '0.1228', 'grad_norm': '1.876', 'learning_rate': '6.503e-06', 'epoch': '0.6253'}

 63%|██████▎   | 23740/37963 [101:44:04<57:47:23, 14.63s/it]
 63%|██████▎   | 23741/37963 [101:44:19<57:27:38, 14.54s/it]
 63%|██████▎   | 23742/37963 [101:44:32<56:43:33, 14.36s/it]
 63%|██████▎   | 23743/37963 [101:44:47<56:50:31, 14.39s/it]
 63%|██████▎   | 23744/37963 [101:45:01<56:08:32, 14.21s/it]
 63%|██████▎   | 23745/37963 [101:45:15<55:40:46, 14.10s/it]
 63%|██████▎   | 23746/37963 [101:45:29<56:00:33, 14.18s/it]
 63%|██████▎   | 23747/37963 [101:45:43<56:20:43, 14.27s/it]
 63%|██████▎   | 23748/37963 [101:45:58<56:31:07, 14.31s/it]
 63%|██████▎   | 23749/37963 [101:46:12<56:11:56, 14.23s/it]
 63%|██████▎   | 23750/37963 [101:46:39<71:39:55, 18.15s/it]
                                                            
{'loss': '0.1292', 'grad_norm': '4.062', 'learning_rate': '6.495e-06', 'epoch': '0.6256'}

 63%|██████▎   | 23750/37963 [101:46:39<71:39:55, 18.15s/it]
 63%|██████▎   | 23751/37963 [101:46:53<66:42:32, 16.90s/it]
 63%|██████▎   | 23752/37963 [101:47:07<63:37:47, 16.12s/it]
 63%|██████▎   | 23753/37963 [101:47:22<61:35:59, 15.61s/it]
 63%|██████▎   | 23754/37963 [101:47:36<59:20:37, 15.04s/it]
 63%|██████▎   | 23755/37963 [101:47:50<58:36:36, 14.85s/it]
 63%|██████▎   | 23756/37963 [101:48:11<65:49:20, 16.68s/it]
 63%|██████▎   | 23757/37963 [101:48:25<62:48:44, 15.92s/it]
 63%|██████▎   | 23758/37963 [101:48:39<60:52:24, 15.43s/it]
 63%|██████▎   | 23759/37963 [101:48:54<59:33:26, 15.09s/it]
 63%|██████▎   | 23760/37963 [101:49:08<58:37:50, 14.86s/it]
                                                            
{'loss': '0.1229', 'grad_norm': '2.072', 'learning_rate': '6.487e-06', 'epoch': '0.6259'}

 63%|██████▎   | 23760/37963 [101:49:08<58:37:50, 14.86s/it]
 63%|██████▎   | 23761/37963 [101:49:22<57:36:48, 14.60s/it]
 63%|██████▎   | 23762/37963 [101:49:42<64:11:04, 16.27s/it]
 63%|██████▎   | 23763/37963 [101:49:57<62:01:40, 15.73s/it]
 63%|██████▎   | 23764/37963 [101:50:18<68:29:13, 17.36s/it]
 63%|██████▎   | 23765/37963 [101:50:32<64:48:06, 16.43s/it]
 63%|██████▎   | 23766/37963 [101:50:46<62:16:53, 15.79s/it]
 63%|██████▎   | 23767/37963 [101:51:01<60:27:46, 15.33s/it]
 63%|██████▎   | 23768/37963 [101:51:15<59:09:23, 15.00s/it]
 63%|██████▎   | 23769/37963 [101:51:29<58:25:07, 14.82s/it]
 63%|██████▎   | 23770/37963 [101:51:50<65:25:09, 16.59s/it]
                                                            
{'loss': '0.1211', 'grad_norm': '2.052', 'learning_rate': '6.479e-06', 'epoch': '0.6261'}

 63%|██████▎   | 23770/37963 [101:51:50<65:25:09, 16.59s/it]
 63%|██████▎   | 23771/37963 [101:52:04<62:05:00, 15.75s/it]
 63%|██████▎   | 23772/37963 [101:52:18<60:30:27, 15.35s/it]
 63%|██████▎   | 23773/37963 [101:52:32<58:41:06, 14.89s/it]
 63%|██████▎   | 23774/37963 [101:52:46<57:34:56, 14.61s/it]
 63%|██████▎   | 23775/37963 [101:53:08<66:15:03, 16.81s/it]
 63%|██████▎   | 23776/37963 [101:53:22<63:24:13, 16.09s/it]
 63%|██████▎   | 23777/37963 [101:53:37<61:29:32, 15.60s/it]
 63%|██████▎   | 23778/37963 [101:53:51<60:01:16, 15.23s/it]
 63%|██████▎   | 23779/37963 [101:54:06<59:01:43, 14.98s/it]
 63%|██████▎   | 23780/37963 [101:54:20<58:27:58, 14.84s/it]
                                                            
{'loss': '0.1184', 'grad_norm': '1.712', 'learning_rate': '6.471e-06', 'epoch': '0.6264'}

 63%|██████▎   | 23780/37963 [101:54:20<58:27:58, 14.84s/it]
 63%|██████▎   | 23781/37963 [101:54:41<65:23:43, 16.60s/it]
 63%|██████▎   | 23782/37963 [101:54:55<62:44:24, 15.93s/it]
 63%|██████▎   | 23783/37963 [101:55:09<60:40:50, 15.41s/it]
 63%|██████▎   | 23784/37963 [101:55:24<59:16:51, 15.05s/it]
 63%|██████▎   | 23785/37963 [101:55:38<58:13:06, 14.78s/it]
 63%|██████▎   | 23786/37963 [101:55:52<57:27:09, 14.59s/it]
 63%|██████▎   | 23787/37963 [101:56:06<57:08:46, 14.51s/it]
 63%|██████▎   | 23788/37963 [101:56:21<57:00:56, 14.48s/it]
 63%|██████▎   | 23789/37963 [101:56:35<56:49:46, 14.43s/it]
 63%|██████▎   | 23790/37963 [101:56:49<56:40:43, 14.40s/it]
                                                            
{'loss': '0.1203', 'grad_norm': '2.723', 'learning_rate': '6.463e-06', 'epoch': '0.6267'}

 63%|██████▎   | 23790/37963 [101:56:49<56:40:43, 14.40s/it]
 63%|██████▎   | 23791/37963 [101:57:04<56:48:59, 14.43s/it]
 63%|██████▎   | 23792/37963 [101:57:18<56:44:31, 14.41s/it]
 63%|██████▎   | 23793/37963 [101:57:33<56:46:59, 14.43s/it]
 63%|██████▎   | 23794/37963 [101:57:47<56:23:03, 14.33s/it]
 63%|██████▎   | 23795/37963 [101:58:01<56:24:58, 14.33s/it]
 63%|██████▎   | 23796/37963 [101:58:15<56:31:22, 14.36s/it]
 63%|██████▎   | 23797/37963 [101:58:29<56:08:27, 14.27s/it]
 63%|██████▎   | 23798/37963 [101:58:44<56:12:53, 14.29s/it]
 63%|██████▎   | 23799/37963 [101:59:05<63:51:33, 16.23s/it]
 63%|██████▎   | 23800/37963 [101:59:19<61:37:54, 15.67s/it]
                                                            
{'loss': '0.121', 'grad_norm': '3.561', 'learning_rate': '6.455e-06', 'epoch': '0.6269'}

 63%|██████▎   | 23800/37963 [101:59:19<61:37:54, 15.67s/it]
 63%|██████▎   | 23801/37963 [101:59:33<60:01:28, 15.26s/it]
 63%|██████▎   | 23802/37963 [101:59:47<58:25:21, 14.85s/it]
 63%|██████▎   | 23803/37963 [102:00:08<65:44:04, 16.71s/it]
 63%|██████▎   | 23804/37963 [102:00:29<70:40:31, 17.97s/it]
 63%|██████▎   | 23805/37963 [102:00:43<66:12:23, 16.83s/it]
 63%|██████▎   | 23806/37963 [102:00:57<63:05:15, 16.04s/it]
 63%|██████▎   | 23807/37963 [102:01:11<60:38:32, 15.42s/it]
 63%|██████▎   | 23808/37963 [102:01:26<59:19:45, 15.09s/it]
 63%|██████▎   | 23809/37963 [102:01:40<58:21:18, 14.84s/it]
 63%|██████▎   | 23810/37963 [102:02:01<65:19:08, 16.61s/it]
                                                            
{'loss': '0.1073', 'grad_norm': '2.175', 'learning_rate': '6.447e-06', 'epoch': '0.6272'}

 63%|██████▎   | 23810/37963 [102:02:01<65:19:08, 16.61s/it]
 63%|██████▎   | 23811/37963 [102:02:15<62:41:10, 15.95s/it]
 63%|██████▎   | 23812/37963 [102:02:29<60:24:14, 15.37s/it]
 63%|██████▎   | 23813/37963 [102:02:50<67:08:44, 17.08s/it]
 63%|██████▎   | 23814/37963 [102:03:04<63:29:01, 16.15s/it]
 63%|██████▎   | 23815/37963 [102:03:18<60:41:30, 15.44s/it]
 63%|██████▎   | 23816/37963 [102:03:32<59:23:22, 15.11s/it]
 63%|██████▎   | 23817/37963 [102:03:47<58:25:27, 14.87s/it]
 63%|██████▎   | 23818/37963 [102:04:01<57:56:36, 14.75s/it]
 63%|██████▎   | 23819/37963 [102:04:22<65:03:26, 16.56s/it]
 63%|██████▎   | 23820/37963 [102:04:36<62:23:32, 15.88s/it]
                                                            
{'loss': '0.1237', 'grad_norm': '1.504', 'learning_rate': '6.439e-06', 'epoch': '0.6275'}

 63%|██████▎   | 23820/37963 [102:04:36<62:23:32, 15.88s/it]
 63%|██████▎   | 23821/37963 [102:04:51<60:34:11, 15.42s/it]
 63%|██████▎   | 23822/37963 [102:05:05<59:23:05, 15.12s/it]
 63%|██████▎   | 23823/37963 [102:05:19<58:29:58, 14.89s/it]
 63%|██████▎   | 23824/37963 [102:05:40<65:53:16, 16.78s/it]
 63%|██████▎   | 23825/37963 [102:05:54<62:32:21, 15.92s/it]
 63%|██████▎   | 23826/37963 [102:06:09<60:38:03, 15.44s/it]
 63%|██████▎   | 23827/37963 [102:06:23<59:17:20, 15.10s/it]
 63%|██████▎   | 23828/37963 [102:06:37<58:17:43, 14.85s/it]
 63%|██████▎   | 23829/37963 [102:06:57<64:21:10, 16.39s/it]
 63%|██████▎   | 23830/37963 [102:07:11<61:21:17, 15.63s/it]
                                                            
{'loss': '0.1329', 'grad_norm': '1.668', 'learning_rate': '6.431e-06', 'epoch': '0.6277'}

 63%|██████▎   | 23830/37963 [102:07:11<61:21:17, 15.63s/it]
 63%|██████▎   | 23831/37963 [102:07:26<59:54:02, 15.26s/it]
 63%|██████▎   | 23832/37963 [102:07:39<58:14:41, 14.84s/it]
 63%|██████▎   | 23833/37963 [102:07:54<57:39:50, 14.69s/it]
 63%|██████▎   | 23834/37963 [102:08:08<57:14:32, 14.59s/it]
 63%|██████▎   | 23835/37963 [102:08:22<56:59:49, 14.52s/it]
 63%|██████▎   | 23836/37963 [102:08:37<56:46:00, 14.47s/it]
 63%|██████▎   | 23837/37963 [102:08:51<56:00:09, 14.27s/it]
 63%|██████▎   | 23838/37963 [102:09:05<56:20:51, 14.36s/it]
 63%|██████▎   | 23839/37963 [102:09:19<56:10:29, 14.32s/it]
 63%|██████▎   | 23840/37963 [102:09:34<56:16:58, 14.35s/it]
                                                            
{'loss': '0.1237', 'grad_norm': '2.152', 'learning_rate': '6.423e-06', 'epoch': '0.628'}

 63%|██████▎   | 23840/37963 [102:09:34<56:16:58, 14.35s/it]
 63%|██████▎   | 23841/37963 [102:09:48<56:21:10, 14.37s/it]
 63%|██████▎   | 23842/37963 [102:10:02<56:10:40, 14.32s/it]
 63%|██████▎   | 23843/37963 [102:10:17<56:10:13, 14.32s/it]
 63%|██████▎   | 23844/37963 [102:10:31<56:00:56, 14.28s/it]
 63%|██████▎   | 23845/37963 [102:10:45<56:04:48, 14.30s/it]
 63%|██████▎   | 23846/37963 [102:11:00<56:14:07, 14.34s/it]
 63%|██████▎   | 23847/37963 [102:11:14<56:00:46, 14.28s/it]
 63%|██████▎   | 23848/37963 [102:11:28<55:37:27, 14.19s/it]
 63%|██████▎   | 23849/37963 [102:11:49<63:33:50, 16.21s/it]
 63%|██████▎   | 23850/37963 [102:12:03<61:25:26, 15.67s/it]
                                                            
{'loss': '0.1197', 'grad_norm': '2.356', 'learning_rate': '6.415e-06', 'epoch': '0.6282'}

 63%|██████▎   | 23850/37963 [102:12:03<61:25:26, 15.67s/it]
 63%|██████▎   | 23851/37963 [102:12:24<67:06:23, 17.12s/it]
 63%|██████▎   | 23852/37963 [102:12:38<63:53:54, 16.30s/it]
 63%|██████▎   | 23853/37963 [102:12:59<69:08:11, 17.64s/it]
 63%|██████▎   | 23854/37963 [102:13:13<65:14:06, 16.65s/it]
 63%|██████▎   | 23855/37963 [102:13:27<62:30:38, 15.95s/it]
 63%|██████▎   | 23856/37963 [102:13:42<60:37:09, 15.47s/it]
 63%|██████▎   | 23857/37963 [102:13:56<58:52:52, 15.03s/it]
 63%|██████▎   | 23858/37963 [102:14:10<57:59:55, 14.80s/it]
 63%|██████▎   | 23859/37963 [102:14:31<65:06:12, 16.62s/it]
 63%|██████▎   | 23860/37963 [102:14:45<62:23:09, 15.92s/it]
                                                            
{'loss': '0.1141', 'grad_norm': '1.607', 'learning_rate': '6.407e-06', 'epoch': '0.6285'}

 63%|██████▎   | 23860/37963 [102:14:45<62:23:09, 15.92s/it]
 63%|██████▎   | 23861/37963 [102:15:00<60:29:33, 15.44s/it]
 63%|██████▎   | 23862/37963 [102:15:14<59:10:50, 15.11s/it]
 63%|██████▎   | 23863/37963 [102:15:28<58:14:19, 14.87s/it]
 63%|██████▎   | 23864/37963 [102:15:49<65:37:28, 16.76s/it]
 63%|██████▎   | 23865/37963 [102:16:04<62:54:44, 16.07s/it]
 63%|██████▎   | 23866/37963 [102:16:18<60:40:59, 15.50s/it]
 63%|██████▎   | 23867/37963 [102:16:39<67:23:53, 17.21s/it]
 63%|██████▎   | 23868/37963 [102:16:53<63:25:02, 16.20s/it]
 63%|██████▎   | 23869/37963 [102:17:07<60:12:11, 15.38s/it]
 63%|██████▎   | 23870/37963 [102:17:21<58:57:54, 15.06s/it]
                                                            
{'loss': '0.1257', 'grad_norm': '1.874', 'learning_rate': '6.399e-06', 'epoch': '0.6288'}

 63%|██████▎   | 23870/37963 [102:17:21<58:57:54, 15.06s/it]
 63%|██████▎   | 23871/37963 [102:17:42<66:40:47, 17.03s/it]
 63%|██████▎   | 23872/37963 [102:17:57<63:31:03, 16.23s/it]
 63%|██████▎   | 23873/37963 [102:18:11<61:11:30, 15.63s/it]
 63%|██████▎   | 23874/37963 [102:18:25<59:33:41, 15.22s/it]
 63%|██████▎   | 23875/37963 [102:18:40<58:28:44, 14.94s/it]
 63%|██████▎   | 23876/37963 [102:18:54<57:32:36, 14.71s/it]
 63%|██████▎   | 23877/37963 [102:19:14<64:34:37, 16.50s/it]
 63%|██████▎   | 23878/37963 [102:19:29<61:59:43, 15.85s/it]
 63%|██████▎   | 23879/37963 [102:19:43<60:14:29, 15.40s/it]
 63%|██████▎   | 23880/37963 [102:19:58<59:08:27, 15.12s/it]
                                                            
{'loss': '0.1154', 'grad_norm': '2.371', 'learning_rate': '6.391e-06', 'epoch': '0.629'}

 63%|██████▎   | 23880/37963 [102:19:58<59:08:27, 15.12s/it]
 63%|██████▎   | 23881/37963 [102:20:12<58:12:40, 14.88s/it]
 63%|██████▎   | 23882/37963 [102:20:26<57:26:03, 14.68s/it]
 63%|██████▎   | 23883/37963 [102:20:40<56:48:28, 14.52s/it]
 63%|██████▎   | 23884/37963 [102:20:55<56:35:52, 14.47s/it]
 63%|██████▎   | 23885/37963 [102:21:09<56:30:52, 14.45s/it]
 63%|██████▎   | 23886/37963 [102:21:23<56:16:35, 14.39s/it]
 63%|██████▎   | 23887/37963 [102:21:38<56:15:57, 14.39s/it]
 63%|██████▎   | 23888/37963 [102:21:52<56:14:22, 14.38s/it]
 63%|██████▎   | 23889/37963 [102:22:06<55:30:39, 14.20s/it]
 63%|██████▎   | 23890/37963 [102:22:20<55:40:47, 14.24s/it]
                                                            
{'loss': '0.1263', 'grad_norm': '4.551', 'learning_rate': '6.383e-06', 'epoch': '0.6293'}

 63%|██████▎   | 23890/37963 [102:22:20<55:40:47, 14.24s/it]
 63%|██████▎   | 23891/37963 [102:22:34<55:17:31, 14.15s/it]
 63%|██████▎   | 23892/37963 [102:22:48<55:28:41, 14.19s/it]
 63%|██████▎   | 23893/37963 [102:23:03<55:43:23, 14.26s/it]
 63%|██████▎   | 23894/37963 [102:23:17<55:53:52, 14.30s/it]
 63%|██████▎   | 23895/37963 [102:23:32<55:59:03, 14.33s/it]
 63%|██████▎   | 23896/37963 [102:23:46<55:59:11, 14.33s/it]
 63%|██████▎   | 23897/37963 [102:24:00<56:02:22, 14.34s/it]
 63%|██████▎   | 23898/37963 [102:24:15<56:14:38, 14.40s/it]
 63%|██████▎   | 23899/37963 [102:24:36<64:11:57, 16.43s/it]
 63%|██████▎   | 23900/37963 [102:24:57<69:32:59, 17.80s/it]
                                                            
{'loss': '0.1239', 'grad_norm': '1.399', 'learning_rate': '6.375e-06', 'epoch': '0.6296'}

 63%|██████▎   | 23900/37963 [102:24:57<69:32:59, 17.80s/it]
 63%|██████▎   | 23901/37963 [102:25:12<65:50:35, 16.86s/it]
 63%|██████▎   | 23902/37963 [102:25:26<62:36:43, 16.03s/it]
 63%|██████▎   | 23903/37963 [102:25:40<60:41:16, 15.54s/it]
 63%|██████▎   | 23904/37963 [102:26:01<67:10:53, 17.20s/it]
 63%|██████▎   | 23905/37963 [102:26:16<63:49:44, 16.35s/it]
 63%|██████▎   | 23906/37963 [102:26:30<61:28:00, 15.74s/it]
 63%|██████▎   | 23907/37963 [102:26:44<59:51:28, 15.33s/it]
 63%|██████▎   | 23908/37963 [102:26:59<58:46:46, 15.06s/it]
 63%|██████▎   | 23909/37963 [102:27:19<65:22:44, 16.75s/it]
 63%|██████▎   | 23910/37963 [102:27:34<62:39:19, 16.05s/it]
                                                            
{'loss': '0.1363', 'grad_norm': '2.485', 'learning_rate': '6.367e-06', 'epoch': '0.6298'}

 63%|██████▎   | 23910/37963 [102:27:34<62:39:19, 16.05s/it]
 63%|██████▎   | 23911/37963 [102:27:48<60:39:20, 15.54s/it]
 63%|██████▎   | 23912/37963 [102:28:03<59:19:04, 15.20s/it]
 63%|██████▎   | 23913/37963 [102:28:24<66:56:13, 17.15s/it]
 63%|██████▎   | 23914/37963 [102:28:39<63:43:53, 16.33s/it]
 63%|██████▎   | 23915/37963 [102:28:53<61:29:44, 15.76s/it]
 63%|██████▎   | 23916/37963 [102:29:08<59:56:32, 15.36s/it]
 63%|██████▎   | 23917/37963 [102:29:28<65:32:49, 16.80s/it]
 63%|██████▎   | 23918/37963 [102:29:42<62:40:01, 16.06s/it]
 63%|██████▎   | 23919/37963 [102:29:56<60:42:41, 15.56s/it]
 63%|██████▎   | 23920/37963 [102:30:18<67:16:42, 17.25s/it]
                                                            
{'loss': '0.1035', 'grad_norm': '1.266', 'learning_rate': '6.359e-06', 'epoch': '0.6301'}

 63%|██████▎   | 23920/37963 [102:30:18<67:16:42, 17.25s/it]
 63%|██████▎   | 23921/37963 [102:30:32<63:50:36, 16.37s/it]
 63%|██████▎   | 23922/37963 [102:30:46<61:25:49, 15.75s/it]
 63%|██████▎   | 23923/37963 [102:31:00<59:32:44, 15.27s/it]
 63%|██████▎   | 23924/37963 [102:31:15<58:35:51, 15.03s/it]
 63%|██████▎   | 23925/37963 [102:31:29<57:36:17, 14.77s/it]
 63%|██████▎   | 23926/37963 [102:31:50<64:27:35, 16.53s/it]
 63%|██████▎   | 23927/37963 [102:32:04<62:03:40, 15.92s/it]
 63%|██████▎   | 23928/37963 [102:32:19<60:14:54, 15.45s/it]
 63%|██████▎   | 23929/37963 [102:32:33<59:02:55, 15.15s/it]
 63%|██████▎   | 23930/37963 [102:32:47<58:01:46, 14.89s/it]
                                                            
{'loss': '0.1304', 'grad_norm': '2.804', 'learning_rate': '6.351e-06', 'epoch': '0.6304'}

 63%|██████▎   | 23930/37963 [102:32:47<58:01:46, 14.89s/it]
 63%|██████▎   | 23931/37963 [102:33:02<57:27:51, 14.74s/it]
 63%|██████▎   | 23932/37963 [102:33:16<57:07:10, 14.66s/it]
 63%|██████▎   | 23933/37963 [102:33:31<56:51:28, 14.59s/it]
 63%|██████▎   | 23934/37963 [102:33:45<56:39:10, 14.54s/it]
 63%|██████▎   | 23935/37963 [102:33:59<56:34:58, 14.52s/it]
 63%|██████▎   | 23936/37963 [102:34:14<56:19:34, 14.46s/it]
 63%|██████▎   | 23937/37963 [102:34:28<56:09:02, 14.41s/it]
 63%|██████▎   | 23938/37963 [102:34:42<55:54:22, 14.35s/it]
 63%|██████▎   | 23939/37963 [102:34:56<55:43:29, 14.30s/it]
 63%|██████▎   | 23940/37963 [102:35:11<55:46:02, 14.32s/it]
                                                            
{'loss': '0.1283', 'grad_norm': '2.492', 'learning_rate': '6.343e-06', 'epoch': '0.6306'}

 63%|██████▎   | 23940/37963 [102:35:11<55:46:02, 14.32s/it]
 63%|██████▎   | 23941/37963 [102:35:25<55:46:56, 14.32s/it]
 63%|██████▎   | 23942/37963 [102:35:39<55:47:47, 14.33s/it]
 63%|██████▎   | 23943/37963 [102:35:54<55:52:30, 14.35s/it]
 63%|██████▎   | 23944/37963 [102:36:08<55:57:01, 14.37s/it]
 63%|██████▎   | 23945/37963 [102:36:23<55:48:25, 14.33s/it]
 63%|██████▎   | 23946/37963 [102:36:37<55:52:18, 14.35s/it]
 63%|██████▎   | 23947/37963 [102:36:58<63:19:00, 16.26s/it]
 63%|██████▎   | 23948/37963 [102:37:18<68:30:40, 17.60s/it]
 63%|██████▎   | 23949/37963 [102:37:33<64:38:55, 16.61s/it]
 63%|██████▎   | 23950/37963 [102:37:47<61:38:47, 15.84s/it]
                                                            
{'loss': '0.1346', 'grad_norm': '3.578', 'learning_rate': '6.335e-06', 'epoch': '0.6309'}

 63%|██████▎   | 23950/37963 [102:37:47<61:38:47, 15.84s/it]
 63%|██████▎   | 23951/37963 [102:38:01<59:52:04, 15.38s/it]
 63%|██████▎   | 23952/37963 [102:38:15<58:10:02, 14.95s/it]
 63%|██████▎   | 23953/37963 [102:38:29<57:14:39, 14.71s/it]
 63%|██████▎   | 23954/37963 [102:38:44<56:55:07, 14.63s/it]
 63%|██████▎   | 23955/37963 [102:39:05<64:21:31, 16.54s/it]
 63%|██████▎   | 23956/37963 [102:39:19<61:36:07, 15.83s/it]
 63%|██████▎   | 23957/37963 [102:39:33<59:37:07, 15.32s/it]
 63%|██████▎   | 23958/37963 [102:39:54<65:57:55, 16.96s/it]
 63%|██████▎   | 23959/37963 [102:40:08<62:33:57, 16.08s/it]
 63%|██████▎   | 23960/37963 [102:40:22<60:30:45, 15.56s/it]
                                                            
{'loss': '0.1202', 'grad_norm': '2.057', 'learning_rate': '6.327e-06', 'epoch': '0.6311'}

 63%|██████▎   | 23960/37963 [102:40:22<60:30:45, 15.56s/it]
 63%|██████▎   | 23961/37963 [102:40:43<67:17:24, 17.30s/it]
 63%|██████▎   | 23962/37963 [102:40:58<63:57:52, 16.45s/it]
 63%|██████▎   | 23963/37963 [102:41:12<61:28:20, 15.81s/it]
 63%|██████▎   | 23964/37963 [102:41:26<59:10:29, 15.22s/it]
 63%|██████▎   | 23965/37963 [102:41:40<58:10:19, 14.96s/it]
 63%|██████▎   | 23966/37963 [102:41:55<57:15:56, 14.73s/it]
 63%|██████▎   | 23967/37963 [102:42:15<63:59:13, 16.46s/it]
 63%|██████▎   | 23968/37963 [102:42:29<61:30:34, 15.82s/it]
 63%|██████▎   | 23969/37963 [102:42:51<67:49:25, 17.45s/it]
 63%|██████▎   | 23970/37963 [102:43:05<64:12:07, 16.52s/it]
                                                            
{'loss': '0.1225', 'grad_norm': '4.645', 'learning_rate': '6.319e-06', 'epoch': '0.6314'}

 63%|██████▎   | 23970/37963 [102:43:05<64:12:07, 16.52s/it]
 63%|██████▎   | 23971/37963 [102:43:19<61:52:50, 15.92s/it]
 63%|██████▎   | 23972/37963 [102:43:34<59:59:24, 15.44s/it]
 63%|██████▎   | 23973/37963 [102:43:48<58:38:08, 15.09s/it]
 63%|██████▎   | 23974/37963 [102:44:09<65:10:52, 16.77s/it]
 63%|██████▎   | 23975/37963 [102:44:23<62:23:36, 16.06s/it]
 63%|██████▎   | 23976/37963 [102:44:38<60:25:02, 15.55s/it]
 63%|██████▎   | 23977/37963 [102:44:52<58:58:58, 15.18s/it]
 63%|██████▎   | 23978/37963 [102:45:06<57:58:04, 14.92s/it]
 63%|██████▎   | 23979/37963 [102:45:21<57:17:04, 14.75s/it]
 63%|██████▎   | 23980/37963 [102:45:35<56:44:13, 14.61s/it]
                                                            
{'loss': '0.1307', 'grad_norm': '2.902', 'learning_rate': '6.312e-06', 'epoch': '0.6317'}

 63%|██████▎   | 23980/37963 [102:45:35<56:44:13, 14.61s/it]
 63%|██████▎   | 23981/37963 [102:45:49<56:38:04, 14.58s/it]
 63%|██████▎   | 23982/37963 [102:46:04<56:14:22, 14.48s/it]
 63%|██████▎   | 23983/37963 [102:46:18<56:03:40, 14.44s/it]
 63%|██████▎   | 23984/37963 [102:46:32<55:16:17, 14.23s/it]
 63%|██████▎   | 23985/37963 [102:46:46<55:25:56, 14.28s/it]
 63%|██████▎   | 23986/37963 [102:47:01<55:45:41, 14.36s/it]
 63%|██████▎   | 23987/37963 [102:47:15<55:23:26, 14.27s/it]
 63%|██████▎   | 23988/37963 [102:47:29<55:35:45, 14.32s/it]
 63%|██████▎   | 23989/37963 [102:47:43<55:40:56, 14.34s/it]
 63%|██████▎   | 23990/37963 [102:47:57<54:42:38, 14.10s/it]
                                                            
{'loss': '0.1266', 'grad_norm': '1.052', 'learning_rate': '6.304e-06', 'epoch': '0.6319'}

 63%|██████▎   | 23990/37963 [102:47:57<54:42:38, 14.10s/it]
 63%|██████▎   | 23991/37963 [102:48:11<54:59:49, 14.17s/it]
 63%|██████▎   | 23992/37963 [102:48:26<55:09:42, 14.21s/it]
 63%|██████▎   | 23993/37963 [102:48:40<54:55:15, 14.15s/it]
 63%|██████▎   | 23994/37963 [102:48:54<55:16:21, 14.24s/it]
 63%|██████▎   | 23995/37963 [102:49:08<55:16:36, 14.25s/it]
 63%|██████▎   | 23996/37963 [102:49:23<55:08:58, 14.21s/it]
 63%|██████▎   | 23997/37963 [102:49:49<69:45:15, 17.98s/it]
 63%|██████▎   | 23998/37963 [102:50:03<65:17:20, 16.83s/it]
 63%|██████▎   | 23999/37963 [102:50:18<62:20:41, 16.07s/it]
 63%|██████▎   | 24000/37963 [102:50:32<59:55:36, 15.45s/it]
                                                            
{'loss': '0.123', 'grad_norm': '2.909', 'learning_rate': '6.296e-06', 'epoch': '0.6322'}

 63%|██████▎   | 24000/37963 [102:50:32<59:55:36, 15.45s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.23s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.24s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 63%|██████▎   | 24001/37963 [102:52:16<163:44:02, 42.22s/it]
 63%|██████▎   | 24002/37963 [102:52:31<131:34:16, 33.93s/it]
 63%|██████▎   | 24003/37963 [102:52:47<110:29:18, 28.49s/it]
 63%|██████▎   | 24004/37963 [102:53:08<102:01:32, 26.31s/it]
 63%|██████▎   | 24005/37963 [102:53:22<87:59:09, 22.69s/it] 
 63%|██████▎   | 24006/37963 [102:53:36<77:50:05, 20.08s/it]
 63%|██████▎   | 24007/37963 [102:53:57<78:41:54, 20.30s/it]
 63%|██████▎   | 24008/37963 [102:54:11<71:29:25, 18.44s/it]
 63%|██████▎   | 24009/37963 [102:54:32<74:35:23, 19.24s/it]
 63%|██████▎   | 24010/37963 [102:54:47<69:01:08, 17.81s/it]
                                                            
{'loss': '0.117', 'grad_norm': '5.285', 'learning_rate': '6.288e-06', 'epoch': '0.6325'}

 63%|██████▎   | 24010/37963 [102:54:47<69:01:08, 17.81s/it]
 63%|██████▎   | 24011/37963 [102:55:01<65:06:19, 16.80s/it]
 63%|██████▎   | 24012/37963 [102:55:15<62:10:18, 16.04s/it]
 63%|██████▎   | 24013/37963 [102:55:36<67:17:16, 17.36s/it]
 63%|██████▎   | 24014/37963 [102:55:50<63:43:18, 16.45s/it]
 63%|██████▎   | 24015/37963 [102:56:05<61:16:42, 15.82s/it]
 63%|██████▎   | 24016/37963 [102:56:27<68:24:34, 17.66s/it]
 63%|██████▎   | 24017/37963 [102:56:41<64:23:53, 16.62s/it]
 63%|██████▎   | 24018/37963 [102:56:55<61:47:04, 15.95s/it]
 63%|██████▎   | 24019/37963 [102:57:09<59:56:27, 15.48s/it]
 63%|██████▎   | 24020/37963 [102:57:24<58:36:17, 15.13s/it]
                                                            
{'loss': '0.1213', 'grad_norm': '5.237', 'learning_rate': '6.28e-06', 'epoch': '0.6327'}

 63%|██████▎   | 24020/37963 [102:57:24<58:36:17, 15.13s/it]
 63%|██████▎   | 24021/37963 [102:57:38<57:06:31, 14.75s/it]
 63%|██████▎   | 24022/37963 [102:57:52<56:51:04, 14.68s/it]
 63%|██████▎   | 24023/37963 [102:58:13<64:14:44, 16.59s/it]
 63%|██████▎   | 24024/37963 [102:58:28<61:49:05, 15.97s/it]
 63%|██████▎   | 24025/37963 [102:58:42<59:51:52, 15.46s/it]
 63%|██████▎   | 24026/37963 [102:58:56<58:35:20, 15.13s/it]
 63%|██████▎   | 24027/37963 [102:59:11<57:42:04, 14.91s/it]
 63%|██████▎   | 24028/37963 [102:59:25<57:06:54, 14.76s/it]
 63%|██████▎   | 24029/37963 [102:59:39<56:34:46, 14.62s/it]
 63%|██████▎   | 24030/37963 [102:59:54<56:15:03, 14.53s/it]
                                                            
{'loss': '0.1256', 'grad_norm': '2.869', 'learning_rate': '6.272e-06', 'epoch': '0.633'}

 63%|██████▎   | 24030/37963 [102:59:54<56:15:03, 14.53s/it]
 63%|██████▎   | 24031/37963 [103:00:08<56:01:10, 14.48s/it]
 63%|██████▎   | 24032/37963 [103:00:23<55:57:17, 14.46s/it]
 63%|██████▎   | 24033/37963 [103:00:37<55:51:43, 14.44s/it]
 63%|██████▎   | 24034/37963 [103:00:51<55:17:53, 14.29s/it]
 63%|██████▎   | 24035/37963 [103:01:05<55:27:07, 14.33s/it]
 63%|██████▎   | 24036/37963 [103:01:20<55:28:20, 14.34s/it]
 63%|██████▎   | 24037/37963 [103:01:34<55:28:41, 14.34s/it]
 63%|██████▎   | 24038/37963 [103:01:48<55:31:58, 14.36s/it]
 63%|██████▎   | 24039/37963 [103:02:03<55:30:24, 14.35s/it]
 63%|██████▎   | 24040/37963 [103:02:17<54:52:38, 14.19s/it]
                                                            
{'loss': '0.1331', 'grad_norm': '1.803', 'learning_rate': '6.264e-06', 'epoch': '0.6333'}

 63%|██████▎   | 24040/37963 [103:02:17<54:52:38, 14.19s/it]
 63%|██████▎   | 24041/37963 [103:02:31<54:55:19, 14.20s/it]
 63%|██████▎   | 24042/37963 [103:02:45<55:01:56, 14.23s/it]
 63%|██████▎   | 24043/37963 [103:02:59<54:30:57, 14.10s/it]
 63%|██████▎   | 24044/37963 [103:03:13<54:26:16, 14.08s/it]
 63%|██████▎   | 24045/37963 [103:03:27<54:44:18, 14.16s/it]
 63%|██████▎   | 24046/37963 [103:03:42<55:07:00, 14.26s/it]
 63%|██████▎   | 24047/37963 [103:04:02<62:29:52, 16.17s/it]
 63%|██████▎   | 24048/37963 [103:04:23<68:00:20, 17.59s/it]
 63%|██████▎   | 24049/37963 [103:04:38<64:17:26, 16.63s/it]
 63%|██████▎   | 24050/37963 [103:04:52<61:51:28, 16.01s/it]
                                                            
{'loss': '0.1334', 'grad_norm': '1.603', 'learning_rate': '6.256e-06', 'epoch': '0.6335'}

 63%|██████▎   | 24050/37963 [103:04:52<61:51:28, 16.01s/it]
 63%|██████▎   | 24051/37963 [103:05:13<67:38:49, 17.51s/it]
 63%|██████▎   | 24052/37963 [103:05:28<63:57:57, 16.55s/it]
 63%|██████▎   | 24053/37963 [103:05:42<61:28:49, 15.91s/it]
 63%|██████▎   | 24054/37963 [103:05:56<59:39:35, 15.44s/it]
 63%|██████▎   | 24055/37963 [103:06:10<57:49:15, 14.97s/it]
 63%|██████▎   | 24056/37963 [103:06:31<64:31:56, 16.70s/it]
 63%|██████▎   | 24057/37963 [103:06:45<61:53:15, 16.02s/it]
 63%|██████▎   | 24058/37963 [103:07:07<68:10:44, 17.65s/it]
 63%|██████▎   | 24059/37963 [103:07:21<64:29:59, 16.70s/it]
 63%|██████▎   | 24060/37963 [103:07:36<61:53:31, 16.03s/it]
                                                            
{'loss': '0.1231', 'grad_norm': '1.176', 'learning_rate': '6.248e-06', 'epoch': '0.6338'}

 63%|██████▎   | 24060/37963 [103:07:36<61:53:31, 16.03s/it]
 63%|██████▎   | 24061/37963 [103:07:56<67:15:08, 17.42s/it]
 63%|██████▎   | 24062/37963 [103:08:11<63:58:27, 16.57s/it]
 63%|██████▎   | 24063/37963 [103:08:25<61:24:25, 15.90s/it]
 63%|██████▎   | 24064/37963 [103:08:46<67:21:32, 17.45s/it]
 63%|██████▎   | 24065/37963 [103:09:00<63:12:45, 16.37s/it]
 63%|██████▎   | 24066/37963 [103:09:15<60:47:29, 15.75s/it]
 63%|██████▎   | 24067/37963 [103:09:28<58:28:41, 15.15s/it]
 63%|██████▎   | 24068/37963 [103:09:42<57:18:02, 14.85s/it]
 63%|██████▎   | 24069/37963 [103:09:57<56:49:04, 14.72s/it]
 63%|██████▎   | 24070/37963 [103:10:11<56:29:28, 14.64s/it]
                                                            
{'loss': '0.1196', 'grad_norm': '2.04', 'learning_rate': '6.24e-06', 'epoch': '0.634'}

 63%|██████▎   | 24070/37963 [103:10:11<56:29:28, 14.64s/it]
 63%|██████▎   | 24071/37963 [103:10:26<56:09:29, 14.55s/it]
 63%|██████▎   | 24072/37963 [103:10:40<55:58:19, 14.51s/it]
 63%|██████▎   | 24073/37963 [103:11:01<63:43:03, 16.51s/it]
 63%|██████▎   | 24074/37963 [103:11:16<61:09:37, 15.85s/it]
 63%|██████▎   | 24075/37963 [103:11:30<59:27:57, 15.41s/it]
 63%|██████▎   | 24076/37963 [103:11:44<58:04:52, 15.06s/it]
 63%|██████▎   | 24077/37963 [103:11:58<57:07:50, 14.81s/it]
 63%|██████▎   | 24078/37963 [103:12:13<56:21:26, 14.61s/it]
 63%|██████▎   | 24079/37963 [103:12:26<55:02:48, 14.27s/it]
 63%|██████▎   | 24080/37963 [103:12:40<55:00:53, 14.27s/it]
                                                            
{'loss': '0.1172', 'grad_norm': '1.672', 'learning_rate': '6.232e-06', 'epoch': '0.6343'}

 63%|██████▎   | 24080/37963 [103:12:40<55:00:53, 14.27s/it]
 63%|██████▎   | 24081/37963 [103:12:54<54:50:45, 14.22s/it]
 63%|██████▎   | 24082/37963 [103:13:09<54:57:04, 14.25s/it]
 63%|██████▎   | 24083/37963 [103:13:23<54:27:05, 14.12s/it]
 63%|██████▎   | 24084/37963 [103:13:37<54:43:17, 14.19s/it]
 63%|██████▎   | 24085/37963 [103:13:51<54:54:06, 14.24s/it]
 63%|██████▎   | 24086/37963 [103:14:05<54:32:32, 14.15s/it]
 63%|██████▎   | 24087/37963 [103:14:20<54:41:07, 14.19s/it]
 63%|██████▎   | 24088/37963 [103:14:34<54:46:13, 14.21s/it]
 63%|██████▎   | 24089/37963 [103:14:48<54:18:31, 14.09s/it]
 63%|██████▎   | 24090/37963 [103:15:02<54:24:51, 14.12s/it]
                                                            
{'loss': '0.1172', 'grad_norm': '2.832', 'learning_rate': '6.224e-06', 'epoch': '0.6346'}

 63%|██████▎   | 24090/37963 [103:15:02<54:24:51, 14.12s/it]
 63%|██████▎   | 24091/37963 [103:15:16<54:26:29, 14.13s/it]
 63%|██████▎   | 24092/37963 [103:15:30<54:38:26, 14.18s/it]
 63%|██████▎   | 24093/37963 [103:15:44<54:41:32, 14.20s/it]
 63%|██████▎   | 24094/37963 [103:16:05<61:46:30, 16.04s/it]
 63%|██████▎   | 24095/37963 [103:16:19<59:16:15, 15.39s/it]
 63%|██████▎   | 24096/37963 [103:16:33<58:08:07, 15.09s/it]
 63%|██████▎   | 24097/37963 [103:16:54<64:36:38, 16.77s/it]
 63%|██████▎   | 24098/37963 [103:17:08<61:40:10, 16.01s/it]
 63%|██████▎   | 24099/37963 [103:17:22<59:34:29, 15.47s/it]
 63%|██████▎   | 24100/37963 [103:17:37<58:24:26, 15.17s/it]
                                                            
{'loss': '0.1211', 'grad_norm': '2.606', 'learning_rate': '6.217e-06', 'epoch': '0.6348'}

 63%|██████▎   | 24100/37963 [103:17:37<58:24:26, 15.17s/it]
 63%|██████▎   | 24101/37963 [103:17:57<64:39:36, 16.79s/it]
 63%|██████▎   | 24102/37963 [103:18:12<61:52:42, 16.07s/it]
 63%|██████▎   | 24103/37963 [103:18:25<59:11:51, 15.38s/it]
 63%|██████▎   | 24104/37963 [103:18:46<65:27:40, 17.00s/it]
 63%|██████▎   | 24105/37963 [103:19:01<62:24:53, 16.21s/it]
 63%|██████▎   | 24106/37963 [103:19:22<67:54:29, 17.64s/it]
 64%|██████▎   | 24107/37963 [103:19:36<63:54:27, 16.60s/it]
 64%|██████▎   | 24108/37963 [103:19:56<67:46:12, 17.61s/it]
 64%|██████▎   | 24109/37963 [103:20:10<64:03:42, 16.65s/it]
 64%|██████▎   | 24110/37963 [103:20:24<61:19:42, 15.94s/it]
                                                            
{'loss': '0.1243', 'grad_norm': '2.808', 'learning_rate': '6.209e-06', 'epoch': '0.6351'}

 64%|██████▎   | 24110/37963 [103:20:24<61:19:42, 15.94s/it]
 64%|██████▎   | 24111/37963 [103:20:38<59:04:35, 15.35s/it]
 64%|██████▎   | 24112/37963 [103:20:53<57:56:07, 15.06s/it]
 64%|██████▎   | 24113/37963 [103:21:15<65:41:33, 17.08s/it]
 64%|██████▎   | 24114/37963 [103:21:29<62:35:38, 16.27s/it]
 64%|██████▎   | 24115/37963 [103:21:43<60:14:03, 15.66s/it]
 64%|██████▎   | 24116/37963 [103:21:57<58:41:36, 15.26s/it]
 64%|██████▎   | 24117/37963 [103:22:12<57:47:40, 15.03s/it]
 64%|██████▎   | 24118/37963 [103:22:26<56:29:43, 14.69s/it]
 64%|██████▎   | 24119/37963 [103:22:40<56:14:58, 14.63s/it]
 64%|██████▎   | 24120/37963 [103:22:55<55:51:37, 14.53s/it]
                                                            
{'loss': '0.1221', 'grad_norm': '3.939', 'learning_rate': '6.201e-06', 'epoch': '0.6354'}

 64%|██████▎   | 24120/37963 [103:22:55<55:51:37, 14.53s/it]
 64%|██████▎   | 24121/37963 [103:23:09<55:33:17, 14.45s/it]
 64%|██████▎   | 24122/37963 [103:23:23<55:18:33, 14.39s/it]
 64%|██████▎   | 24123/37963 [103:23:44<62:39:55, 16.30s/it]
 64%|██████▎   | 24124/37963 [103:23:58<59:56:54, 15.59s/it]
 64%|██████▎   | 24125/37963 [103:24:12<58:25:46, 15.20s/it]
 64%|██████▎   | 24126/37963 [103:24:26<56:31:05, 14.70s/it]
 64%|██████▎   | 24127/37963 [103:24:40<56:12:34, 14.63s/it]
 64%|██████▎   | 24128/37963 [103:24:54<55:45:25, 14.51s/it]
 64%|██████▎   | 24129/37963 [103:25:08<55:05:58, 14.34s/it]
 64%|██████▎   | 24130/37963 [103:25:23<55:04:11, 14.33s/it]
                                                            
{'loss': '0.1224', 'grad_norm': '1.268', 'learning_rate': '6.193e-06', 'epoch': '0.6356'}

 64%|██████▎   | 24130/37963 [103:25:23<55:04:11, 14.33s/it]
 64%|██████▎   | 24131/37963 [103:25:37<55:02:50, 14.33s/it]
 64%|██████▎   | 24132/37963 [103:25:51<54:48:33, 14.27s/it]
 64%|██████▎   | 24133/37963 [103:26:05<54:50:09, 14.27s/it]
 64%|██████▎   | 24134/37963 [103:26:20<54:55:04, 14.30s/it]
 64%|██████▎   | 24135/37963 [103:26:33<54:14:29, 14.12s/it]
 64%|██████▎   | 24136/37963 [103:26:48<54:30:31, 14.19s/it]
 64%|██████▎   | 24137/37963 [103:27:02<54:29:02, 14.19s/it]
 64%|██████▎   | 24138/37963 [103:27:16<54:42:48, 14.25s/it]
 64%|██████▎   | 24139/37963 [103:27:31<54:50:45, 14.28s/it]
 64%|██████▎   | 24140/37963 [103:27:45<55:15:04, 14.39s/it]
                                                            
{'loss': '0.1244', 'grad_norm': '1.485', 'learning_rate': '6.185e-06', 'epoch': '0.6359'}

 64%|██████▎   | 24140/37963 [103:27:45<55:15:04, 14.39s/it]
 64%|██████▎   | 24141/37963 [103:28:00<55:02:46, 14.34s/it]
 64%|██████▎   | 24142/37963 [103:28:14<55:07:06, 14.36s/it]
 64%|██████▎   | 24143/37963 [103:28:35<62:26:01, 16.26s/it]
 64%|██████▎   | 24144/37963 [103:28:49<60:19:07, 15.71s/it]
 64%|██████▎   | 24145/37963 [103:29:03<58:31:25, 15.25s/it]
 64%|██████▎   | 24146/37963 [103:29:24<64:57:13, 16.92s/it]
 64%|██████▎   | 24147/37963 [103:29:39<62:05:46, 16.18s/it]
 64%|██████▎   | 24148/37963 [103:29:53<59:48:56, 15.59s/it]
 64%|██████▎   | 24149/37963 [103:30:14<66:18:09, 17.28s/it]
 64%|██████▎   | 24150/37963 [103:30:28<62:58:26, 16.41s/it]
                                                            
{'loss': '0.1161', 'grad_norm': '2.891', 'learning_rate': '6.177e-06', 'epoch': '0.6361'}

 64%|██████▎   | 24150/37963 [103:30:28<62:58:26, 16.41s/it]
 64%|██████▎   | 24151/37963 [103:30:43<60:24:11, 15.74s/it]
 64%|██████▎   | 24152/37963 [103:30:57<58:54:07, 15.35s/it]
 64%|██████▎   | 24153/37963 [103:31:11<57:47:45, 15.07s/it]
 64%|██████▎   | 24154/37963 [103:31:32<63:37:06, 16.59s/it]
 64%|██████▎   | 24155/37963 [103:31:52<68:39:59, 17.90s/it]
 64%|██████▎   | 24156/37963 [103:32:13<71:54:57, 18.75s/it]
 64%|██████▎   | 24157/37963 [103:32:28<66:56:57, 17.46s/it]
 64%|██████▎   | 24158/37963 [103:32:42<62:56:46, 16.41s/it]
 64%|██████▎   | 24159/37963 [103:32:56<60:48:06, 15.86s/it]
 64%|██████▎   | 24160/37963 [103:33:11<59:03:04, 15.40s/it]
                                                            
{'loss': '0.1288', 'grad_norm': '1.792', 'learning_rate': '6.169e-06', 'epoch': '0.6364'}

 64%|██████▎   | 24160/37963 [103:33:11<59:03:04, 15.40s/it]
 64%|██████▎   | 24161/37963 [103:33:25<57:52:12, 15.09s/it]
 64%|██████▎   | 24162/37963 [103:33:39<57:06:07, 14.90s/it]
 64%|██████▎   | 24163/37963 [103:34:01<64:32:39, 16.84s/it]
 64%|██████▎   | 24164/37963 [103:34:15<61:56:26, 16.16s/it]
 64%|██████▎   | 24165/37963 [103:34:30<59:50:04, 15.61s/it]
 64%|██████▎   | 24166/37963 [103:34:44<58:32:00, 15.27s/it]
 64%|██████▎   | 24167/37963 [103:34:58<57:28:03, 15.00s/it]
 64%|██████▎   | 24168/37963 [103:35:13<56:42:47, 14.80s/it]
 64%|██████▎   | 24169/37963 [103:35:27<56:12:22, 14.67s/it]
 64%|██████▎   | 24170/37963 [103:35:42<55:54:48, 14.59s/it]
                                                            
{'loss': '0.1327', 'grad_norm': '3.641', 'learning_rate': '6.161e-06', 'epoch': '0.6367'}

 64%|██████▎   | 24170/37963 [103:35:42<55:54:48, 14.59s/it]
 64%|██████▎   | 24171/37963 [103:36:03<63:15:23, 16.51s/it]
 64%|██████▎   | 24172/37963 [103:36:17<60:47:18, 15.87s/it]
 64%|██████▎   | 24173/37963 [103:36:31<59:10:03, 15.45s/it]
 64%|██████▎   | 24174/37963 [103:36:46<57:52:13, 15.11s/it]
 64%|██████▎   | 24175/37963 [103:37:00<57:01:56, 14.89s/it]
 64%|██████▎   | 24176/37963 [103:37:14<56:24:36, 14.73s/it]
 64%|██████▎   | 24177/37963 [103:37:29<56:07:32, 14.66s/it]
 64%|██████▎   | 24178/37963 [103:37:43<55:47:09, 14.57s/it]
 64%|██████▎   | 24179/37963 [103:37:58<55:39:58, 14.54s/it]
 64%|██████▎   | 24180/37963 [103:38:12<55:30:12, 14.50s/it]
                                                            
{'loss': '0.1215', 'grad_norm': '1.951', 'learning_rate': '6.153e-06', 'epoch': '0.6369'}

 64%|██████▎   | 24180/37963 [103:38:12<55:30:12, 14.50s/it]
 64%|██████▎   | 24181/37963 [103:38:27<55:25:31, 14.48s/it]
 64%|██████▎   | 24182/37963 [103:38:41<55:25:06, 14.48s/it]
 64%|██████▎   | 24183/37963 [103:38:55<55:13:21, 14.43s/it]
 64%|██████▎   | 24184/37963 [103:39:09<54:39:45, 14.28s/it]
 64%|██████▎   | 24185/37963 [103:39:24<54:47:46, 14.32s/it]
 64%|██████▎   | 24186/37963 [103:39:38<54:48:20, 14.32s/it]
 64%|██████▎   | 24187/37963 [103:39:52<54:46:21, 14.31s/it]
 64%|██████▎   | 24188/37963 [103:40:07<54:47:55, 14.32s/it]
 64%|██████▎   | 24189/37963 [103:40:21<54:54:14, 14.35s/it]
 64%|██████▎   | 24190/37963 [103:40:35<54:40:38, 14.29s/it]
                                                            
{'loss': '0.1191', 'grad_norm': '2.178', 'learning_rate': '6.146e-06', 'epoch': '0.6372'}

 64%|██████▎   | 24190/37963 [103:40:35<54:40:38, 14.29s/it]
 64%|██████▎   | 24191/37963 [103:40:55<61:09:17, 15.99s/it]
 64%|██████▎   | 24192/37963 [103:41:10<59:19:13, 15.51s/it]
 64%|██████▎   | 24193/37963 [103:41:24<58:02:47, 15.18s/it]
 64%|██████▎   | 24194/37963 [103:41:38<57:03:11, 14.92s/it]
 64%|██████▎   | 24195/37963 [103:41:58<63:05:49, 16.50s/it]
 64%|██████▎   | 24196/37963 [103:42:13<60:24:18, 15.80s/it]
 64%|██████▎   | 24197/37963 [103:42:27<58:18:36, 15.25s/it]
 64%|██████▎   | 24198/37963 [103:42:48<64:46:29, 16.94s/it]
 64%|██████▎   | 24199/37963 [103:43:02<61:58:20, 16.21s/it]
 64%|██████▎   | 24200/37963 [103:43:16<59:42:46, 15.62s/it]
                                                            
{'loss': '0.1107', 'grad_norm': '1.982', 'learning_rate': '6.138e-06', 'epoch': '0.6375'}

 64%|██████▎   | 24200/37963 [103:43:16<59:42:46, 15.62s/it]
 64%|██████▎   | 24201/37963 [103:43:31<58:13:44, 15.23s/it]
 64%|██████▍   | 24202/37963 [103:43:51<64:35:21, 16.90s/it]
 64%|██████▍   | 24203/37963 [103:44:12<69:15:00, 18.12s/it]
 64%|██████▍   | 24204/37963 [103:44:26<64:08:54, 16.78s/it]
 64%|██████▍   | 24205/37963 [103:44:47<69:14:11, 18.12s/it]
 64%|██████▍   | 24206/37963 [103:45:02<65:00:53, 17.01s/it]
 64%|██████▍   | 24207/37963 [103:45:16<61:42:49, 16.15s/it]
 64%|██████▍   | 24208/37963 [103:45:30<59:05:19, 15.46s/it]
 64%|██████▍   | 24209/37963 [103:45:44<57:32:23, 15.06s/it]
 64%|██████▍   | 24210/37963 [103:45:58<56:49:55, 14.88s/it]
                                                            
{'loss': '0.115', 'grad_norm': '2.779', 'learning_rate': '6.13e-06', 'epoch': '0.6377'}

 64%|██████▍   | 24210/37963 [103:45:58<56:49:55, 14.88s/it]
 64%|██████▍   | 24211/37963 [103:46:20<64:28:58, 16.88s/it]
 64%|██████▍   | 24212/37963 [103:46:34<61:33:14, 16.11s/it]
 64%|██████▍   | 24213/37963 [103:46:48<59:26:41, 15.56s/it]
 64%|██████▍   | 24214/37963 [103:47:03<58:01:51, 15.19s/it]
 64%|██████▍   | 24215/37963 [103:47:17<57:07:47, 14.96s/it]
 64%|██████▍   | 24216/37963 [103:47:32<56:30:23, 14.80s/it]
 64%|██████▍   | 24217/37963 [103:47:46<55:58:03, 14.66s/it]
 64%|██████▍   | 24218/37963 [103:48:00<55:13:29, 14.46s/it]
 64%|██████▍   | 24219/37963 [103:48:14<55:11:47, 14.46s/it]
 64%|██████▍   | 24220/37963 [103:48:35<62:30:47, 16.38s/it]
                                                            
{'loss': '0.1107', 'grad_norm': '2.298', 'learning_rate': '6.122e-06', 'epoch': '0.638'}

 64%|██████▍   | 24220/37963 [103:48:35<62:30:47, 16.38s/it]
 64%|██████▍   | 24221/37963 [103:48:50<60:08:59, 15.76s/it]
 64%|██████▍   | 24222/37963 [103:49:04<58:29:15, 15.32s/it]
 64%|██████▍   | 24223/37963 [103:49:18<57:16:34, 15.01s/it]
 64%|██████▍   | 24224/37963 [103:49:32<56:28:32, 14.80s/it]
 64%|██████▍   | 24225/37963 [103:49:47<56:03:21, 14.69s/it]
 64%|██████▍   | 24226/37963 [103:50:01<55:43:42, 14.60s/it]
 64%|██████▍   | 24227/37963 [103:50:16<55:27:55, 14.54s/it]
 64%|██████▍   | 24228/37963 [103:50:30<55:11:54, 14.47s/it]
 64%|██████▍   | 24229/37963 [103:50:44<54:15:32, 14.22s/it]
 64%|██████▍   | 24230/37963 [103:50:58<54:19:49, 14.24s/it]
                                                            
{'loss': '0.1331', 'grad_norm': '2.229', 'learning_rate': '6.114e-06', 'epoch': '0.6383'}

 64%|██████▍   | 24230/37963 [103:50:58<54:19:49, 14.24s/it]
 64%|██████▍   | 24231/37963 [103:51:12<54:26:55, 14.27s/it]
 64%|██████▍   | 24232/37963 [103:51:27<54:29:45, 14.29s/it]
 64%|██████▍   | 24233/37963 [103:51:41<54:32:23, 14.30s/it]
 64%|██████▍   | 24234/37963 [103:51:55<54:36:38, 14.32s/it]
 64%|██████▍   | 24235/37963 [103:52:10<54:43:52, 14.35s/it]
 64%|██████▍   | 24236/37963 [103:52:24<54:31:27, 14.30s/it]
 64%|██████▍   | 24237/37963 [103:52:38<54:26:02, 14.28s/it]
 64%|██████▍   | 24238/37963 [103:52:52<54:30:32, 14.30s/it]
 64%|██████▍   | 24239/37963 [103:53:06<54:10:38, 14.21s/it]
 64%|██████▍   | 24240/37963 [103:53:27<61:57:27, 16.25s/it]
                                                            
{'loss': '0.1163', 'grad_norm': '2.399', 'learning_rate': '6.106e-06', 'epoch': '0.6385'}

 64%|██████▍   | 24240/37963 [103:53:27<61:57:27, 16.25s/it]
 64%|██████▍   | 24241/37963 [103:53:41<59:04:39, 15.50s/it]
 64%|██████▍   | 24242/37963 [103:53:55<57:35:28, 15.11s/it]
 64%|██████▍   | 24243/37963 [103:54:09<55:48:36, 14.64s/it]
 64%|██████▍   | 24244/37963 [103:54:30<62:43:13, 16.46s/it]
 64%|██████▍   | 24245/37963 [103:54:44<60:15:30, 15.81s/it]
 64%|██████▍   | 24246/37963 [103:54:58<58:00:23, 15.22s/it]
 64%|██████▍   | 24247/37963 [103:55:12<56:26:37, 14.81s/it]
 64%|██████▍   | 24248/37963 [103:55:33<63:38:39, 16.71s/it]
 64%|██████▍   | 24249/37963 [103:55:47<61:08:23, 16.05s/it]
 64%|██████▍   | 24250/37963 [103:56:02<59:09:32, 15.53s/it]
                                                            
{'loss': '0.1236', 'grad_norm': '2.318', 'learning_rate': '6.098e-06', 'epoch': '0.6388'}

 64%|██████▍   | 24250/37963 [103:56:02<59:09:32, 15.53s/it]
 64%|██████▍   | 24251/37963 [103:56:22<64:53:29, 17.04s/it]
 64%|██████▍   | 24252/37963 [103:56:36<61:46:48, 16.22s/it]
 64%|██████▍   | 24253/37963 [103:57:04<75:03:05, 19.71s/it]
 64%|██████▍   | 24254/37963 [103:57:18<68:29:24, 17.99s/it]
 64%|██████▍   | 24255/37963 [103:57:33<64:20:24, 16.90s/it]
 64%|██████▍   | 24256/37963 [103:57:47<61:05:39, 16.05s/it]
 64%|██████▍   | 24257/37963 [103:58:01<59:09:08, 15.54s/it]
 64%|██████▍   | 24258/37963 [103:58:15<57:43:20, 15.16s/it]
 64%|██████▍   | 24259/37963 [103:58:37<64:37:18, 16.98s/it]
 64%|██████▍   | 24260/37963 [103:58:51<61:38:23, 16.19s/it]
                                                            
{'loss': '0.1256', 'grad_norm': '1.504', 'learning_rate': '6.091e-06', 'epoch': '0.639'}

 64%|██████▍   | 24260/37963 [103:58:51<61:38:23, 16.19s/it]
 64%|██████▍   | 24261/37963 [103:59:05<59:31:29, 15.64s/it]
 64%|██████▍   | 24262/37963 [103:59:19<57:50:13, 15.20s/it]
 64%|██████▍   | 24263/37963 [103:59:34<56:47:15, 14.92s/it]
 64%|██████▍   | 24264/37963 [103:59:48<56:06:07, 14.74s/it]
 64%|██████▍   | 24265/37963 [104:00:02<55:16:54, 14.53s/it]
 64%|██████▍   | 24266/37963 [104:00:16<55:03:57, 14.47s/it]
 64%|██████▍   | 24267/37963 [104:00:31<54:42:24, 14.38s/it]
 64%|██████▍   | 24268/37963 [104:00:51<62:07:31, 16.33s/it]
 64%|██████▍   | 24269/37963 [104:01:06<59:48:32, 15.72s/it]
 64%|██████▍   | 24270/37963 [104:01:20<58:16:12, 15.32s/it]
                                                            
{'loss': '0.12', 'grad_norm': '2.338', 'learning_rate': '6.083e-06', 'epoch': '0.6393'}

 64%|██████▍   | 24270/37963 [104:01:20<58:16:12, 15.32s/it]
 64%|██████▍   | 24271/37963 [104:01:34<57:04:59, 15.01s/it]
 64%|██████▍   | 24272/37963 [104:01:49<56:20:13, 14.81s/it]
 64%|██████▍   | 24273/37963 [104:02:03<55:50:48, 14.69s/it]
 64%|██████▍   | 24274/37963 [104:02:17<55:25:58, 14.58s/it]
 64%|██████▍   | 24275/37963 [104:02:31<54:45:27, 14.40s/it]
 64%|██████▍   | 24276/37963 [104:02:46<54:38:45, 14.37s/it]
 64%|██████▍   | 24277/37963 [104:03:00<54:37:08, 14.37s/it]
 64%|██████▍   | 24278/37963 [104:03:15<54:39:32, 14.38s/it]
 64%|██████▍   | 24279/37963 [104:03:29<54:15:58, 14.28s/it]
 64%|██████▍   | 24280/37963 [104:03:43<54:30:36, 14.34s/it]
                                                            
{'loss': '0.1214', 'grad_norm': '1.891', 'learning_rate': '6.075e-06', 'epoch': '0.6396'}

 64%|██████▍   | 24280/37963 [104:03:43<54:30:36, 14.34s/it]
 64%|██████▍   | 24281/37963 [104:03:57<54:32:39, 14.35s/it]
 64%|██████▍   | 24282/37963 [104:04:12<54:32:45, 14.35s/it]
 64%|██████▍   | 24283/37963 [104:04:26<54:32:59, 14.36s/it]
 64%|██████▍   | 24284/37963 [104:04:40<54:15:40, 14.28s/it]
 64%|██████▍   | 24285/37963 [104:04:55<54:22:14, 14.31s/it]
 64%|██████▍   | 24286/37963 [104:05:16<62:05:41, 16.34s/it]
 64%|██████▍   | 24287/37963 [104:05:30<59:19:59, 15.62s/it]
 64%|██████▍   | 24288/37963 [104:05:44<57:50:46, 15.23s/it]
 64%|██████▍   | 24289/37963 [104:05:58<56:44:03, 14.94s/it]
 64%|██████▍   | 24290/37963 [104:06:13<56:01:14, 14.75s/it]
                                                            
{'loss': '0.1156', 'grad_norm': '1.787', 'learning_rate': '6.067e-06', 'epoch': '0.6398'}

 64%|██████▍   | 24290/37963 [104:06:13<56:01:14, 14.75s/it]
 64%|██████▍   | 24291/37963 [104:06:27<55:32:23, 14.62s/it]
 64%|██████▍   | 24292/37963 [104:06:41<55:20:07, 14.57s/it]
 64%|██████▍   | 24293/37963 [104:06:56<55:02:54, 14.50s/it]
 64%|██████▍   | 24294/37963 [104:07:16<62:10:45, 16.38s/it]
 64%|██████▍   | 24295/37963 [104:07:38<67:35:56, 17.80s/it]
 64%|██████▍   | 24296/37963 [104:07:52<63:38:38, 16.76s/it]
 64%|██████▍   | 24297/37963 [104:08:06<60:15:27, 15.87s/it]
 64%|██████▍   | 24298/37963 [104:08:20<58:37:47, 15.45s/it]
 64%|██████▍   | 24299/37963 [104:08:35<57:31:48, 15.16s/it]
 64%|██████▍   | 24300/37963 [104:08:49<56:24:01, 14.86s/it]
                                                            
{'loss': '0.1203', 'grad_norm': '2.308', 'learning_rate': '6.059e-06', 'epoch': '0.6401'}

 64%|██████▍   | 24300/37963 [104:08:49<56:24:01, 14.86s/it]
 64%|██████▍   | 24301/37963 [104:09:16<70:15:35, 18.51s/it]
 64%|██████▍   | 24302/37963 [104:09:36<72:13:36, 19.03s/it]
 64%|██████▍   | 24303/37963 [104:09:51<67:02:20, 17.67s/it]
 64%|██████▍   | 24304/37963 [104:10:05<63:12:52, 16.66s/it]
 64%|██████▍   | 24305/37963 [104:10:19<60:41:55, 16.00s/it]
 64%|██████▍   | 24306/37963 [104:10:34<58:39:01, 15.46s/it]
 64%|██████▍   | 24307/37963 [104:10:54<64:53:25, 17.11s/it]
 64%|██████▍   | 24308/37963 [104:11:09<61:45:27, 16.28s/it]
 64%|██████▍   | 24309/37963 [104:11:23<59:34:18, 15.71s/it]
 64%|██████▍   | 24310/37963 [104:11:37<57:48:05, 15.24s/it]
                                                            
{'loss': '0.1152', 'grad_norm': '1.779', 'learning_rate': '6.051e-06', 'epoch': '0.6404'}

 64%|██████▍   | 24310/37963 [104:11:37<57:48:05, 15.24s/it]
 64%|██████▍   | 24311/37963 [104:11:52<56:45:49, 14.97s/it]
 64%|██████▍   | 24312/37963 [104:12:06<55:55:23, 14.75s/it]
 64%|██████▍   | 24313/37963 [104:12:20<55:22:24, 14.60s/it]
 64%|██████▍   | 24314/37963 [104:12:34<54:46:09, 14.45s/it]
 64%|██████▍   | 24315/37963 [104:12:49<54:46:09, 14.45s/it]
 64%|██████▍   | 24316/37963 [104:13:09<61:49:35, 16.31s/it]
 64%|██████▍   | 24317/37963 [104:13:23<58:55:54, 15.55s/it]
 64%|██████▍   | 24318/37963 [104:13:37<57:30:08, 15.17s/it]
 64%|██████▍   | 24319/37963 [104:13:52<56:21:17, 14.87s/it]
 64%|██████▍   | 24320/37963 [104:14:06<55:27:40, 14.63s/it]
                                                            
{'loss': '0.1258', 'grad_norm': '1.515', 'learning_rate': '6.043e-06', 'epoch': '0.6406'}

 64%|██████▍   | 24320/37963 [104:14:06<55:27:40, 14.63s/it]
 64%|██████▍   | 24321/37963 [104:14:20<55:06:04, 14.54s/it]
 64%|██████▍   | 24322/37963 [104:14:34<54:52:39, 14.48s/it]
 64%|██████▍   | 24323/37963 [104:14:48<54:15:40, 14.32s/it]
 64%|██████▍   | 24324/37963 [104:15:03<54:19:53, 14.34s/it]
 64%|██████▍   | 24325/37963 [104:15:17<54:22:48, 14.35s/it]
 64%|██████▍   | 24326/37963 [104:15:31<53:26:04, 14.11s/it]
 64%|██████▍   | 24327/37963 [104:15:45<53:37:24, 14.16s/it]
 64%|██████▍   | 24328/37963 [104:15:59<53:53:23, 14.23s/it]
 64%|██████▍   | 24329/37963 [104:16:14<54:09:30, 14.30s/it]
 64%|██████▍   | 24330/37963 [104:16:28<54:15:06, 14.33s/it]
                                                            
{'loss': '0.1154', 'grad_norm': '1.725', 'learning_rate': '6.036e-06', 'epoch': '0.6409'}

 64%|██████▍   | 24330/37963 [104:16:28<54:15:06, 14.33s/it]
 64%|██████▍   | 24331/37963 [104:16:43<54:19:56, 14.35s/it]
 64%|██████▍   | 24332/37963 [104:16:57<54:22:46, 14.36s/it]
 64%|██████▍   | 24333/37963 [104:17:18<61:46:30, 16.32s/it]
 64%|██████▍   | 24334/37963 [104:17:32<59:39:57, 15.76s/it]
 64%|██████▍   | 24335/37963 [104:17:47<58:02:21, 15.33s/it]
 64%|██████▍   | 24336/37963 [104:18:00<56:13:16, 14.85s/it]
 64%|██████▍   | 24337/37963 [104:18:14<55:26:57, 14.65s/it]
 64%|██████▍   | 24338/37963 [104:18:29<55:06:32, 14.56s/it]
 64%|██████▍   | 24339/37963 [104:18:42<54:04:38, 14.29s/it]
 64%|██████▍   | 24340/37963 [104:18:57<54:12:38, 14.33s/it]
                                                            
{'loss': '0.1193', 'grad_norm': '2.508', 'learning_rate': '6.028e-06', 'epoch': '0.6412'}

 64%|██████▍   | 24340/37963 [104:18:57<54:12:38, 14.33s/it]
 64%|██████▍   | 24341/37963 [104:19:11<54:18:14, 14.35s/it]
 64%|██████▍   | 24342/37963 [104:19:26<54:09:48, 14.32s/it]
 64%|██████▍   | 24343/37963 [104:19:40<54:05:22, 14.30s/it]
 64%|██████▍   | 24344/37963 [104:19:54<54:10:05, 14.32s/it]
 64%|██████▍   | 24345/37963 [104:20:14<60:51:51, 16.09s/it]
 64%|██████▍   | 24346/37963 [104:20:34<65:14:49, 17.25s/it]
 64%|██████▍   | 24347/37963 [104:20:48<61:24:55, 16.24s/it]
 64%|██████▍   | 24348/37963 [104:21:09<66:23:50, 17.56s/it]
 64%|██████▍   | 24349/37963 [104:21:23<62:18:26, 16.48s/it]
 64%|██████▍   | 24350/37963 [104:21:37<59:47:18, 15.81s/it]
                                                            
{'loss': '0.1198', 'grad_norm': '1.708', 'learning_rate': '6.02e-06', 'epoch': '0.6414'}

 64%|██████▍   | 24350/37963 [104:21:37<59:47:18, 15.81s/it]
 64%|██████▍   | 24351/37963 [104:21:58<65:52:35, 17.42s/it]
 64%|██████▍   | 24352/37963 [104:22:13<62:34:54, 16.55s/it]
 64%|██████▍   | 24353/37963 [104:22:27<60:03:10, 15.88s/it]
 64%|██████▍   | 24354/37963 [104:22:48<65:45:52, 17.40s/it]
 64%|██████▍   | 24355/37963 [104:23:02<62:20:04, 16.49s/it]
 64%|██████▍   | 24356/37963 [104:23:24<67:44:09, 17.92s/it]
 64%|██████▍   | 24357/37963 [104:23:38<63:36:15, 16.83s/it]
 64%|██████▍   | 24358/37963 [104:23:52<60:43:57, 16.07s/it]
 64%|██████▍   | 24359/37963 [104:24:07<58:46:49, 15.55s/it]
 64%|██████▍   | 24360/37963 [104:24:21<57:15:36, 15.15s/it]
                                                            
{'loss': '0.116', 'grad_norm': '1.606', 'learning_rate': '6.012e-06', 'epoch': '0.6417'}

 64%|██████▍   | 24360/37963 [104:24:21<57:15:36, 15.15s/it]
 64%|██████▍   | 24361/37963 [104:24:34<55:28:29, 14.68s/it]
 64%|██████▍   | 24362/37963 [104:24:49<54:56:28, 14.54s/it]
 64%|██████▍   | 24363/37963 [104:25:03<54:45:23, 14.49s/it]
 64%|██████▍   | 24364/37963 [104:25:24<61:49:31, 16.37s/it]
 64%|██████▍   | 24365/37963 [104:25:37<58:44:29, 15.55s/it]
 64%|██████▍   | 24366/37963 [104:25:52<57:24:24, 15.20s/it]
 64%|██████▍   | 24367/37963 [104:26:06<55:50:56, 14.79s/it]
 64%|██████▍   | 24368/37963 [104:26:20<55:27:11, 14.68s/it]
 64%|██████▍   | 24369/37963 [104:26:34<55:03:12, 14.58s/it]
 64%|██████▍   | 24370/37963 [104:26:49<54:46:36, 14.51s/it]
                                                            
{'loss': '0.105', 'grad_norm': '3.994', 'learning_rate': '6.004e-06', 'epoch': '0.6419'}

 64%|██████▍   | 24370/37963 [104:26:49<54:46:36, 14.51s/it]
 64%|██████▍   | 24371/37963 [104:27:03<54:45:19, 14.50s/it]
 64%|██████▍   | 24372/37963 [104:27:17<54:11:35, 14.35s/it]
 64%|██████▍   | 24373/37963 [104:27:32<54:09:14, 14.35s/it]
 64%|██████▍   | 24374/37963 [104:27:45<53:35:51, 14.20s/it]
 64%|██████▍   | 24375/37963 [104:28:00<53:58:15, 14.30s/it]
 64%|██████▍   | 24376/37963 [104:28:14<54:03:30, 14.32s/it]
 64%|██████▍   | 24377/37963 [104:28:28<53:54:11, 14.28s/it]
 64%|██████▍   | 24378/37963 [104:28:43<54:11:33, 14.36s/it]
 64%|██████▍   | 24379/37963 [104:28:57<54:09:35, 14.35s/it]
 64%|██████▍   | 24380/37963 [104:29:18<61:36:36, 16.33s/it]
                                                            
{'loss': '0.1185', 'grad_norm': '3.706', 'learning_rate': '5.997e-06', 'epoch': '0.6422'}

 64%|██████▍   | 24380/37963 [104:29:18<61:36:36, 16.33s/it]
 64%|██████▍   | 24381/37963 [104:29:32<59:03:10, 15.65s/it]
 64%|██████▍   | 24382/37963 [104:29:47<57:34:02, 15.26s/it]
 64%|██████▍   | 24383/37963 [104:30:01<56:25:04, 14.96s/it]
 64%|██████▍   | 24384/37963 [104:30:15<55:49:17, 14.80s/it]
 64%|██████▍   | 24385/37963 [104:30:29<54:37:41, 14.48s/it]
 64%|██████▍   | 24386/37963 [104:30:44<54:31:03, 14.46s/it]
 64%|██████▍   | 24387/37963 [104:30:58<54:09:29, 14.36s/it]
 64%|██████▍   | 24388/37963 [104:31:12<54:06:37, 14.35s/it]
 64%|██████▍   | 24389/37963 [104:31:26<53:29:29, 14.19s/it]
 64%|██████▍   | 24390/37963 [104:31:40<53:40:15, 14.24s/it]
                                                            
{'loss': '0.1276', 'grad_norm': '1.672', 'learning_rate': '5.989e-06', 'epoch': '0.6425'}

 64%|██████▍   | 24390/37963 [104:31:40<53:40:15, 14.24s/it]
 64%|██████▍   | 24391/37963 [104:31:54<53:43:55, 14.25s/it]
 64%|██████▍   | 24392/37963 [104:32:15<61:23:15, 16.28s/it]
 64%|██████▍   | 24393/37963 [104:32:29<58:45:50, 15.59s/it]
 64%|██████▍   | 24394/37963 [104:32:50<64:42:22, 17.17s/it]
 64%|██████▍   | 24395/37963 [104:33:11<68:32:23, 18.19s/it]
 64%|██████▍   | 24396/37963 [104:33:25<64:03:01, 17.00s/it]
 64%|██████▍   | 24397/37963 [104:33:39<61:00:31, 16.19s/it]
 64%|██████▍   | 24398/37963 [104:33:54<58:55:02, 15.64s/it]
 64%|██████▍   | 24399/37963 [104:34:08<57:28:59, 15.26s/it]
 64%|██████▍   | 24400/37963 [104:34:30<65:06:36, 17.28s/it]
                                                            
{'loss': '0.1252', 'grad_norm': '1.748', 'learning_rate': '5.981e-06', 'epoch': '0.6427'}

 64%|██████▍   | 24400/37963 [104:34:30<65:06:36, 17.28s/it]
 64%|██████▍   | 24401/37963 [104:34:44<61:04:34, 16.21s/it]
 64%|██████▍   | 24402/37963 [104:34:58<58:25:50, 15.51s/it]
 64%|██████▍   | 24403/37963 [104:35:19<64:32:28, 17.13s/it]
 64%|██████▍   | 24404/37963 [104:35:40<69:08:01, 18.36s/it]
 64%|██████▍   | 24405/37963 [104:35:54<64:41:54, 17.18s/it]
 64%|██████▍   | 24406/37963 [104:36:08<61:17:05, 16.27s/it]
 64%|██████▍   | 24407/37963 [104:36:23<59:06:49, 15.70s/it]
 64%|██████▍   | 24408/37963 [104:36:37<57:26:13, 15.25s/it]
 64%|██████▍   | 24409/37963 [104:36:51<56:29:15, 15.00s/it]
 64%|██████▍   | 24410/37963 [104:37:06<55:44:28, 14.81s/it]
                                                            
{'loss': '0.1228', 'grad_norm': '2.241', 'learning_rate': '5.973e-06', 'epoch': '0.643'}

 64%|██████▍   | 24410/37963 [104:37:06<55:44:28, 14.81s/it]
 64%|██████▍   | 24411/37963 [104:37:20<55:15:28, 14.68s/it]
 64%|██████▍   | 24412/37963 [104:37:35<54:57:21, 14.60s/it]
 64%|██████▍   | 24413/37963 [104:37:55<61:45:13, 16.41s/it]
 64%|██████▍   | 24414/37963 [104:38:10<59:33:47, 15.83s/it]
 64%|██████▍   | 24415/37963 [104:38:24<57:54:41, 15.39s/it]
 64%|██████▍   | 24416/37963 [104:38:39<57:02:24, 15.16s/it]
 64%|██████▍   | 24417/37963 [104:38:53<55:56:43, 14.87s/it]
 64%|██████▍   | 24418/37963 [104:39:07<55:24:21, 14.73s/it]
 64%|██████▍   | 24419/37963 [104:39:21<54:39:10, 14.53s/it]
 64%|██████▍   | 24420/37963 [104:39:36<54:26:01, 14.47s/it]
                                                            
{'loss': '0.1141', 'grad_norm': '4.895', 'learning_rate': '5.965e-06', 'epoch': '0.6433'}

 64%|██████▍   | 24420/37963 [104:39:36<54:26:01, 14.47s/it]
 64%|██████▍   | 24421/37963 [104:39:49<53:32:18, 14.23s/it]
 64%|██████▍   | 24422/37963 [104:40:04<53:37:30, 14.26s/it]
 64%|██████▍   | 24423/37963 [104:40:18<53:42:06, 14.28s/it]
 64%|██████▍   | 24424/37963 [104:40:32<53:41:27, 14.28s/it]
 64%|██████▍   | 24425/37963 [104:40:47<53:50:54, 14.32s/it]
 64%|██████▍   | 24426/37963 [104:41:01<53:48:36, 14.31s/it]
 64%|██████▍   | 24427/37963 [104:41:15<53:18:48, 14.18s/it]
 64%|██████▍   | 24428/37963 [104:41:29<52:47:20, 14.04s/it]
 64%|██████▍   | 24429/37963 [104:41:43<53:09:51, 14.14s/it]
 64%|██████▍   | 24430/37963 [104:42:03<60:18:26, 16.04s/it]
                                                            
{'loss': '0.1214', 'grad_norm': '3.142', 'learning_rate': '5.957e-06', 'epoch': '0.6435'}

 64%|██████▍   | 24430/37963 [104:42:03<60:18:26, 16.04s/it]
 64%|██████▍   | 24431/37963 [104:42:18<58:23:43, 15.54s/it]
 64%|██████▍   | 24432/37963 [104:42:32<57:02:17, 15.18s/it]
 64%|██████▍   | 24433/37963 [104:42:46<56:10:54, 14.95s/it]
 64%|██████▍   | 24434/37963 [104:43:01<55:28:30, 14.76s/it]
 64%|██████▍   | 24435/37963 [104:43:15<54:58:26, 14.63s/it]
 64%|██████▍   | 24436/37963 [104:43:29<54:36:34, 14.53s/it]
 64%|██████▍   | 24437/37963 [104:43:44<54:21:46, 14.47s/it]
 64%|██████▍   | 24438/37963 [104:43:58<53:34:23, 14.26s/it]
 64%|██████▍   | 24439/37963 [104:44:11<53:07:12, 14.14s/it]
 64%|██████▍   | 24440/37963 [104:44:31<59:28:45, 15.83s/it]
                                                            
{'loss': '0.1156', 'grad_norm': '3.314', 'learning_rate': '5.95e-06', 'epoch': '0.6438'}

 64%|██████▍   | 24440/37963 [104:44:31<59:28:45, 15.83s/it]
 64%|██████▍   | 24441/37963 [104:44:52<65:32:57, 17.45s/it]
 64%|██████▍   | 24442/37963 [104:45:07<62:00:57, 16.51s/it]
 64%|██████▍   | 24443/37963 [104:45:28<67:07:38, 17.87s/it]
 64%|██████▍   | 24444/37963 [104:45:42<62:32:38, 16.65s/it]
 64%|██████▍   | 24445/37963 [104:45:56<59:58:08, 15.97s/it]
 64%|██████▍   | 24446/37963 [104:46:10<58:13:08, 15.51s/it]
 64%|██████▍   | 24447/37963 [104:46:31<64:22:59, 17.15s/it]
 64%|██████▍   | 24448/37963 [104:46:46<61:17:53, 16.33s/it]
 64%|██████▍   | 24449/37963 [104:47:00<58:48:09, 15.66s/it]
 64%|██████▍   | 24450/37963 [104:47:15<57:40:04, 15.36s/it]
                                                            
{'loss': '0.1191', 'grad_norm': '2.87', 'learning_rate': '5.942e-06', 'epoch': '0.6441'}

 64%|██████▍   | 24450/37963 [104:47:15<57:40:04, 15.36s/it]
 64%|██████▍   | 24451/37963 [104:47:35<63:43:48, 16.98s/it]
 64%|██████▍   | 24452/37963 [104:47:49<60:16:44, 16.06s/it]
 64%|██████▍   | 24453/37963 [104:48:10<66:02:55, 17.60s/it]
 64%|██████▍   | 24454/37963 [104:48:25<62:37:34, 16.69s/it]
 64%|██████▍   | 24455/37963 [104:48:39<60:00:01, 15.99s/it]
 64%|██████▍   | 24456/37963 [104:48:53<57:20:47, 15.28s/it]
 64%|██████▍   | 24457/37963 [104:49:07<56:13:14, 14.99s/it]
 64%|██████▍   | 24458/37963 [104:49:22<55:41:14, 14.84s/it]
 64%|██████▍   | 24459/37963 [104:49:36<55:06:25, 14.69s/it]
 64%|██████▍   | 24460/37963 [104:49:50<54:02:11, 14.41s/it]
                                                            
{'loss': '0.1222', 'grad_norm': '2.474', 'learning_rate': '5.934e-06', 'epoch': '0.6443'}

 64%|██████▍   | 24460/37963 [104:49:50<54:02:11, 14.41s/it]
 64%|██████▍   | 24461/37963 [104:50:10<60:25:56, 16.11s/it]
 64%|██████▍   | 24462/37963 [104:50:24<58:09:00, 15.51s/it]
 64%|██████▍   | 24463/37963 [104:50:38<56:53:03, 15.17s/it]
 64%|██████▍   | 24464/37963 [104:50:53<55:54:40, 14.91s/it]
 64%|██████▍   | 24465/37963 [104:51:07<55:12:48, 14.73s/it]
 64%|██████▍   | 24466/37963 [104:51:21<54:43:45, 14.60s/it]
 64%|██████▍   | 24467/37963 [104:51:36<54:24:36, 14.51s/it]
 64%|██████▍   | 24468/37963 [104:51:50<54:07:37, 14.44s/it]
 64%|██████▍   | 24469/37963 [104:52:03<53:10:50, 14.19s/it]
 64%|██████▍   | 24470/37963 [104:52:18<53:14:42, 14.21s/it]
                                                            
{'loss': '0.1218', 'grad_norm': '2.088', 'learning_rate': '5.926e-06', 'epoch': '0.6446'}

 64%|██████▍   | 24470/37963 [104:52:18<53:14:42, 14.21s/it]
 64%|██████▍   | 24471/37963 [104:52:31<52:35:52, 14.03s/it]
 64%|██████▍   | 24472/37963 [104:52:46<52:53:24, 14.11s/it]
 64%|██████▍   | 24473/37963 [104:53:00<53:12:49, 14.20s/it]
 64%|██████▍   | 24474/37963 [104:53:14<53:16:44, 14.22s/it]
 64%|██████▍   | 24475/37963 [104:53:29<53:18:53, 14.23s/it]
 64%|██████▍   | 24476/37963 [104:53:43<53:32:22, 14.29s/it]
 64%|██████▍   | 24477/37963 [104:53:57<53:35:00, 14.30s/it]
 64%|██████▍   | 24478/37963 [104:54:18<60:51:44, 16.25s/it]
 64%|██████▍   | 24479/37963 [104:54:32<58:36:11, 15.65s/it]
 64%|██████▍   | 24480/37963 [104:54:47<57:12:42, 15.28s/it]
                                                            
{'loss': '0.1209', 'grad_norm': '2.766', 'learning_rate': '5.919e-06', 'epoch': '0.6448'}

 64%|██████▍   | 24480/37963 [104:54:47<57:12:42, 15.28s/it]
 64%|██████▍   | 24481/37963 [104:55:01<55:46:49, 14.89s/it]
 64%|██████▍   | 24482/37963 [104:55:15<55:09:14, 14.73s/it]
 64%|██████▍   | 24483/37963 [104:55:29<53:52:34, 14.39s/it]
 64%|██████▍   | 24484/37963 [104:55:43<53:48:51, 14.37s/it]
 64%|██████▍   | 24485/37963 [104:55:57<53:44:47, 14.36s/it]
 64%|██████▍   | 24486/37963 [104:56:11<53:20:31, 14.25s/it]
 65%|██████▍   | 24487/37963 [104:56:26<53:28:51, 14.29s/it]
 65%|██████▍   | 24488/37963 [104:56:46<60:31:00, 16.17s/it]
 65%|██████▍   | 24489/37963 [104:57:01<58:32:01, 15.64s/it]
 65%|██████▍   | 24490/37963 [104:57:21<63:45:44, 17.04s/it]
                                                            
{'loss': '0.1303', 'grad_norm': '3.57', 'learning_rate': '5.911e-06', 'epoch': '0.6451'}

 65%|██████▍   | 24490/37963 [104:57:21<63:45:44, 17.04s/it]
 65%|██████▍   | 24491/37963 [104:57:42<67:55:17, 18.15s/it]
 65%|██████▍   | 24492/37963 [104:57:56<63:37:34, 17.00s/it]
 65%|██████▍   | 24493/37963 [104:58:10<60:17:01, 16.11s/it]
 65%|██████▍   | 24494/37963 [104:58:24<58:16:30, 15.58s/it]
 65%|██████▍   | 24495/37963 [104:58:39<56:51:57, 15.20s/it]
 65%|██████▍   | 24496/37963 [104:58:53<55:42:44, 14.89s/it]
 65%|██████▍   | 24497/37963 [104:59:14<62:28:33, 16.70s/it]
 65%|██████▍   | 24498/37963 [104:59:28<59:47:17, 15.98s/it]
 65%|██████▍   | 24499/37963 [104:59:43<57:55:39, 15.49s/it]
 65%|██████▍   | 24500/37963 [105:00:03<63:32:04, 16.99s/it]
                                                            
{'loss': '0.1267', 'grad_norm': '1.674', 'learning_rate': '5.903e-06', 'epoch': '0.6454'}

 65%|██████▍   | 24500/37963 [105:00:03<63:32:04, 16.99s/it]
 65%|██████▍   | 24501/37963 [105:00:17<60:11:58, 16.10s/it]
 65%|██████▍   | 24502/37963 [105:00:31<58:12:24, 15.57s/it]
 65%|██████▍   | 24503/37963 [105:00:53<64:27:07, 17.24s/it]
 65%|██████▍   | 24504/37963 [105:01:07<60:58:28, 16.31s/it]
 65%|██████▍   | 24505/37963 [105:01:21<58:41:14, 15.70s/it]
 65%|██████▍   | 24506/37963 [105:01:35<57:11:22, 15.30s/it]
 65%|██████▍   | 24507/37963 [105:01:50<56:10:46, 15.03s/it]
 65%|██████▍   | 24508/37963 [105:02:04<55:20:36, 14.81s/it]
 65%|██████▍   | 24509/37963 [105:02:18<54:53:38, 14.69s/it]
 65%|██████▍   | 24510/37963 [105:02:38<60:54:53, 16.30s/it]
                                                            
{'loss': '0.1109', 'grad_norm': '1.559', 'learning_rate': '5.895e-06', 'epoch': '0.6456'}

 65%|██████▍   | 24510/37963 [105:02:38<60:54:53, 16.30s/it]
 65%|██████▍   | 24511/37963 [105:02:53<58:46:19, 15.73s/it]
 65%|██████▍   | 24512/37963 [105:03:07<56:36:27, 15.15s/it]
 65%|██████▍   | 24513/37963 [105:03:21<55:39:58, 14.90s/it]
 65%|██████▍   | 24514/37963 [105:03:35<54:59:26, 14.72s/it]
 65%|██████▍   | 24515/37963 [105:03:50<54:32:06, 14.60s/it]
 65%|██████▍   | 24516/37963 [105:04:04<54:13:50, 14.52s/it]
 65%|██████▍   | 24517/37963 [105:04:18<53:56:55, 14.44s/it]
 65%|██████▍   | 24518/37963 [105:04:32<53:34:27, 14.34s/it]
 65%|██████▍   | 24519/37963 [105:04:47<53:34:18, 14.35s/it]
 65%|██████▍   | 24520/37963 [105:05:01<53:37:21, 14.36s/it]
                                                            
{'loss': '0.1358', 'grad_norm': '1.953', 'learning_rate': '5.887e-06', 'epoch': '0.6459'}

 65%|██████▍   | 24520/37963 [105:05:01<53:37:21, 14.36s/it]
 65%|██████▍   | 24521/37963 [105:05:15<53:36:53, 14.36s/it]
 65%|██████▍   | 24522/37963 [105:05:30<53:33:39, 14.35s/it]
 65%|██████▍   | 24523/37963 [105:05:44<53:30:59, 14.33s/it]
 65%|██████▍   | 24524/37963 [105:05:58<52:59:25, 14.19s/it]
 65%|██████▍   | 24525/37963 [105:06:19<60:32:07, 16.22s/it]
 65%|██████▍   | 24526/37963 [105:06:33<58:23:55, 15.65s/it]
 65%|██████▍   | 24527/37963 [105:06:47<56:53:14, 15.24s/it]
 65%|██████▍   | 24528/37963 [105:07:02<55:52:24, 14.97s/it]
 65%|██████▍   | 24529/37963 [105:07:16<55:03:50, 14.76s/it]
 65%|██████▍   | 24530/37963 [105:07:30<53:44:34, 14.40s/it]
                                                            
{'loss': '0.1153', 'grad_norm': '2.395', 'learning_rate': '5.88e-06', 'epoch': '0.6462'}

 65%|██████▍   | 24530/37963 [105:07:30<53:44:34, 14.40s/it]
 65%|██████▍   | 24531/37963 [105:07:43<53:08:20, 14.24s/it]
 65%|██████▍   | 24532/37963 [105:07:58<53:12:12, 14.26s/it]
 65%|██████▍   | 24533/37963 [105:08:12<53:16:48, 14.28s/it]
 65%|██████▍   | 24534/37963 [105:08:26<53:19:46, 14.30s/it]
 65%|██████▍   | 24535/37963 [105:08:40<52:19:53, 14.03s/it]
 65%|██████▍   | 24536/37963 [105:08:54<52:42:14, 14.13s/it]
 65%|██████▍   | 24537/37963 [105:09:08<52:48:40, 14.16s/it]
 65%|██████▍   | 24538/37963 [105:09:29<60:10:24, 16.14s/it]
 65%|██████▍   | 24539/37963 [105:09:50<65:13:03, 17.49s/it]
 65%|██████▍   | 24540/37963 [105:10:11<69:08:54, 18.55s/it]
                                                            
{'loss': '0.1228', 'grad_norm': '2.328', 'learning_rate': '5.872e-06', 'epoch': '0.6464'}

 65%|██████▍   | 24540/37963 [105:10:11<69:08:54, 18.55s/it]
 65%|██████▍   | 24541/37963 [105:10:25<64:40:45, 17.35s/it]
 65%|██████▍   | 24542/37963 [105:10:40<61:21:05, 16.46s/it]
 65%|██████▍   | 24543/37963 [105:10:54<58:46:10, 15.77s/it]
 65%|██████▍   | 24544/37963 [105:11:08<56:20:49, 15.12s/it]
 65%|██████▍   | 24545/37963 [105:11:29<63:03:15, 16.92s/it]
 65%|██████▍   | 24546/37963 [105:11:43<59:43:31, 16.03s/it]
 65%|██████▍   | 24547/37963 [105:11:57<57:56:33, 15.55s/it]
 65%|██████▍   | 24548/37963 [105:12:18<63:42:49, 17.10s/it]
 65%|██████▍   | 24549/37963 [105:12:32<60:40:04, 16.28s/it]
 65%|██████▍   | 24550/37963 [105:12:46<58:27:41, 15.69s/it]
                                                            
{'loss': '0.1098', 'grad_norm': '2.813', 'learning_rate': '5.864e-06', 'epoch': '0.6467'}

 65%|██████▍   | 24550/37963 [105:12:46<58:27:41, 15.69s/it]
 65%|██████▍   | 24551/37963 [105:13:08<64:35:09, 17.34s/it]
 65%|██████▍   | 24552/37963 [105:13:22<61:18:06, 16.46s/it]
 65%|██████▍   | 24553/37963 [105:13:36<58:29:58, 15.70s/it]
 65%|██████▍   | 24554/37963 [105:13:50<57:00:47, 15.31s/it]
 65%|██████▍   | 24555/37963 [105:14:05<55:45:04, 14.97s/it]
 65%|██████▍   | 24556/37963 [105:14:19<55:02:22, 14.78s/it]
 65%|██████▍   | 24557/37963 [105:14:33<54:35:55, 14.66s/it]
 65%|██████▍   | 24558/37963 [105:14:47<53:48:12, 14.45s/it]
 65%|██████▍   | 24559/37963 [105:15:02<53:39:08, 14.41s/it]
 65%|██████▍   | 24560/37963 [105:15:22<60:00:51, 16.12s/it]
                                                            
{'loss': '0.111', 'grad_norm': '1.499', 'learning_rate': '5.856e-06', 'epoch': '0.6469'}

 65%|██████▍   | 24560/37963 [105:15:22<60:00:51, 16.12s/it]
 65%|██████▍   | 24561/37963 [105:15:36<58:03:31, 15.60s/it]
 65%|██████▍   | 24562/37963 [105:15:50<56:35:12, 15.20s/it]
 65%|██████▍   | 24563/37963 [105:16:04<55:28:07, 14.90s/it]
 65%|██████▍   | 24564/37963 [105:16:18<54:08:02, 14.54s/it]
 65%|██████▍   | 24565/37963 [105:16:32<53:47:14, 14.45s/it]
 65%|██████▍   | 24566/37963 [105:16:47<53:39:32, 14.42s/it]
 65%|██████▍   | 24567/37963 [105:17:01<53:35:49, 14.40s/it]
 65%|██████▍   | 24568/37963 [105:17:16<53:34:10, 14.40s/it]
 65%|██████▍   | 24569/37963 [105:17:30<53:26:13, 14.36s/it]
 65%|██████▍   | 24570/37963 [105:17:44<53:32:20, 14.39s/it]
                                                            
{'loss': '0.1214', 'grad_norm': '2.669', 'learning_rate': '5.849e-06', 'epoch': '0.6472'}

 65%|██████▍   | 24570/37963 [105:17:44<53:32:20, 14.39s/it]
 65%|██████▍   | 24571/37963 [105:17:58<53:08:24, 14.29s/it]
 65%|██████▍   | 24572/37963 [105:18:13<53:10:06, 14.29s/it]
 65%|██████▍   | 24573/37963 [105:18:27<53:12:52, 14.31s/it]
 65%|██████▍   | 24574/37963 [105:18:48<60:29:32, 16.27s/it]
 65%|██████▍   | 24575/37963 [105:19:02<58:00:24, 15.60s/it]
 65%|██████▍   | 24576/37963 [105:19:16<56:44:16, 15.26s/it]
 65%|██████▍   | 24577/37963 [105:19:30<55:33:27, 14.94s/it]
 65%|██████▍   | 24578/37963 [105:19:45<54:57:33, 14.78s/it]
 65%|██████▍   | 24579/37963 [105:19:59<54:04:09, 14.54s/it]
 65%|██████▍   | 24580/37963 [105:20:13<54:03:33, 14.54s/it]
                                                            
{'loss': '0.1176', 'grad_norm': '2.185', 'learning_rate': '5.841e-06', 'epoch': '0.6475'}

 65%|██████▍   | 24580/37963 [105:20:13<54:03:33, 14.54s/it]
 65%|██████▍   | 24581/37963 [105:20:28<53:50:19, 14.48s/it]
 65%|██████▍   | 24582/37963 [105:20:42<53:37:42, 14.43s/it]
 65%|██████▍   | 24583/37963 [105:20:56<53:32:08, 14.40s/it]
 65%|██████▍   | 24584/37963 [105:21:11<53:27:08, 14.38s/it]
 65%|██████▍   | 24585/37963 [105:21:25<52:51:33, 14.22s/it]
 65%|██████▍   | 24586/37963 [105:21:39<52:49:15, 14.22s/it]
 65%|██████▍   | 24587/37963 [105:21:53<52:57:10, 14.25s/it]
 65%|██████▍   | 24588/37963 [105:22:20<67:29:27, 18.17s/it]
 65%|██████▍   | 24589/37963 [105:22:35<63:18:20, 17.04s/it]
 65%|██████▍   | 24590/37963 [105:22:49<60:09:21, 16.19s/it]
                                                            
{'loss': '0.1166', 'grad_norm': '2.814', 'learning_rate': '5.833e-06', 'epoch': '0.6477'}

 65%|██████▍   | 24590/37963 [105:22:49<60:09:21, 16.19s/it]
 65%|██████▍   | 24591/37963 [105:23:03<57:46:08, 15.55s/it]
 65%|██████▍   | 24592/37963 [105:23:17<56:24:52, 15.19s/it]
 65%|██████▍   | 24593/37963 [105:23:31<54:46:01, 14.75s/it]
 65%|██████▍   | 24594/37963 [105:23:52<62:00:10, 16.70s/it]
 65%|██████▍   | 24595/37963 [105:24:07<59:20:21, 15.98s/it]
 65%|██████▍   | 24596/37963 [105:24:21<57:28:30, 15.48s/it]
 65%|██████▍   | 24597/37963 [105:24:42<63:34:52, 17.13s/it]
 65%|██████▍   | 24598/37963 [105:24:56<60:28:05, 16.29s/it]
 65%|██████▍   | 24599/37963 [105:25:11<58:19:27, 15.71s/it]
 65%|██████▍   | 24600/37963 [105:25:32<64:28:20, 17.37s/it]
                                                            
{'loss': '0.113', 'grad_norm': '1.582', 'learning_rate': '5.825e-06', 'epoch': '0.648'}

 65%|██████▍   | 24600/37963 [105:25:32<64:28:20, 17.37s/it]
 65%|██████▍   | 24601/37963 [105:25:46<60:47:59, 16.38s/it]
 65%|██████▍   | 24602/37963 [105:26:00<58:29:01, 15.76s/it]
 65%|██████▍   | 24603/37963 [105:26:14<56:41:56, 15.28s/it]
 65%|██████▍   | 24604/37963 [105:26:29<55:42:13, 15.01s/it]
 65%|██████▍   | 24605/37963 [105:26:43<54:57:31, 14.81s/it]
 65%|██████▍   | 24606/37963 [105:26:58<54:28:35, 14.68s/it]
 65%|██████▍   | 24607/37963 [105:27:11<53:28:45, 14.41s/it]
 65%|██████▍   | 24608/37963 [105:27:32<60:44:13, 16.37s/it]
 65%|██████▍   | 24609/37963 [105:27:46<57:47:26, 15.58s/it]
 65%|██████▍   | 24610/37963 [105:28:00<55:46:04, 15.04s/it]
                                                            
{'loss': '0.1248', 'grad_norm': '2.57', 'learning_rate': '5.818e-06', 'epoch': '0.6483'}

 65%|██████▍   | 24610/37963 [105:28:00<55:46:04, 15.04s/it]
 65%|██████▍   | 24611/37963 [105:28:14<55:06:26, 14.86s/it]
 65%|██████▍   | 24612/37963 [105:28:29<54:25:46, 14.68s/it]
 65%|██████▍   | 24613/37963 [105:28:43<54:03:05, 14.58s/it]
 65%|██████▍   | 24614/37963 [105:28:57<53:42:34, 14.48s/it]
 65%|██████▍   | 24615/37963 [105:29:11<53:32:54, 14.44s/it]
 65%|██████▍   | 24616/37963 [105:29:26<53:23:34, 14.40s/it]
 65%|██████▍   | 24617/37963 [105:29:40<53:16:02, 14.37s/it]
 65%|██████▍   | 24618/37963 [105:29:54<53:09:18, 14.34s/it]
 65%|██████▍   | 24619/37963 [105:30:09<52:59:13, 14.30s/it]
 65%|██████▍   | 24620/37963 [105:30:23<52:54:22, 14.27s/it]
                                                            
{'loss': '0.1179', 'grad_norm': '1.799', 'learning_rate': '5.81e-06', 'epoch': '0.6485'}

 65%|██████▍   | 24620/37963 [105:30:23<52:54:22, 14.27s/it]
 65%|██████▍   | 24621/37963 [105:30:37<52:58:51, 14.30s/it]
 65%|██████▍   | 24622/37963 [105:30:52<53:18:27, 14.38s/it]
 65%|██████▍   | 24623/37963 [105:31:13<60:35:18, 16.35s/it]
 65%|██████▍   | 24624/37963 [105:31:26<57:44:47, 15.58s/it]
 65%|██████▍   | 24625/37963 [105:31:41<56:25:46, 15.23s/it]
 65%|██████▍   | 24626/37963 [105:31:55<54:46:34, 14.79s/it]
 65%|██████▍   | 24627/37963 [105:32:09<54:17:44, 14.66s/it]
 65%|██████▍   | 24628/37963 [105:32:23<53:57:25, 14.57s/it]
 65%|██████▍   | 24629/37963 [105:32:37<53:01:41, 14.32s/it]
 65%|██████▍   | 24630/37963 [105:32:52<53:15:00, 14.38s/it]
                                                            
{'loss': '0.1203', 'grad_norm': '3.155', 'learning_rate': '5.802e-06', 'epoch': '0.6488'}

 65%|██████▍   | 24630/37963 [105:32:52<53:15:00, 14.38s/it]
 65%|██████▍   | 24631/37963 [105:33:06<53:12:19, 14.37s/it]
 65%|██████▍   | 24632/37963 [105:33:20<53:16:46, 14.39s/it]
 65%|██████▍   | 24633/37963 [105:33:35<53:16:12, 14.39s/it]
 65%|██████▍   | 24634/37963 [105:33:49<52:42:30, 14.24s/it]
 65%|██████▍   | 24635/37963 [105:34:03<52:48:30, 14.26s/it]
 65%|██████▍   | 24636/37963 [105:34:23<59:15:53, 16.01s/it]
 65%|██████▍   | 24637/37963 [105:34:44<64:36:32, 17.45s/it]
 65%|██████▍   | 24638/37963 [105:35:05<68:37:02, 18.54s/it]
 65%|██████▍   | 24639/37963 [105:35:19<64:00:29, 17.29s/it]
 65%|██████▍   | 24640/37963 [105:35:34<60:41:55, 16.40s/it]
                                                            
{'loss': '0.1206', 'grad_norm': '2.326', 'learning_rate': '5.794e-06', 'epoch': '0.6491'}

 65%|██████▍   | 24640/37963 [105:35:34<60:41:55, 16.40s/it]
 65%|██████▍   | 24641/37963 [105:35:48<58:20:09, 15.76s/it]
 65%|██████▍   | 24642/37963 [105:36:08<63:38:27, 17.20s/it]
 65%|██████▍   | 24643/37963 [105:36:22<59:33:18, 16.10s/it]
 65%|██████▍   | 24644/37963 [105:36:36<57:43:50, 15.60s/it]
 65%|██████▍   | 24645/37963 [105:36:57<63:17:12, 17.11s/it]
 65%|██████▍   | 24646/37963 [105:37:11<60:13:43, 16.28s/it]
 65%|██████▍   | 24647/37963 [105:37:25<57:33:03, 15.56s/it]
 65%|██████▍   | 24648/37963 [105:37:39<55:47:52, 15.09s/it]
 65%|██████▍   | 24649/37963 [105:37:54<55:24:36, 14.98s/it]
 65%|██████▍   | 24650/37963 [105:38:15<62:14:44, 16.83s/it]
                                                            
{'loss': '0.1248', 'grad_norm': '2.528', 'learning_rate': '5.787e-06', 'epoch': '0.6493'}

 65%|██████▍   | 24650/37963 [105:38:15<62:14:44, 16.83s/it]
 65%|██████▍   | 24651/37963 [105:38:30<59:37:24, 16.12s/it]
 65%|██████▍   | 24652/37963 [105:38:44<57:39:35, 15.59s/it]
 65%|██████▍   | 24653/37963 [105:38:58<56:13:04, 15.21s/it]
 65%|██████▍   | 24654/37963 [105:39:12<55:03:13, 14.89s/it]
 65%|██████▍   | 24655/37963 [105:39:27<54:24:00, 14.72s/it]
 65%|██████▍   | 24656/37963 [105:39:47<60:28:53, 16.36s/it]
 65%|██████▍   | 24657/37963 [105:40:01<58:12:17, 15.75s/it]
 65%|██████▍   | 24658/37963 [105:40:15<56:18:59, 15.24s/it]
 65%|██████▍   | 24659/37963 [105:40:30<55:19:29, 14.97s/it]
 65%|██████▍   | 24660/37963 [105:40:44<54:33:58, 14.77s/it]
                                                            
{'loss': '0.1078', 'grad_norm': '1.578', 'learning_rate': '5.779e-06', 'epoch': '0.6496'}

 65%|██████▍   | 24660/37963 [105:40:44<54:33:58, 14.77s/it]
 65%|██████▍   | 24661/37963 [105:40:58<54:05:04, 14.64s/it]
 65%|██████▍   | 24662/37963 [105:41:13<53:45:12, 14.55s/it]
 65%|██████▍   | 24663/37963 [105:41:27<53:27:27, 14.47s/it]
 65%|██████▍   | 24664/37963 [105:41:41<53:17:14, 14.42s/it]
 65%|██████▍   | 24665/37963 [105:41:56<53:16:26, 14.42s/it]
 65%|██████▍   | 24666/37963 [105:42:10<53:12:18, 14.40s/it]
 65%|██████▍   | 24667/37963 [105:42:24<53:11:15, 14.40s/it]
 65%|██████▍   | 24668/37963 [105:42:39<53:06:28, 14.38s/it]
 65%|██████▍   | 24669/37963 [105:42:53<52:54:18, 14.33s/it]
 65%|██████▍   | 24670/37963 [105:43:13<59:41:53, 16.17s/it]
                                                            
{'loss': '0.1265', 'grad_norm': '1.19', 'learning_rate': '5.771e-06', 'epoch': '0.6498'}

 65%|██████▍   | 24670/37963 [105:43:13<59:41:53, 16.17s/it]
 65%|██████▍   | 24671/37963 [105:43:28<57:54:54, 15.69s/it]
 65%|██████▍   | 24672/37963 [105:43:42<56:33:56, 15.32s/it]
 65%|██████▍   | 24673/37963 [105:43:57<55:26:28, 15.02s/it]
 65%|██████▍   | 24674/37963 [105:44:11<54:44:42, 14.83s/it]
 65%|██████▍   | 24675/37963 [105:44:26<54:27:50, 14.76s/it]
 65%|██████▌   | 24676/37963 [105:44:40<53:56:42, 14.62s/it]
 65%|██████▌   | 24677/37963 [105:44:54<53:42:43, 14.55s/it]
 65%|██████▌   | 24678/37963 [105:45:09<53:15:35, 14.43s/it]
 65%|██████▌   | 24679/37963 [105:45:23<53:11:38, 14.42s/it]
 65%|██████▌   | 24680/37963 [105:45:37<52:48:10, 14.31s/it]
                                                            
{'loss': '0.1139', 'grad_norm': '2.248', 'learning_rate': '5.763e-06', 'epoch': '0.6501'}

 65%|██████▌   | 24680/37963 [105:45:37<52:48:10, 14.31s/it]
 65%|██████▌   | 24681/37963 [105:45:51<52:54:22, 14.34s/it]
 65%|██████▌   | 24682/37963 [105:46:06<52:51:12, 14.33s/it]
 65%|██████▌   | 24683/37963 [105:46:20<52:53:17, 14.34s/it]
 65%|██████▌   | 24684/37963 [105:46:34<52:52:53, 14.34s/it]
 65%|██████▌   | 24685/37963 [105:46:55<59:59:19, 16.26s/it]
 65%|██████▌   | 24686/37963 [105:47:18<66:46:10, 18.10s/it]
 65%|██████▌   | 24687/37963 [105:47:38<69:36:22, 18.87s/it]
 65%|██████▌   | 24688/37963 [105:47:52<64:19:13, 17.44s/it]
 65%|██████▌   | 24689/37963 [105:48:07<61:01:04, 16.55s/it]
 65%|██████▌   | 24690/37963 [105:48:28<65:53:28, 17.87s/it]
                                                            
{'loss': '0.1165', 'grad_norm': '1.494', 'learning_rate': '5.756e-06', 'epoch': '0.6504'}

 65%|██████▌   | 24690/37963 [105:48:28<65:53:28, 17.87s/it]
 65%|██████▌   | 24691/37963 [105:48:41<61:17:24, 16.62s/it]
 65%|██████▌   | 24692/37963 [105:48:55<58:11:35, 15.79s/it]
 65%|██████▌   | 24693/37963 [105:49:09<56:09:07, 15.23s/it]
 65%|██████▌   | 24694/37963 [105:49:24<55:13:00, 14.98s/it]
 65%|██████▌   | 24695/37963 [105:49:38<54:31:43, 14.80s/it]
 65%|██████▌   | 24696/37963 [105:49:52<54:01:47, 14.66s/it]
 65%|██████▌   | 24697/37963 [105:50:13<60:13:30, 16.34s/it]
 65%|██████▌   | 24698/37963 [105:50:33<65:09:48, 17.68s/it]
 65%|██████▌   | 24699/37963 [105:50:48<61:27:38, 16.68s/it]
 65%|██████▌   | 24700/37963 [105:51:02<58:52:59, 15.98s/it]
                                                            
{'loss': '0.1173', 'grad_norm': '2.426', 'learning_rate': '5.748e-06', 'epoch': '0.6506'}

 65%|██████▌   | 24700/37963 [105:51:02<58:52:59, 15.98s/it]
 65%|██████▌   | 24701/37963 [105:51:17<57:08:56, 15.51s/it]
 65%|██████▌   | 24702/37963 [105:51:31<55:58:39, 15.20s/it]
 65%|██████▌   | 24703/37963 [105:51:45<55:07:29, 14.97s/it]
 65%|██████▌   | 24704/37963 [105:52:00<54:40:15, 14.84s/it]
 65%|██████▌   | 24705/37963 [105:52:20<60:53:52, 16.54s/it]
 65%|██████▌   | 24706/37963 [105:52:35<58:32:24, 15.90s/it]
 65%|██████▌   | 24707/37963 [105:52:49<56:57:10, 15.47s/it]
 65%|██████▌   | 24708/37963 [105:53:04<55:42:46, 15.13s/it]
 65%|██████▌   | 24709/37963 [105:53:18<54:50:36, 14.90s/it]
 65%|██████▌   | 24710/37963 [105:53:32<54:11:28, 14.72s/it]
                                                            
{'loss': '0.1173', 'grad_norm': '2.509', 'learning_rate': '5.74e-06', 'epoch': '0.6509'}

 65%|██████▌   | 24710/37963 [105:53:32<54:11:28, 14.72s/it]
 65%|██████▌   | 24711/37963 [105:53:47<53:47:49, 14.61s/it]
 65%|██████▌   | 24712/37963 [105:54:01<53:32:36, 14.55s/it]
 65%|██████▌   | 24713/37963 [105:54:15<53:00:46, 14.40s/it]
 65%|██████▌   | 24714/37963 [105:54:30<53:00:32, 14.40s/it]
 65%|██████▌   | 24715/37963 [105:54:44<52:59:20, 14.40s/it]
 65%|██████▌   | 24716/37963 [105:54:58<52:54:03, 14.38s/it]
 65%|██████▌   | 24717/37963 [105:55:13<52:54:06, 14.38s/it]
 65%|██████▌   | 24718/37963 [105:55:26<52:12:47, 14.19s/it]
 65%|██████▌   | 24719/37963 [105:55:47<59:12:56, 16.10s/it]
 65%|██████▌   | 24720/37963 [105:56:01<57:06:26, 15.52s/it]
                                                            
{'loss': '0.1195', 'grad_norm': '1.627', 'learning_rate': '5.732e-06', 'epoch': '0.6512'}

 65%|██████▌   | 24720/37963 [105:56:01<57:06:26, 15.52s/it]
 65%|██████▌   | 24721/37963 [105:56:16<55:50:58, 15.18s/it]
 65%|██████▌   | 24722/37963 [105:56:30<54:54:31, 14.93s/it]
 65%|██████▌   | 24723/37963 [105:56:44<54:21:48, 14.78s/it]
 65%|██████▌   | 24724/37963 [105:56:58<53:19:16, 14.50s/it]
 65%|██████▌   | 24725/37963 [105:57:13<53:12:19, 14.47s/it]
 65%|██████▌   | 24726/37963 [105:57:27<53:03:17, 14.43s/it]
 65%|██████▌   | 24727/37963 [105:57:41<53:03:49, 14.43s/it]
 65%|██████▌   | 24728/37963 [105:57:56<52:56:23, 14.40s/it]
 65%|██████▌   | 24729/37963 [105:58:09<52:01:27, 14.15s/it]
 65%|██████▌   | 24730/37963 [105:58:24<52:16:36, 14.22s/it]
                                                            
{'loss': '0.119', 'grad_norm': '3.748', 'learning_rate': '5.725e-06', 'epoch': '0.6514'}

 65%|██████▌   | 24730/37963 [105:58:24<52:16:36, 14.22s/it]
 65%|██████▌   | 24731/37963 [105:58:38<52:05:45, 14.17s/it]
 65%|██████▌   | 24732/37963 [105:58:52<52:16:25, 14.22s/it]
 65%|██████▌   | 24733/37963 [105:59:06<52:31:59, 14.29s/it]
 65%|██████▌   | 24734/37963 [105:59:27<59:03:36, 16.07s/it]
 65%|██████▌   | 24735/37963 [105:59:47<63:53:20, 17.39s/it]
 65%|██████▌   | 24736/37963 [106:00:08<67:31:43, 18.38s/it]
 65%|██████▌   | 24737/37963 [106:00:22<63:06:43, 17.18s/it]
 65%|██████▌   | 24738/37963 [106:00:37<60:04:19, 16.35s/it]
 65%|██████▌   | 24739/37963 [106:00:57<64:34:37, 17.58s/it]
 65%|██████▌   | 24740/37963 [106:01:11<61:03:04, 16.62s/it]
                                                            
{'loss': '0.1292', 'grad_norm': '2.461', 'learning_rate': '5.717e-06', 'epoch': '0.6517'}

 65%|██████▌   | 24740/37963 [106:01:11<61:03:04, 16.62s/it]
 65%|██████▌   | 24741/37963 [106:01:26<58:38:57, 15.97s/it]
 65%|██████▌   | 24742/37963 [106:01:40<56:58:58, 15.52s/it]
 65%|██████▌   | 24743/37963 [106:01:54<55:05:27, 15.00s/it]
 65%|██████▌   | 24744/37963 [106:02:09<54:24:07, 14.82s/it]
 65%|██████▌   | 24745/37963 [106:02:23<53:33:39, 14.59s/it]
 65%|██████▌   | 24746/37963 [106:02:37<53:18:10, 14.52s/it]
 65%|██████▌   | 24747/37963 [106:02:58<60:04:46, 16.37s/it]
 65%|██████▌   | 24748/37963 [106:03:12<57:52:15, 15.77s/it]
 65%|██████▌   | 24749/37963 [106:03:33<63:17:26, 17.24s/it]
 65%|██████▌   | 24750/37963 [106:03:47<60:07:57, 16.38s/it]
                                                            
{'loss': '0.11', 'grad_norm': '1.092', 'learning_rate': '5.709e-06', 'epoch': '0.652'}

 65%|██████▌   | 24750/37963 [106:03:47<60:07:57, 16.38s/it]
 65%|██████▌   | 24751/37963 [106:04:01<57:43:45, 15.73s/it]
 65%|██████▌   | 24752/37963 [106:04:16<56:04:43, 15.28s/it]
 65%|██████▌   | 24753/37963 [106:04:30<55:06:23, 15.02s/it]
 65%|██████▌   | 24754/37963 [106:04:51<61:37:05, 16.79s/it]
 65%|██████▌   | 24755/37963 [106:05:05<58:58:49, 16.08s/it]
 65%|██████▌   | 24756/37963 [106:05:20<57:07:30, 15.57s/it]
 65%|██████▌   | 24757/37963 [106:05:34<55:26:42, 15.11s/it]
 65%|██████▌   | 24758/37963 [106:05:48<54:34:18, 14.88s/it]
 65%|██████▌   | 24759/37963 [106:06:02<53:51:43, 14.69s/it]
 65%|██████▌   | 24760/37963 [106:06:16<53:13:39, 14.51s/it]
                                                            
{'loss': '0.1269', 'grad_norm': '1.686', 'learning_rate': '5.702e-06', 'epoch': '0.6522'}

 65%|██████▌   | 24760/37963 [106:06:16<53:13:39, 14.51s/it]
 65%|██████▌   | 24761/37963 [106:06:31<53:09:19, 14.49s/it]
 65%|██████▌   | 24762/37963 [106:06:45<53:01:19, 14.46s/it]
 65%|██████▌   | 24763/37963 [106:06:59<52:17:46, 14.26s/it]
 65%|██████▌   | 24764/37963 [106:07:13<51:53:51, 14.15s/it]
 65%|██████▌   | 24765/37963 [106:07:27<52:15:34, 14.25s/it]
 65%|██████▌   | 24766/37963 [106:07:42<52:26:30, 14.31s/it]
 65%|██████▌   | 24767/37963 [106:07:56<52:07:58, 14.22s/it]
 65%|██████▌   | 24768/37963 [106:08:17<59:29:39, 16.23s/it]
 65%|██████▌   | 24769/37963 [106:08:31<57:24:01, 15.66s/it]
 65%|██████▌   | 24770/37963 [106:08:45<55:52:01, 15.24s/it]
                                                            
{'loss': '0.1225', 'grad_norm': '1.511', 'learning_rate': '5.694e-06', 'epoch': '0.6525'}

 65%|██████▌   | 24770/37963 [106:08:45<55:52:01, 15.24s/it]
 65%|██████▌   | 24771/37963 [106:09:00<54:55:54, 14.99s/it]
 65%|██████▌   | 24772/37963 [106:09:14<54:19:27, 14.83s/it]
 65%|██████▌   | 24773/37963 [106:09:28<53:01:43, 14.47s/it]
 65%|██████▌   | 24774/37963 [106:09:42<52:57:00, 14.45s/it]
 65%|██████▌   | 24775/37963 [106:09:57<52:54:40, 14.44s/it]
 65%|██████▌   | 24776/37963 [106:10:11<52:57:42, 14.46s/it]
 65%|██████▌   | 24777/37963 [106:10:26<52:52:47, 14.44s/it]
 65%|██████▌   | 24778/37963 [106:10:40<52:52:33, 14.44s/it]
 65%|██████▌   | 24779/37963 [106:10:54<52:50:47, 14.43s/it]
 65%|██████▌   | 24780/37963 [106:11:09<52:49:43, 14.43s/it]
                                                            
{'loss': '0.1143', 'grad_norm': '1.449', 'learning_rate': '5.686e-06', 'epoch': '0.6527'}

 65%|██████▌   | 24780/37963 [106:11:09<52:49:43, 14.43s/it]
 65%|██████▌   | 24781/37963 [106:11:23<52:34:30, 14.36s/it]
 65%|██████▌   | 24782/37963 [106:11:37<52:39:15, 14.38s/it]
 65%|██████▌   | 24783/37963 [106:12:05<67:33:46, 18.45s/it]
 65%|██████▌   | 24784/37963 [106:12:20<63:13:18, 17.27s/it]
 65%|██████▌   | 24785/37963 [106:12:35<60:15:13, 16.46s/it]
 65%|██████▌   | 24786/37963 [106:12:49<58:00:11, 15.85s/it]
 65%|██████▌   | 24787/37963 [106:13:10<63:37:21, 17.38s/it]
 65%|██████▌   | 24788/37963 [106:13:31<67:32:53, 18.46s/it]
 65%|██████▌   | 24789/37963 [106:13:45<62:29:49, 17.08s/it]
 65%|██████▌   | 24790/37963 [106:13:59<59:28:39, 16.25s/it]
                                                            
{'loss': '0.1197', 'grad_norm': '7.382', 'learning_rate': '5.679e-06', 'epoch': '0.653'}

 65%|██████▌   | 24790/37963 [106:13:59<59:28:39, 16.25s/it]
 65%|██████▌   | 24791/37963 [106:14:13<57:15:07, 15.65s/it]
 65%|██████▌   | 24792/37963 [106:14:28<55:54:09, 15.28s/it]
 65%|██████▌   | 24793/37963 [106:14:42<55:00:43, 15.04s/it]
 65%|██████▌   | 24794/37963 [106:15:03<60:53:33, 16.65s/it]
 65%|██████▌   | 24795/37963 [106:15:17<58:24:34, 15.97s/it]
 65%|██████▌   | 24796/37963 [106:15:32<56:53:27, 15.55s/it]
 65%|██████▌   | 24797/37963 [106:15:53<63:00:15, 17.23s/it]
 65%|██████▌   | 24798/37963 [106:16:06<59:00:41, 16.14s/it]
 65%|██████▌   | 24799/37963 [106:16:20<56:51:13, 15.55s/it]
 65%|██████▌   | 24800/37963 [106:16:34<54:56:17, 15.03s/it]
                                                            
{'loss': '0.115', 'grad_norm': '2.963', 'learning_rate': '5.671e-06', 'epoch': '0.6533'}

 65%|██████▌   | 24800/37963 [106:16:34<54:56:17, 15.03s/it]
 65%|██████▌   | 24801/37963 [106:16:48<54:02:58, 14.78s/it]
 65%|██████▌   | 24802/37963 [106:17:03<53:34:29, 14.65s/it]
 65%|██████▌   | 24803/37963 [106:17:24<60:27:54, 16.54s/it]
 65%|██████▌   | 24804/37963 [106:17:38<57:54:31, 15.84s/it]
 65%|██████▌   | 24805/37963 [106:17:52<56:19:26, 15.41s/it]
 65%|██████▌   | 24806/37963 [106:18:07<55:00:15, 15.05s/it]
 65%|██████▌   | 24807/37963 [106:18:21<53:55:25, 14.76s/it]
 65%|██████▌   | 24808/37963 [106:18:35<53:32:28, 14.65s/it]
 65%|██████▌   | 24809/37963 [106:18:49<53:16:36, 14.58s/it]
 65%|██████▌   | 24810/37963 [106:19:04<53:02:06, 14.52s/it]
                                                            
{'loss': '0.1161', 'grad_norm': '1.268', 'learning_rate': '5.663e-06', 'epoch': '0.6535'}

 65%|██████▌   | 24810/37963 [106:19:04<53:02:06, 14.52s/it]
 65%|██████▌   | 24811/37963 [106:19:18<52:52:03, 14.47s/it]
 65%|██████▌   | 24812/37963 [106:19:32<52:20:58, 14.33s/it]
 65%|██████▌   | 24813/37963 [106:19:47<52:26:48, 14.36s/it]
 65%|██████▌   | 24814/37963 [106:20:01<52:27:15, 14.36s/it]
 65%|██████▌   | 24815/37963 [106:20:15<52:33:35, 14.39s/it]
 65%|██████▌   | 24816/37963 [106:20:30<52:48:35, 14.46s/it]
 65%|██████▌   | 24817/37963 [106:20:51<59:56:10, 16.41s/it]
 65%|██████▌   | 24818/37963 [106:21:05<57:41:45, 15.80s/it]
 65%|██████▌   | 24819/37963 [106:21:20<56:04:11, 15.36s/it]
 65%|██████▌   | 24820/37963 [106:21:34<54:56:53, 15.05s/it]
                                                            
{'loss': '0.1238', 'grad_norm': '1.787', 'learning_rate': '5.655e-06', 'epoch': '0.6538'}

 65%|██████▌   | 24820/37963 [106:21:34<54:56:53, 15.05s/it]
 65%|██████▌   | 24821/37963 [106:21:49<54:16:04, 14.87s/it]
 65%|██████▌   | 24822/37963 [106:22:03<53:48:58, 14.74s/it]
 65%|██████▌   | 24823/37963 [106:22:17<53:26:08, 14.64s/it]
 65%|██████▌   | 24824/37963 [106:22:32<53:09:58, 14.57s/it]
 65%|██████▌   | 24825/37963 [106:22:46<52:18:18, 14.33s/it]
 65%|██████▌   | 24826/37963 [106:23:00<52:22:34, 14.35s/it]
 65%|██████▌   | 24827/37963 [106:23:14<52:13:32, 14.31s/it]
 65%|██████▌   | 24828/37963 [106:23:29<52:17:02, 14.33s/it]
 65%|██████▌   | 24829/37963 [106:23:43<52:20:09, 14.35s/it]
 65%|██████▌   | 24830/37963 [106:23:57<52:18:47, 14.34s/it]
                                                            
{'loss': '0.1143', 'grad_norm': '3.416', 'learning_rate': '5.648e-06', 'epoch': '0.6541'}

 65%|██████▌   | 24830/37963 [106:23:57<52:18:47, 14.34s/it]
 65%|██████▌   | 24831/37963 [106:24:24<66:07:31, 18.13s/it]
 65%|██████▌   | 24832/37963 [106:24:39<62:01:43, 17.01s/it]
 65%|██████▌   | 24833/37963 [106:24:52<58:28:19, 16.03s/it]
 65%|██████▌   | 24834/37963 [106:25:13<63:33:53, 17.43s/it]
 65%|██████▌   | 24835/37963 [106:25:27<60:16:04, 16.53s/it]
 65%|██████▌   | 24836/37963 [106:25:49<65:46:23, 18.04s/it]
 65%|██████▌   | 24837/37963 [106:26:03<61:24:05, 16.84s/it]
 65%|██████▌   | 24838/37963 [106:26:17<58:41:06, 16.10s/it]
 65%|██████▌   | 24839/37963 [106:26:32<56:37:47, 15.53s/it]
 65%|██████▌   | 24840/37963 [106:26:46<55:25:55, 15.21s/it]
                                                            
{'loss': '0.1209', 'grad_norm': '2.562', 'learning_rate': '5.64e-06', 'epoch': '0.6543'}

 65%|██████▌   | 24840/37963 [106:26:46<55:25:55, 15.21s/it]
 65%|██████▌   | 24841/37963 [106:27:00<54:24:02, 14.92s/it]
 65%|██████▌   | 24842/37963 [106:27:15<53:46:33, 14.75s/it]
 65%|██████▌   | 24843/37963 [106:27:29<53:18:20, 14.63s/it]
 65%|██████▌   | 24844/37963 [106:27:50<59:39:44, 16.37s/it]
 65%|██████▌   | 24845/37963 [106:28:04<57:30:19, 15.78s/it]
 65%|██████▌   | 24846/37963 [106:28:25<63:24:06, 17.40s/it]
 65%|██████▌   | 24847/37963 [106:28:39<60:06:41, 16.50s/it]
 65%|██████▌   | 24848/37963 [106:28:54<57:35:56, 15.81s/it]
 65%|██████▌   | 24849/37963 [106:29:08<55:38:00, 15.27s/it]
 65%|██████▌   | 24850/37963 [106:29:22<54:42:35, 15.02s/it]
                                                            
{'loss': '0.116', 'grad_norm': '1.411', 'learning_rate': '5.632e-06', 'epoch': '0.6546'}

 65%|██████▌   | 24850/37963 [106:29:22<54:42:35, 15.02s/it]
 65%|██████▌   | 24851/37963 [106:29:37<54:01:10, 14.83s/it]
 65%|██████▌   | 24852/37963 [106:29:57<60:25:01, 16.59s/it]
 65%|██████▌   | 24853/37963 [106:30:12<58:09:04, 15.97s/it]
 65%|██████▌   | 24854/37963 [106:30:26<55:44:54, 15.31s/it]
 65%|██████▌   | 24855/37963 [106:30:39<53:54:51, 14.81s/it]
 65%|██████▌   | 24856/37963 [106:30:53<53:11:56, 14.61s/it]
 65%|██████▌   | 24857/37963 [106:31:08<52:53:19, 14.53s/it]
 65%|██████▌   | 24858/37963 [106:31:22<52:44:04, 14.49s/it]
 65%|██████▌   | 24859/37963 [106:31:36<52:09:19, 14.33s/it]
 65%|██████▌   | 24860/37963 [106:31:51<52:25:00, 14.40s/it]
                                                            
{'loss': '0.1113', 'grad_norm': '1.966', 'learning_rate': '5.625e-06', 'epoch': '0.6549'}

 65%|██████▌   | 24860/37963 [106:31:51<52:25:00, 14.40s/it]
 65%|██████▌   | 24861/37963 [106:32:05<51:59:35, 14.29s/it]
 65%|██████▌   | 24862/37963 [106:32:19<52:07:24, 14.32s/it]
 65%|██████▌   | 24863/37963 [106:32:33<51:59:39, 14.29s/it]
 65%|██████▌   | 24864/37963 [106:32:48<52:04:32, 14.31s/it]
 65%|██████▌   | 24865/37963 [106:33:08<59:14:13, 16.28s/it]
 66%|██████▌   | 24866/37963 [106:33:23<57:05:24, 15.69s/it]
 66%|██████▌   | 24867/37963 [106:33:37<55:15:35, 15.19s/it]
 66%|██████▌   | 24868/37963 [106:33:51<53:59:08, 14.84s/it]
 66%|██████▌   | 24869/37963 [106:34:05<53:37:23, 14.74s/it]
 66%|██████▌   | 24870/37963 [106:34:19<52:46:22, 14.51s/it]
                                                            
{'loss': '0.1218', 'grad_norm': '1.522', 'learning_rate': '5.617e-06', 'epoch': '0.6551'}

 66%|██████▌   | 24870/37963 [106:34:19<52:46:22, 14.51s/it]
 66%|██████▌   | 24871/37963 [106:34:34<52:34:03, 14.45s/it]
 66%|██████▌   | 24872/37963 [106:34:48<52:34:01, 14.46s/it]
 66%|██████▌   | 24873/37963 [106:35:02<52:28:25, 14.43s/it]
 66%|██████▌   | 24874/37963 [106:35:17<52:32:37, 14.45s/it]
 66%|██████▌   | 24875/37963 [106:35:31<52:09:07, 14.34s/it]
 66%|██████▌   | 24876/37963 [106:35:45<51:58:11, 14.30s/it]
 66%|██████▌   | 24877/37963 [106:36:00<52:04:15, 14.32s/it]
 66%|██████▌   | 24878/37963 [106:36:14<52:05:01, 14.33s/it]
 66%|██████▌   | 24879/37963 [106:36:35<59:19:36, 16.32s/it]
 66%|██████▌   | 24880/37963 [106:36:49<56:58:07, 15.68s/it]
                                                            
{'loss': '0.1098', 'grad_norm': '2.803', 'learning_rate': '5.609e-06', 'epoch': '0.6554'}

 66%|██████▌   | 24880/37963 [106:36:49<56:58:07, 15.68s/it]
 66%|██████▌   | 24881/37963 [106:37:10<62:43:36, 17.26s/it]
 66%|██████▌   | 24882/37963 [106:37:24<59:37:46, 16.41s/it]
 66%|██████▌   | 24883/37963 [106:37:45<64:16:52, 17.69s/it]
 66%|██████▌   | 24884/37963 [106:38:06<67:47:45, 18.66s/it]
 66%|██████▌   | 24885/37963 [106:38:20<63:04:46, 17.36s/it]
 66%|██████▌   | 24886/37963 [106:38:34<59:26:21, 16.36s/it]
 66%|██████▌   | 24887/37963 [106:38:49<57:21:14, 15.79s/it]
 66%|██████▌   | 24888/37963 [106:39:03<55:18:11, 15.23s/it]
 66%|██████▌   | 24889/37963 [106:39:17<54:26:28, 14.99s/it]
 66%|██████▌   | 24890/37963 [106:39:32<53:53:54, 14.84s/it]
                                                            
{'loss': '0.1286', 'grad_norm': '1.969', 'learning_rate': '5.602e-06', 'epoch': '0.6556'}

 66%|██████▌   | 24890/37963 [106:39:32<53:53:54, 14.84s/it]
 66%|██████▌   | 24891/37963 [106:39:46<53:26:04, 14.72s/it]
 66%|██████▌   | 24892/37963 [106:40:01<53:08:54, 14.64s/it]
 66%|██████▌   | 24893/37963 [106:40:21<59:19:56, 16.34s/it]
 66%|██████▌   | 24894/37963 [106:40:35<57:05:53, 15.73s/it]
 66%|██████▌   | 24895/37963 [106:40:57<63:15:45, 17.43s/it]
 66%|██████▌   | 24896/37963 [106:41:11<59:56:43, 16.52s/it]
 66%|██████▌   | 24897/37963 [106:41:25<57:39:43, 15.89s/it]
 66%|██████▌   | 24898/37963 [106:41:40<56:02:32, 15.44s/it]
 66%|██████▌   | 24899/37963 [106:41:54<54:51:04, 15.12s/it]
 66%|██████▌   | 24900/37963 [106:42:08<53:40:38, 14.79s/it]
                                                            
{'loss': '0.1237', 'grad_norm': '4.431', 'learning_rate': '5.594e-06', 'epoch': '0.6559'}

 66%|██████▌   | 24900/37963 [106:42:08<53:40:38, 14.79s/it]
 66%|██████▌   | 24901/37963 [106:42:22<52:38:41, 14.51s/it]
 66%|██████▌   | 24902/37963 [106:42:42<58:43:48, 16.19s/it]
 66%|██████▌   | 24903/37963 [106:42:57<56:44:16, 15.64s/it]
 66%|██████▌   | 24904/37963 [106:43:11<55:19:00, 15.25s/it]
 66%|██████▌   | 24905/37963 [106:43:24<53:30:17, 14.75s/it]
 66%|██████▌   | 24906/37963 [106:43:39<53:16:23, 14.69s/it]
 66%|██████▌   | 24907/37963 [106:43:53<52:56:11, 14.60s/it]
 66%|██████▌   | 24908/37963 [106:44:08<52:26:24, 14.46s/it]
 66%|██████▌   | 24909/37963 [106:44:22<52:19:08, 14.43s/it]
 66%|██████▌   | 24910/37963 [106:44:36<52:12:14, 14.40s/it]
                                                            
{'loss': '0.1199', 'grad_norm': '2.944', 'learning_rate': '5.586e-06', 'epoch': '0.6562'}

 66%|██████▌   | 24910/37963 [106:44:36<52:12:14, 14.40s/it]
 66%|██████▌   | 24911/37963 [106:44:50<51:48:42, 14.29s/it]
 66%|██████▌   | 24912/37963 [106:45:04<51:32:06, 14.22s/it]
 66%|██████▌   | 24913/37963 [106:45:26<59:17:50, 16.36s/it]
 66%|██████▌   | 24914/37963 [106:45:40<57:09:19, 15.77s/it]
 66%|██████▌   | 24915/37963 [106:45:55<55:49:46, 15.40s/it]
 66%|██████▌   | 24916/37963 [106:46:09<54:10:56, 14.95s/it]
 66%|██████▌   | 24917/37963 [106:46:23<53:11:15, 14.68s/it]
 66%|██████▌   | 24918/37963 [106:46:37<52:57:10, 14.61s/it]
 66%|██████▌   | 24919/37963 [106:46:51<52:37:44, 14.53s/it]
 66%|██████▌   | 24920/37963 [106:47:05<51:49:08, 14.30s/it]
                                                            
{'loss': '0.1206', 'grad_norm': '2.083', 'learning_rate': '5.579e-06', 'epoch': '0.6564'}

 66%|██████▌   | 24920/37963 [106:47:05<51:49:08, 14.30s/it]
 66%|██████▌   | 24921/37963 [106:47:20<51:58:56, 14.35s/it]
 66%|██████▌   | 24922/37963 [106:47:34<51:58:16, 14.35s/it]
 66%|██████▌   | 24923/37963 [106:47:48<51:59:55, 14.36s/it]
 66%|██████▌   | 24924/37963 [106:48:03<51:52:39, 14.32s/it]
 66%|██████▌   | 24925/37963 [106:48:17<52:02:54, 14.37s/it]
 66%|██████▌   | 24926/37963 [106:48:32<52:11:11, 14.41s/it]
 66%|██████▌   | 24927/37963 [106:48:46<52:07:13, 14.39s/it]
 66%|██████▌   | 24928/37963 [106:49:07<59:19:43, 16.39s/it]
 66%|██████▌   | 24929/37963 [106:49:21<57:08:33, 15.78s/it]
 66%|██████▌   | 24930/37963 [106:49:42<62:57:05, 17.39s/it]
                                                            
{'loss': '0.1196', 'grad_norm': '1.709', 'learning_rate': '5.571e-06', 'epoch': '0.6567'}

 66%|██████▌   | 24930/37963 [106:49:42<62:57:05, 17.39s/it]
 66%|██████▌   | 24931/37963 [106:49:57<59:40:04, 16.48s/it]
 66%|██████▌   | 24932/37963 [106:50:18<64:59:11, 17.95s/it]
 66%|██████▌   | 24933/37963 [106:50:40<68:54:49, 19.04s/it]
 66%|██████▌   | 24934/37963 [106:50:54<63:49:48, 17.64s/it]
 66%|██████▌   | 24935/37963 [106:51:09<60:20:16, 16.67s/it]
 66%|██████▌   | 24936/37963 [106:51:23<57:53:51, 16.00s/it]
 66%|██████▌   | 24937/37963 [106:51:37<55:32:13, 15.35s/it]
 66%|██████▌   | 24938/37963 [106:51:51<53:59:13, 14.92s/it]
 66%|██████▌   | 24939/37963 [106:52:05<53:36:52, 14.82s/it]
 66%|██████▌   | 24940/37963 [106:52:19<52:55:31, 14.63s/it]
                                                            
{'loss': '0.1171', 'grad_norm': '5.043', 'learning_rate': '5.563e-06', 'epoch': '0.657'}

 66%|██████▌   | 24940/37963 [106:52:19<52:55:31, 14.63s/it]
 66%|██████▌   | 24941/37963 [106:52:40<59:48:12, 16.53s/it]
 66%|██████▌   | 24942/37963 [106:52:55<57:28:41, 15.89s/it]
 66%|██████▌   | 24943/37963 [106:53:09<55:29:02, 15.34s/it]
 66%|██████▌   | 24944/37963 [106:53:23<54:27:57, 15.06s/it]
 66%|██████▌   | 24945/37963 [106:53:45<61:22:29, 16.97s/it]
 66%|██████▌   | 24946/37963 [106:53:59<58:31:54, 16.19s/it]
 66%|██████▌   | 24947/37963 [106:54:14<56:36:54, 15.66s/it]
 66%|██████▌   | 24948/37963 [106:54:28<55:03:00, 15.23s/it]
 66%|██████▌   | 24949/37963 [106:54:42<54:11:45, 14.99s/it]
 66%|██████▌   | 24950/37963 [106:54:57<53:31:45, 14.81s/it]
                                                            
{'loss': '0.118', 'grad_norm': '3.033', 'learning_rate': '5.556e-06', 'epoch': '0.6572'}

 66%|██████▌   | 24950/37963 [106:54:57<53:31:45, 14.81s/it]
 66%|██████▌   | 24951/37963 [106:55:17<60:03:57, 16.62s/it]
 66%|██████▌   | 24952/37963 [106:55:31<57:07:13, 15.80s/it]
 66%|██████▌   | 24953/37963 [106:55:46<55:41:16, 15.41s/it]
 66%|██████▌   | 24954/37963 [106:56:00<54:36:23, 15.11s/it]
 66%|██████▌   | 24955/37963 [106:56:15<53:51:50, 14.91s/it]
 66%|██████▌   | 24956/37963 [106:56:29<53:15:22, 14.74s/it]
 66%|██████▌   | 24957/37963 [106:56:43<52:54:18, 14.64s/it]
 66%|██████▌   | 24958/37963 [106:56:58<52:22:28, 14.50s/it]
 66%|██████▌   | 24959/37963 [106:57:12<52:22:31, 14.50s/it]
 66%|██████▌   | 24960/37963 [106:57:26<52:00:17, 14.40s/it]
                                                            
{'loss': '0.1198', 'grad_norm': '1.571', 'learning_rate': '5.548e-06', 'epoch': '0.6575'}

 66%|██████▌   | 24960/37963 [106:57:26<52:00:17, 14.40s/it]
 66%|██████▌   | 24961/37963 [106:57:41<52:09:01, 14.44s/it]
 66%|██████▌   | 24962/37963 [106:58:02<59:08:54, 16.38s/it]
 66%|██████▌   | 24963/37963 [106:58:16<56:35:02, 15.67s/it]
 66%|██████▌   | 24964/37963 [106:58:30<55:01:38, 15.24s/it]
 66%|██████▌   | 24965/37963 [106:58:44<53:44:07, 14.88s/it]
 66%|██████▌   | 24966/37963 [106:58:58<53:12:44, 14.74s/it]
 66%|██████▌   | 24967/37963 [106:59:13<52:47:43, 14.62s/it]
 66%|██████▌   | 24968/37963 [106:59:27<52:29:50, 14.54s/it]
 66%|██████▌   | 24969/37963 [106:59:41<52:19:09, 14.50s/it]
 66%|██████▌   | 24970/37963 [106:59:56<52:12:01, 14.46s/it]
                                                            
{'loss': '0.1198', 'grad_norm': '1.646', 'learning_rate': '5.541e-06', 'epoch': '0.6577'}

 66%|██████▌   | 24970/37963 [106:59:56<52:12:01, 14.46s/it]
 66%|██████▌   | 24971/37963 [107:00:10<51:39:18, 14.31s/it]
 66%|██████▌   | 24972/37963 [107:00:24<51:50:24, 14.37s/it]
 66%|██████▌   | 24973/37963 [107:00:39<51:55:33, 14.39s/it]
 66%|██████▌   | 24974/37963 [107:00:53<51:56:08, 14.39s/it]
 66%|██████▌   | 24975/37963 [107:01:08<51:59:21, 14.41s/it]
 66%|██████▌   | 24976/37963 [107:01:28<58:07:49, 16.11s/it]
 66%|██████▌   | 24977/37963 [107:01:49<63:28:09, 17.60s/it]
 66%|██████▌   | 24978/37963 [107:02:03<59:41:04, 16.55s/it]
 66%|██████▌   | 24979/37963 [107:02:17<57:20:33, 15.90s/it]
 66%|██████▌   | 24980/37963 [107:02:45<70:17:44, 19.49s/it]
                                                            
{'loss': '0.1175', 'grad_norm': '3.797', 'learning_rate': '5.533e-06', 'epoch': '0.658'}

 66%|██████▌   | 24980/37963 [107:02:45<70:17:44, 19.49s/it]
 66%|██████▌   | 24981/37963 [107:02:59<64:43:47, 17.95s/it]
 66%|██████▌   | 24982/37963 [107:03:14<60:49:07, 16.87s/it]
 66%|██████▌   | 24983/37963 [107:03:28<58:09:30, 16.13s/it]
 66%|██████▌   | 24984/37963 [107:03:43<56:14:53, 15.60s/it]
 66%|██████▌   | 24985/37963 [107:03:56<54:22:59, 15.09s/it]
 66%|██████▌   | 24986/37963 [107:04:11<53:24:38, 14.82s/it]
 66%|██████▌   | 24987/37963 [107:04:25<53:03:57, 14.72s/it]
 66%|██████▌   | 24988/37963 [107:04:39<51:44:52, 14.36s/it]
 66%|██████▌   | 24989/37963 [107:04:59<58:40:11, 16.28s/it]
 66%|██████▌   | 24990/37963 [107:05:14<56:37:48, 15.71s/it]
                                                            
{'loss': '0.1105', 'grad_norm': '2.379', 'learning_rate': '5.525e-06', 'epoch': '0.6583'}

 66%|██████▌   | 24990/37963 [107:05:14<56:37:48, 15.71s/it]
 66%|██████▌   | 24991/37963 [107:05:28<55:01:10, 15.27s/it]
 66%|██████▌   | 24992/37963 [107:05:42<54:04:51, 15.01s/it]
 66%|██████▌   | 24993/37963 [107:05:57<53:14:47, 14.78s/it]
 66%|██████▌   | 24994/37963 [107:06:19<61:21:08, 17.03s/it]
 66%|██████▌   | 24995/37963 [107:06:33<57:55:40, 16.08s/it]
 66%|██████▌   | 24996/37963 [107:06:47<55:40:45, 15.46s/it]
 66%|██████▌   | 24997/37963 [107:07:01<54:29:20, 15.13s/it]
 66%|██████▌   | 24998/37963 [107:07:16<53:40:13, 14.90s/it]
 66%|██████▌   | 24999/37963 [107:07:36<59:36:38, 16.55s/it]
 66%|██████▌   | 25000/37963 [107:07:50<57:12:15, 15.89s/it]
                                                            
{'loss': '0.1182', 'grad_norm': '2.064', 'learning_rate': '5.518e-06', 'epoch': '0.6585'}

 66%|██████▌   | 25000/37963 [107:07:50<57:12:15, 15.89s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.26s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.26s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 66%|██████▌   | 25001/37963 [107:09:35<153:33:26, 42.65s/it]
 66%|██████▌   | 25002/37963 [107:09:50<123:18:46, 34.25s/it]
 66%|██████▌   | 25003/37963 [107:10:04<101:51:57, 28.30s/it]
 66%|██████▌   | 25004/37963 [107:10:19<86:46:24, 24.11s/it] 
 66%|██████▌   | 25005/37963 [107:10:33<75:32:42, 20.99s/it]
 66%|██████▌   | 25006/37963 [107:10:47<68:35:45, 19.06s/it]
 66%|██████▌   | 25007/37963 [107:11:01<63:28:18, 17.64s/it]
 66%|██████▌   | 25008/37963 [107:11:16<60:01:31, 16.68s/it]
 66%|██████▌   | 25009/37963 [107:11:30<57:19:55, 15.93s/it]
 66%|██████▌   | 25010/37963 [107:11:45<55:44:10, 15.49s/it]
                                                            
{'loss': '0.1153', 'grad_norm': '3.455', 'learning_rate': '5.51e-06', 'epoch': '0.6588'}

 66%|██████▌   | 25010/37963 [107:11:45<55:44:10, 15.49s/it]
 66%|██████▌   | 25011/37963 [107:11:59<54:21:49, 15.11s/it]
 66%|██████▌   | 25012/37963 [107:12:20<60:44:12, 16.88s/it]
 66%|██████▌   | 25013/37963 [107:12:34<58:06:18, 16.15s/it]
 66%|██████▌   | 25014/37963 [107:12:49<56:16:36, 15.65s/it]
 66%|██████▌   | 25015/37963 [107:13:03<54:31:20, 15.16s/it]
 66%|██████▌   | 25016/37963 [107:13:17<53:42:54, 14.94s/it]
 66%|██████▌   | 25017/37963 [107:13:31<53:02:25, 14.75s/it]
 66%|██████▌   | 25018/37963 [107:13:46<52:38:43, 14.64s/it]
 66%|██████▌   | 25019/37963 [107:14:00<52:01:00, 14.47s/it]
 66%|██████▌   | 25020/37963 [107:14:14<51:56:15, 14.45s/it]
                                                            
{'loss': '0.1196', 'grad_norm': '2.055', 'learning_rate': '5.502e-06', 'epoch': '0.6591'}

 66%|██████▌   | 25020/37963 [107:14:14<51:56:15, 14.45s/it]
 66%|██████▌   | 25021/37963 [107:14:29<51:47:16, 14.41s/it]
 66%|██████▌   | 25022/37963 [107:14:43<51:40:44, 14.38s/it]
 66%|██████▌   | 25023/37963 [107:14:57<51:28:46, 14.32s/it]
 66%|██████▌   | 25024/37963 [107:15:12<51:38:26, 14.37s/it]
 66%|██████▌   | 25025/37963 [107:15:38<65:07:41, 18.12s/it]
 66%|██████▌   | 25026/37963 [107:15:53<61:04:37, 17.00s/it]
 66%|██████▌   | 25027/37963 [107:16:07<57:53:32, 16.11s/it]
 66%|██████▌   | 25028/37963 [107:16:21<55:48:17, 15.53s/it]
 66%|██████▌   | 25029/37963 [107:16:42<61:41:27, 17.17s/it]
 66%|██████▌   | 25030/37963 [107:17:03<65:46:54, 18.31s/it]
                                                            
{'loss': '0.122', 'grad_norm': '2.068', 'learning_rate': '5.495e-06', 'epoch': '0.6593'}

 66%|██████▌   | 25030/37963 [107:17:03<65:46:54, 18.31s/it]
 66%|██████▌   | 25031/37963 [107:17:17<60:59:47, 16.98s/it]
 66%|██████▌   | 25032/37963 [107:17:31<57:35:03, 16.03s/it]
 66%|██████▌   | 25033/37963 [107:17:45<55:46:11, 15.53s/it]
 66%|██████▌   | 25034/37963 [107:17:59<54:30:27, 15.18s/it]
 66%|██████▌   | 25035/37963 [107:18:13<53:14:09, 14.82s/it]
 66%|██████▌   | 25036/37963 [107:18:28<52:33:28, 14.64s/it]
 66%|██████▌   | 25037/37963 [107:18:42<51:46:02, 14.42s/it]
 66%|██████▌   | 25038/37963 [107:19:02<57:54:11, 16.13s/it]
 66%|██████▌   | 25039/37963 [107:19:16<56:01:31, 15.61s/it]
 66%|██████▌   | 25040/37963 [107:19:30<54:23:33, 15.15s/it]
                                                            
{'loss': '0.1149', 'grad_norm': '1.41', 'learning_rate': '5.487e-06', 'epoch': '0.6596'}

 66%|██████▌   | 25040/37963 [107:19:30<54:23:33, 15.15s/it]
 66%|██████▌   | 25041/37963 [107:19:51<60:21:28, 16.82s/it]
 66%|██████▌   | 25042/37963 [107:20:05<57:46:59, 16.10s/it]
 66%|██████▌   | 25043/37963 [107:20:20<56:12:28, 15.66s/it]
 66%|██████▌   | 25044/37963 [107:20:34<54:52:15, 15.29s/it]
 66%|██████▌   | 25045/37963 [107:20:49<53:55:12, 15.03s/it]
 66%|██████▌   | 25046/37963 [107:21:03<53:28:10, 14.90s/it]
 66%|██████▌   | 25047/37963 [107:21:17<52:24:24, 14.61s/it]
 66%|██████▌   | 25048/37963 [107:21:38<59:31:53, 16.59s/it]
 66%|██████▌   | 25049/37963 [107:21:53<57:13:07, 15.95s/it]
 66%|██████▌   | 25050/37963 [107:22:07<55:28:52, 15.47s/it]
                                                            
{'loss': '0.1135', 'grad_norm': '2.447', 'learning_rate': '5.48e-06', 'epoch': '0.6599'}

 66%|██████▌   | 25050/37963 [107:22:07<55:28:52, 15.47s/it]
 66%|██████▌   | 25051/37963 [107:22:22<54:18:27, 15.14s/it]
 66%|██████▌   | 25052/37963 [107:22:36<53:32:31, 14.93s/it]
 66%|██████▌   | 25053/37963 [107:22:51<53:01:26, 14.79s/it]
 66%|██████▌   | 25054/37963 [107:23:05<52:31:14, 14.65s/it]
 66%|██████▌   | 25055/37963 [107:23:19<52:22:01, 14.60s/it]
 66%|██████▌   | 25056/37963 [107:23:33<51:28:49, 14.36s/it]
 66%|██████▌   | 25057/37963 [107:23:47<51:26:59, 14.35s/it]
 66%|██████▌   | 25058/37963 [107:24:02<51:09:27, 14.27s/it]
 66%|██████▌   | 25059/37963 [107:24:16<51:12:56, 14.29s/it]
 66%|██████▌   | 25060/37963 [107:24:30<51:23:57, 14.34s/it]
                                                            
{'loss': '0.1112', 'grad_norm': '1.379', 'learning_rate': '5.472e-06', 'epoch': '0.6601'}

 66%|██████▌   | 25060/37963 [107:24:30<51:23:57, 14.34s/it]
 66%|██████▌   | 25061/37963 [107:24:45<51:27:43, 14.36s/it]
 66%|██████▌   | 25062/37963 [107:25:06<58:27:48, 16.31s/it]
 66%|██████▌   | 25063/37963 [107:25:20<56:24:57, 15.74s/it]
 66%|██████▌   | 25064/37963 [107:25:34<54:56:54, 15.34s/it]
 66%|██████▌   | 25065/37963 [107:25:49<53:47:09, 15.01s/it]
 66%|██████▌   | 25066/37963 [107:26:03<53:13:39, 14.86s/it]
 66%|██████▌   | 25067/37963 [107:26:17<51:49:46, 14.47s/it]
 66%|██████▌   | 25068/37963 [107:26:31<51:44:25, 14.44s/it]
 66%|██████▌   | 25069/37963 [107:26:45<51:37:29, 14.41s/it]
 66%|██████▌   | 25070/37963 [107:27:00<51:33:55, 14.40s/it]
                                                            
{'loss': '0.1183', 'grad_norm': '1.121', 'learning_rate': '5.464e-06', 'epoch': '0.6604'}

 66%|██████▌   | 25070/37963 [107:27:00<51:33:55, 14.40s/it]
 66%|██████▌   | 25071/37963 [107:27:14<51:31:51, 14.39s/it]
 66%|██████▌   | 25072/37963 [107:27:29<51:34:13, 14.40s/it]
 66%|██████▌   | 25073/37963 [107:27:50<58:36:17, 16.37s/it]
 66%|██████▌   | 25074/37963 [107:28:04<56:49:32, 15.87s/it]
 66%|██████▌   | 25075/37963 [107:28:18<54:48:31, 15.31s/it]
 66%|██████▌   | 25076/37963 [107:28:39<60:24:57, 16.88s/it]
 66%|██████▌   | 25077/37963 [107:28:53<57:41:31, 16.12s/it]
 66%|██████▌   | 25078/37963 [107:29:20<69:17:13, 19.36s/it]
 66%|██████▌   | 25079/37963 [107:29:34<63:36:30, 17.77s/it]
 66%|██████▌   | 25080/37963 [107:29:49<59:56:09, 16.75s/it]
                                                            
{'loss': '0.1207', 'grad_norm': '1.5', 'learning_rate': '5.457e-06', 'epoch': '0.6606'}

 66%|██████▌   | 25080/37963 [107:29:49<59:56:09, 16.75s/it]
 66%|██████▌   | 25081/37963 [107:30:03<57:08:46, 15.97s/it]
 66%|██████▌   | 25082/37963 [107:30:17<55:33:37, 15.53s/it]
 66%|██████▌   | 25083/37963 [107:30:32<54:24:17, 15.21s/it]
 66%|██████▌   | 25084/37963 [107:30:46<53:29:56, 14.95s/it]
 66%|██████▌   | 25085/37963 [107:31:00<52:56:29, 14.80s/it]
 66%|██████▌   | 25086/37963 [107:31:15<52:17:22, 14.62s/it]
 66%|██████▌   | 25087/37963 [107:31:29<52:08:59, 14.58s/it]
 66%|██████▌   | 25088/37963 [107:31:50<59:06:28, 16.53s/it]
 66%|██████▌   | 25089/37963 [107:32:04<56:05:38, 15.69s/it]
 66%|██████▌   | 25090/37963 [107:32:25<61:45:43, 17.27s/it]
                                                            
{'loss': '0.1148', 'grad_norm': '1.694', 'learning_rate': '5.449e-06', 'epoch': '0.6609'}

 66%|██████▌   | 25090/37963 [107:32:25<61:45:43, 17.27s/it]
 66%|██████▌   | 25091/37963 [107:32:39<58:41:04, 16.41s/it]
 66%|██████▌   | 25092/37963 [107:32:54<56:32:58, 15.82s/it]
 66%|██████▌   | 25093/37963 [107:33:08<55:04:53, 15.41s/it]
 66%|██████▌   | 25094/37963 [107:33:22<53:14:58, 14.90s/it]
 66%|██████▌   | 25095/37963 [107:33:36<52:27:45, 14.68s/it]
 66%|██████▌   | 25096/37963 [107:33:50<52:06:38, 14.58s/it]
 66%|██████▌   | 25097/37963 [107:34:11<58:49:46, 16.46s/it]
 66%|██████▌   | 25098/37963 [107:34:26<56:45:11, 15.88s/it]
 66%|██████▌   | 25099/37963 [107:34:40<55:03:26, 15.41s/it]
 66%|██████▌   | 25100/37963 [107:34:54<53:26:44, 14.96s/it]
                                                            
{'loss': '0.1183', 'grad_norm': '3.81', 'learning_rate': '5.442e-06', 'epoch': '0.6612'}

 66%|██████▌   | 25100/37963 [107:34:54<53:26:44, 14.96s/it]
 66%|██████▌   | 25101/37963 [107:35:08<52:48:34, 14.78s/it]
 66%|██████▌   | 25102/37963 [107:35:23<52:16:14, 14.63s/it]
 66%|██████▌   | 25103/37963 [107:35:37<51:59:39, 14.56s/it]
 66%|██████▌   | 25104/37963 [107:35:51<51:17:48, 14.36s/it]
 66%|██████▌   | 25105/37963 [107:36:05<51:16:44, 14.36s/it]
 66%|██████▌   | 25106/37963 [107:36:20<51:22:12, 14.38s/it]
 66%|██████▌   | 25107/37963 [107:36:34<51:21:51, 14.38s/it]
 66%|██████▌   | 25108/37963 [107:36:48<50:40:36, 14.19s/it]
 66%|██████▌   | 25109/37963 [107:37:02<50:29:51, 14.14s/it]
 66%|██████▌   | 25110/37963 [107:37:23<57:39:59, 16.15s/it]
                                                            
{'loss': '0.1126', 'grad_norm': '3.436', 'learning_rate': '5.434e-06', 'epoch': '0.6614'}

 66%|██████▌   | 25110/37963 [107:37:23<57:39:59, 16.15s/it]
 66%|██████▌   | 25111/37963 [107:37:37<55:45:17, 15.62s/it]
 66%|██████▌   | 25112/37963 [107:37:51<54:23:34, 15.24s/it]
 66%|██████▌   | 25113/37963 [107:38:06<53:28:52, 14.98s/it]
 66%|██████▌   | 25114/37963 [107:38:20<52:53:14, 14.82s/it]
 66%|██████▌   | 25115/37963 [107:38:35<52:26:29, 14.69s/it]
 66%|██████▌   | 25116/37963 [107:38:49<52:17:56, 14.66s/it]
 66%|██████▌   | 25117/37963 [107:39:03<51:35:20, 14.46s/it]
 66%|██████▌   | 25118/37963 [107:39:17<51:14:37, 14.36s/it]
 66%|██████▌   | 25119/37963 [107:39:32<51:15:50, 14.37s/it]
 66%|██████▌   | 25120/37963 [107:39:45<50:34:03, 14.17s/it]
                                                            
{'loss': '0.119', 'grad_norm': '2.286', 'learning_rate': '5.426e-06', 'epoch': '0.6617'}

 66%|██████▌   | 25120/37963 [107:39:45<50:34:03, 14.17s/it]
 66%|██████▌   | 25121/37963 [107:40:00<50:49:04, 14.25s/it]
 66%|██████▌   | 25122/37963 [107:40:20<57:26:15, 16.10s/it]
 66%|██████▌   | 25123/37963 [107:40:35<55:36:27, 15.59s/it]
 66%|██████▌   | 25124/37963 [107:40:55<60:26:45, 16.95s/it]
 66%|██████▌   | 25125/37963 [107:41:09<57:25:03, 16.10s/it]
 66%|██████▌   | 25126/37963 [107:41:30<63:01:06, 17.67s/it]
 66%|██████▌   | 25127/37963 [107:41:51<66:43:56, 18.72s/it]
 66%|██████▌   | 25128/37963 [107:42:06<61:54:17, 17.36s/it]
 66%|██████▌   | 25129/37963 [107:42:20<58:29:19, 16.41s/it]
 66%|██████▌   | 25130/37963 [107:42:34<56:22:05, 15.81s/it]
                                                            
{'loss': '0.1277', 'grad_norm': '2.678', 'learning_rate': '5.419e-06', 'epoch': '0.662'}

 66%|██████▌   | 25130/37963 [107:42:34<56:22:05, 15.81s/it]
 66%|██████▌   | 25131/37963 [107:42:49<54:49:52, 15.38s/it]
 66%|██████▌   | 25132/37963 [107:43:03<53:46:25, 15.09s/it]
 66%|██████▌   | 25133/37963 [107:43:17<52:51:20, 14.83s/it]
 66%|██████▌   | 25134/37963 [107:43:31<52:11:13, 14.64s/it]
 66%|██████▌   | 25135/37963 [107:43:51<57:53:22, 16.25s/it]
 66%|██████▌   | 25136/37963 [107:44:06<55:51:51, 15.68s/it]
 66%|██████▌   | 25137/37963 [107:44:20<54:26:17, 15.28s/it]
 66%|██████▌   | 25138/37963 [107:44:34<53:14:58, 14.95s/it]
 66%|██████▌   | 25139/37963 [107:44:55<59:31:17, 16.71s/it]
 66%|██████▌   | 25140/37963 [107:45:10<57:01:24, 16.01s/it]
                                                            
{'loss': '0.1078', 'grad_norm': '1.674', 'learning_rate': '5.411e-06', 'epoch': '0.6622'}

 66%|██████▌   | 25140/37963 [107:45:10<57:01:24, 16.01s/it]
 66%|██████▌   | 25141/37963 [107:45:23<54:41:58, 15.36s/it]
 66%|██████▌   | 25142/37963 [107:45:38<53:52:00, 15.13s/it]
 66%|██████▌   | 25143/37963 [107:45:52<53:02:35, 14.90s/it]
 66%|██████▌   | 25144/37963 [107:46:07<52:32:01, 14.75s/it]
 66%|██████▌   | 25145/37963 [107:46:27<58:07:38, 16.33s/it]
 66%|██████▌   | 25146/37963 [107:46:41<56:02:55, 15.74s/it]
 66%|██████▌   | 25147/37963 [107:46:55<54:34:37, 15.33s/it]
 66%|██████▌   | 25148/37963 [107:47:10<53:31:05, 15.03s/it]
 66%|██████▌   | 25149/37963 [107:47:24<52:34:57, 14.77s/it]
 66%|██████▌   | 25150/37963 [107:47:38<52:13:14, 14.67s/it]
                                                            
{'loss': '0.1214', 'grad_norm': '3.225', 'learning_rate': '5.404e-06', 'epoch': '0.6625'}

 66%|██████▌   | 25150/37963 [107:47:38<52:13:14, 14.67s/it]
 66%|██████▋   | 25151/37963 [107:47:53<51:58:07, 14.60s/it]
 66%|██████▋   | 25152/37963 [107:48:07<50:58:36, 14.32s/it]
 66%|██████▋   | 25153/37963 [107:48:21<50:57:06, 14.32s/it]
 66%|██████▋   | 25154/37963 [107:48:35<50:59:58, 14.33s/it]
 66%|██████▋   | 25155/37963 [107:48:50<51:02:27, 14.35s/it]
 66%|██████▋   | 25156/37963 [107:49:03<50:21:11, 14.15s/it]
 66%|██████▋   | 25157/37963 [107:49:18<50:36:45, 14.23s/it]
 66%|██████▋   | 25158/37963 [107:49:31<49:53:27, 14.03s/it]
 66%|██████▋   | 25159/37963 [107:49:46<50:15:51, 14.13s/it]
 66%|██████▋   | 25160/37963 [107:50:07<57:30:05, 16.17s/it]
                                                            
{'loss': '0.1118', 'grad_norm': '2.901', 'learning_rate': '5.396e-06', 'epoch': '0.6628'}

 66%|██████▋   | 25160/37963 [107:50:07<57:30:05, 16.17s/it]
 66%|██████▋   | 25161/37963 [107:50:21<55:27:15, 15.59s/it]
 66%|██████▋   | 25162/37963 [107:50:35<54:10:00, 15.23s/it]
 66%|██████▋   | 25163/37963 [107:50:49<53:08:30, 14.95s/it]
 66%|██████▋   | 25164/37963 [107:51:04<52:35:00, 14.79s/it]
 66%|██████▋   | 25165/37963 [107:51:18<52:09:41, 14.67s/it]
 66%|██████▋   | 25166/37963 [107:51:33<51:50:09, 14.58s/it]
 66%|██████▋   | 25167/37963 [107:51:47<51:45:17, 14.56s/it]
 66%|██████▋   | 25168/37963 [107:52:02<51:32:56, 14.50s/it]
 66%|██████▋   | 25169/37963 [107:52:16<51:25:09, 14.47s/it]
 66%|██████▋   | 25170/37963 [107:52:36<57:36:59, 16.21s/it]
                                                            
{'loss': '0.124', 'grad_norm': '2.415', 'learning_rate': '5.388e-06', 'epoch': '0.663'}

 66%|██████▋   | 25170/37963 [107:52:36<57:36:59, 16.21s/it]
 66%|██████▋   | 25171/37963 [107:52:51<55:45:04, 15.69s/it]
 66%|██████▋   | 25172/37963 [107:53:05<54:24:55, 15.32s/it]
 66%|██████▋   | 25173/37963 [107:53:25<59:45:41, 16.82s/it]
 66%|██████▋   | 25174/37963 [107:53:40<57:11:12, 16.10s/it]
 66%|██████▋   | 25175/37963 [107:54:07<68:53:46, 19.40s/it]
 66%|██████▋   | 25176/37963 [107:54:21<63:26:12, 17.86s/it]
 66%|██████▋   | 25177/37963 [107:54:36<59:40:26, 16.80s/it]
 66%|██████▋   | 25178/37963 [107:54:50<57:07:09, 16.08s/it]
 66%|██████▋   | 25179/37963 [107:55:04<55:20:41, 15.59s/it]
 66%|██████▋   | 25180/37963 [107:55:19<54:09:55, 15.25s/it]
                                                            
{'loss': '0.1183', 'grad_norm': '2.469', 'learning_rate': '5.381e-06', 'epoch': '0.6633'}

 66%|██████▋   | 25180/37963 [107:55:19<54:09:55, 15.25s/it]
 66%|██████▋   | 25181/37963 [107:55:33<53:03:21, 14.94s/it]
 66%|██████▋   | 25182/37963 [107:55:47<52:25:08, 14.76s/it]
 66%|██████▋   | 25183/37963 [107:56:02<52:04:51, 14.67s/it]
 66%|██████▋   | 25184/37963 [107:56:23<58:36:14, 16.51s/it]
 66%|██████▋   | 25185/37963 [107:56:37<56:22:11, 15.88s/it]
 66%|██████▋   | 25186/37963 [107:56:52<55:01:13, 15.50s/it]
 66%|██████▋   | 25187/37963 [107:57:06<53:49:20, 15.17s/it]
 66%|██████▋   | 25188/37963 [107:57:20<52:19:07, 14.74s/it]
 66%|██████▋   | 25189/37963 [107:57:41<58:54:41, 16.60s/it]
 66%|██████▋   | 25190/37963 [107:57:55<56:34:17, 15.94s/it]
                                                            
{'loss': '0.1037', 'grad_norm': '2.086', 'learning_rate': '5.373e-06', 'epoch': '0.6635'}

 66%|██████▋   | 25190/37963 [107:57:55<56:34:17, 15.94s/it]
 66%|██████▋   | 25191/37963 [107:58:10<54:54:31, 15.48s/it]
 66%|██████▋   | 25192/37963 [107:58:24<53:35:25, 15.11s/it]
 66%|██████▋   | 25193/37963 [107:58:38<52:28:01, 14.79s/it]
 66%|██████▋   | 25194/37963 [107:58:59<59:21:18, 16.73s/it]
 66%|██████▋   | 25195/37963 [107:59:13<56:24:31, 15.90s/it]
 66%|██████▋   | 25196/37963 [107:59:28<54:47:18, 15.45s/it]
 66%|██████▋   | 25197/37963 [107:59:42<53:41:31, 15.14s/it]
 66%|██████▋   | 25198/37963 [107:59:56<52:40:22, 14.85s/it]
 66%|██████▋   | 25199/37963 [108:00:11<52:16:53, 14.75s/it]
 66%|██████▋   | 25200/37963 [108:00:25<51:51:36, 14.63s/it]
                                                            
{'loss': '0.1334', 'grad_norm': '3.579', 'learning_rate': '5.366e-06', 'epoch': '0.6638'}

 66%|██████▋   | 25200/37963 [108:00:25<51:51:36, 14.63s/it]
 66%|██████▋   | 25201/37963 [108:00:39<51:34:55, 14.55s/it]
 66%|██████▋   | 25202/37963 [108:00:53<51:01:54, 14.40s/it]
 66%|██████▋   | 25203/37963 [108:01:07<50:38:49, 14.29s/it]
 66%|██████▋   | 25204/37963 [108:01:21<50:22:16, 14.21s/it]
 66%|██████▋   | 25205/37963 [108:01:36<50:26:16, 14.23s/it]
 66%|██████▋   | 25206/37963 [108:01:50<50:04:19, 14.13s/it]
 66%|██████▋   | 25207/37963 [108:02:04<50:19:55, 14.20s/it]
 66%|██████▋   | 25208/37963 [108:02:18<50:19:20, 14.20s/it]
 66%|██████▋   | 25209/37963 [108:02:39<57:47:23, 16.31s/it]
 66%|██████▋   | 25210/37963 [108:02:54<55:32:05, 15.68s/it]
                                                            
{'loss': '0.1095', 'grad_norm': '2.579', 'learning_rate': '5.358e-06', 'epoch': '0.6641'}

 66%|██████▋   | 25210/37963 [108:02:54<55:32:05, 15.68s/it]
 66%|██████▋   | 25211/37963 [108:03:08<54:09:19, 15.29s/it]
 66%|██████▋   | 25212/37963 [108:03:23<53:19:17, 15.05s/it]
 66%|██████▋   | 25213/37963 [108:03:37<52:35:25, 14.85s/it]
 66%|██████▋   | 25214/37963 [108:03:51<52:06:54, 14.72s/it]
 66%|██████▋   | 25215/37963 [108:04:06<51:46:49, 14.62s/it]
 66%|██████▋   | 25216/37963 [108:04:20<51:31:35, 14.55s/it]
 66%|██████▋   | 25217/37963 [108:04:34<51:09:40, 14.45s/it]
 66%|██████▋   | 25218/37963 [108:04:49<51:01:54, 14.41s/it]
 66%|██████▋   | 25219/37963 [108:05:10<57:59:44, 16.38s/it]
 66%|██████▋   | 25220/37963 [108:05:24<55:53:53, 15.79s/it]
                                                            
{'loss': '0.1145', 'grad_norm': '2.335', 'learning_rate': '5.351e-06', 'epoch': '0.6643'}

 66%|██████▋   | 25220/37963 [108:05:24<55:53:53, 15.79s/it]
 66%|██████▋   | 25221/37963 [108:05:45<61:21:57, 17.34s/it]
 66%|██████▋   | 25222/37963 [108:05:59<58:13:34, 16.45s/it]
 66%|██████▋   | 25223/37963 [108:06:14<55:59:49, 15.82s/it]
 66%|██████▋   | 25224/37963 [108:06:42<68:43:02, 19.42s/it]
 66%|██████▋   | 25225/37963 [108:06:56<63:20:16, 17.90s/it]
 66%|██████▋   | 25226/37963 [108:07:10<59:45:01, 16.89s/it]
 66%|██████▋   | 25227/37963 [108:07:25<57:04:38, 16.13s/it]
 66%|██████▋   | 25228/37963 [108:07:39<55:11:47, 15.60s/it]
 66%|██████▋   | 25229/37963 [108:07:53<53:51:15, 15.22s/it]
 66%|██████▋   | 25230/37963 [108:08:08<52:52:51, 14.95s/it]
                                                            
{'loss': '0.1263', 'grad_norm': '2.723', 'learning_rate': '5.343e-06', 'epoch': '0.6646'}

 66%|██████▋   | 25230/37963 [108:08:08<52:52:51, 14.95s/it]
 66%|██████▋   | 25231/37963 [108:08:28<58:45:57, 16.62s/it]
 66%|██████▋   | 25232/37963 [108:08:42<56:07:37, 15.87s/it]
 66%|██████▋   | 25233/37963 [108:08:57<54:29:19, 15.41s/it]
 66%|██████▋   | 25234/37963 [108:09:11<53:24:42, 15.11s/it]
 66%|██████▋   | 25235/37963 [108:09:25<52:15:01, 14.78s/it]
 66%|██████▋   | 25236/37963 [108:09:40<51:52:25, 14.67s/it]
 66%|██████▋   | 25237/37963 [108:10:01<59:08:53, 16.73s/it]
 66%|██████▋   | 25238/37963 [108:10:15<56:36:17, 16.01s/it]
 66%|██████▋   | 25239/37963 [108:10:30<54:44:26, 15.49s/it]
 66%|██████▋   | 25240/37963 [108:10:50<59:44:37, 16.90s/it]
                                                            
{'loss': '0.1137', 'grad_norm': '1.634', 'learning_rate': '5.336e-06', 'epoch': '0.6649'}

 66%|██████▋   | 25240/37963 [108:10:50<59:44:37, 16.90s/it]
 66%|██████▋   | 25241/37963 [108:11:04<57:06:39, 16.16s/it]
 66%|██████▋   | 25242/37963 [108:11:19<55:05:09, 15.59s/it]
 66%|██████▋   | 25243/37963 [108:11:33<53:44:44, 15.21s/it]
 66%|██████▋   | 25244/37963 [108:11:47<52:48:14, 14.95s/it]
 66%|██████▋   | 25245/37963 [108:12:02<52:15:27, 14.79s/it]
 67%|██████▋   | 25246/37963 [108:12:16<51:51:08, 14.68s/it]
 67%|██████▋   | 25247/37963 [108:12:31<51:33:14, 14.60s/it]
 67%|██████▋   | 25248/37963 [108:12:45<51:08:08, 14.48s/it]
 67%|██████▋   | 25249/37963 [108:12:59<51:02:37, 14.45s/it]
 67%|██████▋   | 25250/37963 [108:13:14<51:06:15, 14.47s/it]
                                                            
{'loss': '0.1112', 'grad_norm': '3.892', 'learning_rate': '5.328e-06', 'epoch': '0.6651'}

 67%|██████▋   | 25250/37963 [108:13:14<51:06:15, 14.47s/it]
 67%|██████▋   | 25251/37963 [108:13:28<51:02:23, 14.45s/it]
 67%|██████▋   | 25252/37963 [108:13:42<50:53:33, 14.41s/it]
 67%|██████▋   | 25253/37963 [108:13:57<50:55:54, 14.43s/it]
 67%|██████▋   | 25254/37963 [108:14:11<50:51:39, 14.41s/it]
 67%|██████▋   | 25255/37963 [108:14:26<50:51:33, 14.41s/it]
 67%|██████▋   | 25256/37963 [108:14:40<50:55:58, 14.43s/it]
 67%|██████▋   | 25257/37963 [108:15:01<57:34:48, 16.31s/it]
 67%|██████▋   | 25258/37963 [108:15:15<55:12:47, 15.64s/it]
 67%|██████▋   | 25259/37963 [108:15:29<53:51:38, 15.26s/it]
 67%|██████▋   | 25260/37963 [108:15:44<52:54:58, 15.00s/it]
                                                            
{'loss': '0.1187', 'grad_norm': '3.674', 'learning_rate': '5.32e-06', 'epoch': '0.6654'}

 67%|██████▋   | 25260/37963 [108:15:44<52:54:58, 15.00s/it]
 67%|██████▋   | 25261/37963 [108:15:58<52:11:46, 14.79s/it]
 67%|██████▋   | 25262/37963 [108:16:12<51:40:11, 14.65s/it]
 67%|██████▋   | 25263/37963 [108:16:26<51:13:29, 14.52s/it]
 67%|██████▋   | 25264/37963 [108:16:41<51:07:31, 14.49s/it]
 67%|██████▋   | 25265/37963 [108:16:55<51:05:57, 14.49s/it]
 67%|██████▋   | 25266/37963 [108:17:10<51:05:32, 14.49s/it]
 67%|██████▋   | 25267/37963 [108:17:24<51:01:49, 14.47s/it]
 67%|██████▋   | 25268/37963 [108:17:46<58:14:20, 16.52s/it]
 67%|██████▋   | 25269/37963 [108:18:06<62:00:35, 17.59s/it]
 67%|██████▋   | 25270/37963 [108:18:20<58:41:58, 16.65s/it]
                                                            
{'loss': '0.1164', 'grad_norm': '2.549', 'learning_rate': '5.313e-06', 'epoch': '0.6657'}

 67%|██████▋   | 25270/37963 [108:18:20<58:41:58, 16.65s/it]
 67%|██████▋   | 25271/37963 [108:18:34<56:16:32, 15.96s/it]
 67%|██████▋   | 25272/37963 [108:18:55<61:29:06, 17.44s/it]
 67%|██████▋   | 25273/37963 [108:19:09<57:56:43, 16.44s/it]
 67%|██████▋   | 25274/37963 [108:19:30<62:03:06, 17.60s/it]
 67%|██████▋   | 25275/37963 [108:19:44<58:27:07, 16.58s/it]
 67%|██████▋   | 25276/37963 [108:19:58<56:07:31, 15.93s/it]
 67%|██████▋   | 25277/37963 [108:20:13<54:33:00, 15.48s/it]
 67%|██████▋   | 25278/37963 [108:20:27<53:21:56, 15.15s/it]
 67%|██████▋   | 25279/37963 [108:20:48<59:26:26, 16.87s/it]
 67%|██████▋   | 25280/37963 [108:21:02<56:35:25, 16.06s/it]
                                                            
{'loss': '0.1114', 'grad_norm': '1.853', 'learning_rate': '5.305e-06', 'epoch': '0.6659'}

 67%|██████▋   | 25280/37963 [108:21:02<56:35:25, 16.06s/it]
 67%|██████▋   | 25281/37963 [108:21:17<54:45:25, 15.54s/it]
 67%|██████▋   | 25282/37963 [108:21:31<53:30:58, 15.19s/it]
 67%|██████▋   | 25283/37963 [108:21:45<52:40:22, 14.95s/it]
 67%|██████▋   | 25284/37963 [108:22:00<52:13:38, 14.83s/it]
 67%|██████▋   | 25285/37963 [108:22:14<51:20:56, 14.58s/it]
 67%|██████▋   | 25286/37963 [108:22:35<58:18:21, 16.56s/it]
 67%|██████▋   | 25287/37963 [108:22:56<63:00:52, 17.90s/it]
 67%|██████▋   | 25288/37963 [108:23:10<59:17:18, 16.84s/it]
 67%|██████▋   | 25289/37963 [108:23:25<56:36:23, 16.08s/it]
 67%|██████▋   | 25290/37963 [108:23:39<54:48:36, 15.57s/it]
                                                            
{'loss': '0.1224', 'grad_norm': '2.282', 'learning_rate': '5.298e-06', 'epoch': '0.6662'}

 67%|██████▋   | 25290/37963 [108:23:39<54:48:36, 15.57s/it]
 67%|██████▋   | 25291/37963 [108:23:53<52:31:24, 14.92s/it]
 67%|██████▋   | 25292/37963 [108:24:07<51:59:46, 14.77s/it]
 67%|██████▋   | 25293/37963 [108:24:21<51:13:29, 14.55s/it]
 67%|██████▋   | 25294/37963 [108:24:35<51:01:55, 14.50s/it]
 67%|██████▋   | 25295/37963 [108:24:49<50:33:49, 14.37s/it]
 67%|██████▋   | 25296/37963 [108:25:04<50:35:13, 14.38s/it]
 67%|██████▋   | 25297/37963 [108:25:18<50:35:29, 14.38s/it]
 67%|██████▋   | 25298/37963 [108:25:33<50:36:02, 14.38s/it]
 67%|██████▋   | 25299/37963 [108:25:47<50:37:10, 14.39s/it]
 67%|██████▋   | 25300/37963 [108:26:01<50:39:38, 14.40s/it]
                                                            
{'loss': '0.1115', 'grad_norm': '2.286', 'learning_rate': '5.29e-06', 'epoch': '0.6664'}

 67%|██████▋   | 25300/37963 [108:26:01<50:39:38, 14.40s/it]
 67%|██████▋   | 25301/37963 [108:26:16<50:36:23, 14.39s/it]
 67%|██████▋   | 25302/37963 [108:26:30<50:24:42, 14.33s/it]
 67%|██████▋   | 25303/37963 [108:26:45<50:38:05, 14.40s/it]
 67%|██████▋   | 25304/37963 [108:26:59<50:39:34, 14.41s/it]
 67%|██████▋   | 25305/37963 [108:27:13<49:57:20, 14.21s/it]
 67%|██████▋   | 25306/37963 [108:27:27<50:07:42, 14.26s/it]
 67%|██████▋   | 25307/37963 [108:27:42<50:18:36, 14.31s/it]
 67%|██████▋   | 25308/37963 [108:28:02<56:39:29, 16.12s/it]
 67%|██████▋   | 25309/37963 [108:28:16<54:52:29, 15.61s/it]
 67%|██████▋   | 25310/37963 [108:28:31<53:20:28, 15.18s/it]
                                                            
{'loss': '0.1161', 'grad_norm': '2.515', 'learning_rate': '5.283e-06', 'epoch': '0.6667'}

 67%|██████▋   | 25310/37963 [108:28:31<53:20:28, 15.18s/it]
 67%|██████▋   | 25311/37963 [108:28:45<52:16:25, 14.87s/it]
 67%|██████▋   | 25312/37963 [108:28:59<51:38:29, 14.70s/it]
 67%|██████▋   | 25313/37963 [108:29:13<50:52:59, 14.48s/it]
 67%|██████▋   | 25314/37963 [108:29:27<50:13:23, 14.29s/it]
 67%|██████▋   | 25315/37963 [108:29:41<50:01:09, 14.24s/it]
 67%|██████▋   | 25316/37963 [108:30:02<57:45:17, 16.44s/it]
 67%|██████▋   | 25317/37963 [108:30:16<55:02:49, 15.67s/it]
 67%|██████▋   | 25318/37963 [108:30:37<60:37:57, 17.26s/it]
 67%|██████▋   | 25319/37963 [108:30:52<57:23:24, 16.34s/it]
 67%|██████▋   | 25320/37963 [108:31:06<55:19:11, 15.75s/it]
                                                            
{'loss': '0.1045', 'grad_norm': '2.015', 'learning_rate': '5.275e-06', 'epoch': '0.667'}

 67%|██████▋   | 25320/37963 [108:31:06<55:19:11, 15.75s/it]
 67%|██████▋   | 25321/37963 [108:31:27<61:00:59, 17.38s/it]
 67%|██████▋   | 25322/37963 [108:31:41<57:15:53, 16.31s/it]
 67%|██████▋   | 25323/37963 [108:31:55<55:13:11, 15.73s/it]
 67%|██████▋   | 25324/37963 [108:32:10<53:42:45, 15.30s/it]
 67%|██████▋   | 25325/37963 [108:32:30<59:38:18, 16.99s/it]
 67%|██████▋   | 25326/37963 [108:32:45<56:55:23, 16.22s/it]
 67%|██████▋   | 25327/37963 [108:32:59<54:52:08, 15.63s/it]
 67%|██████▋   | 25328/37963 [108:33:14<53:34:24, 15.26s/it]
 67%|██████▋   | 25329/37963 [108:33:35<59:35:42, 16.98s/it]
 67%|██████▋   | 25330/37963 [108:33:49<56:44:34, 16.17s/it]
                                                            
{'loss': '0.1097', 'grad_norm': '2.349', 'learning_rate': '5.268e-06', 'epoch': '0.6672'}

 67%|██████▋   | 25330/37963 [108:33:49<56:44:34, 16.17s/it]
 67%|██████▋   | 25331/37963 [108:34:03<54:44:26, 15.60s/it]
 67%|██████▋   | 25332/37963 [108:34:17<53:10:48, 15.16s/it]
 67%|██████▋   | 25333/37963 [108:34:31<52:00:03, 14.82s/it]
 67%|██████▋   | 25334/37963 [108:34:46<51:35:20, 14.71s/it]
 67%|██████▋   | 25335/37963 [108:35:06<57:54:58, 16.51s/it]
 67%|██████▋   | 25336/37963 [108:35:21<55:53:49, 15.94s/it]
 67%|██████▋   | 25337/37963 [108:35:35<54:13:08, 15.46s/it]
 67%|██████▋   | 25338/37963 [108:35:57<60:18:41, 17.20s/it]
 67%|██████▋   | 25339/37963 [108:36:11<57:26:34, 16.38s/it]
 67%|██████▋   | 25340/37963 [108:36:25<54:54:26, 15.66s/it]
                                                            
{'loss': '0.1256', 'grad_norm': '1.601', 'learning_rate': '5.26e-06', 'epoch': '0.6675'}

 67%|██████▋   | 25340/37963 [108:36:25<54:54:26, 15.66s/it]
 67%|██████▋   | 25341/37963 [108:36:39<53:32:50, 15.27s/it]
 67%|██████▋   | 25342/37963 [108:36:54<52:38:58, 15.02s/it]
 67%|██████▋   | 25343/37963 [108:37:08<52:02:38, 14.85s/it]
 67%|██████▋   | 25344/37963 [108:37:23<51:34:55, 14.72s/it]
 67%|██████▋   | 25345/37963 [108:37:37<51:12:17, 14.61s/it]
 67%|██████▋   | 25346/37963 [108:37:51<50:45:07, 14.48s/it]
 67%|██████▋   | 25347/37963 [108:38:06<50:43:48, 14.48s/it]
 67%|██████▋   | 25348/37963 [108:38:19<49:53:25, 14.24s/it]
 67%|██████▋   | 25349/37963 [108:38:34<50:10:03, 14.32s/it]
 67%|██████▋   | 25350/37963 [108:38:48<50:16:29, 14.35s/it]
                                                            
{'loss': '0.1092', 'grad_norm': '2.262', 'learning_rate': '5.253e-06', 'epoch': '0.6678'}

 67%|██████▋   | 25350/37963 [108:38:48<50:16:29, 14.35s/it]
 67%|██████▋   | 25351/37963 [108:39:03<50:26:28, 14.40s/it]
 67%|██████▋   | 25352/37963 [108:39:17<50:14:19, 14.34s/it]
 67%|██████▋   | 25353/37963 [108:39:31<49:52:02, 14.24s/it]
 67%|██████▋   | 25354/37963 [108:39:45<50:02:39, 14.29s/it]
 67%|██████▋   | 25355/37963 [108:40:00<50:09:35, 14.32s/it]
 67%|██████▋   | 25356/37963 [108:40:14<50:18:22, 14.37s/it]
 67%|██████▋   | 25357/37963 [108:40:36<57:55:44, 16.54s/it]
 67%|██████▋   | 25358/37963 [108:40:50<55:37:28, 15.89s/it]
 67%|██████▋   | 25359/37963 [108:41:05<54:05:28, 15.45s/it]
 67%|██████▋   | 25360/37963 [108:41:19<52:50:59, 15.10s/it]
                                                            
{'loss': '0.1069', 'grad_norm': '1.478', 'learning_rate': '5.245e-06', 'epoch': '0.668'}

 67%|██████▋   | 25360/37963 [108:41:19<52:50:59, 15.10s/it]
 67%|██████▋   | 25361/37963 [108:41:33<52:00:52, 14.86s/it]
 67%|██████▋   | 25362/37963 [108:41:48<51:27:12, 14.70s/it]
 67%|██████▋   | 25363/37963 [108:42:01<50:31:11, 14.43s/it]
 67%|██████▋   | 25364/37963 [108:42:16<50:24:19, 14.40s/it]
 67%|██████▋   | 25365/37963 [108:42:43<64:00:39, 18.29s/it]
 67%|██████▋   | 25366/37963 [108:42:58<59:59:05, 17.14s/it]
 67%|██████▋   | 25367/37963 [108:43:12<57:06:59, 16.32s/it]
 67%|██████▋   | 25368/37963 [108:43:33<62:01:41, 17.73s/it]
 67%|██████▋   | 25369/37963 [108:43:48<58:38:05, 16.76s/it]
 67%|██████▋   | 25370/37963 [108:44:01<55:33:02, 15.88s/it]
                                                            
{'loss': '0.1168', 'grad_norm': '3.481', 'learning_rate': '5.238e-06', 'epoch': '0.6683'}

 67%|██████▋   | 25370/37963 [108:44:01<55:33:02, 15.88s/it]
 67%|██████▋   | 25371/37963 [108:44:16<53:58:33, 15.43s/it]
 67%|██████▋   | 25372/37963 [108:44:30<52:56:24, 15.14s/it]
 67%|██████▋   | 25373/37963 [108:44:45<52:14:36, 14.94s/it]
 67%|██████▋   | 25374/37963 [108:44:59<51:39:22, 14.77s/it]
 67%|██████▋   | 25375/37963 [108:45:20<57:37:58, 16.48s/it]
 67%|██████▋   | 25376/37963 [108:45:34<55:24:31, 15.85s/it]
 67%|██████▋   | 25377/37963 [108:45:55<60:30:09, 17.31s/it]
 67%|██████▋   | 25378/37963 [108:46:09<57:21:49, 16.41s/it]
 67%|██████▋   | 25379/37963 [108:46:23<55:19:12, 15.83s/it]
 67%|██████▋   | 25380/37963 [108:46:37<53:11:11, 15.22s/it]
                                                            
{'loss': '0.126', 'grad_norm': '1.572', 'learning_rate': '5.23e-06', 'epoch': '0.6685'}

 67%|██████▋   | 25380/37963 [108:46:37<53:11:11, 15.22s/it]
 67%|██████▋   | 25381/37963 [108:46:52<52:33:07, 15.04s/it]
 67%|██████▋   | 25382/37963 [108:47:06<51:13:08, 14.66s/it]
 67%|██████▋   | 25383/37963 [108:47:27<57:58:54, 16.59s/it]
 67%|██████▋   | 25384/37963 [108:47:41<55:44:46, 15.95s/it]
 67%|██████▋   | 25385/37963 [108:47:56<54:06:21, 15.49s/it]
 67%|██████▋   | 25386/37963 [108:48:10<52:35:55, 15.06s/it]
 67%|██████▋   | 25387/37963 [108:48:30<57:52:37, 16.57s/it]
 67%|██████▋   | 25388/37963 [108:48:44<55:35:44, 15.92s/it]
 67%|██████▋   | 25389/37963 [108:48:59<54:03:53, 15.48s/it]
 67%|██████▋   | 25390/37963 [108:49:13<52:56:51, 15.16s/it]
                                                            
{'loss': '0.1123', 'grad_norm': '1.538', 'learning_rate': '5.223e-06', 'epoch': '0.6688'}

 67%|██████▋   | 25390/37963 [108:49:13<52:56:51, 15.16s/it]
 67%|██████▋   | 25391/37963 [108:49:27<52:07:50, 14.93s/it]
 67%|██████▋   | 25392/37963 [108:49:42<51:35:16, 14.77s/it]
 67%|██████▋   | 25393/37963 [108:49:56<51:05:01, 14.63s/it]
 67%|██████▋   | 25394/37963 [108:50:10<50:44:54, 14.54s/it]
 67%|██████▋   | 25395/37963 [108:50:25<50:26:46, 14.45s/it]
 67%|██████▋   | 25396/37963 [108:50:39<50:17:45, 14.41s/it]
 67%|██████▋   | 25397/37963 [108:50:53<50:16:56, 14.41s/it]
 67%|██████▋   | 25398/37963 [108:51:08<50:14:16, 14.39s/it]
 67%|██████▋   | 25399/37963 [108:51:22<50:14:42, 14.40s/it]
 67%|██████▋   | 25400/37963 [108:51:36<49:57:59, 14.32s/it]
                                                            
{'loss': '0.1106', 'grad_norm': '3.52', 'learning_rate': '5.215e-06', 'epoch': '0.6691'}

 67%|██████▋   | 25400/37963 [108:51:36<49:57:59, 14.32s/it]
 67%|██████▋   | 25401/37963 [108:51:51<50:00:25, 14.33s/it]
 67%|██████▋   | 25402/37963 [108:52:05<49:57:59, 14.32s/it]
 67%|██████▋   | 25403/37963 [108:52:19<49:51:09, 14.29s/it]
 67%|██████▋   | 25404/37963 [108:52:34<50:00:14, 14.33s/it]
 67%|██████▋   | 25405/37963 [108:52:48<50:05:01, 14.36s/it]
 67%|██████▋   | 25406/37963 [108:53:09<56:47:38, 16.28s/it]
 67%|██████▋   | 25407/37963 [108:53:23<54:51:08, 15.73s/it]
 67%|██████▋   | 25408/37963 [108:53:37<52:54:54, 15.17s/it]
 67%|██████▋   | 25409/37963 [108:53:51<52:02:59, 14.93s/it]
 67%|██████▋   | 25410/37963 [108:54:06<51:27:35, 14.76s/it]
                                                            
{'loss': '0.1111', 'grad_norm': '1.404', 'learning_rate': '5.208e-06', 'epoch': '0.6693'}

 67%|██████▋   | 25410/37963 [108:54:06<51:27:35, 14.76s/it]
 67%|██████▋   | 25411/37963 [108:54:20<51:04:51, 14.65s/it]
 67%|██████▋   | 25412/37963 [108:54:35<50:52:18, 14.59s/it]
 67%|██████▋   | 25413/37963 [108:54:55<57:23:59, 16.47s/it]
 67%|██████▋   | 25414/37963 [108:55:10<55:12:03, 15.84s/it]
 67%|██████▋   | 25415/37963 [108:55:24<53:41:59, 15.41s/it]
 67%|██████▋   | 25416/37963 [108:55:39<52:42:28, 15.12s/it]
 67%|██████▋   | 25417/37963 [108:56:00<58:58:06, 16.92s/it]
 67%|██████▋   | 25418/37963 [108:56:14<56:17:38, 16.15s/it]
 67%|██████▋   | 25419/37963 [108:56:29<54:28:39, 15.63s/it]
 67%|██████▋   | 25420/37963 [108:56:43<53:05:47, 15.24s/it]
                                                            
{'loss': '0.1138', 'grad_norm': '2.624', 'learning_rate': '5.2e-06', 'epoch': '0.6696'}

 67%|██████▋   | 25420/37963 [108:56:43<53:05:47, 15.24s/it]
 67%|██████▋   | 25421/37963 [108:56:57<52:00:02, 14.93s/it]
 67%|██████▋   | 25422/37963 [108:57:11<50:55:26, 14.62s/it]
 67%|██████▋   | 25423/37963 [108:57:32<57:35:50, 16.54s/it]
 67%|██████▋   | 25424/37963 [108:57:46<55:16:42, 15.87s/it]
 67%|██████▋   | 25425/37963 [108:58:01<53:44:34, 15.43s/it]
 67%|██████▋   | 25426/37963 [108:58:22<59:36:54, 17.12s/it]
 67%|██████▋   | 25427/37963 [108:58:36<56:32:08, 16.24s/it]
 67%|██████▋   | 25428/37963 [108:58:50<54:14:50, 15.58s/it]
 67%|██████▋   | 25429/37963 [108:59:04<53:04:36, 15.24s/it]
 67%|██████▋   | 25430/37963 [108:59:19<52:13:42, 15.00s/it]
                                                            
{'loss': '0.1203', 'grad_norm': '1.73', 'learning_rate': '5.193e-06', 'epoch': '0.6699'}

 67%|██████▋   | 25430/37963 [108:59:19<52:13:42, 15.00s/it]
 67%|██████▋   | 25431/37963 [108:59:40<58:32:30, 16.82s/it]
 67%|██████▋   | 25432/37963 [108:59:54<56:04:37, 16.11s/it]
 67%|██████▋   | 25433/37963 [109:00:09<54:20:51, 15.61s/it]
 67%|██████▋   | 25434/37963 [109:00:22<51:54:15, 14.91s/it]
 67%|██████▋   | 25435/37963 [109:00:37<51:24:02, 14.77s/it]
 67%|██████▋   | 25436/37963 [109:00:57<57:46:36, 16.60s/it]
 67%|██████▋   | 25437/37963 [109:01:12<55:14:01, 15.87s/it]
 67%|██████▋   | 25438/37963 [109:01:26<53:21:53, 15.34s/it]
 67%|██████▋   | 25439/37963 [109:01:40<52:16:54, 15.03s/it]
 67%|██████▋   | 25440/37963 [109:01:54<51:36:45, 14.84s/it]
                                                            
{'loss': '0.1138', 'grad_norm': '1.966', 'learning_rate': '5.185e-06', 'epoch': '0.6701'}

 67%|██████▋   | 25440/37963 [109:01:54<51:36:45, 14.84s/it]
 67%|██████▋   | 25441/37963 [109:02:09<51:09:04, 14.71s/it]
 67%|██████▋   | 25442/37963 [109:02:23<50:52:14, 14.63s/it]
 67%|██████▋   | 25443/37963 [109:02:38<50:32:28, 14.53s/it]
 67%|██████▋   | 25444/37963 [109:02:52<50:14:16, 14.45s/it]
 67%|██████▋   | 25445/37963 [109:03:06<49:49:17, 14.33s/it]
 67%|██████▋   | 25446/37963 [109:03:20<49:54:10, 14.35s/it]
 67%|██████▋   | 25447/37963 [109:03:35<49:52:31, 14.35s/it]
 67%|██████▋   | 25448/37963 [109:03:49<49:53:53, 14.35s/it]
 67%|██████▋   | 25449/37963 [109:04:03<49:54:58, 14.36s/it]
 67%|██████▋   | 25450/37963 [109:04:18<49:55:51, 14.37s/it]
                                                            
{'loss': '0.1183', 'grad_norm': '1.83', 'learning_rate': '5.178e-06', 'epoch': '0.6704'}

 67%|██████▋   | 25450/37963 [109:04:18<49:55:51, 14.37s/it]
 67%|██████▋   | 25451/37963 [109:04:32<49:55:03, 14.36s/it]
 67%|██████▋   | 25452/37963 [109:04:46<49:53:16, 14.36s/it]
 67%|██████▋   | 25453/37963 [109:05:01<49:40:37, 14.30s/it]
 67%|██████▋   | 25454/37963 [109:05:15<49:21:37, 14.21s/it]
 67%|██████▋   | 25455/37963 [109:05:35<55:30:33, 15.98s/it]
 67%|██████▋   | 25456/37963 [109:05:49<53:51:25, 15.50s/it]
 67%|██████▋   | 25457/37963 [109:06:03<52:40:12, 15.16s/it]
 67%|██████▋   | 25458/37963 [109:06:18<51:39:02, 14.87s/it]
 67%|██████▋   | 25459/37963 [109:06:32<50:45:01, 14.61s/it]
 67%|██████▋   | 25460/37963 [109:06:46<50:32:43, 14.55s/it]
                                                            
{'loss': '0.1038', 'grad_norm': '1.982', 'learning_rate': '5.17e-06', 'epoch': '0.6707'}

 67%|██████▋   | 25460/37963 [109:06:46<50:32:43, 14.55s/it]
 67%|██████▋   | 25461/37963 [109:07:01<50:25:58, 14.52s/it]
 67%|██████▋   | 25462/37963 [109:07:22<57:15:52, 16.49s/it]
 67%|██████▋   | 25463/37963 [109:07:42<61:44:00, 17.78s/it]
 67%|██████▋   | 25464/37963 [109:08:04<65:21:35, 18.83s/it]
 67%|██████▋   | 25465/37963 [109:08:18<60:41:07, 17.48s/it]
 67%|██████▋   | 25466/37963 [109:08:32<56:54:37, 16.39s/it]
 67%|██████▋   | 25467/37963 [109:08:46<54:28:15, 15.69s/it]
 67%|██████▋   | 25468/37963 [109:09:00<53:07:04, 15.30s/it]
 67%|██████▋   | 25469/37963 [109:09:14<51:56:35, 14.97s/it]
 67%|██████▋   | 25470/37963 [109:09:29<51:07:33, 14.73s/it]
                                                            
{'loss': '0.111', 'grad_norm': '2.473', 'learning_rate': '5.163e-06', 'epoch': '0.6709'}

 67%|██████▋   | 25470/37963 [109:09:29<51:07:33, 14.73s/it]
 67%|██████▋   | 25471/37963 [109:09:43<50:47:26, 14.64s/it]
 67%|██████▋   | 25472/37963 [109:09:57<50:11:59, 14.47s/it]
 67%|██████▋   | 25473/37963 [109:10:18<56:44:47, 16.36s/it]
 67%|██████▋   | 25474/37963 [109:10:32<54:39:59, 15.76s/it]
 67%|██████▋   | 25475/37963 [109:10:53<59:57:53, 17.29s/it]
 67%|██████▋   | 25476/37963 [109:11:07<56:53:47, 16.40s/it]
 67%|██████▋   | 25477/37963 [109:11:22<54:55:14, 15.83s/it]
 67%|██████▋   | 25478/37963 [109:11:36<53:29:38, 15.42s/it]
 67%|██████▋   | 25479/37963 [109:11:58<59:22:21, 17.12s/it]
 67%|██████▋   | 25480/37963 [109:12:12<56:22:48, 16.26s/it]
                                                            
{'loss': '0.1227', 'grad_norm': '2.283', 'learning_rate': '5.155e-06', 'epoch': '0.6712'}

 67%|██████▋   | 25480/37963 [109:12:12<56:22:48, 16.26s/it]
 67%|██████▋   | 25481/37963 [109:12:26<54:22:45, 15.68s/it]
 67%|██████▋   | 25482/37963 [109:12:41<53:01:22, 15.29s/it]
 67%|██████▋   | 25483/37963 [109:13:01<58:31:58, 16.88s/it]
 67%|██████▋   | 25484/37963 [109:13:15<55:54:07, 16.13s/it]
 67%|██████▋   | 25485/37963 [109:13:30<53:52:00, 15.54s/it]
 67%|██████▋   | 25486/37963 [109:13:44<52:41:21, 15.20s/it]
 67%|██████▋   | 25487/37963 [109:13:58<51:50:44, 14.96s/it]
 67%|██████▋   | 25488/37963 [109:14:13<51:12:03, 14.78s/it]
 67%|██████▋   | 25489/37963 [109:14:27<50:54:33, 14.69s/it]
 67%|██████▋   | 25490/37963 [109:14:42<50:37:20, 14.61s/it]
                                                            
{'loss': '0.1149', 'grad_norm': '1.454', 'learning_rate': '5.148e-06', 'epoch': '0.6714'}

 67%|██████▋   | 25490/37963 [109:14:42<50:37:20, 14.61s/it]
 67%|██████▋   | 25491/37963 [109:14:56<50:26:32, 14.56s/it]
 67%|██████▋   | 25492/37963 [109:15:11<50:26:38, 14.56s/it]
 67%|██████▋   | 25493/37963 [109:15:25<50:01:47, 14.44s/it]
 67%|██████▋   | 25494/37963 [109:15:39<49:48:16, 14.38s/it]
 67%|██████▋   | 25495/37963 [109:15:53<49:44:59, 14.36s/it]
 67%|██████▋   | 25496/37963 [109:16:08<49:32:47, 14.31s/it]
 67%|██████▋   | 25497/37963 [109:16:22<49:34:34, 14.32s/it]
 67%|██████▋   | 25498/37963 [109:16:36<49:36:36, 14.33s/it]
 67%|██████▋   | 25499/37963 [109:16:51<49:48:59, 14.39s/it]
 67%|██████▋   | 25500/37963 [109:17:05<49:43:46, 14.36s/it]
                                                            
{'loss': '0.1274', 'grad_norm': '2.116', 'learning_rate': '5.141e-06', 'epoch': '0.6717'}

 67%|██████▋   | 25500/37963 [109:17:05<49:43:46, 14.36s/it]
 67%|██████▋   | 25501/37963 [109:17:20<49:49:34, 14.39s/it]
 67%|██████▋   | 25502/37963 [109:17:33<49:10:13, 14.21s/it]
 67%|██████▋   | 25503/37963 [109:17:48<49:20:56, 14.26s/it]
 67%|██████▋   | 25504/37963 [109:18:02<49:24:45, 14.28s/it]
 67%|██████▋   | 25505/37963 [109:18:23<56:07:48, 16.22s/it]
 67%|██████▋   | 25506/37963 [109:18:37<54:02:31, 15.62s/it]
 67%|██████▋   | 25507/37963 [109:18:51<52:42:17, 15.23s/it]
 67%|██████▋   | 25508/37963 [109:19:06<51:50:32, 14.98s/it]
 67%|██████▋   | 25509/37963 [109:19:20<51:26:53, 14.87s/it]
 67%|██████▋   | 25510/37963 [109:19:42<58:11:12, 16.82s/it]
                                                            
{'loss': '0.1143', 'grad_norm': '1.786', 'learning_rate': '5.133e-06', 'epoch': '0.672'}

 67%|██████▋   | 25510/37963 [109:19:42<58:11:12, 16.82s/it]
 67%|██████▋   | 25511/37963 [109:20:09<68:53:19, 19.92s/it]
 67%|██████▋   | 25512/37963 [109:20:23<62:31:40, 18.08s/it]
 67%|██████▋   | 25513/37963 [109:20:37<58:43:28, 16.98s/it]
 67%|██████▋   | 25514/37963 [109:20:52<56:01:36, 16.20s/it]
 67%|██████▋   | 25515/37963 [109:21:05<53:27:30, 15.46s/it]
 67%|██████▋   | 25516/37963 [109:21:20<52:17:32, 15.12s/it]
 67%|██████▋   | 25517/37963 [109:21:33<50:56:03, 14.73s/it]
 67%|██████▋   | 25518/37963 [109:21:48<50:32:23, 14.62s/it]
 67%|██████▋   | 25519/37963 [109:22:02<50:16:32, 14.54s/it]
 67%|██████▋   | 25520/37963 [109:22:16<49:58:09, 14.46s/it]
                                                            
{'loss': '0.1131', 'grad_norm': '2.212', 'learning_rate': '5.126e-06', 'epoch': '0.6722'}

 67%|██████▋   | 25520/37963 [109:22:16<49:58:09, 14.46s/it]
 67%|██████▋   | 25521/37963 [109:22:31<49:52:40, 14.43s/it]
 67%|██████▋   | 25522/37963 [109:22:45<49:47:09, 14.41s/it]
 67%|██████▋   | 25523/37963 [109:23:00<49:57:46, 14.46s/it]
 67%|██████▋   | 25524/37963 [109:23:14<49:52:55, 14.44s/it]
 67%|██████▋   | 25525/37963 [109:23:36<57:11:47, 16.55s/it]
 67%|██████▋   | 25526/37963 [109:23:50<55:08:56, 15.96s/it]
 67%|██████▋   | 25527/37963 [109:24:05<53:33:15, 15.50s/it]
 67%|██████▋   | 25528/37963 [109:24:26<59:18:27, 17.17s/it]
 67%|██████▋   | 25529/37963 [109:24:40<56:12:53, 16.28s/it]
 67%|██████▋   | 25530/37963 [109:24:54<53:58:19, 15.63s/it]
                                                            
{'loss': '0.1237', 'grad_norm': '4.844', 'learning_rate': '5.118e-06', 'epoch': '0.6725'}

 67%|██████▋   | 25530/37963 [109:24:54<53:58:19, 15.63s/it]
 67%|██████▋   | 25531/37963 [109:25:08<52:47:46, 15.29s/it]
 67%|██████▋   | 25532/37963 [109:25:29<58:34:18, 16.96s/it]
 67%|██████▋   | 25533/37963 [109:25:44<55:54:51, 16.19s/it]
 67%|██████▋   | 25534/37963 [109:25:58<53:50:53, 15.60s/it]
 67%|██████▋   | 25535/37963 [109:26:12<52:39:27, 15.25s/it]
 67%|██████▋   | 25536/37963 [109:26:27<51:48:33, 15.01s/it]
 67%|██████▋   | 25537/37963 [109:26:41<51:11:16, 14.83s/it]
 67%|██████▋   | 25538/37963 [109:26:56<50:47:36, 14.72s/it]
 67%|██████▋   | 25539/37963 [109:27:10<50:30:52, 14.64s/it]
 67%|██████▋   | 25540/37963 [109:27:25<50:19:11, 14.58s/it]
                                                            
{'loss': '0.1161', 'grad_norm': '2.319', 'learning_rate': '5.111e-06', 'epoch': '0.6728'}

 67%|██████▋   | 25540/37963 [109:27:25<50:19:11, 14.58s/it]
 67%|██████▋   | 25541/37963 [109:27:38<49:33:04, 14.36s/it]
 67%|██████▋   | 25542/37963 [109:27:53<49:35:18, 14.37s/it]
 67%|██████▋   | 25543/37963 [109:28:07<49:50:00, 14.44s/it]
 67%|██████▋   | 25544/37963 [109:28:22<49:44:35, 14.42s/it]
 67%|██████▋   | 25545/37963 [109:28:36<49:37:59, 14.39s/it]
 67%|██████▋   | 25546/37963 [109:28:50<49:26:40, 14.34s/it]
 67%|██████▋   | 25547/37963 [109:29:05<49:26:48, 14.34s/it]
 67%|██████▋   | 25548/37963 [109:29:19<49:00:01, 14.21s/it]
 67%|██████▋   | 25549/37963 [109:29:33<49:05:49, 14.24s/it]
 67%|██████▋   | 25550/37963 [109:29:46<48:21:10, 14.02s/it]
                                                            
{'loss': '0.1112', 'grad_norm': '2.706', 'learning_rate': '5.103e-06', 'epoch': '0.673'}

 67%|██████▋   | 25550/37963 [109:29:46<48:21:10, 14.02s/it]
 67%|██████▋   | 25551/37963 [109:30:00<48:16:19, 14.00s/it]
 67%|██████▋   | 25552/37963 [109:30:15<48:38:24, 14.11s/it]
 67%|██████▋   | 25553/37963 [109:30:29<48:41:09, 14.12s/it]
 67%|██████▋   | 25554/37963 [109:30:50<55:39:48, 16.15s/it]
 67%|██████▋   | 25555/37963 [109:31:04<54:00:54, 15.67s/it]
 67%|██████▋   | 25556/37963 [109:31:18<52:23:55, 15.20s/it]
 67%|██████▋   | 25557/37963 [109:31:33<51:41:58, 15.00s/it]
 67%|██████▋   | 25558/37963 [109:31:54<57:29:56, 16.69s/it]
 67%|██████▋   | 25559/37963 [109:32:21<68:57:19, 20.01s/it]
 67%|██████▋   | 25560/37963 [109:32:36<63:00:15, 18.29s/it]
                                                            
{'loss': '0.108', 'grad_norm': '4.729', 'learning_rate': '5.096e-06', 'epoch': '0.6733'}

 67%|██████▋   | 25560/37963 [109:32:36<63:00:15, 18.29s/it]
 67%|██████▋   | 25561/37963 [109:32:50<58:58:11, 17.12s/it]
 67%|██████▋   | 25562/37963 [109:33:04<56:05:44, 16.28s/it]
 67%|██████▋   | 25563/37963 [109:33:19<54:20:45, 15.78s/it]
 67%|██████▋   | 25564/37963 [109:33:33<52:56:23, 15.37s/it]
 67%|██████▋   | 25565/37963 [109:33:48<51:54:18, 15.07s/it]
 67%|██████▋   | 25566/37963 [109:34:02<51:00:10, 14.81s/it]
 67%|██████▋   | 25567/37963 [109:34:16<50:38:42, 14.71s/it]
 67%|██████▋   | 25568/37963 [109:34:31<50:13:47, 14.59s/it]
 67%|██████▋   | 25569/37963 [109:34:45<50:10:28, 14.57s/it]
 67%|██████▋   | 25570/37963 [109:34:59<49:37:12, 14.41s/it]
                                                            
{'loss': '0.1165', 'grad_norm': '1.784', 'learning_rate': '5.088e-06', 'epoch': '0.6736'}

 67%|██████▋   | 25570/37963 [109:34:59<49:37:12, 14.41s/it]
 67%|██████▋   | 25571/37963 [109:35:14<49:37:39, 14.42s/it]
 67%|██████▋   | 25572/37963 [109:35:28<49:08:46, 14.28s/it]
 67%|██████▋   | 25573/37963 [109:35:49<55:59:51, 16.27s/it]
 67%|██████▋   | 25574/37963 [109:36:09<60:38:41, 17.62s/it]
 67%|██████▋   | 25575/37963 [109:36:31<64:21:17, 18.70s/it]
 67%|██████▋   | 25576/37963 [109:36:45<59:53:35, 17.41s/it]
 67%|██████▋   | 25577/37963 [109:36:59<56:05:32, 16.30s/it]
 67%|██████▋   | 25578/37963 [109:37:13<53:38:11, 15.59s/it]
 67%|██████▋   | 25579/37963 [109:37:27<52:29:38, 15.26s/it]
 67%|██████▋   | 25580/37963 [109:37:42<51:47:49, 15.06s/it]
                                                            
{'loss': '0.1065', 'grad_norm': '1.852', 'learning_rate': '5.081e-06', 'epoch': '0.6738'}

 67%|██████▋   | 25580/37963 [109:37:42<51:47:49, 15.06s/it]
 67%|██████▋   | 25581/37963 [109:37:56<51:05:43, 14.86s/it]
 67%|██████▋   | 25582/37963 [109:38:17<57:16:59, 16.66s/it]
 67%|██████▋   | 25583/37963 [109:38:31<54:55:06, 15.97s/it]
 67%|██████▋   | 25584/37963 [109:38:46<53:16:04, 15.49s/it]
 67%|██████▋   | 25585/37963 [109:39:00<52:06:59, 15.16s/it]
 67%|██████▋   | 25586/37963 [109:39:14<51:09:19, 14.88s/it]
 67%|██████▋   | 25587/37963 [109:39:29<50:42:24, 14.75s/it]
 67%|██████▋   | 25588/37963 [109:39:43<50:27:38, 14.68s/it]
 67%|██████▋   | 25589/37963 [109:39:57<49:43:21, 14.47s/it]
 67%|██████▋   | 25590/37963 [109:40:12<49:43:42, 14.47s/it]
                                                            
{'loss': '0.1208', 'grad_norm': '5.926', 'learning_rate': '5.074e-06', 'epoch': '0.6741'}

 67%|██████▋   | 25590/37963 [109:40:12<49:43:42, 14.47s/it]
 67%|██████▋   | 25591/37963 [109:40:26<49:35:52, 14.43s/it]
 67%|██████▋   | 25592/37963 [109:40:40<49:29:39, 14.40s/it]
 67%|██████▋   | 25593/37963 [109:40:55<49:26:56, 14.39s/it]
 67%|██████▋   | 25594/37963 [109:41:09<49:26:19, 14.39s/it]
 67%|██████▋   | 25595/37963 [109:41:23<49:26:19, 14.39s/it]
 67%|██████▋   | 25596/37963 [109:41:37<48:51:57, 14.22s/it]
 67%|██████▋   | 25597/37963 [109:41:52<48:59:44, 14.26s/it]
 67%|██████▋   | 25598/37963 [109:42:06<49:10:24, 14.32s/it]
 67%|██████▋   | 25599/37963 [109:42:20<49:08:07, 14.31s/it]
 67%|██████▋   | 25600/37963 [109:42:41<55:12:00, 16.07s/it]
                                                            
{'loss': '0.1066', 'grad_norm': '1.691', 'learning_rate': '5.066e-06', 'epoch': '0.6743'}

 67%|██████▋   | 25600/37963 [109:42:41<55:12:00, 16.07s/it]
 67%|██████▋   | 25601/37963 [109:42:55<53:24:28, 15.55s/it]
 67%|██████▋   | 25602/37963 [109:43:09<51:54:04, 15.12s/it]
 67%|██████▋   | 25603/37963 [109:43:23<50:42:42, 14.77s/it]
 67%|██████▋   | 25604/37963 [109:43:37<50:19:24, 14.66s/it]
 67%|██████▋   | 25605/37963 [109:43:51<49:01:40, 14.28s/it]
 67%|██████▋   | 25606/37963 [109:44:05<49:02:37, 14.29s/it]
 67%|██████▋   | 25607/37963 [109:44:26<55:44:15, 16.24s/it]
 67%|██████▋   | 25608/37963 [109:44:47<60:39:06, 17.67s/it]
 67%|██████▋   | 25609/37963 [109:45:08<64:20:50, 18.75s/it]
 67%|██████▋   | 25610/37963 [109:45:23<59:54:32, 17.46s/it]
                                                            
{'loss': '0.1249', 'grad_norm': '3.545', 'learning_rate': '5.059e-06', 'epoch': '0.6746'}

 67%|██████▋   | 25610/37963 [109:45:23<59:54:32, 17.46s/it]
 67%|██████▋   | 25611/37963 [109:45:37<56:23:48, 16.44s/it]
 67%|██████▋   | 25612/37963 [109:45:51<54:17:34, 15.82s/it]
 67%|██████▋   | 25613/37963 [109:46:06<52:57:37, 15.44s/it]
 67%|██████▋   | 25614/37963 [109:46:20<51:42:22, 15.07s/it]
 67%|██████▋   | 25615/37963 [109:46:34<50:58:17, 14.86s/it]
 67%|██████▋   | 25616/37963 [109:46:49<50:27:39, 14.71s/it]
 67%|██████▋   | 25617/37963 [109:47:03<50:08:45, 14.62s/it]
 67%|██████▋   | 25618/37963 [109:47:17<49:28:12, 14.43s/it]
 67%|██████▋   | 25619/37963 [109:47:31<49:15:20, 14.36s/it]
 67%|██████▋   | 25620/37963 [109:47:46<49:17:45, 14.38s/it]
                                                            
{'loss': '0.1101', 'grad_norm': '2.292', 'learning_rate': '5.051e-06', 'epoch': '0.6749'}

 67%|██████▋   | 25620/37963 [109:47:46<49:17:45, 14.38s/it]
 67%|██████▋   | 25621/37963 [109:48:06<55:13:42, 16.11s/it]
 67%|██████▋   | 25622/37963 [109:48:20<53:27:44, 15.60s/it]
 67%|██████▋   | 25623/37963 [109:48:41<58:40:48, 17.12s/it]
 67%|██████▋   | 25624/37963 [109:49:02<62:51:51, 18.34s/it]
 67%|██████▋   | 25625/37963 [109:49:17<58:58:45, 17.21s/it]
 68%|██████▊   | 25626/37963 [109:49:31<55:54:50, 16.32s/it]
 68%|██████▊   | 25627/37963 [109:49:45<53:55:50, 15.74s/it]
 68%|██████▊   | 25628/37963 [109:50:00<52:35:05, 15.35s/it]
 68%|██████▊   | 25629/37963 [109:50:14<51:37:21, 15.07s/it]
 68%|██████▊   | 25630/37963 [109:50:28<50:44:53, 14.81s/it]
                                                            
{'loss': '0.1229', 'grad_norm': '1.709', 'learning_rate': '5.044e-06', 'epoch': '0.6751'}

 68%|██████▊   | 25630/37963 [109:50:28<50:44:53, 14.81s/it]
 68%|██████▊   | 25631/37963 [109:50:49<56:39:35, 16.54s/it]
 68%|██████▊   | 25632/37963 [109:51:03<54:25:27, 15.89s/it]
 68%|██████▊   | 25633/37963 [109:51:17<52:44:37, 15.40s/it]
 68%|██████▊   | 25634/37963 [109:51:32<51:31:59, 15.05s/it]
 68%|██████▊   | 25635/37963 [109:51:46<50:24:46, 14.72s/it]
 68%|██████▊   | 25636/37963 [109:52:00<50:07:25, 14.64s/it]
 68%|██████▊   | 25637/37963 [109:52:15<50:04:22, 14.62s/it]
 68%|██████▊   | 25638/37963 [109:52:29<49:52:12, 14.57s/it]
 68%|██████▊   | 25639/37963 [109:52:43<49:34:12, 14.48s/it]
 68%|██████▊   | 25640/37963 [109:52:57<48:55:23, 14.29s/it]
                                                            
{'loss': '0.108', 'grad_norm': '3.008', 'learning_rate': '5.036e-06', 'epoch': '0.6754'}

 68%|██████▊   | 25640/37963 [109:52:57<48:55:23, 14.29s/it]
 68%|██████▊   | 25641/37963 [109:53:12<49:04:39, 14.34s/it]
 68%|██████▊   | 25642/37963 [109:53:26<48:54:50, 14.29s/it]
 68%|██████▊   | 25643/37963 [109:53:40<48:44:37, 14.24s/it]
 68%|██████▊   | 25644/37963 [109:53:54<48:51:31, 14.28s/it]
 68%|██████▊   | 25645/37963 [109:54:09<49:05:23, 14.35s/it]
 68%|██████▊   | 25646/37963 [109:54:23<48:56:31, 14.30s/it]
 68%|██████▊   | 25647/37963 [109:54:37<48:55:22, 14.30s/it]
 68%|██████▊   | 25648/37963 [109:54:51<48:29:29, 14.18s/it]
 68%|██████▊   | 25649/37963 [109:55:12<54:53:41, 16.05s/it]
 68%|██████▊   | 25650/37963 [109:55:26<53:05:14, 15.52s/it]
                                                            
{'loss': '0.109', 'grad_norm': '1.547', 'learning_rate': '5.029e-06', 'epoch': '0.6757'}

 68%|██████▊   | 25650/37963 [109:55:26<53:05:14, 15.52s/it]
 68%|██████▊   | 25651/37963 [109:55:40<51:53:07, 15.17s/it]
 68%|██████▊   | 25652/37963 [109:55:54<50:50:14, 14.87s/it]
 68%|██████▊   | 25653/37963 [109:56:09<50:19:26, 14.72s/it]
 68%|██████▊   | 25654/37963 [109:56:23<50:03:56, 14.64s/it]
 68%|██████▊   | 25655/37963 [109:56:38<50:01:17, 14.63s/it]
 68%|██████▊   | 25656/37963 [109:57:05<62:32:00, 18.29s/it]
 68%|██████▊   | 25657/37963 [109:57:26<65:11:17, 19.07s/it]
 68%|██████▊   | 25658/37963 [109:57:40<60:23:57, 17.67s/it]
 68%|██████▊   | 25659/37963 [109:57:54<56:48:41, 16.62s/it]
 68%|██████▊   | 25660/37963 [109:58:08<54:15:56, 15.88s/it]
                                                            
{'loss': '0.1002', 'grad_norm': '2.771', 'learning_rate': '5.022e-06', 'epoch': '0.6759'}

 68%|██████▊   | 25660/37963 [109:58:08<54:15:56, 15.88s/it]
 68%|██████▊   | 25661/37963 [109:58:23<52:42:49, 15.43s/it]
 68%|██████▊   | 25662/37963 [109:58:37<51:38:52, 15.12s/it]
 68%|██████▊   | 25663/37963 [109:58:52<51:04:40, 14.95s/it]
 68%|██████▊   | 25664/37963 [109:59:06<50:26:29, 14.76s/it]
 68%|██████▊   | 25665/37963 [109:59:20<49:27:28, 14.48s/it]
 68%|██████▊   | 25666/37963 [109:59:34<49:25:01, 14.47s/it]
 68%|██████▊   | 25667/37963 [109:59:49<49:22:38, 14.46s/it]
 68%|██████▊   | 25668/37963 [110:00:03<49:18:03, 14.44s/it]
 68%|██████▊   | 25669/37963 [110:00:17<48:57:23, 14.34s/it]
 68%|██████▊   | 25670/37963 [110:00:38<55:21:18, 16.21s/it]
                                                            
{'loss': '0.1196', 'grad_norm': '1.808', 'learning_rate': '5.014e-06', 'epoch': '0.6762'}

 68%|██████▊   | 25670/37963 [110:00:38<55:21:18, 16.21s/it]
 68%|██████▊   | 25671/37963 [110:00:52<52:49:29, 15.47s/it]
 68%|██████▊   | 25672/37963 [110:01:19<65:33:25, 19.20s/it]
 68%|██████▊   | 25673/37963 [110:01:34<60:30:00, 17.72s/it]
 68%|██████▊   | 25674/37963 [110:01:47<56:13:57, 16.47s/it]
 68%|██████▊   | 25675/37963 [110:02:02<54:03:42, 15.84s/it]
 68%|██████▊   | 25676/37963 [110:02:16<52:30:36, 15.39s/it]
 68%|██████▊   | 25677/37963 [110:02:30<50:53:13, 14.91s/it]
 68%|██████▊   | 25678/37963 [110:02:44<49:57:49, 14.64s/it]
 68%|██████▊   | 25679/37963 [110:03:05<56:17:12, 16.50s/it]
 68%|██████▊   | 25680/37963 [110:03:19<54:13:15, 15.89s/it]
                                                            
{'loss': '0.1116', 'grad_norm': '1.679', 'learning_rate': '5.007e-06', 'epoch': '0.6765'}

 68%|██████▊   | 25680/37963 [110:03:19<54:13:15, 15.89s/it]
 68%|██████▊   | 25681/37963 [110:03:33<52:40:41, 15.44s/it]
 68%|██████▊   | 25682/37963 [110:03:48<51:39:38, 15.14s/it]
 68%|██████▊   | 25683/37963 [110:04:02<50:47:25, 14.89s/it]
 68%|██████▊   | 25684/37963 [110:04:17<50:21:52, 14.77s/it]
 68%|██████▊   | 25685/37963 [110:04:31<49:57:27, 14.65s/it]
 68%|██████▊   | 25686/37963 [110:04:45<49:38:50, 14.56s/it]
 68%|██████▊   | 25687/37963 [110:05:00<49:25:37, 14.49s/it]
 68%|██████▊   | 25688/37963 [110:05:14<49:16:29, 14.45s/it]
 68%|██████▊   | 25689/37963 [110:05:28<49:11:18, 14.43s/it]
 68%|██████▊   | 25690/37963 [110:05:43<49:06:14, 14.40s/it]
                                                            
{'loss': '0.113', 'grad_norm': '1.496', 'learning_rate': '5e-06', 'epoch': '0.6767'}

 68%|██████▊   | 25690/37963 [110:05:43<49:06:14, 14.40s/it]
 68%|██████▊   | 25691/37963 [110:05:57<48:54:18, 14.35s/it]
 68%|██████▊   | 25692/37963 [110:06:11<48:55:34, 14.35s/it]
 68%|██████▊   | 25693/37963 [110:06:26<48:57:53, 14.37s/it]
 68%|██████▊   | 25694/37963 [110:06:40<49:00:49, 14.38s/it]
 68%|██████▊   | 25695/37963 [110:06:55<48:58:49, 14.37s/it]
 68%|██████▊   | 25696/37963 [110:07:09<49:00:10, 14.38s/it]
 68%|██████▊   | 25697/37963 [110:07:23<49:00:27, 14.38s/it]
 68%|██████▊   | 25698/37963 [110:07:38<49:00:31, 14.38s/it]
 68%|██████▊   | 25699/37963 [110:07:52<48:59:27, 14.38s/it]
 68%|██████▊   | 25700/37963 [110:08:13<55:12:08, 16.21s/it]
                                                            
{'loss': '0.1124', 'grad_norm': '1.838', 'learning_rate': '4.992e-06', 'epoch': '0.677'}

 68%|██████▊   | 25700/37963 [110:08:13<55:12:08, 16.21s/it]
 68%|██████▊   | 25701/37963 [110:08:26<52:45:15, 15.49s/it]
 68%|██████▊   | 25702/37963 [110:08:41<51:26:01, 15.10s/it]
 68%|██████▊   | 25703/37963 [110:08:55<50:33:11, 14.84s/it]
 68%|██████▊   | 25704/37963 [110:09:09<49:52:03, 14.64s/it]
 68%|██████▊   | 25705/37963 [110:09:36<62:50:25, 18.46s/it]
 68%|██████▊   | 25706/37963 [110:09:58<65:45:22, 19.31s/it]
 68%|██████▊   | 25707/37963 [110:10:12<60:20:04, 17.72s/it]
 68%|██████▊   | 25708/37963 [110:10:26<56:54:33, 16.72s/it]
 68%|██████▊   | 25709/37963 [110:10:40<54:30:32, 16.01s/it]
 68%|██████▊   | 25710/37963 [110:10:54<52:28:11, 15.42s/it]
                                                            
{'loss': '0.1103', 'grad_norm': '2.331', 'learning_rate': '4.985e-06', 'epoch': '0.6772'}

 68%|██████▊   | 25710/37963 [110:10:54<52:28:11, 15.42s/it]
 68%|██████▊   | 25711/37963 [110:11:08<50:54:13, 14.96s/it]
 68%|██████▊   | 25712/37963 [110:11:23<50:17:00, 14.78s/it]
 68%|██████▊   | 25713/37963 [110:11:37<49:54:05, 14.66s/it]
 68%|██████▊   | 25714/37963 [110:11:51<49:36:38, 14.58s/it]
 68%|██████▊   | 25715/37963 [110:12:06<49:24:06, 14.52s/it]
 68%|██████▊   | 25716/37963 [110:12:20<49:16:13, 14.48s/it]
 68%|██████▊   | 25717/37963 [110:12:35<49:11:19, 14.46s/it]
 68%|██████▊   | 25718/37963 [110:12:55<55:38:40, 16.36s/it]
 68%|██████▊   | 25719/37963 [110:13:10<53:43:16, 15.80s/it]
 68%|██████▊   | 25720/37963 [110:13:24<51:40:54, 15.20s/it]
                                                            
{'loss': '0.1162', 'grad_norm': '2.868', 'learning_rate': '4.977e-06', 'epoch': '0.6775'}

 68%|██████▊   | 25720/37963 [110:13:24<51:40:54, 15.20s/it]
 68%|██████▊   | 25721/37963 [110:13:51<64:26:25, 18.95s/it]
 68%|██████▊   | 25722/37963 [110:14:06<59:39:12, 17.54s/it]
 68%|██████▊   | 25723/37963 [110:14:20<56:27:23, 16.60s/it]
 68%|██████▊   | 25724/37963 [110:14:34<53:50:16, 15.84s/it]
 68%|██████▊   | 25725/37963 [110:14:48<52:18:20, 15.39s/it]
 68%|██████▊   | 25726/37963 [110:15:08<56:58:46, 16.76s/it]
 68%|██████▊   | 25727/37963 [110:15:23<54:33:18, 16.05s/it]
 68%|██████▊   | 25728/37963 [110:15:37<52:55:16, 15.57s/it]
 68%|██████▊   | 25729/37963 [110:15:51<51:01:45, 15.02s/it]
 68%|██████▊   | 25730/37963 [110:16:05<49:55:09, 14.69s/it]
                                                            
{'loss': '0.1237', 'grad_norm': '2.049', 'learning_rate': '4.97e-06', 'epoch': '0.6778'}

 68%|██████▊   | 25730/37963 [110:16:05<49:55:09, 14.69s/it]
 68%|██████▊   | 25731/37963 [110:16:19<49:23:29, 14.54s/it]
 68%|██████▊   | 25732/37963 [110:16:33<48:57:58, 14.41s/it]
 68%|██████▊   | 25733/37963 [110:16:48<48:56:50, 14.41s/it]
 68%|██████▊   | 25734/37963 [110:17:02<48:51:39, 14.38s/it]
 68%|██████▊   | 25735/37963 [110:17:16<48:55:54, 14.41s/it]
 68%|██████▊   | 25736/37963 [110:17:31<48:57:29, 14.41s/it]
 68%|██████▊   | 25737/37963 [110:17:45<48:55:24, 14.41s/it]
 68%|██████▊   | 25738/37963 [110:17:59<48:36:52, 14.32s/it]
 68%|██████▊   | 25739/37963 [110:18:14<48:46:25, 14.36s/it]
 68%|██████▊   | 25740/37963 [110:18:28<48:14:14, 14.21s/it]
                                                            
{'loss': '0.09844', 'grad_norm': '2.124', 'learning_rate': '4.963e-06', 'epoch': '0.678'}

 68%|██████▊   | 25740/37963 [110:18:28<48:14:14, 14.21s/it]
 68%|██████▊   | 25741/37963 [110:18:41<47:44:54, 14.06s/it]
 68%|██████▊   | 25742/37963 [110:18:56<48:16:08, 14.22s/it]
 68%|██████▊   | 25743/37963 [110:19:10<48:05:34, 14.17s/it]
 68%|██████▊   | 25744/37963 [110:19:24<48:16:09, 14.22s/it]
 68%|██████▊   | 25745/37963 [110:19:38<48:03:47, 14.16s/it]
 68%|██████▊   | 25746/37963 [110:19:53<48:14:27, 14.22s/it]
 68%|██████▊   | 25747/37963 [110:20:07<48:21:36, 14.25s/it]
 68%|██████▊   | 25748/37963 [110:20:21<48:28:58, 14.29s/it]
 68%|██████▊   | 25749/37963 [110:20:42<55:10:40, 16.26s/it]
 68%|██████▊   | 25750/37963 [110:20:56<52:43:52, 15.54s/it]
                                                            
{'loss': '0.1153', 'grad_norm': '1.966', 'learning_rate': '4.955e-06', 'epoch': '0.6783'}

 68%|██████▊   | 25750/37963 [110:20:56<52:43:52, 15.54s/it]
 68%|██████▊   | 25751/37963 [110:21:11<51:31:04, 15.19s/it]
 68%|██████▊   | 25752/37963 [110:21:25<50:48:29, 14.98s/it]
 68%|██████▊   | 25753/37963 [110:21:46<56:38:40, 16.70s/it]
 68%|██████▊   | 25754/37963 [110:22:14<67:58:11, 20.04s/it]
 68%|██████▊   | 25755/37963 [110:22:28<62:13:33, 18.35s/it]
 68%|██████▊   | 25756/37963 [110:22:42<58:05:30, 17.13s/it]
 68%|██████▊   | 25757/37963 [110:22:57<55:18:21, 16.31s/it]
 68%|██████▊   | 25758/37963 [110:23:11<53:17:32, 15.72s/it]
 68%|██████▊   | 25759/37963 [110:23:25<51:56:56, 15.32s/it]
 68%|██████▊   | 25760/37963 [110:23:40<51:04:04, 15.07s/it]
                                                            
{'loss': '0.1191', 'grad_norm': '1.91', 'learning_rate': '4.948e-06', 'epoch': '0.6786'}

 68%|██████▊   | 25760/37963 [110:23:40<51:04:04, 15.07s/it]
 68%|██████▊   | 25761/37963 [110:23:54<49:40:30, 14.66s/it]
 68%|██████▊   | 25762/37963 [110:24:08<49:10:19, 14.51s/it]
 68%|██████▊   | 25763/37963 [110:24:22<49:09:22, 14.51s/it]
 68%|██████▊   | 25764/37963 [110:24:37<49:04:14, 14.48s/it]
 68%|██████▊   | 25765/37963 [110:24:51<48:55:29, 14.44s/it]
 68%|██████▊   | 25766/37963 [110:25:12<55:28:17, 16.37s/it]
 68%|██████▊   | 25767/37963 [110:25:26<53:26:31, 15.77s/it]
 68%|██████▊   | 25768/37963 [110:25:41<52:02:10, 15.36s/it]
 68%|██████▊   | 25769/37963 [110:26:02<58:21:21, 17.23s/it]
 68%|██████▊   | 25770/37963 [110:26:23<62:03:57, 18.33s/it]
                                                            
{'loss': '0.1174', 'grad_norm': '4.05', 'learning_rate': '4.941e-06', 'epoch': '0.6788'}

 68%|██████▊   | 25770/37963 [110:26:23<62:03:57, 18.33s/it]
 68%|██████▊   | 25771/37963 [110:26:38<58:10:15, 17.18s/it]
 68%|██████▊   | 25772/37963 [110:26:52<55:19:07, 16.34s/it]
 68%|██████▊   | 25773/37963 [110:27:06<53:20:05, 15.75s/it]
 68%|██████▊   | 25774/37963 [110:27:21<51:58:20, 15.35s/it]
 68%|██████▊   | 25775/37963 [110:27:41<57:04:55, 16.86s/it]
 68%|██████▊   | 25776/37963 [110:27:56<54:31:49, 16.11s/it]
 68%|██████▊   | 25777/37963 [110:28:10<52:28:25, 15.50s/it]
 68%|██████▊   | 25778/37963 [110:28:24<51:09:38, 15.12s/it]
 68%|██████▊   | 25779/37963 [110:28:38<50:22:28, 14.88s/it]
 68%|██████▊   | 25780/37963 [110:28:53<49:48:24, 14.72s/it]
                                                            
{'loss': '0.1077', 'grad_norm': '1.412', 'learning_rate': '4.933e-06', 'epoch': '0.6791'}

 68%|██████▊   | 25780/37963 [110:28:53<49:48:24, 14.72s/it]
 68%|██████▊   | 25781/37963 [110:29:07<49:07:25, 14.52s/it]
 68%|██████▊   | 25782/37963 [110:29:21<48:54:16, 14.45s/it]
 68%|██████▊   | 25783/37963 [110:29:35<48:56:25, 14.47s/it]
 68%|██████▊   | 25784/37963 [110:29:50<48:57:49, 14.47s/it]
 68%|██████▊   | 25785/37963 [110:30:04<48:18:11, 14.28s/it]
 68%|██████▊   | 25786/37963 [110:30:18<48:27:27, 14.33s/it]
 68%|██████▊   | 25787/37963 [110:30:33<48:33:55, 14.36s/it]
 68%|██████▊   | 25788/37963 [110:30:47<48:43:22, 14.41s/it]
 68%|██████▊   | 25789/37963 [110:31:01<48:43:21, 14.41s/it]
 68%|██████▊   | 25790/37963 [110:31:15<48:18:24, 14.29s/it]
                                                            
{'loss': '0.1059', 'grad_norm': '1.772', 'learning_rate': '4.926e-06', 'epoch': '0.6793'}

 68%|██████▊   | 25790/37963 [110:31:15<48:18:24, 14.29s/it]
 68%|██████▊   | 25791/37963 [110:31:30<48:12:48, 14.26s/it]
 68%|██████▊   | 25792/37963 [110:31:44<48:20:07, 14.30s/it]
 68%|██████▊   | 25793/37963 [110:31:58<47:45:49, 14.13s/it]
 68%|██████▊   | 25794/37963 [110:32:12<48:05:05, 14.23s/it]
 68%|██████▊   | 25795/37963 [110:32:27<48:13:56, 14.27s/it]
 68%|██████▊   | 25796/37963 [110:32:41<48:12:46, 14.27s/it]
 68%|██████▊   | 25797/37963 [110:33:02<54:48:45, 16.22s/it]
 68%|██████▊   | 25798/37963 [110:33:16<52:55:41, 15.66s/it]
 68%|██████▊   | 25799/37963 [110:33:30<51:28:28, 15.23s/it]
 68%|██████▊   | 25800/37963 [110:33:45<50:33:58, 14.97s/it]
                                                            
{'loss': '0.1099', 'grad_norm': '1.553', 'learning_rate': '4.918e-06', 'epoch': '0.6796'}

 68%|██████▊   | 25800/37963 [110:33:45<50:33:58, 14.97s/it]
 68%|██████▊   | 25801/37963 [110:33:59<50:00:30, 14.80s/it]
 68%|██████▊   | 25802/37963 [110:34:32<68:40:00, 20.33s/it]
 68%|██████▊   | 25803/37963 [110:34:47<62:39:59, 18.55s/it]
 68%|██████▊   | 25804/37963 [110:35:01<58:29:06, 17.32s/it]
 68%|██████▊   | 25805/37963 [110:35:15<55:26:21, 16.42s/it]
 68%|██████▊   | 25806/37963 [110:35:30<53:23:02, 15.81s/it]
 68%|██████▊   | 25807/37963 [110:35:44<51:22:20, 15.21s/it]
 68%|██████▊   | 25808/37963 [110:35:57<49:45:30, 14.74s/it]
 68%|██████▊   | 25809/37963 [110:36:12<49:26:33, 14.64s/it]
 68%|██████▊   | 25810/37963 [110:36:26<49:09:30, 14.56s/it]
                                                            
{'loss': '0.1036', 'grad_norm': '2.507', 'learning_rate': '4.911e-06', 'epoch': '0.6799'}

 68%|██████▊   | 25810/37963 [110:36:26<49:09:30, 14.56s/it]
 68%|██████▊   | 25811/37963 [110:36:40<48:54:15, 14.49s/it]
 68%|██████▊   | 25812/37963 [110:36:55<48:37:27, 14.41s/it]
 68%|██████▊   | 25813/37963 [110:37:15<55:07:10, 16.33s/it]
 68%|██████▊   | 25814/37963 [110:37:30<53:11:14, 15.76s/it]
 68%|██████▊   | 25815/37963 [110:37:44<51:30:05, 15.26s/it]
 68%|██████▊   | 25816/37963 [110:37:58<50:38:27, 15.01s/it]
 68%|██████▊   | 25817/37963 [110:38:13<49:57:26, 14.81s/it]
 68%|██████▊   | 25818/37963 [110:38:34<56:09:07, 16.64s/it]
 68%|██████▊   | 25819/37963 [110:38:54<60:23:16, 17.90s/it]
 68%|██████▊   | 25820/37963 [110:39:09<56:48:45, 16.84s/it]
                                                            
{'loss': '0.1168', 'grad_norm': '4.807', 'learning_rate': '4.904e-06', 'epoch': '0.6801'}

 68%|██████▊   | 25820/37963 [110:39:09<56:48:45, 16.84s/it]
 68%|██████▊   | 25821/37963 [110:39:23<54:19:48, 16.11s/it]
 68%|██████▊   | 25822/37963 [110:39:38<52:31:38, 15.58s/it]
 68%|██████▊   | 25823/37963 [110:39:58<57:49:38, 17.15s/it]
 68%|██████▊   | 25824/37963 [110:40:13<55:03:32, 16.33s/it]
 68%|██████▊   | 25825/37963 [110:40:27<53:09:48, 15.77s/it]
 68%|██████▊   | 25826/37963 [110:40:42<51:43:36, 15.34s/it]
 68%|██████▊   | 25827/37963 [110:40:56<50:49:53, 15.08s/it]
 68%|██████▊   | 25828/37963 [110:41:10<50:01:36, 14.84s/it]
 68%|██████▊   | 25829/37963 [110:41:25<49:38:51, 14.73s/it]
 68%|██████▊   | 25830/37963 [110:41:39<49:08:54, 14.58s/it]
                                                            
{'loss': '0.1093', 'grad_norm': '2.004', 'learning_rate': '4.896e-06', 'epoch': '0.6804'}

 68%|██████▊   | 25830/37963 [110:41:39<49:08:54, 14.58s/it]
 68%|██████▊   | 25831/37963 [110:41:53<48:57:28, 14.53s/it]
 68%|██████▊   | 25832/37963 [110:42:08<48:32:29, 14.41s/it]
 68%|██████▊   | 25833/37963 [110:42:22<48:39:15, 14.44s/it]
 68%|██████▊   | 25834/37963 [110:42:36<47:41:50, 14.16s/it]
 68%|██████▊   | 25835/37963 [110:42:50<47:59:26, 14.25s/it]
 68%|██████▊   | 25836/37963 [110:43:04<48:03:13, 14.27s/it]
 68%|██████▊   | 25837/37963 [110:43:19<48:19:05, 14.34s/it]
 68%|██████▊   | 25838/37963 [110:43:33<48:22:55, 14.36s/it]
 68%|██████▊   | 25839/37963 [110:43:48<48:24:38, 14.37s/it]
 68%|██████▊   | 25840/37963 [110:44:02<47:56:08, 14.23s/it]
                                                            
{'loss': '0.1083', 'grad_norm': '1.521', 'learning_rate': '4.889e-06', 'epoch': '0.6807'}

 68%|██████▊   | 25840/37963 [110:44:02<47:56:08, 14.23s/it]
 68%|██████▊   | 25841/37963 [110:44:16<48:00:25, 14.26s/it]
 68%|██████▊   | 25842/37963 [110:44:30<48:07:06, 14.29s/it]
 68%|██████▊   | 25843/37963 [110:44:44<47:51:01, 14.21s/it]
 68%|██████▊   | 25844/37963 [110:44:58<47:41:12, 14.17s/it]
 68%|██████▊   | 25845/37963 [110:45:13<47:55:12, 14.24s/it]
 68%|██████▊   | 25846/37963 [110:45:33<54:26:06, 16.17s/it]
 68%|██████▊   | 25847/37963 [110:45:48<52:21:06, 15.56s/it]
 68%|██████▊   | 25848/37963 [110:46:02<50:54:13, 15.13s/it]
 68%|██████▊   | 25849/37963 [110:46:16<50:03:41, 14.88s/it]
 68%|██████▊   | 25850/37963 [110:46:37<56:16:56, 16.73s/it]
                                                            
{'loss': '0.1203', 'grad_norm': '2.62', 'learning_rate': '4.882e-06', 'epoch': '0.6809'}

 68%|██████▊   | 25850/37963 [110:46:37<56:16:56, 16.73s/it]
 68%|██████▊   | 25851/37963 [110:47:05<67:34:31, 20.09s/it]
 68%|██████▊   | 25852/37963 [110:47:19<61:51:28, 18.39s/it]
 68%|██████▊   | 25853/37963 [110:47:34<57:50:01, 17.19s/it]
 68%|██████▊   | 25854/37963 [110:47:48<55:04:43, 16.37s/it]
 68%|██████▊   | 25855/37963 [110:48:03<53:01:02, 15.76s/it]
 68%|██████▊   | 25856/37963 [110:48:17<51:41:13, 15.37s/it]
 68%|██████▊   | 25857/37963 [110:48:32<50:46:17, 15.10s/it]
 68%|██████▊   | 25858/37963 [110:48:46<49:58:11, 14.86s/it]
 68%|██████▊   | 25859/37963 [110:49:00<49:34:38, 14.75s/it]
 68%|██████▊   | 25860/37963 [110:49:15<49:09:15, 14.62s/it]
                                                            
{'loss': '0.1122', 'grad_norm': '2.677', 'learning_rate': '4.874e-06', 'epoch': '0.6812'}

 68%|██████▊   | 25860/37963 [110:49:15<49:09:15, 14.62s/it]
 68%|██████▊   | 25861/37963 [110:49:29<48:55:18, 14.55s/it]
 68%|██████▊   | 25862/37963 [110:49:50<55:28:17, 16.50s/it]
 68%|██████▊   | 25863/37963 [110:50:04<52:58:19, 15.76s/it]
 68%|██████▊   | 25864/37963 [110:50:18<51:32:53, 15.34s/it]
 68%|██████▊   | 25865/37963 [110:50:33<50:39:49, 15.08s/it]
 68%|██████▊   | 25866/37963 [110:50:54<56:31:58, 16.82s/it]
 68%|██████▊   | 25867/37963 [110:51:08<54:08:37, 16.11s/it]
 68%|██████▊   | 25868/37963 [110:51:23<52:21:29, 15.58s/it]
 68%|██████▊   | 25869/37963 [110:51:37<50:57:30, 15.17s/it]
 68%|██████▊   | 25870/37963 [110:51:51<50:21:17, 14.99s/it]
                                                            
{'loss': '0.109', 'grad_norm': '1.564', 'learning_rate': '4.867e-06', 'epoch': '0.6815'}

 68%|██████▊   | 25870/37963 [110:51:51<50:21:17, 14.99s/it]
 68%|██████▊   | 25871/37963 [110:52:12<56:17:02, 16.76s/it]
 68%|██████▊   | 25872/37963 [110:52:32<59:26:58, 17.70s/it]
 68%|██████▊   | 25873/37963 [110:52:47<56:06:44, 16.71s/it]
 68%|██████▊   | 25874/37963 [110:53:01<53:37:59, 15.97s/it]
 68%|██████▊   | 25875/37963 [110:53:15<52:05:16, 15.51s/it]
 68%|██████▊   | 25876/37963 [110:53:29<50:36:06, 15.07s/it]
 68%|██████▊   | 25877/37963 [110:53:44<49:55:32, 14.87s/it]
 68%|██████▊   | 25878/37963 [110:53:58<49:08:44, 14.64s/it]
 68%|██████▊   | 25879/37963 [110:54:12<48:52:29, 14.56s/it]
 68%|██████▊   | 25880/37963 [110:54:27<48:46:27, 14.53s/it]
                                                            
{'loss': '0.1167', 'grad_norm': '2.107', 'learning_rate': '4.86e-06', 'epoch': '0.6817'}

 68%|██████▊   | 25880/37963 [110:54:27<48:46:27, 14.53s/it]
 68%|██████▊   | 25881/37963 [110:54:41<48:27:58, 14.44s/it]
 68%|██████▊   | 25882/37963 [110:54:55<48:11:21, 14.36s/it]
 68%|██████▊   | 25883/37963 [110:55:09<48:01:44, 14.31s/it]
 68%|██████▊   | 25884/37963 [110:55:23<47:42:49, 14.22s/it]
 68%|██████▊   | 25885/37963 [110:55:38<47:52:23, 14.27s/it]
 68%|██████▊   | 25886/37963 [110:55:52<48:10:52, 14.36s/it]
 68%|██████▊   | 25887/37963 [110:56:07<48:13:24, 14.38s/it]
 68%|██████▊   | 25888/37963 [110:56:21<48:14:25, 14.38s/it]
 68%|██████▊   | 25889/37963 [110:56:35<48:08:39, 14.35s/it]
 68%|██████▊   | 25890/37963 [110:56:50<48:09:19, 14.36s/it]
                                                            
{'loss': '0.1099', 'grad_norm': '2.124', 'learning_rate': '4.852e-06', 'epoch': '0.682'}

 68%|██████▊   | 25890/37963 [110:56:50<48:09:19, 14.36s/it]
 68%|██████▊   | 25891/37963 [110:57:04<48:11:26, 14.37s/it]
 68%|██████▊   | 25892/37963 [110:57:19<48:15:35, 14.39s/it]
 68%|██████▊   | 25893/37963 [110:57:33<48:15:07, 14.39s/it]
 68%|██████▊   | 25894/37963 [110:57:54<54:54:50, 16.38s/it]
 68%|██████▊   | 25895/37963 [110:58:08<52:53:48, 15.78s/it]
 68%|██████▊   | 25896/37963 [110:58:23<51:18:42, 15.31s/it]
 68%|██████▊   | 25897/37963 [110:58:36<49:42:25, 14.83s/it]
 68%|██████▊   | 25898/37963 [110:58:51<49:13:57, 14.69s/it]
 68%|██████▊   | 25899/37963 [110:59:17<61:16:16, 18.28s/it]
 68%|██████▊   | 25900/37963 [110:59:38<63:52:26, 19.06s/it]
                                                            
{'loss': '0.103', 'grad_norm': '3.185', 'learning_rate': '4.845e-06', 'epoch': '0.6822'}

 68%|██████▊   | 25900/37963 [110:59:38<63:52:26, 19.06s/it]
 68%|██████▊   | 25901/37963 [110:59:53<59:19:38, 17.71s/it]
 68%|██████▊   | 25902/37963 [111:00:07<55:37:44, 16.60s/it]
 68%|██████▊   | 25903/37963 [111:00:21<53:21:01, 15.93s/it]
 68%|██████▊   | 25904/37963 [111:00:35<51:46:11, 15.45s/it]
 68%|██████▊   | 25905/37963 [111:00:50<50:42:31, 15.14s/it]
 68%|██████▊   | 25906/37963 [111:01:04<49:59:30, 14.93s/it]
 68%|██████▊   | 25907/37963 [111:01:18<49:04:09, 14.65s/it]
 68%|██████▊   | 25908/37963 [111:01:33<48:48:05, 14.57s/it]
 68%|██████▊   | 25909/37963 [111:01:47<48:36:01, 14.51s/it]
 68%|██████▊   | 25910/37963 [111:02:02<48:36:27, 14.52s/it]
                                                            
{'loss': '0.1135', 'grad_norm': '3.783', 'learning_rate': '4.838e-06', 'epoch': '0.6825'}

 68%|██████▊   | 25910/37963 [111:02:02<48:36:27, 14.52s/it]
 68%|██████▊   | 25911/37963 [111:02:22<54:44:54, 16.35s/it]
 68%|██████▊   | 25912/37963 [111:02:37<52:46:03, 15.76s/it]
 68%|██████▊   | 25913/37963 [111:02:51<51:28:36, 15.38s/it]
 68%|██████▊   | 25914/37963 [111:03:12<57:02:00, 17.04s/it]
 68%|██████▊   | 25915/37963 [111:03:26<54:19:17, 16.23s/it]
 68%|██████▊   | 25916/37963 [111:03:40<52:04:27, 15.56s/it]
 68%|██████▊   | 25917/37963 [111:03:55<50:55:41, 15.22s/it]
 68%|██████▊   | 25918/37963 [111:04:09<50:09:31, 14.99s/it]
 68%|██████▊   | 25919/37963 [111:04:24<49:32:32, 14.81s/it]
 68%|██████▊   | 25920/37963 [111:04:50<61:16:57, 18.32s/it]
                                                            
{'loss': '0.1044', 'grad_norm': '2.513', 'learning_rate': '4.831e-06', 'epoch': '0.6828'}

 68%|██████▊   | 25920/37963 [111:04:50<61:16:57, 18.32s/it]
 68%|██████▊   | 25921/37963 [111:05:04<56:57:06, 17.03s/it]
 68%|██████▊   | 25922/37963 [111:05:18<54:17:46, 16.23s/it]
 68%|██████▊   | 25923/37963 [111:05:33<52:17:34, 15.64s/it]
 68%|██████▊   | 25924/37963 [111:05:47<50:50:18, 15.20s/it]
 68%|██████▊   | 25925/37963 [111:06:01<49:57:51, 14.94s/it]
 68%|██████▊   | 25926/37963 [111:06:16<49:20:14, 14.76s/it]
 68%|██████▊   | 25927/37963 [111:06:29<48:29:27, 14.50s/it]
 68%|██████▊   | 25928/37963 [111:06:44<48:18:45, 14.45s/it]
 68%|██████▊   | 25929/37963 [111:06:58<48:14:23, 14.43s/it]
 68%|██████▊   | 25930/37963 [111:07:12<48:04:42, 14.38s/it]
                                                            
{'loss': '0.1117', 'grad_norm': '2.039', 'learning_rate': '4.823e-06', 'epoch': '0.683'}

 68%|██████▊   | 25930/37963 [111:07:12<48:04:42, 14.38s/it]
 68%|██████▊   | 25931/37963 [111:07:27<47:47:46, 14.30s/it]
 68%|██████▊   | 25932/37963 [111:07:40<47:17:15, 14.15s/it]
 68%|██████▊   | 25933/37963 [111:07:55<47:30:35, 14.22s/it]
 68%|██████▊   | 25934/37963 [111:08:09<47:18:48, 14.16s/it]
 68%|██████▊   | 25935/37963 [111:08:23<47:41:57, 14.28s/it]
 68%|██████▊   | 25936/37963 [111:08:37<47:21:00, 14.17s/it]
 68%|██████▊   | 25937/37963 [111:08:52<47:34:08, 14.24s/it]
 68%|██████▊   | 25938/37963 [111:09:06<47:43:42, 14.29s/it]
 68%|██████▊   | 25939/37963 [111:09:20<47:35:58, 14.25s/it]
 68%|██████▊   | 25940/37963 [111:09:35<48:01:57, 14.38s/it]
                                                            
{'loss': '0.116', 'grad_norm': '0.9718', 'learning_rate': '4.816e-06', 'epoch': '0.6833'}

 68%|██████▊   | 25940/37963 [111:09:35<48:01:57, 14.38s/it]
 68%|██████▊   | 25941/37963 [111:09:55<53:34:42, 16.04s/it]
 68%|██████▊   | 25942/37963 [111:10:09<51:54:22, 15.54s/it]
 68%|██████▊   | 25943/37963 [111:10:24<50:42:05, 15.19s/it]
 68%|██████▊   | 25944/37963 [111:10:38<49:46:22, 14.91s/it]
 68%|██████▊   | 25945/37963 [111:10:52<48:59:56, 14.68s/it]
 68%|██████▊   | 25946/37963 [111:11:06<48:48:51, 14.62s/it]
 68%|██████▊   | 25947/37963 [111:11:27<55:04:33, 16.50s/it]
 68%|██████▊   | 25948/37963 [111:11:42<52:55:08, 15.86s/it]
 68%|██████▊   | 25949/37963 [111:12:03<58:41:33, 17.59s/it]
 68%|██████▊   | 25950/37963 [111:12:18<55:25:55, 16.61s/it]
                                                            
{'loss': '0.1077', 'grad_norm': '3.589', 'learning_rate': '4.809e-06', 'epoch': '0.6836'}

 68%|██████▊   | 25950/37963 [111:12:18<55:25:55, 16.61s/it]
 68%|██████▊   | 25951/37963 [111:12:32<53:15:42, 15.96s/it]
 68%|██████▊   | 25952/37963 [111:12:46<51:39:24, 15.48s/it]
 68%|██████▊   | 25953/37963 [111:13:01<50:29:34, 15.14s/it]
 68%|██████▊   | 25954/37963 [111:13:15<49:40:29, 14.89s/it]
 68%|██████▊   | 25955/37963 [111:13:29<49:07:24, 14.73s/it]
 68%|██████▊   | 25956/37963 [111:13:44<48:45:29, 14.62s/it]
 68%|██████▊   | 25957/37963 [111:13:58<48:33:41, 14.56s/it]
 68%|██████▊   | 25958/37963 [111:14:12<48:00:01, 14.39s/it]
 68%|██████▊   | 25959/37963 [111:14:33<54:00:36, 16.20s/it]
 68%|██████▊   | 25960/37963 [111:14:47<52:06:13, 15.63s/it]
                                                            
{'loss': '0.113', 'grad_norm': '1.371', 'learning_rate': '4.801e-06', 'epoch': '0.6838'}

 68%|██████▊   | 25960/37963 [111:14:47<52:06:13, 15.63s/it]
 68%|██████▊   | 25961/37963 [111:15:01<50:51:23, 15.25s/it]
 68%|██████▊   | 25962/37963 [111:15:16<49:56:56, 14.98s/it]
 68%|██████▊   | 25963/37963 [111:15:37<56:14:17, 16.87s/it]
 68%|██████▊   | 25964/37963 [111:15:51<53:14:48, 15.98s/it]
 68%|██████▊   | 25965/37963 [111:16:05<51:36:28, 15.48s/it]
 68%|██████▊   | 25966/37963 [111:16:19<50:18:49, 15.10s/it]
 68%|██████▊   | 25967/37963 [111:16:40<55:43:44, 16.72s/it]
 68%|██████▊   | 25968/37963 [111:16:54<53:12:03, 15.97s/it]
 68%|██████▊   | 25969/37963 [111:17:08<51:35:10, 15.48s/it]
 68%|██████▊   | 25970/37963 [111:17:29<56:22:45, 16.92s/it]
                                                            
{'loss': '0.09445', 'grad_norm': '2.468', 'learning_rate': '4.794e-06', 'epoch': '0.6841'}

 68%|██████▊   | 25970/37963 [111:17:29<56:22:45, 16.92s/it]
 68%|██████▊   | 25971/37963 [111:17:43<53:51:15, 16.17s/it]
 68%|██████▊   | 25972/37963 [111:17:57<51:59:06, 15.61s/it]
 68%|██████▊   | 25973/37963 [111:18:12<50:44:24, 15.23s/it]
 68%|██████▊   | 25974/37963 [111:18:26<49:17:20, 14.80s/it]
 68%|██████▊   | 25975/37963 [111:18:40<48:55:12, 14.69s/it]
 68%|██████▊   | 25976/37963 [111:18:54<48:18:34, 14.51s/it]
 68%|██████▊   | 25977/37963 [111:19:08<48:09:11, 14.46s/it]
 68%|██████▊   | 25978/37963 [111:19:23<48:10:05, 14.47s/it]
 68%|██████▊   | 25979/37963 [111:19:37<47:45:28, 14.35s/it]
 68%|██████▊   | 25980/37963 [111:19:52<47:56:21, 14.40s/it]
                                                            
{'loss': '0.1201', 'grad_norm': '1.663', 'learning_rate': '4.787e-06', 'epoch': '0.6844'}

 68%|██████▊   | 25980/37963 [111:19:52<47:56:21, 14.40s/it]
 68%|██████▊   | 25981/37963 [111:20:06<47:55:30, 14.40s/it]
 68%|██████▊   | 25982/37963 [111:20:20<47:52:52, 14.39s/it]
 68%|██████▊   | 25983/37963 [111:20:34<47:39:05, 14.32s/it]
 68%|██████▊   | 25984/37963 [111:20:48<46:47:29, 14.06s/it]
 68%|██████▊   | 25985/37963 [111:21:02<47:06:31, 14.16s/it]
 68%|██████▊   | 25986/37963 [111:21:17<47:24:04, 14.25s/it]
 68%|██████▊   | 25987/37963 [111:21:31<47:25:43, 14.26s/it]
 68%|██████▊   | 25988/37963 [111:21:45<47:31:47, 14.29s/it]
 68%|██████▊   | 25989/37963 [111:22:00<47:40:09, 14.33s/it]
 68%|██████▊   | 25990/37963 [111:22:21<54:11:56, 16.30s/it]
                                                            
{'loss': '0.1186', 'grad_norm': '3.761', 'learning_rate': '4.78e-06', 'epoch': '0.6846'}

 68%|██████▊   | 25990/37963 [111:22:21<54:11:56, 16.30s/it]
 68%|██████▊   | 25991/37963 [111:22:35<52:15:43, 15.72s/it]
 68%|██████▊   | 25992/37963 [111:22:49<50:47:12, 15.27s/it]
 68%|██████▊   | 25993/37963 [111:23:03<49:37:13, 14.92s/it]
 68%|██████▊   | 25994/37963 [111:23:18<49:02:36, 14.75s/it]
 68%|██████▊   | 25995/37963 [111:23:32<48:38:05, 14.63s/it]
 68%|██████▊   | 25996/37963 [111:23:53<55:02:08, 16.56s/it]
 68%|██████▊   | 25997/37963 [111:24:13<58:38:37, 17.64s/it]
 68%|██████▊   | 25998/37963 [111:24:34<62:07:42, 18.69s/it]
 68%|██████▊   | 25999/37963 [111:24:49<57:48:37, 17.40s/it]
 68%|██████▊   | 26000/37963 [111:25:03<54:52:46, 16.51s/it]
                                                            
{'loss': '0.1129', 'grad_norm': '2.61', 'learning_rate': '4.772e-06', 'epoch': '0.6849'}

 68%|██████▊   | 26000/37963 [111:25:03<54:52:46, 16.51s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.18s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.19s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 68%|██████▊   | 26001/37963 [111:26:47<142:14:59, 42.81s/it]
 68%|██████▊   | 26002/37963 [111:27:02<114:03:38, 34.33s/it]
 68%|██████▊   | 26003/37963 [111:27:17<94:15:20, 28.37s/it] 
 68%|██████▊   | 26004/37963 [111:27:31<80:16:25, 24.16s/it]
 69%|██████▊   | 26005/37963 [111:27:45<70:31:01, 21.23s/it]
 69%|██████▊   | 26006/37963 [111:28:06<69:37:23, 20.96s/it]
 69%|██████▊   | 26007/37963 [111:28:20<62:44:49, 18.89s/it]
 69%|██████▊   | 26008/37963 [111:28:41<65:07:09, 19.61s/it]
 69%|██████▊   | 26009/37963 [111:28:55<59:50:14, 18.02s/it]
 69%|██████▊   | 26010/37963 [111:29:09<55:34:17, 16.74s/it]
                                                            
{'loss': '0.1069', 'grad_norm': '3.206', 'learning_rate': '4.765e-06', 'epoch': '0.6851'}

 69%|██████▊   | 26010/37963 [111:29:09<55:34:17, 16.74s/it]
 69%|██████▊   | 26011/37963 [111:29:23<52:58:33, 15.96s/it]
 69%|██████▊   | 26012/37963 [111:29:37<51:22:10, 15.47s/it]
 69%|██████▊   | 26013/37963 [111:29:52<50:13:22, 15.13s/it]
 69%|██████▊   | 26014/37963 [111:30:06<49:29:27, 14.91s/it]
 69%|██████▊   | 26015/37963 [111:30:20<48:12:31, 14.53s/it]
 69%|██████▊   | 26016/37963 [111:30:34<48:05:43, 14.49s/it]
 69%|██████▊   | 26017/37963 [111:30:48<47:27:57, 14.30s/it]
 69%|██████▊   | 26018/37963 [111:31:09<53:59:33, 16.27s/it]
 69%|██████▊   | 26019/37963 [111:31:29<57:49:47, 17.43s/it]
 69%|██████▊   | 26020/37963 [111:31:43<54:44:51, 16.50s/it]
                                                            
{'loss': '0.1098', 'grad_norm': '1.832', 'learning_rate': '4.758e-06', 'epoch': '0.6854'}

 69%|██████▊   | 26020/37963 [111:31:43<54:44:51, 16.50s/it]
 69%|██████▊   | 26021/37963 [111:31:58<52:38:00, 15.87s/it]
 69%|██████▊   | 26022/37963 [111:32:12<51:14:33, 15.45s/it]
 69%|██████▊   | 26023/37963 [111:32:26<49:59:10, 15.07s/it]
 69%|██████▊   | 26024/37963 [111:32:41<49:13:00, 14.84s/it]
 69%|██████▊   | 26025/37963 [111:32:55<48:46:07, 14.71s/it]
 69%|██████▊   | 26026/37963 [111:33:10<48:38:44, 14.67s/it]
 69%|██████▊   | 26027/37963 [111:33:24<48:21:24, 14.58s/it]
 69%|██████▊   | 26028/37963 [111:33:39<48:09:28, 14.53s/it]
 69%|██████▊   | 26029/37963 [111:33:53<47:41:45, 14.39s/it]
 69%|██████▊   | 26030/37963 [111:34:07<47:46:06, 14.41s/it]
                                                            
{'loss': '0.1079', 'grad_norm': '4.683', 'learning_rate': '4.75e-06', 'epoch': '0.6857'}

 69%|██████▊   | 26030/37963 [111:34:07<47:46:06, 14.41s/it]
 69%|██████▊   | 26031/37963 [111:34:21<47:28:00, 14.32s/it]
 69%|██████▊   | 26032/37963 [111:34:36<47:34:49, 14.36s/it]
 69%|██████▊   | 26033/37963 [111:34:50<47:39:29, 14.38s/it]
 69%|██████▊   | 26034/37963 [111:35:04<47:38:32, 14.38s/it]
 69%|██████▊   | 26035/37963 [111:35:19<47:38:24, 14.38s/it]
 69%|██████▊   | 26036/37963 [111:35:33<47:37:08, 14.37s/it]
 69%|██████▊   | 26037/37963 [111:35:48<47:37:20, 14.38s/it]
 69%|██████▊   | 26038/37963 [111:36:08<53:58:53, 16.30s/it]
 69%|██████▊   | 26039/37963 [111:36:23<52:04:48, 15.72s/it]
 69%|██████▊   | 26040/37963 [111:36:37<50:31:19, 15.25s/it]
                                                            
{'loss': '0.1347', 'grad_norm': '6.52', 'learning_rate': '4.743e-06', 'epoch': '0.6859'}

 69%|██████▊   | 26040/37963 [111:36:37<50:31:19, 15.25s/it]
 69%|██████▊   | 26041/37963 [111:36:51<49:45:09, 15.02s/it]
 69%|██████▊   | 26042/37963 [111:37:06<49:10:01, 14.85s/it]
 69%|██████▊   | 26043/37963 [111:37:27<55:11:24, 16.67s/it]
 69%|██████▊   | 26044/37963 [111:37:41<52:57:19, 15.99s/it]
 69%|██████▊   | 26045/37963 [111:38:02<57:35:29, 17.40s/it]
 69%|██████▊   | 26046/37963 [111:38:23<61:01:11, 18.43s/it]
 69%|██████▊   | 26047/37963 [111:38:37<56:58:36, 17.21s/it]
 69%|██████▊   | 26048/37963 [111:38:51<54:06:01, 16.35s/it]
 69%|██████▊   | 26049/37963 [111:39:06<52:08:44, 15.76s/it]
 69%|██████▊   | 26050/37963 [111:39:20<50:17:15, 15.20s/it]
                                                            
{'loss': '0.1071', 'grad_norm': '1.667', 'learning_rate': '4.736e-06', 'epoch': '0.6862'}

 69%|██████▊   | 26050/37963 [111:39:20<50:17:15, 15.20s/it]
 69%|██████▊   | 26051/37963 [111:39:34<49:32:30, 14.97s/it]
 69%|██████▊   | 26052/37963 [111:39:48<48:59:34, 14.81s/it]
 69%|██████▊   | 26053/37963 [111:40:03<48:33:44, 14.68s/it]
 69%|██████▊   | 26054/37963 [111:40:17<48:19:16, 14.61s/it]
 69%|██████▊   | 26055/37963 [111:40:32<48:05:43, 14.54s/it]
 69%|██████▊   | 26056/37963 [111:40:46<47:33:07, 14.38s/it]
 69%|██████▊   | 26057/37963 [111:41:06<53:37:02, 16.21s/it]
 69%|██████▊   | 26058/37963 [111:41:27<58:31:15, 17.70s/it]
 69%|██████▊   | 26059/37963 [111:41:42<55:16:36, 16.72s/it]
 69%|██████▊   | 26060/37963 [111:41:56<52:47:11, 15.97s/it]
                                                            
{'loss': '0.1151', 'grad_norm': '2.286', 'learning_rate': '4.729e-06', 'epoch': '0.6865'}

 69%|██████▊   | 26060/37963 [111:41:56<52:47:11, 15.97s/it]
 69%|██████▊   | 26061/37963 [111:42:10<50:44:32, 15.35s/it]
 69%|██████▊   | 26062/37963 [111:42:24<49:05:16, 14.85s/it]
 69%|██████▊   | 26063/37963 [111:42:38<48:28:27, 14.66s/it]
 69%|██████▊   | 26064/37963 [111:42:52<48:19:42, 14.62s/it]
 69%|██████▊   | 26065/37963 [111:43:07<47:54:53, 14.50s/it]
 69%|██████▊   | 26066/37963 [111:43:21<47:45:52, 14.45s/it]
 69%|██████▊   | 26067/37963 [111:43:35<47:29:11, 14.37s/it]
 69%|██████▊   | 26068/37963 [111:44:02<60:09:19, 18.21s/it]
 69%|██████▊   | 26069/37963 [111:44:17<56:19:24, 17.05s/it]
 69%|██████▊   | 26070/37963 [111:44:31<53:41:40, 16.25s/it]
                                                            
{'loss': '0.1144', 'grad_norm': '1.868', 'learning_rate': '4.721e-06', 'epoch': '0.6867'}

 69%|██████▊   | 26070/37963 [111:44:31<53:41:40, 16.25s/it]
 69%|██████▊   | 26071/37963 [111:44:45<51:49:25, 15.69s/it]
 69%|██████▊   | 26072/37963 [111:45:00<50:36:20, 15.32s/it]
 69%|██████▊   | 26073/37963 [111:45:14<49:41:11, 15.04s/it]
 69%|██████▊   | 26074/37963 [111:45:29<49:09:45, 14.89s/it]
 69%|██████▊   | 26075/37963 [111:45:43<48:41:36, 14.75s/it]
 69%|██████▊   | 26076/37963 [111:45:57<48:15:32, 14.62s/it]
 69%|██████▊   | 26077/37963 [111:46:12<48:03:23, 14.56s/it]
 69%|██████▊   | 26078/37963 [111:46:26<47:55:39, 14.52s/it]
 69%|██████▊   | 26079/37963 [111:46:41<47:48:03, 14.48s/it]
 69%|██████▊   | 26080/37963 [111:46:55<47:39:14, 14.44s/it]
                                                            
{'loss': '0.1116', 'grad_norm': '1.747', 'learning_rate': '4.714e-06', 'epoch': '0.687'}

 69%|██████▊   | 26080/37963 [111:46:55<47:39:14, 14.44s/it]
 69%|██████▊   | 26081/37963 [111:47:09<46:54:52, 14.21s/it]
 69%|██████▊   | 26082/37963 [111:47:23<47:04:34, 14.26s/it]
 69%|██████▊   | 26083/37963 [111:47:38<47:21:10, 14.35s/it]
 69%|██████▊   | 26084/37963 [111:47:52<47:33:46, 14.41s/it]
 69%|██████▊   | 26085/37963 [111:48:12<53:17:09, 16.15s/it]
 69%|██████▊   | 26086/37963 [111:48:27<51:32:34, 15.62s/it]
 69%|██████▊   | 26087/37963 [111:48:41<50:21:31, 15.27s/it]
 69%|██████▊   | 26088/37963 [111:48:56<49:26:54, 14.99s/it]
 69%|██████▊   | 26089/37963 [111:49:10<48:47:04, 14.79s/it]
 69%|██████▊   | 26090/37963 [111:49:24<48:11:38, 14.61s/it]
                                                            
{'loss': '0.1106', 'grad_norm': '1.851', 'learning_rate': '4.707e-06', 'epoch': '0.6873'}

 69%|██████▊   | 26090/37963 [111:49:24<48:11:38, 14.61s/it]
 69%|██████▊   | 26091/37963 [111:49:39<47:59:59, 14.56s/it]
 69%|██████▊   | 26092/37963 [111:49:59<54:14:59, 16.45s/it]
 69%|██████▊   | 26093/37963 [111:50:20<58:11:21, 17.65s/it]
 69%|██████▊   | 26094/37963 [111:50:34<55:02:00, 16.69s/it]
 69%|██████▊   | 26095/37963 [111:50:56<59:34:41, 18.07s/it]
 69%|██████▊   | 26096/37963 [111:51:10<55:59:33, 16.99s/it]
 69%|██████▊   | 26097/37963 [111:51:24<53:25:30, 16.21s/it]
 69%|██████▊   | 26098/37963 [111:51:39<51:39:15, 15.67s/it]
 69%|██████▊   | 26099/37963 [111:51:53<50:23:07, 15.29s/it]
 69%|██████▉   | 26100/37963 [111:52:08<49:34:32, 15.04s/it]
                                                            
{'loss': '0.1034', 'grad_norm': '2.718', 'learning_rate': '4.7e-06', 'epoch': '0.6875'}

 69%|██████▉   | 26100/37963 [111:52:08<49:34:32, 15.04s/it]
 69%|██████▉   | 26101/37963 [111:52:22<49:06:54, 14.91s/it]
 69%|██████▉   | 26102/37963 [111:52:36<47:45:34, 14.50s/it]
 69%|██████▉   | 26103/37963 [111:52:50<47:42:54, 14.48s/it]
 69%|██████▉   | 26104/37963 [111:53:04<47:07:32, 14.31s/it]
 69%|██████▉   | 26105/37963 [111:53:19<47:07:45, 14.31s/it]
 69%|██████▉   | 26106/37963 [111:53:39<53:22:43, 16.21s/it]
 69%|██████▉   | 26107/37963 [111:54:01<58:49:36, 17.86s/it]
 69%|██████▉   | 26108/37963 [111:54:15<55:01:32, 16.71s/it]
 69%|██████▉   | 26109/37963 [111:54:29<52:45:03, 16.02s/it]
 69%|██████▉   | 26110/37963 [111:54:44<51:08:46, 15.53s/it]
                                                            
{'loss': '0.1073', 'grad_norm': '1.376', 'learning_rate': '4.692e-06', 'epoch': '0.6878'}

 69%|██████▉   | 26110/37963 [111:54:44<51:08:46, 15.53s/it]
 69%|██████▉   | 26111/37963 [111:54:57<49:21:47, 14.99s/it]
 69%|██████▉   | 26112/37963 [111:55:12<48:49:36, 14.83s/it]
 69%|██████▉   | 26113/37963 [111:55:26<48:21:37, 14.69s/it]
 69%|██████▉   | 26114/37963 [111:55:41<48:06:02, 14.61s/it]
 69%|██████▉   | 26115/37963 [111:55:55<47:56:55, 14.57s/it]
 69%|██████▉   | 26116/37963 [111:56:16<54:21:25, 16.52s/it]
 69%|██████▉   | 26117/37963 [111:56:37<58:31:54, 17.79s/it]
 69%|██████▉   | 26118/37963 [111:56:51<55:07:06, 16.75s/it]
 69%|██████▉   | 26119/37963 [111:57:06<52:44:49, 16.03s/it]
 69%|██████▉   | 26120/37963 [111:57:20<51:16:43, 15.59s/it]
                                                            
{'loss': '0.1213', 'grad_norm': '2.942', 'learning_rate': '4.685e-06', 'epoch': '0.688'}

 69%|██████▉   | 26120/37963 [111:57:20<51:16:43, 15.59s/it]
 69%|██████▉   | 26121/37963 [111:57:35<50:05:48, 15.23s/it]
 69%|██████▉   | 26122/37963 [111:57:49<49:14:25, 14.97s/it]
 69%|██████▉   | 26123/37963 [111:58:03<48:47:20, 14.83s/it]
 69%|██████▉   | 26124/37963 [111:58:18<48:20:45, 14.70s/it]
 69%|██████▉   | 26125/37963 [111:58:32<48:03:39, 14.62s/it]
 69%|██████▉   | 26126/37963 [111:58:47<48:00:30, 14.60s/it]
 69%|██████▉   | 26127/37963 [111:59:01<47:48:18, 14.54s/it]
 69%|██████▉   | 26128/37963 [111:59:16<47:40:23, 14.50s/it]
 69%|██████▉   | 26129/37963 [111:59:30<47:35:35, 14.48s/it]
 69%|██████▉   | 26130/37963 [111:59:45<47:32:02, 14.46s/it]
                                                            
{'loss': '0.1089', 'grad_norm': '1.727', 'learning_rate': '4.678e-06', 'epoch': '0.6883'}

 69%|██████▉   | 26130/37963 [111:59:45<47:32:02, 14.46s/it]
 69%|██████▉   | 26131/37963 [111:59:59<47:15:51, 14.38s/it]
 69%|██████▉   | 26132/37963 [112:00:13<47:23:58, 14.42s/it]
 69%|██████▉   | 26133/37963 [112:00:28<47:21:24, 14.41s/it]
 69%|██████▉   | 26134/37963 [112:00:42<47:04:57, 14.33s/it]
 69%|██████▉   | 26135/37963 [112:00:56<47:04:33, 14.33s/it]
 69%|██████▉   | 26136/37963 [112:01:17<53:11:33, 16.19s/it]
 69%|██████▉   | 26137/37963 [112:01:31<51:28:33, 15.67s/it]
 69%|██████▉   | 26138/37963 [112:01:45<50:08:31, 15.27s/it]
 69%|██████▉   | 26139/37963 [112:02:00<49:16:35, 15.00s/it]
 69%|██████▉   | 26140/37963 [112:02:21<55:41:25, 16.96s/it]
                                                            
{'loss': '0.1109', 'grad_norm': '1.603', 'learning_rate': '4.671e-06', 'epoch': '0.6886'}

 69%|██████▉   | 26140/37963 [112:02:21<55:41:25, 16.96s/it]
 69%|██████▉   | 26141/37963 [112:02:36<53:03:00, 16.15s/it]
 69%|██████▉   | 26142/37963 [112:02:50<51:24:03, 15.65s/it]
 69%|██████▉   | 26143/37963 [112:03:10<55:51:04, 17.01s/it]
 69%|██████▉   | 26144/37963 [112:03:31<59:46:47, 18.21s/it]
 69%|██████▉   | 26145/37963 [112:03:46<55:58:03, 17.05s/it]
 69%|██████▉   | 26146/37963 [112:04:00<53:16:32, 16.23s/it]
 69%|██████▉   | 26147/37963 [112:04:14<51:26:19, 15.67s/it]
 69%|██████▉   | 26148/37963 [112:04:29<50:14:17, 15.31s/it]
 69%|██████▉   | 26149/37963 [112:04:43<49:04:12, 14.95s/it]
 69%|██████▉   | 26150/37963 [112:04:57<48:28:23, 14.77s/it]
                                                            
{'loss': '0.107', 'grad_norm': '5.13', 'learning_rate': '4.664e-06', 'epoch': '0.6888'}

 69%|██████▉   | 26150/37963 [112:04:57<48:28:23, 14.77s/it]
 69%|██████▉   | 26151/37963 [112:05:12<48:09:12, 14.68s/it]
 69%|██████▉   | 26152/37963 [112:05:25<47:04:35, 14.35s/it]
 69%|██████▉   | 26153/37963 [112:05:40<47:09:16, 14.37s/it]
 69%|██████▉   | 26154/37963 [112:05:54<47:16:10, 14.41s/it]
 69%|██████▉   | 26155/37963 [112:06:15<53:35:26, 16.34s/it]
 69%|██████▉   | 26156/37963 [112:06:36<58:24:42, 17.81s/it]
 69%|██████▉   | 26157/37963 [112:06:51<55:05:27, 16.80s/it]
 69%|██████▉   | 26158/37963 [112:07:05<52:42:41, 16.07s/it]
 69%|██████▉   | 26159/37963 [112:07:20<51:12:42, 15.62s/it]
 69%|██████▉   | 26160/37963 [112:07:34<49:59:33, 15.25s/it]
                                                            
{'loss': '0.09502', 'grad_norm': '3.708', 'learning_rate': '4.656e-06', 'epoch': '0.6891'}

 69%|██████▉   | 26160/37963 [112:07:34<49:59:33, 15.25s/it]
 69%|██████▉   | 26161/37963 [112:07:48<48:50:08, 14.90s/it]
 69%|██████▉   | 26162/37963 [112:08:02<48:16:23, 14.73s/it]
 69%|██████▉   | 26163/37963 [112:08:17<47:57:36, 14.63s/it]
 69%|██████▉   | 26164/37963 [112:08:38<53:56:56, 16.46s/it]
 69%|██████▉   | 26165/37963 [112:08:52<51:54:08, 15.84s/it]
 69%|██████▉   | 26166/37963 [112:09:06<50:34:59, 15.44s/it]
 69%|██████▉   | 26167/37963 [112:09:27<55:47:09, 17.03s/it]
 69%|██████▉   | 26168/37963 [112:09:42<53:09:35, 16.23s/it]
 69%|██████▉   | 26169/37963 [112:09:56<51:26:07, 15.70s/it]
 69%|██████▉   | 26170/37963 [112:10:10<50:12:33, 15.33s/it]
                                                            
{'loss': '0.1228', 'grad_norm': '2.608', 'learning_rate': '4.649e-06', 'epoch': '0.6894'}

 69%|██████▉   | 26170/37963 [112:10:10<50:12:33, 15.33s/it]
 69%|██████▉   | 26171/37963 [112:10:25<49:16:21, 15.04s/it]
 69%|██████▉   | 26172/37963 [112:10:39<48:40:03, 14.86s/it]
 69%|██████▉   | 26173/37963 [112:10:54<48:12:36, 14.72s/it]
 69%|██████▉   | 26174/37963 [112:11:08<47:40:37, 14.56s/it]
 69%|██████▉   | 26175/37963 [112:11:22<47:07:22, 14.39s/it]
 69%|██████▉   | 26176/37963 [112:11:36<46:51:48, 14.31s/it]
 69%|██████▉   | 26177/37963 [112:11:50<46:26:13, 14.18s/it]
 69%|██████▉   | 26178/37963 [112:12:04<46:36:52, 14.24s/it]
 69%|██████▉   | 26179/37963 [112:12:19<46:52:31, 14.32s/it]
 69%|██████▉   | 26180/37963 [112:12:33<47:02:01, 14.37s/it]
                                                            
{'loss': '0.1072', 'grad_norm': '2.624', 'learning_rate': '4.642e-06', 'epoch': '0.6896'}

 69%|██████▉   | 26180/37963 [112:12:33<47:02:01, 14.37s/it]
 69%|██████▉   | 26181/37963 [112:12:47<46:32:41, 14.22s/it]
 69%|██████▉   | 26182/37963 [112:13:02<46:55:33, 14.34s/it]
 69%|██████▉   | 26183/37963 [112:13:16<46:51:04, 14.32s/it]
 69%|██████▉   | 26184/37963 [112:13:37<53:10:05, 16.25s/it]
 69%|██████▉   | 26185/37963 [112:13:51<51:17:54, 15.68s/it]
 69%|██████▉   | 26186/37963 [112:14:05<50:00:45, 15.29s/it]
 69%|██████▉   | 26187/37963 [112:14:20<49:08:41, 15.02s/it]
 69%|██████▉   | 26188/37963 [112:14:40<54:38:23, 16.71s/it]
 69%|██████▉   | 26189/37963 [112:14:55<52:22:04, 16.01s/it]
 69%|██████▉   | 26190/37963 [112:15:09<50:50:45, 15.55s/it]
                                                            
{'loss': '0.1043', 'grad_norm': '2.362', 'learning_rate': '4.635e-06', 'epoch': '0.6899'}

 69%|██████▉   | 26190/37963 [112:15:09<50:50:45, 15.55s/it]
 69%|██████▉   | 26191/37963 [112:15:30<55:57:47, 17.11s/it]
 69%|██████▉   | 26192/37963 [112:15:51<59:28:00, 18.19s/it]
 69%|██████▉   | 26193/37963 [112:16:05<55:35:23, 17.00s/it]
 69%|██████▉   | 26194/37963 [112:16:19<52:49:17, 16.16s/it]
 69%|██████▉   | 26195/37963 [112:16:34<51:06:30, 15.63s/it]
 69%|██████▉   | 26196/37963 [112:16:48<49:36:34, 15.18s/it]
 69%|██████▉   | 26197/37963 [112:17:02<48:54:37, 14.96s/it]
 69%|██████▉   | 26198/37963 [112:17:16<48:10:20, 14.74s/it]
 69%|██████▉   | 26199/37963 [112:17:31<47:42:52, 14.60s/it]
 69%|██████▉   | 26200/37963 [112:17:45<47:35:22, 14.56s/it]
                                                            
{'loss': '0.1076', 'grad_norm': '2.671', 'learning_rate': '4.628e-06', 'epoch': '0.6901'}

 69%|██████▉   | 26200/37963 [112:17:45<47:35:22, 14.56s/it]
 69%|██████▉   | 26201/37963 [112:18:00<47:29:58, 14.54s/it]
 69%|██████▉   | 26202/37963 [112:18:14<47:12:01, 14.45s/it]
 69%|██████▉   | 26203/37963 [112:18:35<53:16:25, 16.31s/it]
 69%|██████▉   | 26204/37963 [112:18:49<51:07:56, 15.65s/it]
 69%|██████▉   | 26205/37963 [112:19:10<56:48:29, 17.39s/it]
 69%|██████▉   | 26206/37963 [112:19:24<53:41:02, 16.44s/it]
 69%|██████▉   | 26207/37963 [112:19:38<51:17:56, 15.71s/it]
 69%|██████▉   | 26208/37963 [112:19:52<49:44:51, 15.24s/it]
 69%|██████▉   | 26209/37963 [112:20:07<48:47:50, 14.95s/it]
 69%|██████▉   | 26210/37963 [112:20:21<48:20:09, 14.81s/it]
                                                            
{'loss': '0.1008', 'grad_norm': '2.287', 'learning_rate': '4.62e-06', 'epoch': '0.6904'}

 69%|██████▉   | 26210/37963 [112:20:21<48:20:09, 14.81s/it]
 69%|██████▉   | 26211/37963 [112:20:36<47:55:31, 14.68s/it]
 69%|██████▉   | 26212/37963 [112:20:50<47:09:06, 14.45s/it]
 69%|██████▉   | 26213/37963 [112:21:10<52:48:18, 16.18s/it]
 69%|██████▉   | 26214/37963 [112:21:31<57:31:07, 17.62s/it]
 69%|██████▉   | 26215/37963 [112:21:45<54:23:17, 16.67s/it]
 69%|██████▉   | 26216/37963 [112:22:00<52:06:56, 15.97s/it]
 69%|██████▉   | 26217/37963 [112:22:14<50:41:35, 15.54s/it]
 69%|██████▉   | 26218/37963 [112:22:28<49:35:26, 15.20s/it]
 69%|██████▉   | 26219/37963 [112:22:43<48:35:12, 14.89s/it]
 69%|██████▉   | 26220/37963 [112:22:57<48:04:23, 14.74s/it]
                                                            
{'loss': '0.09719', 'grad_norm': '1.862', 'learning_rate': '4.613e-06', 'epoch': '0.6907'}

 69%|██████▉   | 26220/37963 [112:22:57<48:04:23, 14.74s/it]
 69%|██████▉   | 26221/37963 [112:23:11<47:31:27, 14.57s/it]
 69%|██████▉   | 26222/37963 [112:23:26<47:24:52, 14.54s/it]
 69%|██████▉   | 26223/37963 [112:23:40<47:25:56, 14.54s/it]
 69%|██████▉   | 26224/37963 [112:23:55<47:17:40, 14.50s/it]
 69%|██████▉   | 26225/37963 [112:24:09<47:13:54, 14.49s/it]
 69%|██████▉   | 26226/37963 [112:24:23<47:01:47, 14.43s/it]
 69%|██████▉   | 26227/37963 [112:24:37<46:40:58, 14.32s/it]
 69%|██████▉   | 26228/37963 [112:24:52<46:45:24, 14.34s/it]
 69%|██████▉   | 26229/37963 [112:25:06<46:48:26, 14.36s/it]
 69%|██████▉   | 26230/37963 [112:25:21<46:48:00, 14.36s/it]
                                                            
{'loss': '0.1152', 'grad_norm': '1.628', 'learning_rate': '4.606e-06', 'epoch': '0.6909'}

 69%|██████▉   | 26230/37963 [112:25:21<46:48:00, 14.36s/it]
 69%|██████▉   | 26231/37963 [112:25:35<46:49:27, 14.37s/it]
 69%|██████▉   | 26232/37963 [112:25:49<46:50:36, 14.38s/it]
 69%|██████▉   | 26233/37963 [112:26:03<46:33:36, 14.29s/it]
 69%|██████▉   | 26234/37963 [112:26:24<52:55:56, 16.25s/it]
 69%|██████▉   | 26235/37963 [112:26:39<51:06:57, 15.69s/it]
 69%|██████▉   | 26236/37963 [112:26:59<56:00:24, 17.19s/it]
 69%|██████▉   | 26237/37963 [112:27:14<53:02:06, 16.28s/it]
 69%|██████▉   | 26238/37963 [112:27:28<51:09:56, 15.71s/it]
 69%|██████▉   | 26239/37963 [112:27:48<55:54:16, 17.17s/it]
 69%|██████▉   | 26240/37963 [112:28:10<59:45:59, 18.35s/it]
                                                            
{'loss': '0.1037', 'grad_norm': '3.003', 'learning_rate': '4.599e-06', 'epoch': '0.6912'}

 69%|██████▉   | 26240/37963 [112:28:10<59:45:59, 18.35s/it]
 69%|██████▉   | 26241/37963 [112:28:24<55:55:27, 17.18s/it]
 69%|██████▉   | 26242/37963 [112:28:38<53:11:39, 16.34s/it]
 69%|██████▉   | 26243/37963 [112:28:53<51:15:01, 15.74s/it]
 69%|██████▉   | 26244/37963 [112:29:07<49:33:53, 15.23s/it]
 69%|██████▉   | 26245/37963 [112:29:21<48:47:47, 14.99s/it]
 69%|██████▉   | 26246/37963 [112:29:36<48:18:07, 14.84s/it]
 69%|██████▉   | 26247/37963 [112:29:50<47:30:14, 14.60s/it]
 69%|██████▉   | 26248/37963 [112:30:04<47:12:59, 14.51s/it]
 69%|██████▉   | 26249/37963 [112:30:18<47:05:34, 14.47s/it]
 69%|██████▉   | 26250/37963 [112:30:33<46:54:11, 14.42s/it]
                                                            
{'loss': '0.09567', 'grad_norm': '1.688', 'learning_rate': '4.592e-06', 'epoch': '0.6915'}

 69%|██████▉   | 26250/37963 [112:30:33<46:54:11, 14.42s/it]
 69%|██████▉   | 26251/37963 [112:30:47<46:52:33, 14.41s/it]
 69%|██████▉   | 26252/37963 [112:31:01<46:49:00, 14.39s/it]
 69%|██████▉   | 26253/37963 [112:31:29<59:39:44, 18.34s/it]
 69%|██████▉   | 26254/37963 [112:31:43<55:50:27, 17.17s/it]
 69%|██████▉   | 26255/37963 [112:31:58<53:05:33, 16.33s/it]
 69%|██████▉   | 26256/37963 [112:32:12<51:12:08, 15.75s/it]
 69%|██████▉   | 26257/37963 [112:32:26<49:46:40, 15.31s/it]
 69%|██████▉   | 26258/37963 [112:32:41<48:50:50, 15.02s/it]
 69%|██████▉   | 26259/37963 [112:32:55<48:13:41, 14.83s/it]
 69%|██████▉   | 26260/37963 [112:33:10<47:50:54, 14.72s/it]
                                                            
{'loss': '0.1157', 'grad_norm': '1.674', 'learning_rate': '4.584e-06', 'epoch': '0.6917'}

 69%|██████▉   | 26260/37963 [112:33:10<47:50:54, 14.72s/it]
 69%|██████▉   | 26261/37963 [112:33:30<53:43:22, 16.53s/it]
 69%|██████▉   | 26262/37963 [112:33:45<51:38:33, 15.89s/it]
 69%|██████▉   | 26263/37963 [112:33:59<49:58:47, 15.38s/it]
 69%|██████▉   | 26264/37963 [112:34:20<54:58:39, 16.92s/it]
 69%|██████▉   | 26265/37963 [112:34:34<52:37:20, 16.19s/it]
 69%|██████▉   | 26266/37963 [112:34:48<50:52:18, 15.66s/it]
 69%|██████▉   | 26267/37963 [112:35:03<49:54:39, 15.36s/it]
 69%|██████▉   | 26268/37963 [112:35:17<48:56:08, 15.06s/it]
 69%|██████▉   | 26269/37963 [112:35:32<48:16:30, 14.86s/it]
 69%|██████▉   | 26270/37963 [112:35:46<47:49:28, 14.72s/it]
                                                            
{'loss': '0.109', 'grad_norm': '2.86', 'learning_rate': '4.577e-06', 'epoch': '0.692'}

 69%|██████▉   | 26270/37963 [112:35:46<47:49:28, 14.72s/it]
 69%|██████▉   | 26271/37963 [112:36:01<47:24:23, 14.60s/it]
 69%|██████▉   | 26272/37963 [112:36:15<46:47:00, 14.41s/it]
 69%|██████▉   | 26273/37963 [112:36:29<46:46:22, 14.40s/it]
 69%|██████▉   | 26274/37963 [112:36:43<46:30:28, 14.32s/it]
 69%|██████▉   | 26275/37963 [112:36:57<45:54:26, 14.14s/it]
 69%|██████▉   | 26276/37963 [112:37:10<45:20:01, 13.96s/it]
 69%|██████▉   | 26277/37963 [112:37:25<45:42:07, 14.08s/it]
 69%|██████▉   | 26278/37963 [112:37:39<45:57:52, 14.16s/it]
 69%|██████▉   | 26279/37963 [112:37:53<46:07:38, 14.21s/it]
 69%|██████▉   | 26280/37963 [112:38:08<46:22:19, 14.29s/it]
                                                            
{'loss': '0.1139', 'grad_norm': '2.069', 'learning_rate': '4.57e-06', 'epoch': '0.6923'}

 69%|██████▉   | 26280/37963 [112:38:08<46:22:19, 14.29s/it]
 69%|██████▉   | 26281/37963 [112:38:22<46:25:38, 14.31s/it]
 69%|██████▉   | 26282/37963 [112:38:43<52:59:15, 16.33s/it]
 69%|██████▉   | 26283/37963 [112:38:58<51:08:00, 15.76s/it]
 69%|██████▉   | 26284/37963 [112:39:12<49:52:33, 15.37s/it]
 69%|██████▉   | 26285/37963 [112:39:33<55:23:51, 17.08s/it]
 69%|██████▉   | 26286/37963 [112:39:47<52:37:43, 16.23s/it]
 69%|██████▉   | 26287/37963 [112:40:08<56:48:30, 17.52s/it]
 69%|██████▉   | 26288/37963 [112:40:29<60:17:59, 18.59s/it]
 69%|██████▉   | 26289/37963 [112:40:44<56:20:18, 17.37s/it]
 69%|██████▉   | 26290/37963 [112:40:58<53:21:40, 16.46s/it]
                                                            
{'loss': '0.1215', 'grad_norm': '1.867', 'learning_rate': '4.563e-06', 'epoch': '0.6925'}

 69%|██████▉   | 26290/37963 [112:40:58<53:21:40, 16.46s/it]
 69%|██████▉   | 26291/37963 [112:41:12<51:15:42, 15.81s/it]
 69%|██████▉   | 26292/37963 [112:41:27<49:59:27, 15.42s/it]
 69%|██████▉   | 26293/37963 [112:41:41<49:05:05, 15.14s/it]
 69%|██████▉   | 26294/37963 [112:41:56<48:29:17, 14.96s/it]
 69%|██████▉   | 26295/37963 [112:42:10<47:58:31, 14.80s/it]
 69%|██████▉   | 26296/37963 [112:42:25<47:40:10, 14.71s/it]
 69%|██████▉   | 26297/37963 [112:42:39<47:17:25, 14.59s/it]
 69%|██████▉   | 26298/37963 [112:42:53<47:05:10, 14.53s/it]
 69%|██████▉   | 26299/37963 [112:43:08<47:00:57, 14.51s/it]
 69%|██████▉   | 26300/37963 [112:43:22<46:55:26, 14.48s/it]
                                                            
{'loss': '0.1184', 'grad_norm': '3.04', 'learning_rate': '4.556e-06', 'epoch': '0.6928'}

 69%|██████▉   | 26300/37963 [112:43:22<46:55:26, 14.48s/it]
 69%|██████▉   | 26301/37963 [112:43:37<46:48:16, 14.45s/it]
 69%|██████▉   | 26302/37963 [112:44:04<59:29:02, 18.36s/it]
 69%|██████▉   | 26303/37963 [112:44:18<55:35:30, 17.16s/it]
 69%|██████▉   | 26304/37963 [112:44:33<52:52:28, 16.33s/it]
 69%|██████▉   | 26305/37963 [112:44:47<51:01:08, 15.75s/it]
 69%|██████▉   | 26306/37963 [112:45:02<49:45:25, 15.37s/it]
 69%|██████▉   | 26307/37963 [112:45:16<48:55:53, 15.11s/it]
 69%|██████▉   | 26308/37963 [112:45:31<48:16:10, 14.91s/it]
 69%|██████▉   | 26309/37963 [112:45:45<47:50:30, 14.78s/it]
 69%|██████▉   | 26310/37963 [112:46:06<53:51:04, 16.64s/it]
                                                            
{'loss': '0.1056', 'grad_norm': '3.609', 'learning_rate': '4.549e-06', 'epoch': '0.693'}

 69%|██████▉   | 26310/37963 [112:46:06<53:51:04, 16.64s/it]
 69%|██████▉   | 26311/37963 [112:46:21<51:38:22, 15.95s/it]
 69%|██████▉   | 26312/37963 [112:46:35<50:05:52, 15.48s/it]
 69%|██████▉   | 26313/37963 [112:46:56<55:29:14, 17.15s/it]
 69%|██████▉   | 26314/37963 [112:47:10<52:51:11, 16.33s/it]
 69%|██████▉   | 26315/37963 [112:47:25<51:03:16, 15.78s/it]
 69%|██████▉   | 26316/37963 [112:47:39<49:45:33, 15.38s/it]
 69%|██████▉   | 26317/37963 [112:47:53<47:55:38, 14.82s/it]
 69%|██████▉   | 26318/37963 [112:48:07<47:14:36, 14.61s/it]
 69%|██████▉   | 26319/37963 [112:48:20<46:04:54, 14.25s/it]
 69%|██████▉   | 26320/37963 [112:48:34<45:40:58, 14.13s/it]
                                                            
{'loss': '0.1127', 'grad_norm': '1.751', 'learning_rate': '4.541e-06', 'epoch': '0.6933'}

 69%|██████▉   | 26320/37963 [112:48:34<45:40:58, 14.13s/it]
 69%|██████▉   | 26321/37963 [112:48:49<46:00:28, 14.23s/it]
 69%|██████▉   | 26322/37963 [112:49:03<45:59:25, 14.22s/it]
 69%|██████▉   | 26323/37963 [112:49:17<46:07:58, 14.27s/it]
 69%|██████▉   | 26324/37963 [112:49:31<45:51:14, 14.18s/it]
 69%|██████▉   | 26325/37963 [112:49:45<45:53:04, 14.19s/it]
 69%|██████▉   | 26326/37963 [112:50:00<46:03:01, 14.25s/it]
 69%|██████▉   | 26327/37963 [112:50:14<46:11:13, 14.29s/it]
 69%|██████▉   | 26328/37963 [112:50:35<52:32:26, 16.26s/it]
 69%|██████▉   | 26329/37963 [112:50:50<50:54:47, 15.75s/it]
 69%|██████▉   | 26330/37963 [112:51:04<49:38:20, 15.36s/it]
                                                            
{'loss': '0.1053', 'grad_norm': '2.407', 'learning_rate': '4.534e-06', 'epoch': '0.6936'}

 69%|██████▉   | 26330/37963 [112:51:04<49:38:20, 15.36s/it]
 69%|██████▉   | 26331/37963 [112:51:19<48:46:40, 15.10s/it]
 69%|██████▉   | 26332/37963 [112:51:32<47:32:57, 14.72s/it]
 69%|██████▉   | 26333/37963 [112:51:53<53:46:27, 16.65s/it]
 69%|██████▉   | 26334/37963 [112:52:07<50:57:44, 15.78s/it]
 69%|██████▉   | 26335/37963 [112:52:35<62:11:06, 19.25s/it]
 69%|██████▉   | 26336/37963 [112:52:49<57:32:43, 17.82s/it]
 69%|██████▉   | 26337/37963 [112:53:04<54:25:11, 16.85s/it]
 69%|██████▉   | 26338/37963 [112:53:18<51:41:20, 16.01s/it]
 69%|██████▉   | 26339/37963 [112:53:32<50:13:08, 15.55s/it]
 69%|██████▉   | 26340/37963 [112:53:47<49:05:33, 15.21s/it]
                                                            
{'loss': '0.1163', 'grad_norm': '1.84', 'learning_rate': '4.527e-06', 'epoch': '0.6938'}

 69%|██████▉   | 26340/37963 [112:53:47<49:05:33, 15.21s/it]
 69%|██████▉   | 26341/37963 [112:54:01<47:54:37, 14.84s/it]
 69%|██████▉   | 26342/37963 [112:54:15<47:21:34, 14.67s/it]
 69%|██████▉   | 26343/37963 [112:54:29<46:54:58, 14.54s/it]
 69%|██████▉   | 26344/37963 [112:54:44<46:51:05, 14.52s/it]
 69%|██████▉   | 26345/37963 [112:54:58<46:42:57, 14.48s/it]
 69%|██████▉   | 26346/37963 [112:55:12<46:36:55, 14.45s/it]
 69%|██████▉   | 26347/37963 [112:55:27<46:39:22, 14.46s/it]
 69%|██████▉   | 26348/37963 [112:55:41<46:34:42, 14.44s/it]
 69%|██████▉   | 26349/37963 [112:55:56<46:38:52, 14.46s/it]
 69%|██████▉   | 26350/37963 [112:56:10<46:35:30, 14.44s/it]
                                                            
{'loss': '0.1239', 'grad_norm': '3.705', 'learning_rate': '4.52e-06', 'epoch': '0.6941'}

 69%|██████▉   | 26350/37963 [112:56:10<46:35:30, 14.44s/it]
 69%|██████▉   | 26351/37963 [112:56:25<46:33:56, 14.44s/it]
 69%|██████▉   | 26352/37963 [112:56:46<53:40:29, 16.64s/it]
 69%|██████▉   | 26353/37963 [112:57:01<51:28:58, 15.96s/it]
 69%|██████▉   | 26354/37963 [112:57:15<49:50:16, 15.45s/it]
 69%|██████▉   | 26355/37963 [112:57:29<48:50:48, 15.15s/it]
 69%|██████▉   | 26356/37963 [112:57:44<48:05:52, 14.92s/it]
 69%|██████▉   | 26357/37963 [112:57:58<47:36:04, 14.77s/it]
 69%|██████▉   | 26358/37963 [112:58:13<47:15:14, 14.66s/it]
 69%|██████▉   | 26359/37963 [112:58:27<47:03:29, 14.60s/it]
 69%|██████▉   | 26360/37963 [112:58:47<52:14:42, 16.21s/it]
                                                            
{'loss': '0.1039', 'grad_norm': '1.538', 'learning_rate': '4.513e-06', 'epoch': '0.6944'}

 69%|██████▉   | 26360/37963 [112:58:47<52:14:42, 16.21s/it]
 69%|██████▉   | 26361/37963 [112:59:08<56:25:33, 17.51s/it]
 69%|██████▉   | 26362/37963 [112:59:22<53:23:10, 16.57s/it]
 69%|██████▉   | 26363/37963 [112:59:36<50:49:15, 15.77s/it]
 69%|██████▉   | 26364/37963 [112:59:50<49:29:43, 15.36s/it]
 69%|██████▉   | 26365/37963 [113:00:05<48:38:17, 15.10s/it]
 69%|██████▉   | 26366/37963 [113:00:19<47:24:52, 14.72s/it]
 69%|██████▉   | 26367/37963 [113:00:33<47:03:17, 14.61s/it]
 69%|██████▉   | 26368/37963 [113:00:47<46:51:22, 14.55s/it]
 69%|██████▉   | 26369/37963 [113:01:02<46:43:39, 14.51s/it]
 69%|██████▉   | 26370/37963 [113:01:16<46:37:20, 14.48s/it]
                                                            
{'loss': '0.1025', 'grad_norm': '1.495', 'learning_rate': '4.506e-06', 'epoch': '0.6946'}

 69%|██████▉   | 26370/37963 [113:01:16<46:37:20, 14.48s/it]
 69%|██████▉   | 26371/37963 [113:01:31<46:39:17, 14.49s/it]
 69%|██████▉   | 26372/37963 [113:01:45<46:21:59, 14.40s/it]
 69%|██████▉   | 26373/37963 [113:01:59<46:27:33, 14.43s/it]
 69%|██████▉   | 26374/37963 [113:02:13<46:04:46, 14.31s/it]
 69%|██████▉   | 26375/37963 [113:02:27<45:43:37, 14.21s/it]
 69%|██████▉   | 26376/37963 [113:02:42<45:59:54, 14.29s/it]
 69%|██████▉   | 26377/37963 [113:02:56<46:01:43, 14.30s/it]
 69%|██████▉   | 26378/37963 [113:03:17<52:20:57, 16.27s/it]
 69%|██████▉   | 26379/37963 [113:03:30<49:34:35, 15.41s/it]
 69%|██████▉   | 26380/37963 [113:03:45<48:36:08, 15.11s/it]
                                                            
{'loss': '0.1055', 'grad_norm': '2.487', 'learning_rate': '4.499e-06', 'epoch': '0.6949'}

 69%|██████▉   | 26380/37963 [113:03:45<48:36:08, 15.11s/it]
 69%|██████▉   | 26381/37963 [113:03:59<47:52:52, 14.88s/it]
 69%|██████▉   | 26382/37963 [113:04:20<53:38:20, 16.67s/it]
 69%|██████▉   | 26383/37963 [113:04:34<50:59:42, 15.85s/it]
 69%|██████▉   | 26384/37963 [113:04:54<55:24:42, 17.23s/it]
 70%|██████▉   | 26385/37963 [113:05:15<59:07:19, 18.38s/it]
 70%|██████▉   | 26386/37963 [113:05:29<54:42:48, 17.01s/it]
 70%|██████▉   | 26387/37963 [113:05:43<51:32:19, 16.03s/it]
 70%|██████▉   | 26388/37963 [113:05:57<49:57:47, 15.54s/it]
 70%|██████▉   | 26389/37963 [113:06:12<48:51:47, 15.20s/it]
 70%|██████▉   | 26390/37963 [113:06:26<47:44:51, 14.85s/it]
                                                            
{'loss': '0.1026', 'grad_norm': '2.616', 'learning_rate': '4.492e-06', 'epoch': '0.6952'}

 70%|██████▉   | 26390/37963 [113:06:26<47:44:51, 14.85s/it]
 70%|██████▉   | 26391/37963 [113:06:40<47:18:59, 14.72s/it]
 70%|██████▉   | 26392/37963 [113:06:55<47:09:02, 14.67s/it]
 70%|██████▉   | 26393/37963 [113:07:09<46:40:54, 14.53s/it]
 70%|██████▉   | 26394/37963 [113:07:24<46:45:57, 14.55s/it]
 70%|██████▉   | 26395/37963 [113:07:38<46:20:05, 14.42s/it]
 70%|██████▉   | 26396/37963 [113:07:52<46:08:53, 14.36s/it]
 70%|██████▉   | 26397/37963 [113:08:06<46:15:35, 14.40s/it]
 70%|██████▉   | 26398/37963 [113:08:21<46:14:56, 14.40s/it]
 70%|██████▉   | 26399/37963 [113:08:35<46:09:22, 14.37s/it]
 70%|██████▉   | 26400/37963 [113:08:49<46:03:21, 14.34s/it]
                                                            
{'loss': '0.1188', 'grad_norm': '2.215', 'learning_rate': '4.484e-06', 'epoch': '0.6954'}

 70%|██████▉   | 26400/37963 [113:08:49<46:03:21, 14.34s/it]
 70%|██████▉   | 26401/37963 [113:09:11<52:48:24, 16.44s/it]
 70%|██████▉   | 26402/37963 [113:09:26<51:08:27, 15.92s/it]
 70%|██████▉   | 26403/37963 [113:09:40<49:39:55, 15.47s/it]
 70%|██████▉   | 26404/37963 [113:09:54<48:31:58, 15.12s/it]
 70%|██████▉   | 26405/37963 [113:10:09<47:49:36, 14.90s/it]
 70%|██████▉   | 26406/37963 [113:10:23<47:26:06, 14.78s/it]
 70%|██████▉   | 26407/37963 [113:10:38<47:07:57, 14.68s/it]
 70%|██████▉   | 26408/37963 [113:10:59<53:13:50, 16.58s/it]
 70%|██████▉   | 26409/37963 [113:11:13<51:04:26, 15.91s/it]
 70%|██████▉   | 26410/37963 [113:11:34<55:37:19, 17.33s/it]
                                                            
{'loss': '0.1141', 'grad_norm': '2.109', 'learning_rate': '4.477e-06', 'epoch': '0.6957'}

 70%|██████▉   | 26410/37963 [113:11:34<55:37:19, 17.33s/it]
 70%|██████▉   | 26411/37963 [113:11:48<52:57:03, 16.50s/it]
 70%|██████▉   | 26412/37963 [113:12:03<51:00:57, 15.90s/it]
 70%|██████▉   | 26413/37963 [113:12:17<49:48:11, 15.52s/it]
 70%|██████▉   | 26414/37963 [113:12:32<48:42:14, 15.18s/it]
 70%|██████▉   | 26415/37963 [113:12:46<47:58:48, 14.96s/it]
 70%|██████▉   | 26416/37963 [113:13:00<46:58:36, 14.65s/it]
 70%|██████▉   | 26417/37963 [113:13:14<46:47:24, 14.59s/it]
 70%|██████▉   | 26418/37963 [113:13:29<46:15:54, 14.43s/it]
 70%|██████▉   | 26419/37963 [113:13:43<46:18:22, 14.44s/it]
 70%|██████▉   | 26420/37963 [113:13:57<46:19:39, 14.45s/it]
                                                            
{'loss': '0.1102', 'grad_norm': '1.167', 'learning_rate': '4.47e-06', 'epoch': '0.6959'}

 70%|██████▉   | 26420/37963 [113:13:57<46:19:39, 14.45s/it]
 70%|██████▉   | 26421/37963 [113:14:12<46:23:41, 14.47s/it]
 70%|██████▉   | 26422/37963 [113:14:26<46:20:02, 14.45s/it]
 70%|██████▉   | 26423/37963 [113:14:41<46:13:33, 14.42s/it]
 70%|██████▉   | 26424/37963 [113:14:55<45:50:51, 14.30s/it]
 70%|██████▉   | 26425/37963 [113:15:09<46:03:54, 14.37s/it]
 70%|██████▉   | 26426/37963 [113:15:24<46:08:35, 14.40s/it]
 70%|██████▉   | 26427/37963 [113:15:38<45:34:02, 14.22s/it]
 70%|██████▉   | 26428/37963 [113:15:58<51:50:59, 16.18s/it]
 70%|██████▉   | 26429/37963 [113:16:13<50:05:18, 15.63s/it]
 70%|██████▉   | 26430/37963 [113:16:27<48:39:12, 15.19s/it]
                                                            
{'loss': '0.1025', 'grad_norm': '1.757', 'learning_rate': '4.463e-06', 'epoch': '0.6962'}

 70%|██████▉   | 26430/37963 [113:16:27<48:39:12, 15.19s/it]
 70%|██████▉   | 26431/37963 [113:16:48<54:01:01, 16.86s/it]
 70%|██████▉   | 26432/37963 [113:17:02<51:21:35, 16.03s/it]
 70%|██████▉   | 26433/37963 [113:17:23<56:16:08, 17.57s/it]
 70%|██████▉   | 26434/37963 [113:17:37<53:14:22, 16.62s/it]
 70%|██████▉   | 26435/37963 [113:17:58<57:27:23, 17.94s/it]
 70%|██████▉   | 26436/37963 [113:18:13<54:10:51, 16.92s/it]
 70%|██████▉   | 26437/37963 [113:18:27<51:40:50, 16.14s/it]
 70%|██████▉   | 26438/37963 [113:18:42<50:08:54, 15.66s/it]
 70%|██████▉   | 26439/37963 [113:18:56<49:04:26, 15.33s/it]
 70%|██████▉   | 26440/37963 [113:19:11<48:15:28, 15.08s/it]
                                                            
{'loss': '0.1088', 'grad_norm': '2.508', 'learning_rate': '4.456e-06', 'epoch': '0.6965'}

 70%|██████▉   | 26440/37963 [113:19:11<48:15:28, 15.08s/it]
 70%|██████▉   | 26441/37963 [113:19:25<47:34:10, 14.86s/it]
 70%|██████▉   | 26442/37963 [113:19:39<47:04:34, 14.71s/it]
 70%|██████▉   | 26443/37963 [113:19:54<46:34:12, 14.55s/it]
 70%|██████▉   | 26444/37963 [113:20:08<46:22:00, 14.49s/it]
 70%|██████▉   | 26445/37963 [113:20:22<46:14:48, 14.45s/it]
 70%|██████▉   | 26446/37963 [113:20:37<46:12:22, 14.44s/it]
 70%|██████▉   | 26447/37963 [113:20:51<46:11:13, 14.44s/it]
 70%|██████▉   | 26448/37963 [113:21:05<46:02:57, 14.40s/it]
 70%|██████▉   | 26449/37963 [113:21:26<52:11:36, 16.32s/it]
 70%|██████▉   | 26450/37963 [113:21:47<56:48:53, 17.77s/it]
                                                            
{'loss': '0.1028', 'grad_norm': '2.685', 'learning_rate': '4.449e-06', 'epoch': '0.6967'}

 70%|██████▉   | 26450/37963 [113:21:47<56:48:53, 17.77s/it]
 70%|██████▉   | 26451/37963 [113:22:01<52:51:47, 16.53s/it]
 70%|██████▉   | 26452/37963 [113:22:15<50:28:03, 15.78s/it]
 70%|██████▉   | 26453/37963 [113:22:30<49:09:08, 15.37s/it]
 70%|██████▉   | 26454/37963 [113:22:44<48:14:59, 15.09s/it]
 70%|██████▉   | 26455/37963 [113:23:04<53:24:02, 16.71s/it]
 70%|██████▉   | 26456/37963 [113:23:18<50:31:33, 15.81s/it]
 70%|██████▉   | 26457/37963 [113:23:33<49:11:48, 15.39s/it]
 70%|██████▉   | 26458/37963 [113:23:54<54:29:56, 17.05s/it]
 70%|██████▉   | 26459/37963 [113:24:07<51:19:00, 16.06s/it]
 70%|██████▉   | 26460/37963 [113:24:21<49:10:50, 15.39s/it]
                                                            
{'loss': '0.1271', 'grad_norm': '2.741', 'learning_rate': '4.442e-06', 'epoch': '0.697'}

 70%|██████▉   | 26460/37963 [113:24:21<49:10:50, 15.39s/it]
 70%|██████▉   | 26461/37963 [113:24:35<47:42:47, 14.93s/it]
 70%|██████▉   | 26462/37963 [113:24:49<47:14:21, 14.79s/it]
 70%|██████▉   | 26463/37963 [113:25:03<46:12:04, 14.46s/it]
 70%|██████▉   | 26464/37963 [113:25:17<45:46:19, 14.33s/it]
 70%|██████▉   | 26465/37963 [113:25:31<45:43:15, 14.32s/it]
 70%|██████▉   | 26466/37963 [113:25:46<45:41:49, 14.31s/it]
 70%|██████▉   | 26467/37963 [113:26:00<45:46:15, 14.33s/it]
 70%|██████▉   | 26468/37963 [113:26:14<45:48:15, 14.34s/it]
 70%|██████▉   | 26469/37963 [113:26:29<45:30:58, 14.26s/it]
 70%|██████▉   | 26470/37963 [113:26:43<45:36:43, 14.29s/it]
                                                            
{'loss': '0.1083', 'grad_norm': '2.036', 'learning_rate': '4.435e-06', 'epoch': '0.6973'}

 70%|██████▉   | 26470/37963 [113:26:43<45:36:43, 14.29s/it]
 70%|██████▉   | 26471/37963 [113:26:57<45:40:47, 14.31s/it]
 70%|██████▉   | 26472/37963 [113:27:12<45:43:23, 14.32s/it]
 70%|██████▉   | 26473/37963 [113:27:26<45:43:43, 14.33s/it]
 70%|██████▉   | 26474/37963 [113:27:40<45:27:07, 14.24s/it]
 70%|██████▉   | 26475/37963 [113:27:54<45:30:07, 14.26s/it]
 70%|██████▉   | 26476/37963 [113:28:09<45:38:25, 14.30s/it]
 70%|██████▉   | 26477/37963 [113:28:30<52:06:44, 16.33s/it]
 70%|██████▉   | 26478/37963 [113:28:44<50:21:32, 15.79s/it]
 70%|██████▉   | 26479/37963 [113:29:05<55:01:55, 17.25s/it]
 70%|██████▉   | 26480/37963 [113:29:26<58:47:18, 18.43s/it]
                                                            
{'loss': '0.1036', 'grad_norm': '2.607', 'learning_rate': '4.428e-06', 'epoch': '0.6975'}

 70%|██████▉   | 26480/37963 [113:29:26<58:47:18, 18.43s/it]
 70%|██████▉   | 26481/37963 [113:29:41<54:58:52, 17.24s/it]
 70%|██████▉   | 26482/37963 [113:29:55<52:21:55, 16.42s/it]
 70%|██████▉   | 26483/37963 [113:30:10<50:36:35, 15.87s/it]
 70%|██████▉   | 26484/37963 [113:30:31<55:42:00, 17.47s/it]
 70%|██████▉   | 26485/37963 [113:30:45<52:17:11, 16.40s/it]
 70%|██████▉   | 26486/37963 [113:30:59<50:07:04, 15.72s/it]
 70%|██████▉   | 26487/37963 [113:31:13<48:57:02, 15.36s/it]
 70%|██████▉   | 26488/37963 [113:31:28<47:49:04, 15.00s/it]
 70%|██████▉   | 26489/37963 [113:31:42<47:18:11, 14.84s/it]
 70%|██████▉   | 26490/37963 [113:31:57<46:57:34, 14.73s/it]
                                                            
{'loss': '0.1094', 'grad_norm': '2.604', 'learning_rate': '4.421e-06', 'epoch': '0.6978'}

 70%|██████▉   | 26490/37963 [113:31:57<46:57:34, 14.73s/it]
 70%|██████▉   | 26491/37963 [113:32:11<46:42:00, 14.65s/it]
 70%|██████▉   | 26492/37963 [113:32:25<46:30:47, 14.60s/it]
 70%|██████▉   | 26493/37963 [113:32:40<46:25:33, 14.57s/it]
 70%|██████▉   | 26494/37963 [113:32:54<46:14:10, 14.51s/it]
 70%|██████▉   | 26495/37963 [113:33:09<46:07:55, 14.48s/it]
 70%|██████▉   | 26496/37963 [113:33:23<45:59:58, 14.44s/it]
 70%|██████▉   | 26497/37963 [113:33:37<45:56:06, 14.42s/it]
 70%|██████▉   | 26498/37963 [113:33:58<51:17:30, 16.11s/it]
 70%|██████▉   | 26499/37963 [113:34:12<49:28:04, 15.53s/it]
 70%|██████▉   | 26500/37963 [113:34:34<55:38:32, 17.47s/it]
                                                            
{'loss': '0.1188', 'grad_norm': '3.463', 'learning_rate': '4.413e-06', 'epoch': '0.6981'}

 70%|██████▉   | 26500/37963 [113:34:34<55:38:32, 17.47s/it]
 70%|██████▉   | 26501/37963 [113:34:47<52:05:43, 16.36s/it]
 70%|██████▉   | 26502/37963 [113:35:02<50:22:45, 15.82s/it]
 70%|██████▉   | 26503/37963 [113:35:16<48:59:03, 15.39s/it]
 70%|██████▉   | 26504/37963 [113:35:37<54:04:36, 16.99s/it]
 70%|██████▉   | 26505/37963 [113:35:52<51:33:53, 16.20s/it]
 70%|██████▉   | 26506/37963 [113:36:06<49:50:53, 15.66s/it]
 70%|██████▉   | 26507/37963 [113:36:26<54:28:09, 17.12s/it]
 70%|██████▉   | 26508/37963 [113:36:41<51:56:20, 16.32s/it]
 70%|██████▉   | 26509/37963 [113:36:55<49:27:58, 15.55s/it]
 70%|██████▉   | 26510/37963 [113:37:09<48:22:54, 15.21s/it]
                                                            
{'loss': '0.0956', 'grad_norm': '3.759', 'learning_rate': '4.406e-06', 'epoch': '0.6983'}

 70%|██████▉   | 26510/37963 [113:37:09<48:22:54, 15.21s/it]
 70%|██████▉   | 26511/37963 [113:37:23<47:36:58, 14.97s/it]
 70%|██████▉   | 26512/37963 [113:37:38<46:59:20, 14.77s/it]
 70%|██████▉   | 26513/37963 [113:37:52<46:30:53, 14.62s/it]
 70%|██████▉   | 26514/37963 [113:38:06<46:12:09, 14.53s/it]
 70%|██████▉   | 26515/37963 [113:38:21<45:51:34, 14.42s/it]
 70%|██████▉   | 26516/37963 [113:38:35<45:56:27, 14.45s/it]
 70%|██████▉   | 26517/37963 [113:38:49<45:54:07, 14.44s/it]
 70%|██████▉   | 26518/37963 [113:39:04<45:51:48, 14.43s/it]
 70%|██████▉   | 26519/37963 [113:39:18<45:53:42, 14.44s/it]
 70%|██████▉   | 26520/37963 [113:39:32<45:36:59, 14.35s/it]
                                                            
{'loss': '0.1', 'grad_norm': '1.532', 'learning_rate': '4.399e-06', 'epoch': '0.6986'}

 70%|██████▉   | 26520/37963 [113:39:32<45:36:59, 14.35s/it]
 70%|██████▉   | 26521/37963 [113:39:47<45:47:36, 14.41s/it]
 70%|██████▉   | 26522/37963 [113:40:01<45:22:13, 14.28s/it]
 70%|██████▉   | 26523/37963 [113:40:15<45:30:39, 14.32s/it]
 70%|██████▉   | 26524/37963 [113:40:30<45:19:12, 14.26s/it]
 70%|██████▉   | 26525/37963 [113:40:50<51:35:07, 16.24s/it]
 70%|██████▉   | 26526/37963 [113:41:05<49:52:22, 15.70s/it]
 70%|██████▉   | 26527/37963 [113:41:19<48:14:53, 15.19s/it]
 70%|██████▉   | 26528/37963 [113:41:39<53:23:33, 16.81s/it]
 70%|██████▉   | 26529/37963 [113:41:54<51:05:19, 16.09s/it]
 70%|██████▉   | 26530/37963 [113:42:15<56:04:56, 17.66s/it]
                                                            
{'loss': '0.1101', 'grad_norm': '4.347', 'learning_rate': '4.392e-06', 'epoch': '0.6988'}

 70%|██████▉   | 26530/37963 [113:42:15<56:04:56, 17.66s/it]
 70%|██████▉   | 26531/37963 [113:42:30<52:58:57, 16.68s/it]
 70%|██████▉   | 26532/37963 [113:42:44<50:48:16, 16.00s/it]
 70%|██████▉   | 26533/37963 [113:43:05<55:55:14, 17.61s/it]
 70%|██████▉   | 26534/37963 [113:43:20<52:52:56, 16.66s/it]
 70%|██████▉   | 26535/37963 [113:43:34<50:42:41, 15.97s/it]
 70%|██████▉   | 26536/37963 [113:43:48<49:10:24, 15.49s/it]
 70%|██████▉   | 26537/37963 [113:44:03<48:05:58, 15.15s/it]
 70%|██████▉   | 26538/37963 [113:44:17<47:25:32, 14.94s/it]
 70%|██████▉   | 26539/37963 [113:44:31<46:33:16, 14.67s/it]
 70%|██████▉   | 26540/37963 [113:44:46<46:15:19, 14.58s/it]
                                                            
{'loss': '0.1054', 'grad_norm': '2.658', 'learning_rate': '4.385e-06', 'epoch': '0.6991'}

 70%|██████▉   | 26540/37963 [113:44:46<46:15:19, 14.58s/it]
 70%|██████▉   | 26541/37963 [113:45:00<46:01:58, 14.51s/it]
 70%|██████▉   | 26542/37963 [113:45:15<46:07:13, 14.54s/it]
 70%|██████▉   | 26543/37963 [113:45:29<45:59:20, 14.50s/it]
 70%|██████▉   | 26544/37963 [113:45:43<45:18:04, 14.28s/it]
 70%|██████▉   | 26545/37963 [113:45:57<45:13:48, 14.26s/it]
 70%|██████▉   | 26546/37963 [113:46:11<45:08:37, 14.23s/it]
 70%|██████▉   | 26547/37963 [113:46:31<50:45:26, 16.01s/it]
 70%|██████▉   | 26548/37963 [113:46:53<55:53:46, 17.63s/it]
 70%|██████▉   | 26549/37963 [113:47:14<59:25:32, 18.74s/it]
 70%|██████▉   | 26550/37963 [113:47:29<55:23:25, 17.47s/it]
                                                            
{'loss': '0.1118', 'grad_norm': '3.451', 'learning_rate': '4.378e-06', 'epoch': '0.6994'}

 70%|██████▉   | 26550/37963 [113:47:29<55:23:25, 17.47s/it]
 70%|██████▉   | 26551/37963 [113:47:43<52:25:48, 16.54s/it]
 70%|██████▉   | 26552/37963 [113:47:57<50:25:33, 15.91s/it]
 70%|██████▉   | 26553/37963 [113:48:12<48:59:03, 15.46s/it]
 70%|██████▉   | 26554/37963 [113:48:32<53:13:45, 16.80s/it]
 70%|██████▉   | 26555/37963 [113:48:46<50:47:37, 16.03s/it]
 70%|██████▉   | 26556/37963 [113:49:00<49:11:50, 15.53s/it]
 70%|██████▉   | 26557/37963 [113:49:15<48:05:31, 15.18s/it]
 70%|██████▉   | 26558/37963 [113:49:29<47:03:07, 14.85s/it]
 70%|██████▉   | 26559/37963 [113:49:43<46:34:15, 14.70s/it]
 70%|██████▉   | 26560/37963 [113:49:58<46:21:04, 14.63s/it]
                                                            
{'loss': '0.109', 'grad_norm': '2.923', 'learning_rate': '4.371e-06', 'epoch': '0.6996'}

 70%|██████▉   | 26560/37963 [113:49:58<46:21:04, 14.63s/it]
 70%|██████▉   | 26561/37963 [113:50:12<45:45:29, 14.45s/it]
 70%|██████▉   | 26562/37963 [113:50:26<45:42:31, 14.43s/it]
 70%|██████▉   | 26563/37963 [113:50:40<45:35:53, 14.40s/it]
 70%|██████▉   | 26564/37963 [113:50:55<45:37:16, 14.41s/it]
 70%|██████▉   | 26565/37963 [113:51:09<45:34:15, 14.39s/it]
 70%|██████▉   | 26566/37963 [113:51:23<45:19:33, 14.32s/it]
 70%|██████▉   | 26567/37963 [113:51:38<45:24:59, 14.35s/it]
 70%|██████▉   | 26568/37963 [113:51:52<45:25:38, 14.35s/it]
 70%|██████▉   | 26569/37963 [113:52:06<45:24:11, 14.35s/it]
 70%|██████▉   | 26570/37963 [113:52:20<45:02:25, 14.23s/it]
                                                            
{'loss': '0.08763', 'grad_norm': '2.146', 'learning_rate': '4.364e-06', 'epoch': '0.6999'}

 70%|██████▉   | 26570/37963 [113:52:20<45:02:25, 14.23s/it]
 70%|██████▉   | 26571/37963 [113:52:34<44:44:09, 14.14s/it]
 70%|██████▉   | 26572/37963 [113:52:48<44:47:25, 14.16s/it]
 70%|██████▉   | 26573/37963 [113:53:02<44:19:51, 14.01s/it]
 70%|██████▉   | 26574/37963 [113:53:17<44:40:53, 14.12s/it]
 70%|███████   | 26575/37963 [113:53:37<50:31:10, 15.97s/it]
 70%|███████   | 26576/37963 [113:53:57<54:45:15, 17.31s/it]
 70%|███████   | 26577/37963 [113:54:11<51:40:04, 16.34s/it]
 70%|███████   | 26578/37963 [113:54:25<49:30:05, 15.65s/it]
 70%|███████   | 26579/37963 [113:54:46<54:23:24, 17.20s/it]
 70%|███████   | 26580/37963 [113:55:01<51:41:08, 16.35s/it]
                                                            
{'loss': '0.1014', 'grad_norm': '1.676', 'learning_rate': '4.357e-06', 'epoch': '0.7002'}

 70%|███████   | 26580/37963 [113:55:01<51:41:08, 16.35s/it]
 70%|███████   | 26581/37963 [113:55:15<49:50:33, 15.76s/it]
 70%|███████   | 26582/37963 [113:55:36<54:23:49, 17.21s/it]
 70%|███████   | 26583/37963 [113:55:50<51:47:28, 16.38s/it]
 70%|███████   | 26584/37963 [113:56:04<49:50:56, 15.77s/it]
 70%|███████   | 26585/37963 [113:56:18<47:53:54, 15.16s/it]
 70%|███████   | 26586/37963 [113:56:33<47:17:53, 14.97s/it]
 70%|███████   | 26587/37963 [113:56:47<46:23:37, 14.68s/it]
 70%|███████   | 26588/37963 [113:57:01<45:48:54, 14.50s/it]
 70%|███████   | 26589/37963 [113:57:15<45:35:03, 14.43s/it]
 70%|███████   | 26590/37963 [113:57:29<45:30:01, 14.40s/it]
                                                            
{'loss': '0.1069', 'grad_norm': '3.937', 'learning_rate': '4.35e-06', 'epoch': '0.7004'}

 70%|███████   | 26590/37963 [113:57:29<45:30:01, 14.40s/it]
 70%|███████   | 26591/37963 [113:57:43<44:58:43, 14.24s/it]
 70%|███████   | 26592/37963 [113:57:57<45:02:58, 14.26s/it]
 70%|███████   | 26593/37963 [113:58:12<44:55:00, 14.22s/it]
 70%|███████   | 26594/37963 [113:58:25<44:36:35, 14.13s/it]
 70%|███████   | 26595/37963 [113:58:40<44:54:16, 14.22s/it]
 70%|███████   | 26596/37963 [113:59:01<51:00:57, 16.16s/it]
 70%|███████   | 26597/37963 [113:59:15<49:22:08, 15.64s/it]
 70%|███████   | 26598/37963 [113:59:43<61:24:07, 19.45s/it]
 70%|███████   | 26599/37963 [113:59:58<56:34:25, 17.92s/it]
 70%|███████   | 26600/37963 [114:00:12<53:12:42, 16.86s/it]
                                                            
{'loss': '0.1116', 'grad_norm': '2.75', 'learning_rate': '4.343e-06', 'epoch': '0.7007'}

 70%|███████   | 26600/37963 [114:00:12<53:12:42, 16.86s/it]
 70%|███████   | 26601/37963 [114:00:26<50:35:27, 16.03s/it]
 70%|███████   | 26602/37963 [114:00:41<49:02:19, 15.54s/it]
 70%|███████   | 26603/37963 [114:01:01<53:48:28, 17.05s/it]
 70%|███████   | 26604/37963 [114:01:16<51:15:52, 16.25s/it]
 70%|███████   | 26605/37963 [114:01:30<49:35:30, 15.72s/it]
 70%|███████   | 26606/37963 [114:01:44<48:23:16, 15.34s/it]
 70%|███████   | 26607/37963 [114:01:59<47:37:34, 15.10s/it]
 70%|███████   | 26608/37963 [114:02:13<46:51:29, 14.86s/it]
 70%|███████   | 26609/37963 [114:02:28<46:26:22, 14.72s/it]
 70%|███████   | 26610/37963 [114:02:42<45:49:18, 14.53s/it]
                                                            
{'loss': '0.1031', 'grad_norm': '1.826', 'learning_rate': '4.336e-06', 'epoch': '0.7009'}

 70%|███████   | 26610/37963 [114:02:42<45:49:18, 14.53s/it]
 70%|███████   | 26611/37963 [114:02:56<45:34:25, 14.45s/it]
 70%|███████   | 26612/37963 [114:03:10<45:30:30, 14.43s/it]
 70%|███████   | 26613/37963 [114:03:25<45:27:12, 14.42s/it]
 70%|███████   | 26614/37963 [114:03:39<45:23:59, 14.40s/it]
 70%|███████   | 26615/37963 [114:03:54<45:28:12, 14.42s/it]
 70%|███████   | 26616/37963 [114:04:08<45:05:27, 14.31s/it]
 70%|███████   | 26617/37963 [114:04:22<45:08:35, 14.32s/it]
 70%|███████   | 26618/37963 [114:04:37<45:16:18, 14.37s/it]
 70%|███████   | 26619/37963 [114:04:51<45:14:58, 14.36s/it]
 70%|███████   | 26620/37963 [114:05:05<45:06:44, 14.32s/it]
                                                            
{'loss': '0.09792', 'grad_norm': '2.197', 'learning_rate': '4.329e-06', 'epoch': '0.7012'}

 70%|███████   | 26620/37963 [114:05:05<45:06:44, 14.32s/it]
 70%|███████   | 26621/37963 [114:05:20<45:16:25, 14.37s/it]
 70%|███████   | 26622/37963 [114:05:34<45:22:21, 14.40s/it]
 70%|███████   | 26623/37963 [114:05:48<45:23:11, 14.41s/it]
 70%|███████   | 26624/37963 [114:06:03<45:18:36, 14.39s/it]
 70%|███████   | 26625/37963 [114:06:24<51:25:13, 16.33s/it]
 70%|███████   | 26626/37963 [114:06:38<49:36:40, 15.75s/it]
 70%|███████   | 26627/37963 [114:06:59<54:24:45, 17.28s/it]
 70%|███████   | 26628/37963 [114:07:20<57:53:17, 18.39s/it]
 70%|███████   | 26629/37963 [114:07:34<54:09:40, 17.20s/it]
 70%|███████   | 26630/37963 [114:07:49<51:34:58, 16.39s/it]
                                                            
{'loss': '0.1071', 'grad_norm': '4.093', 'learning_rate': '4.322e-06', 'epoch': '0.7015'}

 70%|███████   | 26630/37963 [114:07:49<51:34:58, 16.39s/it]
 70%|███████   | 26631/37963 [114:08:10<55:47:01, 17.72s/it]
 70%|███████   | 26632/37963 [114:08:24<52:39:42, 16.73s/it]
 70%|███████   | 26633/37963 [114:08:39<50:30:38, 16.05s/it]
 70%|███████   | 26634/37963 [114:08:53<49:01:57, 15.58s/it]
 70%|███████   | 26635/37963 [114:09:07<47:51:36, 15.21s/it]
 70%|███████   | 26636/37963 [114:09:22<47:03:37, 14.96s/it]
 70%|███████   | 26637/37963 [114:09:36<46:29:49, 14.78s/it]
 70%|███████   | 26638/37963 [114:09:50<46:04:57, 14.65s/it]
 70%|███████   | 26639/37963 [114:10:05<45:50:41, 14.57s/it]
 70%|███████   | 26640/37963 [114:10:19<45:25:56, 14.44s/it]
                                                            
{'loss': '0.1032', 'grad_norm': '1.798', 'learning_rate': '4.315e-06', 'epoch': '0.7017'}

 70%|███████   | 26640/37963 [114:10:19<45:25:56, 14.44s/it]
 70%|███████   | 26641/37963 [114:10:33<44:49:57, 14.26s/it]
 70%|███████   | 26642/37963 [114:10:47<44:55:06, 14.28s/it]
 70%|███████   | 26643/37963 [114:11:01<44:55:26, 14.29s/it]
 70%|███████   | 26644/37963 [114:11:16<44:53:16, 14.28s/it]
 70%|███████   | 26645/37963 [114:11:37<51:11:12, 16.28s/it]
 70%|███████   | 26646/37963 [114:12:04<61:53:42, 19.69s/it]
 70%|███████   | 26647/37963 [114:12:18<56:22:21, 17.93s/it]
 70%|███████   | 26648/37963 [114:12:33<53:01:04, 16.87s/it]
 70%|███████   | 26649/37963 [114:12:47<50:53:28, 16.19s/it]
 70%|███████   | 26650/37963 [114:13:01<48:29:27, 15.43s/it]
                                                            
{'loss': '0.0999', 'grad_norm': '4.007', 'learning_rate': '4.308e-06', 'epoch': '0.702'}

 70%|███████   | 26650/37963 [114:13:01<48:29:27, 15.43s/it]
 70%|███████   | 26651/37963 [114:13:22<54:04:27, 17.21s/it]
 70%|███████   | 26652/37963 [114:13:36<51:06:05, 16.26s/it]
 70%|███████   | 26653/37963 [114:13:50<49:06:51, 15.63s/it]
 70%|███████   | 26654/37963 [114:14:04<47:09:46, 15.01s/it]
 70%|███████   | 26655/37963 [114:14:18<46:37:53, 14.85s/it]
 70%|███████   | 26656/37963 [114:14:33<46:12:47, 14.71s/it]
 70%|███████   | 26657/37963 [114:14:47<45:56:27, 14.63s/it]
 70%|███████   | 26658/37963 [114:15:02<45:40:36, 14.55s/it]
 70%|███████   | 26659/37963 [114:15:16<45:28:49, 14.48s/it]
 70%|███████   | 26660/37963 [114:15:30<44:47:48, 14.27s/it]
                                                            
{'loss': '0.1059', 'grad_norm': '2.067', 'learning_rate': '4.301e-06', 'epoch': '0.7023'}

 70%|███████   | 26660/37963 [114:15:30<44:47:48, 14.27s/it]
 70%|███████   | 26661/37963 [114:15:44<44:45:31, 14.26s/it]
 70%|███████   | 26662/37963 [114:15:58<44:22:41, 14.14s/it]
 70%|███████   | 26663/37963 [114:16:12<44:03:11, 14.03s/it]
 70%|███████   | 26664/37963 [114:16:26<44:25:11, 14.15s/it]
 70%|███████   | 26665/37963 [114:16:41<44:47:54, 14.27s/it]
 70%|███████   | 26666/37963 [114:16:55<45:06:57, 14.38s/it]
 70%|███████   | 26667/37963 [114:17:10<45:08:20, 14.39s/it]
 70%|███████   | 26668/37963 [114:17:24<45:15:02, 14.42s/it]
 70%|███████   | 26669/37963 [114:17:39<45:15:23, 14.43s/it]
 70%|███████   | 26670/37963 [114:17:53<45:13:58, 14.42s/it]
                                                            
{'loss': '0.1074', 'grad_norm': '3.032', 'learning_rate': '4.294e-06', 'epoch': '0.7025'}

 70%|███████   | 26670/37963 [114:17:53<45:13:58, 14.42s/it]
 70%|███████   | 26671/37963 [114:18:07<45:14:54, 14.43s/it]
 70%|███████   | 26672/37963 [114:18:21<44:53:46, 14.31s/it]
 70%|███████   | 26673/37963 [114:18:42<50:57:22, 16.25s/it]
 70%|███████   | 26674/37963 [114:18:57<49:10:26, 15.68s/it]
 70%|███████   | 26675/37963 [114:19:17<54:03:53, 17.24s/it]
 70%|███████   | 26676/37963 [114:19:38<57:24:01, 18.31s/it]
 70%|███████   | 26677/37963 [114:19:53<53:46:19, 17.15s/it]
 70%|███████   | 26678/37963 [114:20:07<50:50:10, 16.22s/it]
 70%|███████   | 26679/37963 [114:20:21<48:40:40, 15.53s/it]
 70%|███████   | 26680/37963 [114:20:42<54:11:49, 17.29s/it]
                                                            
{'loss': '0.0998', 'grad_norm': '3.631', 'learning_rate': '4.287e-06', 'epoch': '0.7028'}

 70%|███████   | 26680/37963 [114:20:42<54:11:49, 17.29s/it]
 70%|███████   | 26681/37963 [114:20:56<51:30:22, 16.44s/it]
 70%|███████   | 26682/37963 [114:21:11<49:33:53, 15.82s/it]
 70%|███████   | 26683/37963 [114:21:25<48:03:26, 15.34s/it]
 70%|███████   | 26684/37963 [114:21:39<47:00:17, 15.00s/it]
 70%|███████   | 26685/37963 [114:21:54<46:27:44, 14.83s/it]
 70%|███████   | 26686/37963 [114:22:08<46:02:59, 14.70s/it]
 70%|███████   | 26687/37963 [114:22:23<45:50:25, 14.64s/it]
 70%|███████   | 26688/37963 [114:22:37<45:33:01, 14.54s/it]
 70%|███████   | 26689/37963 [114:22:51<45:12:29, 14.44s/it]
 70%|███████   | 26690/37963 [114:23:05<44:48:36, 14.31s/it]
                                                            
{'loss': '0.1158', 'grad_norm': '3.398', 'learning_rate': '4.28e-06', 'epoch': '0.7031'}

 70%|███████   | 26690/37963 [114:23:05<44:48:36, 14.31s/it]
 70%|███████   | 26691/37963 [114:23:19<44:49:00, 14.31s/it]
 70%|███████   | 26692/37963 [114:23:34<44:55:16, 14.35s/it]
 70%|███████   | 26693/37963 [114:23:48<44:56:54, 14.36s/it]
 70%|███████   | 26694/37963 [114:24:09<51:05:04, 16.32s/it]
 70%|███████   | 26695/37963 [114:24:30<55:36:57, 17.77s/it]
 70%|███████   | 26696/37963 [114:24:44<51:39:32, 16.51s/it]
 70%|███████   | 26697/37963 [114:25:05<55:46:04, 17.82s/it]
 70%|███████   | 26698/37963 [114:25:26<58:43:29, 18.77s/it]
 70%|███████   | 26699/37963 [114:25:40<54:23:34, 17.38s/it]
 70%|███████   | 26700/37963 [114:25:54<51:36:32, 16.50s/it]
                                                            
{'loss': '0.09645', 'grad_norm': '1.73', 'learning_rate': '4.273e-06', 'epoch': '0.7033'}

 70%|███████   | 26700/37963 [114:25:54<51:36:32, 16.50s/it]
 70%|███████   | 26701/37963 [114:26:09<49:36:27, 15.86s/it]
 70%|███████   | 26702/37963 [114:26:23<47:58:27, 15.34s/it]
 70%|███████   | 26703/37963 [114:26:37<47:12:32, 15.09s/it]
 70%|███████   | 26704/37963 [114:26:52<46:32:03, 14.88s/it]
 70%|███████   | 26705/37963 [114:27:06<46:03:07, 14.73s/it]
 70%|███████   | 26706/37963 [114:27:20<45:04:38, 14.42s/it]
 70%|███████   | 26707/37963 [114:27:34<45:00:51, 14.40s/it]
 70%|███████   | 26708/37963 [114:27:48<44:39:27, 14.28s/it]
 70%|███████   | 26709/37963 [114:28:02<44:17:04, 14.17s/it]
 70%|███████   | 26710/37963 [114:28:16<44:33:53, 14.26s/it]
                                                            
{'loss': '0.09924', 'grad_norm': '1.873', 'learning_rate': '4.266e-06', 'epoch': '0.7036'}

 70%|███████   | 26710/37963 [114:28:17<44:33:53, 14.26s/it]
 70%|███████   | 26711/37963 [114:28:31<44:42:37, 14.30s/it]
 70%|███████   | 26712/37963 [114:28:45<44:45:36, 14.32s/it]
 70%|███████   | 26713/37963 [114:29:00<44:52:26, 14.36s/it]
 70%|███████   | 26714/37963 [114:29:14<44:34:00, 14.26s/it]
 70%|███████   | 26715/37963 [114:29:28<44:16:18, 14.17s/it]
 70%|███████   | 26716/37963 [114:29:42<44:25:29, 14.22s/it]
 70%|███████   | 26717/37963 [114:29:56<44:33:51, 14.27s/it]
 70%|███████   | 26718/37963 [114:30:11<44:37:27, 14.29s/it]
 70%|███████   | 26719/37963 [114:30:25<44:42:07, 14.31s/it]
 70%|███████   | 26720/37963 [114:30:39<44:23:09, 14.21s/it]
                                                            
{'loss': '0.112', 'grad_norm': '1.834', 'learning_rate': '4.259e-06', 'epoch': '0.7038'}

 70%|███████   | 26720/37963 [114:30:39<44:23:09, 14.21s/it]
 70%|███████   | 26721/37963 [114:31:00<50:30:51, 16.18s/it]
 70%|███████   | 26722/37963 [114:31:14<48:52:05, 15.65s/it]
 70%|███████   | 26723/37963 [114:31:35<53:45:05, 17.22s/it]
 70%|███████   | 26724/37963 [114:31:50<51:04:52, 16.36s/it]
 70%|███████   | 26725/37963 [114:32:11<55:52:19, 17.90s/it]
 70%|███████   | 26726/37963 [114:32:25<52:32:03, 16.83s/it]
 70%|███████   | 26727/37963 [114:32:46<56:25:38, 18.08s/it]
 70%|███████   | 26728/37963 [114:33:00<52:15:07, 16.74s/it]
 70%|███████   | 26729/37963 [114:33:14<50:04:43, 16.05s/it]
 70%|███████   | 26730/37963 [114:33:29<48:34:01, 15.57s/it]
                                                            
{'loss': '0.1158', 'grad_norm': '4.407', 'learning_rate': '4.252e-06', 'epoch': '0.7041'}

 70%|███████   | 26730/37963 [114:33:29<48:34:01, 15.57s/it]
 70%|███████   | 26731/37963 [114:33:43<47:27:28, 15.21s/it]
 70%|███████   | 26732/37963 [114:33:57<46:19:54, 14.85s/it]
 70%|███████   | 26733/37963 [114:34:12<45:56:58, 14.73s/it]
 70%|███████   | 26734/37963 [114:34:26<45:37:10, 14.63s/it]
 70%|███████   | 26735/37963 [114:34:40<45:22:38, 14.55s/it]
 70%|███████   | 26736/37963 [114:34:55<45:32:34, 14.60s/it]
 70%|███████   | 26737/37963 [114:35:10<45:17:44, 14.53s/it]
 70%|███████   | 26738/37963 [114:35:24<45:06:32, 14.47s/it]
 70%|███████   | 26739/37963 [114:35:38<45:01:56, 14.44s/it]
 70%|███████   | 26740/37963 [114:35:53<44:58:41, 14.43s/it]
                                                            
{'loss': '0.1093', 'grad_norm': '2.105', 'learning_rate': '4.245e-06', 'epoch': '0.7044'}

 70%|███████   | 26740/37963 [114:35:53<44:58:41, 14.43s/it]
 70%|███████   | 26741/37963 [114:36:13<50:54:52, 16.33s/it]
 70%|███████   | 26742/37963 [114:36:28<49:07:30, 15.76s/it]
 70%|███████   | 26743/37963 [114:36:42<47:56:36, 15.38s/it]
 70%|███████   | 26744/37963 [114:37:02<52:20:45, 16.80s/it]
 70%|███████   | 26745/37963 [114:37:24<57:07:11, 18.33s/it]
 70%|███████   | 26746/37963 [114:37:44<58:47:36, 18.87s/it]
 70%|███████   | 26747/37963 [114:37:59<54:36:10, 17.53s/it]
 70%|███████   | 26748/37963 [114:38:13<51:38:22, 16.58s/it]
 70%|███████   | 26749/37963 [114:38:27<49:22:18, 15.85s/it]
 70%|███████   | 26750/37963 [114:38:42<47:59:34, 15.41s/it]
                                                            
{'loss': '0.1133', 'grad_norm': '2.766', 'learning_rate': '4.238e-06', 'epoch': '0.7046'}

 70%|███████   | 26750/37963 [114:38:42<47:59:34, 15.41s/it]
 70%|███████   | 26751/37963 [114:38:56<47:03:43, 15.11s/it]
 70%|███████   | 26752/37963 [114:39:11<46:20:38, 14.88s/it]
 70%|███████   | 26753/37963 [114:39:25<45:50:04, 14.72s/it]
 70%|███████   | 26754/37963 [114:39:39<45:31:42, 14.62s/it]
 70%|███████   | 26755/37963 [114:39:53<45:08:33, 14.50s/it]
 70%|███████   | 26756/37963 [114:40:08<45:04:17, 14.48s/it]
 70%|███████   | 26757/37963 [114:40:22<44:54:47, 14.43s/it]
 70%|███████   | 26758/37963 [114:40:36<44:26:10, 14.28s/it]
 70%|███████   | 26759/37963 [114:40:50<44:17:50, 14.23s/it]
 70%|███████   | 26760/37963 [114:41:04<43:50:59, 14.09s/it]
                                                            
{'loss': '0.115', 'grad_norm': '1.951', 'learning_rate': '4.231e-06', 'epoch': '0.7049'}

 70%|███████   | 26760/37963 [114:41:04<43:50:59, 14.09s/it]
 70%|███████   | 26761/37963 [114:41:18<44:07:27, 14.18s/it]
 70%|███████   | 26762/37963 [114:41:33<44:16:57, 14.23s/it]
 70%|███████   | 26763/37963 [114:41:47<44:23:08, 14.27s/it]
 71%|███████   | 26764/37963 [114:42:01<44:29:00, 14.30s/it]
 71%|███████   | 26765/37963 [114:42:15<44:13:10, 14.22s/it]
 71%|███████   | 26766/37963 [114:42:30<44:25:09, 14.28s/it]
 71%|███████   | 26767/37963 [114:42:44<44:33:03, 14.33s/it]
 71%|███████   | 26768/37963 [114:42:59<44:35:58, 14.34s/it]
 71%|███████   | 26769/37963 [114:43:13<44:37:55, 14.35s/it]
 71%|███████   | 26770/37963 [114:43:34<50:36:26, 16.28s/it]
                                                            
{'loss': '0.1004', 'grad_norm': '1.837', 'learning_rate': '4.224e-06', 'epoch': '0.7052'}

 71%|███████   | 26770/37963 [114:43:34<50:36:26, 16.28s/it]
 71%|███████   | 26771/37963 [114:43:48<48:59:35, 15.76s/it]
 71%|███████   | 26772/37963 [114:44:09<53:51:34, 17.33s/it]
 71%|███████   | 26773/37963 [114:44:23<50:34:57, 16.27s/it]
 71%|███████   | 26774/37963 [114:44:50<60:19:29, 19.41s/it]
 71%|███████   | 26775/37963 [114:45:04<55:13:41, 17.77s/it]
 71%|███████   | 26776/37963 [114:45:18<52:05:02, 16.76s/it]
 71%|███████   | 26777/37963 [114:45:33<49:47:42, 16.03s/it]
 71%|███████   | 26778/37963 [114:45:47<47:50:27, 15.40s/it]
 71%|███████   | 26779/37963 [114:46:01<46:53:50, 15.10s/it]
 71%|███████   | 26780/37963 [114:46:15<46:14:40, 14.89s/it]
                                                            
{'loss': '0.1149', 'grad_norm': '3.091', 'learning_rate': '4.217e-06', 'epoch': '0.7054'}

 71%|███████   | 26780/37963 [114:46:15<46:14:40, 14.89s/it]
 71%|███████   | 26781/37963 [114:46:30<45:40:11, 14.70s/it]
 71%|███████   | 26782/37963 [114:46:44<45:15:13, 14.57s/it]
 71%|███████   | 26783/37963 [114:46:58<45:07:45, 14.53s/it]
 71%|███████   | 26784/37963 [114:47:13<44:55:20, 14.47s/it]
 71%|███████   | 26785/37963 [114:47:27<44:45:22, 14.41s/it]
 71%|███████   | 26786/37963 [114:47:41<44:15:21, 14.25s/it]
 71%|███████   | 26787/37963 [114:47:55<44:20:25, 14.28s/it]
 71%|███████   | 26788/37963 [114:48:10<44:28:39, 14.33s/it]
 71%|███████   | 26789/37963 [114:48:30<50:23:02, 16.23s/it]
 71%|███████   | 26790/37963 [114:48:44<48:28:01, 15.62s/it]
                                                            
{'loss': '0.1017', 'grad_norm': '1.845', 'learning_rate': '4.21e-06', 'epoch': '0.7057'}

 71%|███████   | 26790/37963 [114:48:44<48:28:01, 15.62s/it]
 71%|███████   | 26791/37963 [114:48:59<47:19:49, 15.25s/it]
 71%|███████   | 26792/37963 [114:49:20<52:53:52, 17.05s/it]
 71%|███████   | 26793/37963 [114:49:41<56:19:54, 18.16s/it]
 71%|███████   | 26794/37963 [114:50:02<58:58:00, 19.01s/it]
 71%|███████   | 26795/37963 [114:50:16<54:47:08, 17.66s/it]
 71%|███████   | 26796/37963 [114:50:31<51:40:23, 16.66s/it]
 71%|███████   | 26797/37963 [114:50:45<49:33:52, 15.98s/it]
 71%|███████   | 26798/37963 [114:50:59<47:54:32, 15.45s/it]
 71%|███████   | 26799/37963 [114:51:14<46:51:17, 15.11s/it]
 71%|███████   | 26800/37963 [114:51:28<46:03:41, 14.85s/it]
                                                            
{'loss': '0.1034', 'grad_norm': '2.355', 'learning_rate': '4.203e-06', 'epoch': '0.706'}

 71%|███████   | 26800/37963 [114:51:28<46:03:41, 14.85s/it]
 71%|███████   | 26801/37963 [114:51:42<45:32:28, 14.69s/it]
 71%|███████   | 26802/37963 [114:51:57<45:15:35, 14.60s/it]
 71%|███████   | 26803/37963 [114:52:11<45:16:09, 14.60s/it]
 71%|███████   | 26804/37963 [114:52:26<45:03:47, 14.54s/it]
 71%|███████   | 26805/37963 [114:52:40<44:49:11, 14.46s/it]
 71%|███████   | 26806/37963 [114:52:54<44:43:46, 14.43s/it]
 71%|███████   | 26807/37963 [114:53:09<44:50:48, 14.47s/it]
 71%|███████   | 26808/37963 [114:53:23<44:47:41, 14.46s/it]
 71%|███████   | 26809/37963 [114:53:38<44:48:33, 14.46s/it]
 71%|███████   | 26810/37963 [114:53:52<44:38:41, 14.41s/it]
                                                            
{'loss': '0.1144', 'grad_norm': '1.873', 'learning_rate': '4.196e-06', 'epoch': '0.7062'}

 71%|███████   | 26810/37963 [114:53:52<44:38:41, 14.41s/it]
 71%|███████   | 26811/37963 [114:54:06<44:39:24, 14.42s/it]
 71%|███████   | 26812/37963 [114:54:21<44:38:13, 14.41s/it]
 71%|███████   | 26813/37963 [114:54:35<44:37:44, 14.41s/it]
 71%|███████   | 26814/37963 [114:54:50<44:39:44, 14.42s/it]
 71%|███████   | 26815/37963 [114:55:04<44:38:48, 14.42s/it]
 71%|███████   | 26816/37963 [114:55:18<44:16:22, 14.30s/it]
 71%|███████   | 26817/37963 [114:55:32<44:19:07, 14.31s/it]
 71%|███████   | 26818/37963 [114:55:47<44:19:04, 14.32s/it]
 71%|███████   | 26819/37963 [114:56:07<50:07:00, 16.19s/it]
 71%|███████   | 26820/37963 [114:56:21<48:16:59, 15.60s/it]
                                                            
{'loss': '0.1227', 'grad_norm': '2.074', 'learning_rate': '4.189e-06', 'epoch': '0.7065'}

 71%|███████   | 26820/37963 [114:56:21<48:16:59, 15.60s/it]
 71%|███████   | 26821/37963 [114:56:42<53:12:21, 17.19s/it]
 71%|███████   | 26822/37963 [114:56:57<50:23:20, 16.28s/it]
 71%|███████   | 26823/37963 [114:57:18<54:46:44, 17.70s/it]
 71%|███████   | 26824/37963 [114:57:32<51:44:00, 16.72s/it]
 71%|███████   | 26825/37963 [114:57:53<55:27:29, 17.93s/it]
 71%|███████   | 26826/37963 [114:58:07<52:14:24, 16.89s/it]
 71%|███████   | 26827/37963 [114:58:21<49:35:33, 16.03s/it]
 71%|███████   | 26828/37963 [114:58:36<48:05:44, 15.55s/it]
 71%|███████   | 26829/37963 [114:58:50<46:54:48, 15.17s/it]
 71%|███████   | 26830/37963 [114:59:04<46:13:10, 14.95s/it]
                                                            
{'loss': '0.1151', 'grad_norm': '2.762', 'learning_rate': '4.182e-06', 'epoch': '0.7067'}

 71%|███████   | 26830/37963 [114:59:04<46:13:10, 14.95s/it]
 71%|███████   | 26831/37963 [114:59:19<45:36:03, 14.75s/it]
 71%|███████   | 26832/37963 [114:59:33<45:22:25, 14.67s/it]
 71%|███████   | 26833/37963 [114:59:48<45:07:44, 14.60s/it]
 71%|███████   | 26834/37963 [115:00:02<44:54:34, 14.53s/it]
 71%|███████   | 26835/37963 [115:00:16<44:23:48, 14.36s/it]
 71%|███████   | 26836/37963 [115:00:30<44:25:32, 14.37s/it]
 71%|███████   | 26837/37963 [115:00:45<44:30:02, 14.40s/it]
 71%|███████   | 26838/37963 [115:01:05<49:57:28, 16.17s/it]
 71%|███████   | 26839/37963 [115:01:19<47:58:58, 15.53s/it]
 71%|███████   | 26840/37963 [115:01:34<46:58:11, 15.20s/it]
                                                            
{'loss': '0.1033', 'grad_norm': '1.776', 'learning_rate': '4.175e-06', 'epoch': '0.707'}

 71%|███████   | 26840/37963 [115:01:34<46:58:11, 15.20s/it]
 71%|███████   | 26841/37963 [115:02:01<58:31:50, 18.95s/it]
 71%|███████   | 26842/37963 [115:02:16<54:16:14, 17.57s/it]
 71%|███████   | 26843/37963 [115:02:30<51:16:43, 16.60s/it]
 71%|███████   | 26844/37963 [115:02:51<55:15:34, 17.89s/it]
 71%|███████   | 26845/37963 [115:03:05<51:56:07, 16.82s/it]
 71%|███████   | 26846/37963 [115:03:19<49:30:16, 16.03s/it]
 71%|███████   | 26847/37963 [115:03:34<47:51:31, 15.50s/it]
 71%|███████   | 26848/37963 [115:03:48<46:36:49, 15.10s/it]
 71%|███████   | 26849/37963 [115:04:02<45:55:11, 14.87s/it]
 71%|███████   | 26850/37963 [115:04:16<45:24:47, 14.71s/it]
                                                            
{'loss': '0.09133', 'grad_norm': '3.362', 'learning_rate': '4.168e-06', 'epoch': '0.7073'}

 71%|███████   | 26850/37963 [115:04:16<45:24:47, 14.71s/it]
 71%|███████   | 26851/37963 [115:04:31<45:02:58, 14.59s/it]
 71%|███████   | 26852/37963 [115:04:45<44:48:28, 14.52s/it]
 71%|███████   | 26853/37963 [115:04:59<44:28:45, 14.41s/it]
 71%|███████   | 26854/37963 [115:05:14<44:32:32, 14.43s/it]
 71%|███████   | 26855/37963 [115:05:28<44:35:18, 14.45s/it]
 71%|███████   | 26856/37963 [115:05:42<44:05:46, 14.29s/it]
 71%|███████   | 26857/37963 [115:05:56<43:47:06, 14.19s/it]
 71%|███████   | 26858/37963 [115:06:10<43:51:44, 14.22s/it]
 71%|███████   | 26859/37963 [115:06:24<43:44:16, 14.18s/it]
 71%|███████   | 26860/37963 [115:06:39<43:45:57, 14.19s/it]
                                                            
{'loss': '0.1104', 'grad_norm': '1.924', 'learning_rate': '4.161e-06', 'epoch': '0.7075'}

 71%|███████   | 26860/37963 [115:06:39<43:45:57, 14.19s/it]
 71%|███████   | 26861/37963 [115:06:53<43:49:08, 14.21s/it]
 71%|███████   | 26862/37963 [115:07:07<43:57:11, 14.25s/it]
 71%|███████   | 26863/37963 [115:07:22<44:06:14, 14.30s/it]
 71%|███████   | 26864/37963 [115:07:36<44:08:53, 14.32s/it]
 71%|███████   | 26865/37963 [115:07:50<44:09:15, 14.32s/it]
 71%|███████   | 26866/37963 [115:08:11<50:15:32, 16.30s/it]
 71%|███████   | 26867/37963 [115:08:31<53:45:49, 17.44s/it]
 71%|███████   | 26868/37963 [115:08:46<50:55:10, 16.52s/it]
 71%|███████   | 26869/37963 [115:09:00<48:58:28, 15.89s/it]
 71%|███████   | 26870/37963 [115:09:15<47:32:41, 15.43s/it]
                                                            
{'loss': '0.1064', 'grad_norm': '2.959', 'learning_rate': '4.154e-06', 'epoch': '0.7078'}

 71%|███████   | 26870/37963 [115:09:15<47:32:41, 15.43s/it]
 71%|███████   | 26871/37963 [115:09:36<52:55:43, 17.18s/it]
 71%|███████   | 26872/37963 [115:09:50<50:21:49, 16.35s/it]
 71%|███████   | 26873/37963 [115:10:04<47:57:25, 15.57s/it]
 71%|███████   | 26874/37963 [115:10:25<53:06:28, 17.24s/it]
 71%|███████   | 26875/37963 [115:10:40<50:31:08, 16.40s/it]
 71%|███████   | 26876/37963 [115:10:54<48:38:30, 15.79s/it]
 71%|███████   | 26877/37963 [115:11:08<47:19:42, 15.37s/it]
 71%|███████   | 26878/37963 [115:11:23<46:14:12, 15.02s/it]
 71%|███████   | 26879/37963 [115:11:37<45:38:59, 14.83s/it]
 71%|███████   | 26880/37963 [115:11:50<44:28:32, 14.45s/it]
                                                            
{'loss': '0.1015', 'grad_norm': '3.245', 'learning_rate': '4.148e-06', 'epoch': '0.7081'}

 71%|███████   | 26880/37963 [115:11:50<44:28:32, 14.45s/it]
 71%|███████   | 26881/37963 [115:12:05<44:29:53, 14.46s/it]
 71%|███████   | 26882/37963 [115:12:19<44:26:36, 14.44s/it]
 71%|███████   | 26883/37963 [115:12:34<44:22:29, 14.42s/it]
 71%|███████   | 26884/37963 [115:12:48<44:17:49, 14.39s/it]
 71%|███████   | 26885/37963 [115:13:02<44:14:18, 14.38s/it]
 71%|███████   | 26886/37963 [115:13:16<43:57:11, 14.28s/it]
 71%|███████   | 26887/37963 [115:13:37<50:00:50, 16.26s/it]
 71%|███████   | 26888/37963 [115:13:52<48:08:41, 15.65s/it]
 71%|███████   | 26889/37963 [115:14:13<53:17:49, 17.33s/it]
 71%|███████   | 26890/37963 [115:14:33<55:41:05, 18.10s/it]
                                                            
{'loss': '0.09535', 'grad_norm': '1.949', 'learning_rate': '4.141e-06', 'epoch': '0.7083'}

 71%|███████   | 26890/37963 [115:14:33<55:41:05, 18.10s/it]
 71%|███████   | 26891/37963 [115:14:47<52:13:35, 16.98s/it]
 71%|███████   | 26892/37963 [115:15:01<49:48:36, 16.20s/it]
 71%|███████   | 26893/37963 [115:15:22<54:07:38, 17.60s/it]
 71%|███████   | 26894/37963 [115:15:37<51:06:40, 16.62s/it]
 71%|███████   | 26895/37963 [115:15:51<49:04:57, 15.96s/it]
 71%|███████   | 26896/37963 [115:16:05<47:02:11, 15.30s/it]
 71%|███████   | 26897/37963 [115:16:19<46:09:09, 15.01s/it]
 71%|███████   | 26898/37963 [115:16:34<45:32:10, 14.82s/it]
 71%|███████   | 26899/37963 [115:16:48<45:01:20, 14.65s/it]
 71%|███████   | 26900/37963 [115:17:02<44:47:27, 14.58s/it]
                                                            
{'loss': '0.09107', 'grad_norm': '3.939', 'learning_rate': '4.134e-06', 'epoch': '0.7086'}

 71%|███████   | 26900/37963 [115:17:02<44:47:27, 14.58s/it]
 71%|███████   | 26901/37963 [115:17:16<44:15:17, 14.40s/it]
 71%|███████   | 26902/37963 [115:17:31<44:13:14, 14.39s/it]
 71%|███████   | 26903/37963 [115:17:45<44:13:55, 14.40s/it]
 71%|███████   | 26904/37963 [115:17:59<44:17:14, 14.42s/it]
 71%|███████   | 26905/37963 [115:18:14<43:57:24, 14.31s/it]
 71%|███████   | 26906/37963 [115:18:28<44:01:12, 14.33s/it]
 71%|███████   | 26907/37963 [115:18:42<44:03:29, 14.35s/it]
 71%|███████   | 26908/37963 [115:18:56<43:27:31, 14.15s/it]
 71%|███████   | 26909/37963 [115:19:10<43:34:35, 14.19s/it]
 71%|███████   | 26910/37963 [115:19:25<43:45:01, 14.25s/it]
                                                            
{'loss': '0.1047', 'grad_norm': '1.773', 'learning_rate': '4.127e-06', 'epoch': '0.7089'}

 71%|███████   | 26910/37963 [115:19:25<43:45:01, 14.25s/it]
 71%|███████   | 26911/37963 [115:19:39<43:51:08, 14.28s/it]
 71%|███████   | 26912/37963 [115:19:53<43:45:47, 14.26s/it]
 71%|███████   | 26913/37963 [115:20:07<43:31:20, 14.18s/it]
 71%|███████   | 26914/37963 [115:20:22<43:45:06, 14.26s/it]
 71%|███████   | 26915/37963 [115:20:36<43:37:01, 14.21s/it]
 71%|███████   | 26916/37963 [115:20:50<43:28:30, 14.17s/it]
 71%|███████   | 26917/37963 [115:21:17<55:03:46, 17.95s/it]
 71%|███████   | 26918/37963 [115:21:31<51:35:53, 16.82s/it]
 71%|███████   | 26919/37963 [115:21:45<48:47:44, 15.91s/it]
 71%|███████   | 26920/37963 [115:22:06<53:33:57, 17.46s/it]
                                                            
{'loss': '0.1102', 'grad_norm': '3.938', 'learning_rate': '4.12e-06', 'epoch': '0.7091'}

 71%|███████   | 26920/37963 [115:22:06<53:33:57, 17.46s/it]
 71%|███████   | 26921/37963 [115:22:20<50:47:55, 16.56s/it]
 71%|███████   | 26922/37963 [115:22:34<47:58:32, 15.64s/it]
 71%|███████   | 26923/37963 [115:22:54<52:45:00, 17.20s/it]
 71%|███████   | 26924/37963 [115:23:09<50:16:05, 16.39s/it]
 71%|███████   | 26925/37963 [115:23:23<48:22:11, 15.78s/it]
 71%|███████   | 26926/37963 [115:23:37<46:47:05, 15.26s/it]
 71%|███████   | 26927/37963 [115:23:52<45:55:47, 14.98s/it]
 71%|███████   | 26928/37963 [115:24:06<45:24:44, 14.82s/it]
 71%|███████   | 26929/37963 [115:24:20<44:55:59, 14.66s/it]
 71%|███████   | 26930/37963 [115:24:35<44:44:10, 14.60s/it]
                                                            
{'loss': '0.1056', 'grad_norm': '2.81', 'learning_rate': '4.113e-06', 'epoch': '0.7094'}

 71%|███████   | 26930/37963 [115:24:35<44:44:10, 14.60s/it]
 71%|███████   | 26931/37963 [115:24:49<44:31:01, 14.53s/it]
 71%|███████   | 26932/37963 [115:25:04<44:24:20, 14.49s/it]
 71%|███████   | 26933/37963 [115:25:18<44:14:15, 14.44s/it]
 71%|███████   | 26934/37963 [115:25:32<44:15:05, 14.44s/it]
 71%|███████   | 26935/37963 [115:25:53<49:55:32, 16.30s/it]
 71%|███████   | 26936/37963 [115:26:07<48:06:00, 15.70s/it]
 71%|███████   | 26937/37963 [115:26:22<46:55:10, 15.32s/it]
 71%|███████   | 26938/37963 [115:26:43<52:14:48, 17.06s/it]
 71%|███████   | 26939/37963 [115:27:04<55:32:07, 18.14s/it]
 71%|███████   | 26940/37963 [115:27:18<52:03:51, 17.00s/it]
                                                            
{'loss': '0.1068', 'grad_norm': '2.238', 'learning_rate': '4.106e-06', 'epoch': '0.7096'}

 71%|███████   | 26940/37963 [115:27:18<52:03:51, 17.00s/it]
 71%|███████   | 26941/37963 [115:27:39<55:53:58, 18.26s/it]
 71%|███████   | 26942/37963 [115:27:53<51:33:18, 16.84s/it]
 71%|███████   | 26943/37963 [115:28:07<49:12:29, 16.08s/it]
 71%|███████   | 26944/37963 [115:28:21<47:44:02, 15.60s/it]
 71%|███████   | 26945/37963 [115:28:36<46:34:58, 15.22s/it]
 71%|███████   | 26946/37963 [115:28:50<45:51:31, 14.99s/it]
 71%|███████   | 26947/37963 [115:29:04<45:04:13, 14.73s/it]
 71%|███████   | 26948/37963 [115:29:18<44:16:07, 14.47s/it]
 71%|███████   | 26949/37963 [115:29:32<44:08:45, 14.43s/it]
 71%|███████   | 26950/37963 [115:29:47<44:04:13, 14.41s/it]
                                                            
{'loss': '0.1032', 'grad_norm': '2.185', 'learning_rate': '4.099e-06', 'epoch': '0.7099'}

 71%|███████   | 26950/37963 [115:29:47<44:04:13, 14.41s/it]
 71%|███████   | 26951/37963 [115:30:01<43:45:47, 14.31s/it]
 71%|███████   | 26952/37963 [115:30:15<43:32:52, 14.24s/it]
 71%|███████   | 26953/37963 [115:30:29<43:39:24, 14.27s/it]
 71%|███████   | 26954/37963 [115:30:44<43:44:54, 14.31s/it]
 71%|███████   | 26955/37963 [115:30:57<43:09:24, 14.11s/it]
 71%|███████   | 26956/37963 [115:31:12<43:29:24, 14.22s/it]
 71%|███████   | 26957/37963 [115:31:26<43:27:45, 14.22s/it]
 71%|███████   | 26958/37963 [115:31:40<43:18:31, 14.17s/it]
 71%|███████   | 26959/37963 [115:31:54<43:26:53, 14.21s/it]
 71%|███████   | 26960/37963 [115:32:09<43:35:08, 14.26s/it]
                                                            
{'loss': '0.1104', 'grad_norm': '1.906', 'learning_rate': '4.092e-06', 'epoch': '0.7102'}

 71%|███████   | 26960/37963 [115:32:09<43:35:08, 14.26s/it]
 71%|███████   | 26961/37963 [115:32:23<43:46:16, 14.32s/it]
 71%|███████   | 26962/37963 [115:32:38<43:47:48, 14.33s/it]
 71%|███████   | 26963/37963 [115:32:52<43:46:20, 14.33s/it]
 71%|███████   | 26964/37963 [115:33:06<43:47:27, 14.33s/it]
 71%|███████   | 26965/37963 [115:33:21<43:48:44, 14.34s/it]
 71%|███████   | 26966/37963 [115:33:48<55:35:19, 18.20s/it]
 71%|███████   | 26967/37963 [115:34:02<52:17:11, 17.12s/it]
 71%|███████   | 26968/37963 [115:34:23<55:47:51, 18.27s/it]
 71%|███████   | 26969/37963 [115:34:38<52:12:18, 17.09s/it]
 71%|███████   | 26970/37963 [115:34:59<55:49:07, 18.28s/it]
                                                            
{'loss': '0.1124', 'grad_norm': '2.784', 'learning_rate': '4.085e-06', 'epoch': '0.7104'}

 71%|███████   | 26970/37963 [115:34:59<55:49:07, 18.28s/it]
 71%|███████   | 26971/37963 [115:35:13<52:16:09, 17.12s/it]
 71%|███████   | 26972/37963 [115:35:27<49:05:04, 16.08s/it]
 71%|███████   | 26973/37963 [115:35:41<47:23:34, 15.52s/it]
 71%|███████   | 26974/37963 [115:35:55<46:19:49, 15.18s/it]
 71%|███████   | 26975/37963 [115:36:10<45:37:57, 14.95s/it]
 71%|███████   | 26976/37963 [115:36:24<45:04:34, 14.77s/it]
 71%|███████   | 26977/37963 [115:36:38<44:11:08, 14.48s/it]
 71%|███████   | 26978/37963 [115:36:52<43:47:22, 14.35s/it]
 71%|███████   | 26979/37963 [115:37:06<43:50:25, 14.37s/it]
 71%|███████   | 26980/37963 [115:37:21<43:51:19, 14.37s/it]
                                                            
{'loss': '0.1112', 'grad_norm': '2.042', 'learning_rate': '4.079e-06', 'epoch': '0.7107'}

 71%|███████   | 26980/37963 [115:37:21<43:51:19, 14.37s/it]
 71%|███████   | 26981/37963 [115:37:35<43:53:23, 14.39s/it]
 71%|███████   | 26982/37963 [115:37:56<49:39:12, 16.28s/it]
 71%|███████   | 26983/37963 [115:38:10<47:44:46, 15.65s/it]
 71%|███████   | 26984/37963 [115:38:25<46:32:36, 15.26s/it]
 71%|███████   | 26985/37963 [115:38:39<46:04:40, 15.11s/it]
 71%|███████   | 26986/37963 [115:39:00<51:28:46, 16.88s/it]
 71%|███████   | 26987/37963 [115:39:21<55:17:45, 18.14s/it]
 71%|███████   | 26988/37963 [115:39:36<51:42:57, 16.96s/it]
 71%|███████   | 26989/37963 [115:39:56<55:03:44, 18.06s/it]
 71%|███████   | 26990/37963 [115:40:11<51:37:20, 16.94s/it]
                                                            
{'loss': '0.1048', 'grad_norm': '4.612', 'learning_rate': '4.072e-06', 'epoch': '0.711'}

 71%|███████   | 26990/37963 [115:40:11<51:37:20, 16.94s/it]
 71%|███████   | 26991/37963 [115:40:25<49:25:05, 16.21s/it]
 71%|███████   | 26992/37963 [115:40:39<47:46:23, 15.68s/it]
 71%|███████   | 26993/37963 [115:40:54<46:34:32, 15.28s/it]
 71%|███████   | 26994/37963 [115:41:08<45:41:32, 15.00s/it]
 71%|███████   | 26995/37963 [115:41:23<45:09:32, 14.82s/it]
 71%|███████   | 26996/37963 [115:41:37<44:44:47, 14.69s/it]
 71%|███████   | 26997/37963 [115:41:51<44:29:00, 14.60s/it]
 71%|███████   | 26998/37963 [115:42:05<43:46:03, 14.37s/it]
 71%|███████   | 26999/37963 [115:42:19<43:35:15, 14.31s/it]
 71%|███████   | 27000/37963 [115:42:33<43:07:55, 14.16s/it]
                                                            
{'loss': '0.1007', 'grad_norm': '4.528', 'learning_rate': '4.065e-06', 'epoch': '0.7112'}

 71%|███████   | 27000/37963 [115:42:33<43:07:55, 14.16s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.10s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.11s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 71%|███████   | 27001/37963 [115:44:18<125:36:11, 41.25s/it]
 71%|███████   | 27002/37963 [115:44:32<101:02:07, 33.18s/it]
 71%|███████   | 27003/37963 [115:44:46<83:50:38, 27.54s/it] 
 71%|███████   | 27004/37963 [115:45:01<71:47:16, 23.58s/it]
 71%|███████   | 27005/37963 [115:45:15<63:21:47, 20.82s/it]
 71%|███████   | 27006/37963 [115:45:29<56:49:45, 18.67s/it]
 71%|███████   | 27007/37963 [115:45:43<53:00:38, 17.42s/it]
 71%|███████   | 27008/37963 [115:45:58<50:13:22, 16.50s/it]
 71%|███████   | 27009/37963 [115:46:12<48:23:49, 15.91s/it]
 71%|███████   | 27010/37963 [115:46:26<46:52:04, 15.40s/it]
                                                            
{'loss': '0.09893', 'grad_norm': '1.985', 'learning_rate': '4.058e-06', 'epoch': '0.7115'}

 71%|███████   | 27010/37963 [115:46:26<46:52:04, 15.40s/it]
 71%|███████   | 27011/37963 [115:46:41<45:57:42, 15.11s/it]
 71%|███████   | 27012/37963 [115:46:55<45:12:33, 14.86s/it]
 71%|███████   | 27013/37963 [115:47:09<44:34:13, 14.65s/it]
 71%|███████   | 27014/37963 [115:47:30<50:13:41, 16.51s/it]
 71%|███████   | 27015/37963 [115:47:51<54:24:16, 17.89s/it]
 71%|███████   | 27016/37963 [115:48:06<51:10:33, 16.83s/it]
 71%|███████   | 27017/37963 [115:48:20<49:06:27, 16.15s/it]
 71%|███████   | 27018/37963 [115:48:41<53:28:27, 17.59s/it]
 71%|███████   | 27019/37963 [115:48:55<50:14:39, 16.53s/it]
 71%|███████   | 27020/37963 [115:49:10<48:19:04, 15.90s/it]
                                                            
{'loss': '0.09981', 'grad_norm': '2.236', 'learning_rate': '4.051e-06', 'epoch': '0.7117'}

 71%|███████   | 27020/37963 [115:49:10<48:19:04, 15.90s/it]
 71%|███████   | 27021/37963 [115:49:24<46:57:15, 15.45s/it]
 71%|███████   | 27022/37963 [115:49:38<45:55:31, 15.11s/it]
 71%|███████   | 27023/37963 [115:49:53<45:18:01, 14.91s/it]
 71%|███████   | 27024/37963 [115:50:07<44:52:13, 14.77s/it]
 71%|███████   | 27025/37963 [115:50:21<44:20:32, 14.59s/it]
 71%|███████   | 27026/37963 [115:50:36<44:01:36, 14.49s/it]
 71%|███████   | 27027/37963 [115:50:50<43:58:52, 14.48s/it]
 71%|███████   | 27028/37963 [115:51:04<43:26:20, 14.30s/it]
 71%|███████   | 27029/37963 [115:51:18<43:30:28, 14.32s/it]
 71%|███████   | 27030/37963 [115:51:39<49:15:27, 16.22s/it]
                                                            
{'loss': '0.09835', 'grad_norm': '1.846', 'learning_rate': '4.044e-06', 'epoch': '0.712'}

 71%|███████   | 27030/37963 [115:51:39<49:15:27, 16.22s/it]
 71%|███████   | 27031/37963 [115:51:53<47:22:24, 15.60s/it]
 71%|███████   | 27032/37963 [115:52:13<51:39:33, 17.01s/it]
 71%|███████   | 27033/37963 [115:52:28<49:22:02, 16.26s/it]
 71%|███████   | 27034/37963 [115:52:49<53:20:54, 17.57s/it]
 71%|███████   | 27035/37963 [115:53:03<50:23:08, 16.60s/it]
 71%|███████   | 27036/37963 [115:53:24<54:07:00, 17.83s/it]
 71%|███████   | 27037/37963 [115:53:38<50:37:49, 16.68s/it]
 71%|███████   | 27038/37963 [115:53:52<48:33:59, 16.00s/it]
 71%|███████   | 27039/37963 [115:54:06<47:09:02, 15.54s/it]
 71%|███████   | 27040/37963 [115:54:21<46:06:16, 15.20s/it]
                                                            
{'loss': '0.1106', 'grad_norm': '2.058', 'learning_rate': '4.037e-06', 'epoch': '0.7123'}

 71%|███████   | 27040/37963 [115:54:21<46:06:16, 15.20s/it]
 71%|███████   | 27041/37963 [115:54:35<45:24:34, 14.97s/it]
 71%|███████   | 27042/37963 [115:54:50<45:00:16, 14.84s/it]
 71%|███████   | 27043/37963 [115:55:04<44:34:25, 14.69s/it]
 71%|███████   | 27044/37963 [115:55:19<44:17:10, 14.60s/it]
 71%|███████   | 27045/37963 [115:55:33<44:03:57, 14.53s/it]
 71%|███████   | 27046/37963 [115:55:47<43:57:45, 14.50s/it]
 71%|███████   | 27047/37963 [115:56:02<43:52:29, 14.47s/it]
 71%|███████   | 27048/37963 [115:56:16<43:48:22, 14.45s/it]
 71%|███████▏  | 27049/37963 [115:56:31<43:56:41, 14.50s/it]
 71%|███████▏  | 27050/37963 [115:56:44<43:05:14, 14.21s/it]
                                                            
{'loss': '0.1239', 'grad_norm': '3.87', 'learning_rate': '4.031e-06', 'epoch': '0.7125'}

 71%|███████▏  | 27050/37963 [115:56:44<43:05:14, 14.21s/it]
 71%|███████▏  | 27051/37963 [115:56:59<43:14:46, 14.27s/it]
 71%|███████▏  | 27052/37963 [115:57:13<43:21:46, 14.31s/it]
 71%|███████▏  | 27053/37963 [115:57:27<43:25:59, 14.33s/it]
 71%|███████▏  | 27054/37963 [115:57:42<43:28:07, 14.34s/it]
 71%|███████▏  | 27055/37963 [115:57:56<43:35:33, 14.39s/it]
 71%|███████▏  | 27056/37963 [115:58:10<43:01:32, 14.20s/it]
 71%|███████▏  | 27057/37963 [115:58:24<43:11:33, 14.26s/it]
 71%|███████▏  | 27058/37963 [115:58:38<42:41:41, 14.09s/it]
 71%|███████▏  | 27059/37963 [115:58:53<42:57:47, 14.18s/it]
 71%|███████▏  | 27060/37963 [115:59:07<43:22:24, 14.32s/it]
                                                            
{'loss': '0.1032', 'grad_norm': '2.411', 'learning_rate': '4.024e-06', 'epoch': '0.7128'}

 71%|███████▏  | 27060/37963 [115:59:07<43:22:24, 14.32s/it]
 71%|███████▏  | 27061/37963 [115:59:22<43:23:06, 14.33s/it]
 71%|███████▏  | 27062/37963 [115:59:42<49:11:08, 16.24s/it]
 71%|███████▏  | 27063/37963 [116:00:03<53:28:03, 17.66s/it]
 71%|███████▏  | 27064/37963 [116:00:18<50:30:18, 16.68s/it]
 71%|███████▏  | 27065/37963 [116:00:31<47:54:56, 15.83s/it]
 71%|███████▏  | 27066/37963 [116:00:59<58:37:32, 19.37s/it]
 71%|███████▏  | 27067/37963 [116:01:14<54:08:44, 17.89s/it]
 71%|███████▏  | 27068/37963 [116:01:28<50:50:58, 16.80s/it]
 71%|███████▏  | 27069/37963 [116:01:42<48:36:13, 16.06s/it]
 71%|███████▏  | 27070/37963 [116:01:56<46:25:40, 15.34s/it]
                                                            
{'loss': '0.09432', 'grad_norm': '1.5', 'learning_rate': '4.017e-06', 'epoch': '0.7131'}

 71%|███████▏  | 27070/37963 [116:01:56<46:25:40, 15.34s/it]
 71%|███████▏  | 27071/37963 [116:02:10<44:58:58, 14.87s/it]
 71%|███████▏  | 27072/37963 [116:02:23<43:44:24, 14.46s/it]
 71%|███████▏  | 27073/37963 [116:02:37<42:54:34, 14.18s/it]
 71%|███████▏  | 27074/37963 [116:02:51<43:17:45, 14.31s/it]
 71%|███████▏  | 27075/37963 [116:03:06<43:29:50, 14.38s/it]
 71%|███████▏  | 27076/37963 [116:03:20<43:31:43, 14.39s/it]
 71%|███████▏  | 27077/37963 [116:03:35<43:30:54, 14.39s/it]
 71%|███████▏  | 27078/37963 [116:03:49<43:28:07, 14.38s/it]
 71%|███████▏  | 27079/37963 [116:04:17<55:38:38, 18.40s/it]
 71%|███████▏  | 27080/37963 [116:04:31<51:57:08, 17.19s/it]
                                                            
{'loss': '0.1051', 'grad_norm': '1.561', 'learning_rate': '4.01e-06', 'epoch': '0.7133'}

 71%|███████▏  | 27080/37963 [116:04:31<51:57:08, 17.19s/it]
 71%|███████▏  | 27081/37963 [116:04:45<49:09:41, 16.26s/it]
 71%|███████▏  | 27082/37963 [116:05:00<47:31:12, 15.72s/it]
 71%|███████▏  | 27083/37963 [116:05:14<46:19:09, 15.33s/it]
 71%|███████▏  | 27084/37963 [116:05:28<45:27:56, 15.05s/it]
 71%|███████▏  | 27085/37963 [116:05:55<56:00:02, 18.53s/it]
 71%|███████▏  | 27086/37963 [116:06:09<51:29:59, 17.05s/it]
 71%|███████▏  | 27087/37963 [116:06:23<49:06:52, 16.26s/it]
 71%|███████▏  | 27088/37963 [116:06:37<47:23:57, 15.69s/it]
 71%|███████▏  | 27089/37963 [116:06:52<46:12:43, 15.30s/it]
 71%|███████▏  | 27090/37963 [116:07:06<44:59:07, 14.89s/it]
                                                            
{'loss': '0.1135', 'grad_norm': '1.726', 'learning_rate': '4.003e-06', 'epoch': '0.7136'}

 71%|███████▏  | 27090/37963 [116:07:06<44:59:07, 14.89s/it]
 71%|███████▏  | 27091/37963 [116:07:20<44:29:10, 14.73s/it]
 71%|███████▏  | 27092/37963 [116:07:35<44:18:07, 14.67s/it]
 71%|███████▏  | 27093/37963 [116:07:49<43:58:10, 14.56s/it]
 71%|███████▏  | 27094/37963 [116:08:03<43:44:12, 14.49s/it]
 71%|███████▏  | 27095/37963 [116:08:18<43:34:10, 14.43s/it]
 71%|███████▏  | 27096/37963 [116:08:32<43:21:25, 14.36s/it]
 71%|███████▏  | 27097/37963 [116:08:46<43:15:01, 14.33s/it]
 71%|███████▏  | 27098/37963 [116:09:00<43:14:30, 14.33s/it]
 71%|███████▏  | 27099/37963 [116:09:15<43:21:21, 14.37s/it]
 71%|███████▏  | 27100/37963 [116:09:29<43:24:51, 14.39s/it]
                                                            
{'loss': '0.1157', 'grad_norm': '2.378', 'learning_rate': '3.996e-06', 'epoch': '0.7139'}

 71%|███████▏  | 27100/37963 [116:09:29<43:24:51, 14.39s/it]
 71%|███████▏  | 27101/37963 [116:09:43<43:13:21, 14.33s/it]
 71%|███████▏  | 27102/37963 [116:09:57<42:43:53, 14.16s/it]
 71%|███████▏  | 27103/37963 [116:10:11<42:45:33, 14.17s/it]
 71%|███████▏  | 27104/37963 [116:10:26<42:47:40, 14.19s/it]
 71%|███████▏  | 27105/37963 [116:10:40<43:06:36, 14.29s/it]
 71%|███████▏  | 27106/37963 [116:10:54<43:02:31, 14.27s/it]
 71%|███████▏  | 27107/37963 [116:11:09<43:09:18, 14.31s/it]
 71%|███████▏  | 27108/37963 [116:11:23<43:12:26, 14.33s/it]
 71%|███████▏  | 27109/37963 [116:11:38<43:20:59, 14.38s/it]
 71%|███████▏  | 27110/37963 [116:11:58<48:54:51, 16.23s/it]
                                                            
{'loss': '0.1102', 'grad_norm': '2.157', 'learning_rate': '3.99e-06', 'epoch': '0.7141'}

 71%|███████▏  | 27110/37963 [116:11:58<48:54:51, 16.23s/it]
 71%|███████▏  | 27111/37963 [116:12:13<47:12:43, 15.66s/it]
 71%|███████▏  | 27112/37963 [116:12:27<45:39:46, 15.15s/it]
 71%|███████▏  | 27113/37963 [116:12:47<50:41:56, 16.82s/it]
 71%|███████▏  | 27114/37963 [116:13:14<60:02:58, 19.93s/it]
 71%|███████▏  | 27115/37963 [116:13:28<54:28:44, 18.08s/it]
 71%|███████▏  | 27116/37963 [116:13:42<50:56:02, 16.90s/it]
 71%|███████▏  | 27117/37963 [116:13:57<48:39:07, 16.15s/it]
 71%|███████▏  | 27118/37963 [116:14:11<46:43:31, 15.51s/it]
 71%|███████▏  | 27119/37963 [116:14:25<45:32:15, 15.12s/it]
 71%|███████▏  | 27120/37963 [116:14:39<44:50:28, 14.89s/it]
                                                            
{'loss': '0.1014', 'grad_norm': '1.873', 'learning_rate': '3.983e-06', 'epoch': '0.7144'}

 71%|███████▏  | 27120/37963 [116:14:39<44:50:28, 14.89s/it]
 71%|███████▏  | 27121/37963 [116:14:54<44:18:21, 14.71s/it]
 71%|███████▏  | 27122/37963 [116:15:08<44:05:51, 14.64s/it]
 71%|███████▏  | 27123/37963 [116:15:23<44:00:16, 14.61s/it]
 71%|███████▏  | 27124/37963 [116:15:37<43:42:46, 14.52s/it]
 71%|███████▏  | 27125/37963 [116:15:51<43:35:01, 14.48s/it]
 71%|███████▏  | 27126/37963 [116:16:06<43:33:01, 14.47s/it]
 71%|███████▏  | 27127/37963 [116:16:20<43:22:05, 14.41s/it]
 71%|███████▏  | 27128/37963 [116:16:34<43:21:53, 14.41s/it]
 71%|███████▏  | 27129/37963 [116:16:56<49:28:40, 16.44s/it]
 71%|███████▏  | 27130/37963 [116:17:10<47:44:15, 15.86s/it]
                                                            
{'loss': '0.1056', 'grad_norm': '2.207', 'learning_rate': '3.976e-06', 'epoch': '0.7146'}

 71%|███████▏  | 27130/37963 [116:17:10<47:44:15, 15.86s/it]
 71%|███████▏  | 27131/37963 [116:17:25<46:28:34, 15.45s/it]
 71%|███████▏  | 27132/37963 [116:17:46<51:26:55, 17.10s/it]
 71%|███████▏  | 27133/37963 [116:18:00<48:52:07, 16.24s/it]
 71%|███████▏  | 27134/37963 [116:18:21<53:11:18, 17.68s/it]
 71%|███████▏  | 27135/37963 [116:18:42<56:01:49, 18.63s/it]
 71%|███████▏  | 27136/37963 [116:18:55<51:37:34, 17.17s/it]
 71%|███████▏  | 27137/37963 [116:19:10<49:08:57, 16.34s/it]
 71%|███████▏  | 27138/37963 [116:19:24<47:29:50, 15.80s/it]
 71%|███████▏  | 27139/37963 [116:19:39<46:11:10, 15.36s/it]
 71%|███████▏  | 27140/37963 [116:19:53<45:02:21, 14.98s/it]
                                                            
{'loss': '0.1102', 'grad_norm': '3.004', 'learning_rate': '3.969e-06', 'epoch': '0.7149'}

 71%|███████▏  | 27140/37963 [116:19:53<45:02:21, 14.98s/it]
 71%|███████▏  | 27141/37963 [116:20:07<44:28:24, 14.79s/it]
 71%|███████▏  | 27142/37963 [116:20:22<44:07:14, 14.68s/it]
 71%|███████▏  | 27143/37963 [116:20:36<43:48:38, 14.58s/it]
 72%|███████▏  | 27144/37963 [116:20:50<43:37:03, 14.51s/it]
 72%|███████▏  | 27145/37963 [116:21:04<42:42:32, 14.21s/it]
 72%|███████▏  | 27146/37963 [116:21:18<42:53:34, 14.28s/it]
 72%|███████▏  | 27147/37963 [116:21:33<43:02:44, 14.33s/it]
 72%|███████▏  | 27148/37963 [116:21:47<43:08:09, 14.36s/it]
 72%|███████▏  | 27149/37963 [116:22:01<42:15:21, 14.07s/it]
 72%|███████▏  | 27150/37963 [116:22:15<42:33:38, 14.17s/it]
                                                            
{'loss': '0.1084', 'grad_norm': '2.175', 'learning_rate': '3.962e-06', 'epoch': '0.7152'}

 72%|███████▏  | 27150/37963 [116:22:15<42:33:38, 14.17s/it]
 72%|███████▏  | 27151/37963 [116:22:29<42:46:05, 14.24s/it]
 72%|███████▏  | 27152/37963 [116:22:43<42:09:25, 14.04s/it]
 72%|███████▏  | 27153/37963 [116:22:57<42:24:48, 14.12s/it]
 72%|███████▏  | 27154/37963 [116:23:12<42:45:40, 14.24s/it]
 72%|███████▏  | 27155/37963 [116:23:26<42:53:00, 14.28s/it]
 72%|███████▏  | 27156/37963 [116:23:41<42:59:58, 14.32s/it]
 72%|███████▏  | 27157/37963 [116:23:55<43:07:35, 14.37s/it]
 72%|███████▏  | 27158/37963 [116:24:10<43:14:09, 14.41s/it]
 72%|███████▏  | 27159/37963 [116:24:30<48:44:52, 16.24s/it]
 72%|███████▏  | 27160/37963 [116:24:44<47:04:33, 15.69s/it]
                                                            
{'loss': '0.1117', 'grad_norm': '2.518', 'learning_rate': '3.956e-06', 'epoch': '0.7154'}

 72%|███████▏  | 27160/37963 [116:24:44<47:04:33, 15.69s/it]
 72%|███████▏  | 27161/37963 [116:24:59<45:39:02, 15.21s/it]
 72%|███████▏  | 27162/37963 [116:25:13<44:55:44, 14.97s/it]
 72%|███████▏  | 27163/37963 [116:25:47<62:06:08, 20.70s/it]
 72%|███████▏  | 27164/37963 [116:26:01<56:30:10, 18.84s/it]
 72%|███████▏  | 27165/37963 [116:26:16<52:31:01, 17.51s/it]
 72%|███████▏  | 27166/37963 [116:26:30<49:04:00, 16.36s/it]
 72%|███████▏  | 27167/37963 [116:26:44<47:16:16, 15.76s/it]
 72%|███████▏  | 27168/37963 [116:26:58<46:00:48, 15.34s/it]
 72%|███████▏  | 27169/37963 [116:27:13<45:09:03, 15.06s/it]
 72%|███████▏  | 27170/37963 [116:27:27<44:30:59, 14.85s/it]
                                                            
{'loss': '0.09874', 'grad_norm': '2.725', 'learning_rate': '3.949e-06', 'epoch': '0.7157'}

 72%|███████▏  | 27170/37963 [116:27:27<44:30:59, 14.85s/it]
 72%|███████▏  | 27171/37963 [116:27:42<44:10:41, 14.74s/it]
 72%|███████▏  | 27172/37963 [116:27:56<43:44:03, 14.59s/it]
 72%|███████▏  | 27173/37963 [116:28:10<43:31:41, 14.52s/it]
 72%|███████▏  | 27174/37963 [116:28:24<43:18:48, 14.45s/it]
 72%|███████▏  | 27175/37963 [116:28:39<43:14:11, 14.43s/it]
 72%|███████▏  | 27176/37963 [116:28:53<43:11:51, 14.42s/it]
 72%|███████▏  | 27177/37963 [116:29:15<49:43:40, 16.60s/it]
 72%|███████▏  | 27178/37963 [116:29:29<47:51:14, 15.97s/it]
 72%|███████▏  | 27179/37963 [116:29:44<46:28:39, 15.52s/it]
 72%|███████▏  | 27180/37963 [116:30:04<50:35:16, 16.89s/it]
                                                            
{'loss': '0.1043', 'grad_norm': '2.725', 'learning_rate': '3.942e-06', 'epoch': '0.716'}

 72%|███████▏  | 27180/37963 [116:30:04<50:35:16, 16.89s/it]
 72%|███████▏  | 27181/37963 [116:30:18<48:21:01, 16.14s/it]
 72%|███████▏  | 27182/37963 [116:30:33<46:45:23, 15.61s/it]
 72%|███████▏  | 27183/37963 [116:30:53<51:06:36, 17.07s/it]
 72%|███████▏  | 27184/37963 [116:31:14<54:28:34, 18.19s/it]
 72%|███████▏  | 27185/37963 [116:31:28<51:00:51, 17.04s/it]
 72%|███████▏  | 27186/37963 [116:31:43<48:38:18, 16.25s/it]
 72%|███████▏  | 27187/37963 [116:31:57<47:00:59, 15.71s/it]
 72%|███████▏  | 27188/37963 [116:32:12<45:54:52, 15.34s/it]
 72%|███████▏  | 27189/37963 [116:32:26<45:01:46, 15.05s/it]
 72%|███████▏  | 27190/37963 [116:32:41<44:31:21, 14.88s/it]
                                                            
{'loss': '0.1007', 'grad_norm': '2.508', 'learning_rate': '3.935e-06', 'epoch': '0.7162'}

 72%|███████▏  | 27190/37963 [116:32:41<44:31:21, 14.88s/it]
 72%|███████▏  | 27191/37963 [116:32:55<44:03:43, 14.73s/it]
 72%|███████▏  | 27192/37963 [116:33:09<43:31:53, 14.55s/it]
 72%|███████▏  | 27193/37963 [116:33:23<43:22:40, 14.50s/it]
 72%|███████▏  | 27194/37963 [116:33:38<43:09:41, 14.43s/it]
 72%|███████▏  | 27195/37963 [116:33:52<43:05:48, 14.41s/it]
 72%|███████▏  | 27196/37963 [116:34:06<43:06:57, 14.42s/it]
 72%|███████▏  | 27197/37963 [116:34:21<43:06:48, 14.42s/it]
 72%|███████▏  | 27198/37963 [116:34:35<43:06:03, 14.41s/it]
 72%|███████▏  | 27199/37963 [116:34:49<42:50:15, 14.33s/it]
 72%|███████▏  | 27200/37963 [116:35:04<42:46:01, 14.30s/it]
                                                            
{'loss': '0.09832', 'grad_norm': '1.6', 'learning_rate': '3.928e-06', 'epoch': '0.7165'}

 72%|███████▏  | 27200/37963 [116:35:04<42:46:01, 14.30s/it]
 72%|███████▏  | 27201/37963 [116:35:18<42:37:22, 14.26s/it]
 72%|███████▏  | 27202/37963 [116:35:32<42:42:09, 14.29s/it]
 72%|███████▏  | 27203/37963 [116:35:47<42:47:48, 14.32s/it]
 72%|███████▏  | 27204/37963 [116:36:01<42:52:31, 14.35s/it]
 72%|███████▏  | 27205/37963 [116:36:15<42:45:39, 14.31s/it]
 72%|███████▏  | 27206/37963 [116:36:30<42:56:27, 14.37s/it]
 72%|███████▏  | 27207/37963 [116:36:50<48:27:05, 16.22s/it]
 72%|███████▏  | 27208/37963 [116:37:05<46:50:56, 15.68s/it]
 72%|███████▏  | 27209/37963 [116:37:19<45:40:41, 15.29s/it]
 72%|███████▏  | 27210/37963 [116:37:33<44:52:16, 15.02s/it]
                                                            
{'loss': '0.1076', 'grad_norm': '2.854', 'learning_rate': '3.922e-06', 'epoch': '0.7168'}

 72%|███████▏  | 27210/37963 [116:37:33<44:52:16, 15.02s/it]
 72%|███████▏  | 27211/37963 [116:38:02<56:39:06, 18.97s/it]
 72%|███████▏  | 27212/37963 [116:38:16<52:15:07, 17.50s/it]
 72%|███████▏  | 27213/37963 [116:38:30<49:31:26, 16.58s/it]
 72%|███████▏  | 27214/37963 [116:38:44<47:29:24, 15.91s/it]
 72%|███████▏  | 27215/37963 [116:38:59<45:57:50, 15.40s/it]
 72%|███████▏  | 27216/37963 [116:39:13<45:08:01, 15.12s/it]
 72%|███████▏  | 27217/37963 [116:39:28<44:31:31, 14.92s/it]
 72%|███████▏  | 27218/37963 [116:39:42<43:45:02, 14.66s/it]
 72%|███████▏  | 27219/37963 [116:39:56<43:35:54, 14.61s/it]
 72%|███████▏  | 27220/37963 [116:40:11<43:26:03, 14.55s/it]
                                                            
{'loss': '0.1053', 'grad_norm': '1.712', 'learning_rate': '3.915e-06', 'epoch': '0.717'}

 72%|███████▏  | 27220/37963 [116:40:11<43:26:03, 14.55s/it]
 72%|███████▏  | 27221/37963 [116:40:25<43:15:48, 14.50s/it]
 72%|███████▏  | 27222/37963 [116:40:39<43:17:30, 14.51s/it]
 72%|███████▏  | 27223/37963 [116:40:54<43:04:12, 14.44s/it]
 72%|███████▏  | 27224/37963 [116:41:08<43:03:31, 14.43s/it]
 72%|███████▏  | 27225/37963 [116:41:23<42:58:46, 14.41s/it]
 72%|███████▏  | 27226/37963 [116:41:50<54:36:07, 18.31s/it]
 72%|███████▏  | 27227/37963 [116:42:04<51:06:32, 17.14s/it]
 72%|███████▏  | 27228/37963 [116:42:19<48:33:08, 16.28s/it]
 72%|███████▏  | 27229/37963 [116:42:33<46:52:23, 15.72s/it]
 72%|███████▏  | 27230/37963 [116:42:54<51:28:33, 17.27s/it]
                                                            
{'loss': '0.1028', 'grad_norm': '3.136', 'learning_rate': '3.908e-06', 'epoch': '0.7173'}

 72%|███████▏  | 27230/37963 [116:42:54<51:28:33, 17.27s/it]
 72%|███████▏  | 27231/37963 [116:43:08<49:03:18, 16.46s/it]
 72%|███████▏  | 27232/37963 [116:43:29<52:25:28, 17.59s/it]
 72%|███████▏  | 27233/37963 [116:43:43<49:34:20, 16.63s/it]
 72%|███████▏  | 27234/37963 [116:43:57<47:28:27, 15.93s/it]
 72%|███████▏  | 27235/37963 [116:44:12<46:00:18, 15.44s/it]
 72%|███████▏  | 27236/37963 [116:44:26<45:05:14, 15.13s/it]
 72%|███████▏  | 27237/37963 [116:44:40<44:23:08, 14.90s/it]
 72%|███████▏  | 27238/37963 [116:44:55<43:52:14, 14.73s/it]
 72%|███████▏  | 27239/37963 [116:45:09<43:20:25, 14.55s/it]
 72%|███████▏  | 27240/37963 [116:45:23<42:54:07, 14.40s/it]
                                                            
{'loss': '0.09489', 'grad_norm': '1.947', 'learning_rate': '3.901e-06', 'epoch': '0.7175'}

 72%|███████▏  | 27240/37963 [116:45:23<42:54:07, 14.40s/it]
 72%|███████▏  | 27241/37963 [116:45:37<42:57:25, 14.42s/it]
 72%|███████▏  | 27242/37963 [116:45:52<42:55:04, 14.41s/it]
 72%|███████▏  | 27243/37963 [116:46:06<42:54:06, 14.41s/it]
 72%|███████▏  | 27244/37963 [116:46:21<42:51:16, 14.39s/it]
 72%|███████▏  | 27245/37963 [116:46:35<42:50:18, 14.39s/it]
 72%|███████▏  | 27246/37963 [116:46:49<42:55:15, 14.42s/it]
 72%|███████▏  | 27247/37963 [116:47:04<42:57:30, 14.43s/it]
 72%|███████▏  | 27248/37963 [116:47:18<42:55:47, 14.42s/it]
 72%|███████▏  | 27249/37963 [116:47:33<42:53:20, 14.41s/it]
 72%|███████▏  | 27250/37963 [116:47:47<42:53:11, 14.41s/it]
                                                            
{'loss': '0.1116', 'grad_norm': '1.985', 'learning_rate': '3.895e-06', 'epoch': '0.7178'}

 72%|███████▏  | 27250/37963 [116:47:47<42:53:11, 14.41s/it]
 72%|███████▏  | 27251/37963 [116:48:02<42:53:40, 14.42s/it]
 72%|███████▏  | 27252/37963 [116:48:16<42:53:48, 14.42s/it]
 72%|███████▏  | 27253/37963 [116:48:30<42:07:36, 14.16s/it]
 72%|███████▏  | 27254/37963 [116:48:44<42:26:14, 14.27s/it]
 72%|███████▏  | 27255/37963 [116:48:58<42:21:26, 14.24s/it]
 72%|███████▏  | 27256/37963 [116:49:19<48:06:50, 16.18s/it]
 72%|███████▏  | 27257/37963 [116:49:33<46:32:38, 15.65s/it]
 72%|███████▏  | 27258/37963 [116:49:54<51:10:09, 17.21s/it]
 72%|███████▏  | 27259/37963 [116:50:09<48:37:31, 16.35s/it]
 72%|███████▏  | 27260/37963 [116:50:29<52:38:35, 17.71s/it]
                                                            
{'loss': '0.1017', 'grad_norm': '2.058', 'learning_rate': '3.888e-06', 'epoch': '0.7181'}

 72%|███████▏  | 27260/37963 [116:50:29<52:38:35, 17.71s/it]
 72%|███████▏  | 27261/37963 [116:50:50<55:36:36, 18.71s/it]
 72%|███████▏  | 27262/37963 [116:51:05<51:42:38, 17.40s/it]
 72%|███████▏  | 27263/37963 [116:51:19<49:05:25, 16.52s/it]
 72%|███████▏  | 27264/37963 [116:51:33<47:00:03, 15.81s/it]
 72%|███████▏  | 27265/37963 [116:51:48<45:53:46, 15.44s/it]
 72%|███████▏  | 27266/37963 [116:52:02<45:00:29, 15.15s/it]
 72%|███████▏  | 27267/37963 [116:52:17<44:18:20, 14.91s/it]
 72%|███████▏  | 27268/37963 [116:52:31<43:50:04, 14.75s/it]
 72%|███████▏  | 27269/37963 [116:52:46<43:31:35, 14.65s/it]
 72%|███████▏  | 27270/37963 [116:52:59<42:41:17, 14.37s/it]
                                                            
{'loss': '0.1022', 'grad_norm': '1.524', 'learning_rate': '3.881e-06', 'epoch': '0.7183'}

 72%|███████▏  | 27270/37963 [116:52:59<42:41:17, 14.37s/it]
 72%|███████▏  | 27271/37963 [116:53:13<42:14:03, 14.22s/it]
 72%|███████▏  | 27272/37963 [116:53:28<42:26:34, 14.29s/it]
 72%|███████▏  | 27273/37963 [116:53:42<42:30:41, 14.32s/it]
 72%|███████▏  | 27274/37963 [116:53:56<42:24:10, 14.28s/it]
 72%|███████▏  | 27275/37963 [116:54:24<54:25:54, 18.33s/it]
 72%|███████▏  | 27276/37963 [116:54:38<50:36:34, 17.05s/it]
 72%|███████▏  | 27277/37963 [116:54:52<47:57:47, 16.16s/it]
 72%|███████▏  | 27278/37963 [116:55:13<51:59:58, 17.52s/it]
 72%|███████▏  | 27279/37963 [116:55:33<54:08:32, 18.24s/it]
 72%|███████▏  | 27280/37963 [116:55:47<50:18:40, 16.95s/it]
                                                            
{'loss': '0.1026', 'grad_norm': '1.936', 'learning_rate': '3.874e-06', 'epoch': '0.7186'}

 72%|███████▏  | 27280/37963 [116:55:47<50:18:40, 16.95s/it]
 72%|███████▏  | 27281/37963 [116:56:01<48:00:14, 16.18s/it]
 72%|███████▏  | 27282/37963 [116:56:16<46:26:25, 15.65s/it]
 72%|███████▏  | 27283/37963 [116:56:29<44:53:42, 15.13s/it]
 72%|███████▏  | 27284/37963 [116:56:44<44:16:50, 14.93s/it]
 72%|███████▏  | 27285/37963 [116:56:58<43:52:58, 14.79s/it]
 72%|███████▏  | 27286/37963 [116:57:13<43:32:36, 14.68s/it]
 72%|███████▏  | 27287/37963 [116:57:27<43:06:31, 14.54s/it]
 72%|███████▏  | 27288/37963 [116:57:41<43:01:33, 14.51s/it]
 72%|███████▏  | 27289/37963 [116:57:55<42:17:44, 14.27s/it]
 72%|███████▏  | 27290/37963 [116:58:09<42:20:54, 14.28s/it]
                                                            
{'loss': '0.09862', 'grad_norm': '2.285', 'learning_rate': '3.868e-06', 'epoch': '0.7189'}

 72%|███████▏  | 27290/37963 [116:58:09<42:20:54, 14.28s/it]
 72%|███████▏  | 27291/37963 [116:58:24<42:28:10, 14.33s/it]
 72%|███████▏  | 27292/37963 [116:58:38<42:33:38, 14.36s/it]
 72%|███████▏  | 27293/37963 [116:58:53<42:34:17, 14.36s/it]
 72%|███████▏  | 27294/37963 [116:59:07<42:33:18, 14.36s/it]
 72%|███████▏  | 27295/37963 [116:59:21<42:27:13, 14.33s/it]
 72%|███████▏  | 27296/37963 [116:59:36<42:29:54, 14.34s/it]
 72%|███████▏  | 27297/37963 [116:59:50<42:23:00, 14.31s/it]
 72%|███████▏  | 27298/37963 [117:00:04<42:24:17, 14.31s/it]
 72%|███████▏  | 27299/37963 [117:00:19<42:31:13, 14.35s/it]
 72%|███████▏  | 27300/37963 [117:00:33<42:34:47, 14.38s/it]
                                                            
{'loss': '0.09131', 'grad_norm': '1.654', 'learning_rate': '3.861e-06', 'epoch': '0.7191'}

 72%|███████▏  | 27300/37963 [117:00:33<42:34:47, 14.38s/it]
 72%|███████▏  | 27301/37963 [117:00:48<42:35:55, 14.38s/it]
 72%|███████▏  | 27302/37963 [117:01:02<42:29:50, 14.35s/it]
 72%|███████▏  | 27303/37963 [117:01:16<42:19:24, 14.29s/it]
 72%|███████▏  | 27304/37963 [117:01:30<42:26:08, 14.33s/it]
 72%|███████▏  | 27305/37963 [117:01:45<42:30:57, 14.36s/it]
 72%|███████▏  | 27306/37963 [117:02:05<47:47:33, 16.14s/it]
 72%|███████▏  | 27307/37963 [117:02:20<46:17:20, 15.64s/it]
 72%|███████▏  | 27308/37963 [117:02:40<50:48:44, 17.17s/it]
 72%|███████▏  | 27309/37963 [117:03:01<54:11:47, 18.31s/it]
 72%|███████▏  | 27310/37963 [117:03:23<57:20:40, 19.38s/it]
                                                            
{'loss': '0.1103', 'grad_norm': '2.136', 'learning_rate': '3.854e-06', 'epoch': '0.7194'}

 72%|███████▏  | 27310/37963 [117:03:23<57:20:40, 19.38s/it]
 72%|███████▏  | 27311/37963 [117:03:37<52:46:50, 17.84s/it]
 72%|███████▏  | 27312/37963 [117:03:52<49:45:55, 16.82s/it]
 72%|███████▏  | 27313/37963 [117:04:05<46:51:42, 15.84s/it]
 72%|███████▏  | 27314/37963 [117:04:19<45:04:53, 15.24s/it]
 72%|███████▏  | 27315/37963 [117:04:34<44:18:45, 14.98s/it]
 72%|███████▏  | 27316/37963 [117:04:48<43:45:40, 14.80s/it]
 72%|███████▏  | 27317/37963 [117:05:02<43:01:05, 14.55s/it]
 72%|███████▏  | 27318/37963 [117:05:16<42:56:20, 14.52s/it]
 72%|███████▏  | 27319/37963 [117:05:30<42:19:48, 14.32s/it]
 72%|███████▏  | 27320/37963 [117:05:45<42:28:08, 14.37s/it]
                                                            
{'loss': '0.1053', 'grad_norm': '2.033', 'learning_rate': '3.847e-06', 'epoch': '0.7197'}

 72%|███████▏  | 27320/37963 [117:05:45<42:28:08, 14.37s/it]
 72%|███████▏  | 27321/37963 [117:05:59<42:27:04, 14.36s/it]
 72%|███████▏  | 27322/37963 [117:06:14<42:34:04, 14.40s/it]
 72%|███████▏  | 27323/37963 [117:06:28<42:23:08, 14.34s/it]
 72%|███████▏  | 27324/37963 [117:06:49<48:20:16, 16.36s/it]
 72%|███████▏  | 27325/37963 [117:07:10<52:09:45, 17.65s/it]
 72%|███████▏  | 27326/37963 [117:07:30<54:54:10, 18.58s/it]
 72%|███████▏  | 27327/37963 [117:07:50<56:17:08, 19.05s/it]
 72%|███████▏  | 27328/37963 [117:08:05<52:15:46, 17.69s/it]
 72%|███████▏  | 27329/37963 [117:08:19<49:22:44, 16.72s/it]
 72%|███████▏  | 27330/37963 [117:08:34<47:15:04, 16.00s/it]
                                                            
{'loss': '0.09705', 'grad_norm': '2.085', 'learning_rate': '3.841e-06', 'epoch': '0.7199'}

 72%|███████▏  | 27330/37963 [117:08:34<47:15:04, 16.00s/it]
 72%|███████▏  | 27331/37963 [117:08:48<45:31:56, 15.42s/it]
 72%|███████▏  | 27332/37963 [117:09:02<44:17:49, 15.00s/it]
 72%|███████▏  | 27333/37963 [117:09:16<43:42:14, 14.80s/it]
 72%|███████▏  | 27334/37963 [117:09:30<43:15:30, 14.65s/it]
 72%|███████▏  | 27335/37963 [117:09:45<43:03:21, 14.58s/it]
 72%|███████▏  | 27336/37963 [117:09:59<42:48:50, 14.50s/it]
 72%|███████▏  | 27337/37963 [117:10:14<42:45:19, 14.49s/it]
 72%|███████▏  | 27338/37963 [117:10:28<42:28:35, 14.39s/it]
 72%|███████▏  | 27339/37963 [117:10:42<41:56:11, 14.21s/it]
 72%|███████▏  | 27340/37963 [117:10:56<42:03:36, 14.25s/it]
                                                            
{'loss': '0.09809', 'grad_norm': '3.044', 'learning_rate': '3.834e-06', 'epoch': '0.7202'}

 72%|███████▏  | 27340/37963 [117:10:56<42:03:36, 14.25s/it]
 72%|███████▏  | 27341/37963 [117:11:10<41:52:46, 14.19s/it]
 72%|███████▏  | 27342/37963 [117:11:24<42:04:17, 14.26s/it]
 72%|███████▏  | 27343/37963 [117:11:38<41:41:54, 14.14s/it]
 72%|███████▏  | 27344/37963 [117:11:52<41:40:38, 14.13s/it]
 72%|███████▏  | 27345/37963 [117:12:07<41:55:49, 14.22s/it]
 72%|███████▏  | 27346/37963 [117:12:21<42:10:47, 14.30s/it]
 72%|███████▏  | 27347/37963 [117:12:35<41:56:35, 14.22s/it]
 72%|███████▏  | 27348/37963 [117:12:50<42:09:06, 14.30s/it]
 72%|███████▏  | 27349/37963 [117:13:04<42:03:41, 14.27s/it]
 72%|███████▏  | 27350/37963 [117:13:18<41:52:59, 14.21s/it]
                                                            
{'loss': '0.1202', 'grad_norm': '3.27', 'learning_rate': '3.827e-06', 'epoch': '0.7204'}

 72%|███████▏  | 27350/37963 [117:13:18<41:52:59, 14.21s/it]
 72%|███████▏  | 27351/37963 [117:13:32<41:27:29, 14.06s/it]
 72%|███████▏  | 27352/37963 [117:13:46<41:54:25, 14.22s/it]
 72%|███████▏  | 27353/37963 [117:14:01<42:01:43, 14.26s/it]
 72%|███████▏  | 27354/37963 [117:14:21<47:46:23, 16.21s/it]
 72%|███████▏  | 27355/37963 [117:14:36<46:06:25, 15.65s/it]
 72%|███████▏  | 27356/37963 [117:14:50<44:56:11, 15.25s/it]
 72%|███████▏  | 27357/37963 [117:15:11<50:08:12, 17.02s/it]
 72%|███████▏  | 27358/37963 [117:15:32<53:51:28, 18.28s/it]
 72%|███████▏  | 27359/37963 [117:15:54<56:22:16, 19.14s/it]
 72%|███████▏  | 27360/37963 [117:16:07<51:21:26, 17.44s/it]
                                                            
{'loss': '0.1044', 'grad_norm': '3.137', 'learning_rate': '3.821e-06', 'epoch': '0.7207'}

 72%|███████▏  | 27360/37963 [117:16:07<51:21:26, 17.44s/it]
 72%|███████▏  | 27361/37963 [117:16:21<48:35:34, 16.50s/it]
 72%|███████▏  | 27362/37963 [117:16:35<46:14:14, 15.70s/it]
 72%|███████▏  | 27363/37963 [117:16:50<45:03:31, 15.30s/it]
 72%|███████▏  | 27364/37963 [117:17:04<44:15:05, 15.03s/it]
 72%|███████▏  | 27365/37963 [117:17:18<43:24:32, 14.75s/it]
 72%|███████▏  | 27366/37963 [117:17:32<43:04:38, 14.63s/it]
 72%|███████▏  | 27367/37963 [117:17:47<42:49:01, 14.55s/it]
 72%|███████▏  | 27368/37963 [117:18:01<42:40:26, 14.50s/it]
 72%|███████▏  | 27369/37963 [117:18:15<42:13:28, 14.35s/it]
 72%|███████▏  | 27370/37963 [117:18:30<42:19:22, 14.38s/it]
                                                            
{'loss': '0.09824', 'grad_norm': '1.978', 'learning_rate': '3.814e-06', 'epoch': '0.721'}

 72%|███████▏  | 27370/37963 [117:18:30<42:19:22, 14.38s/it]
 72%|███████▏  | 27371/37963 [117:18:44<42:16:50, 14.37s/it]
 72%|███████▏  | 27372/37963 [117:18:58<41:47:04, 14.20s/it]
 72%|███████▏  | 27373/37963 [117:19:19<47:56:31, 16.30s/it]
 72%|███████▏  | 27374/37963 [117:19:40<51:44:48, 17.59s/it]
 72%|███████▏  | 27375/37963 [117:20:01<55:06:30, 18.74s/it]
 72%|███████▏  | 27376/37963 [117:20:22<57:04:50, 19.41s/it]
 72%|███████▏  | 27377/37963 [117:20:36<52:41:20, 17.92s/it]
 72%|███████▏  | 27378/37963 [117:20:51<49:35:04, 16.86s/it]
 72%|███████▏  | 27379/37963 [117:21:05<47:29:44, 16.16s/it]
 72%|███████▏  | 27380/37963 [117:21:19<45:40:16, 15.54s/it]
                                                            
{'loss': '0.1136', 'grad_norm': '3.285', 'learning_rate': '3.807e-06', 'epoch': '0.7212'}

 72%|███████▏  | 27380/37963 [117:21:19<45:40:16, 15.54s/it]
 72%|███████▏  | 27381/37963 [117:21:34<44:42:13, 15.21s/it]
 72%|███████▏  | 27382/37963 [117:21:48<43:47:13, 14.90s/it]
 72%|███████▏  | 27383/37963 [117:22:02<43:18:38, 14.74s/it]
 72%|███████▏  | 27384/37963 [117:22:17<43:04:35, 14.66s/it]
 72%|███████▏  | 27385/37963 [117:22:31<42:17:27, 14.39s/it]
 72%|███████▏  | 27386/37963 [117:22:45<42:14:59, 14.38s/it]
 72%|███████▏  | 27387/37963 [117:22:59<42:19:04, 14.40s/it]
 72%|███████▏  | 27388/37963 [117:23:14<42:24:03, 14.43s/it]
 72%|███████▏  | 27389/37963 [117:23:29<42:30:55, 14.47s/it]
 72%|███████▏  | 27390/37963 [117:23:43<42:24:57, 14.44s/it]
                                                            
{'loss': '0.1139', 'grad_norm': '3.799', 'learning_rate': '3.8e-06', 'epoch': '0.7215'}

 72%|███████▏  | 27390/37963 [117:23:43<42:24:57, 14.44s/it]
 72%|███████▏  | 27391/37963 [117:23:57<42:24:59, 14.44s/it]
 72%|███████▏  | 27392/37963 [117:24:11<42:07:00, 14.34s/it]
 72%|███████▏  | 27393/37963 [117:24:26<42:07:44, 14.35s/it]
 72%|███████▏  | 27394/37963 [117:24:40<42:02:02, 14.32s/it]
 72%|███████▏  | 27395/37963 [117:24:54<41:45:50, 14.23s/it]
 72%|███████▏  | 27396/37963 [117:25:09<41:57:09, 14.29s/it]
 72%|███████▏  | 27397/37963 [117:25:23<42:02:23, 14.32s/it]
 72%|███████▏  | 27398/37963 [117:25:37<42:03:23, 14.33s/it]
 72%|███████▏  | 27399/37963 [117:25:51<41:13:50, 14.05s/it]
 72%|███████▏  | 27400/37963 [117:26:05<41:34:07, 14.17s/it]
                                                            
{'loss': '0.09834', 'grad_norm': '2.177', 'learning_rate': '3.794e-06', 'epoch': '0.7218'}

 72%|███████▏  | 27400/37963 [117:26:05<41:34:07, 14.17s/it]
 72%|███████▏  | 27401/37963 [117:26:26<47:22:12, 16.15s/it]
 72%|███████▏  | 27402/37963 [117:26:40<45:49:08, 15.62s/it]
 72%|███████▏  | 27403/37963 [117:26:55<44:50:21, 15.29s/it]
 72%|███████▏  | 27404/37963 [117:27:08<43:21:38, 14.78s/it]
 72%|███████▏  | 27405/37963 [117:27:23<43:04:23, 14.69s/it]
 72%|███████▏  | 27406/37963 [117:27:44<48:38:45, 16.59s/it]
 72%|███████▏  | 27407/37963 [117:28:11<58:17:34, 19.88s/it]
 72%|███████▏  | 27408/37963 [117:28:26<53:27:15, 18.23s/it]
 72%|███████▏  | 27409/37963 [117:28:40<50:08:30, 17.10s/it]
 72%|███████▏  | 27410/37963 [117:28:54<47:26:05, 16.18s/it]
                                                            
{'loss': '0.09848', 'grad_norm': '2.811', 'learning_rate': '3.787e-06', 'epoch': '0.722'}

 72%|███████▏  | 27410/37963 [117:28:54<47:26:05, 16.18s/it]
 72%|███████▏  | 27411/37963 [117:29:09<45:41:56, 15.59s/it]
 72%|███████▏  | 27412/37963 [117:29:23<44:37:33, 15.23s/it]
 72%|███████▏  | 27413/37963 [117:29:37<43:23:17, 14.81s/it]
 72%|███████▏  | 27414/37963 [117:29:51<43:03:13, 14.69s/it]
 72%|███████▏  | 27415/37963 [117:30:05<42:32:01, 14.52s/it]
 72%|███████▏  | 27416/37963 [117:30:20<42:28:58, 14.50s/it]
 72%|███████▏  | 27417/37963 [117:30:34<42:23:16, 14.47s/it]
 72%|███████▏  | 27418/37963 [117:30:48<42:08:05, 14.38s/it]
 72%|███████▏  | 27419/37963 [117:31:03<42:03:15, 14.36s/it]
 72%|███████▏  | 27420/37963 [117:31:23<47:40:13, 16.28s/it]
                                                            
{'loss': '0.1135', 'grad_norm': '1.958', 'learning_rate': '3.78e-06', 'epoch': '0.7223'}

 72%|███████▏  | 27420/37963 [117:31:23<47:40:13, 16.28s/it]
 72%|███████▏  | 27421/37963 [117:31:37<45:33:47, 15.56s/it]
 72%|███████▏  | 27422/37963 [117:32:05<56:08:12, 19.17s/it]
 72%|███████▏  | 27423/37963 [117:32:19<51:55:59, 17.74s/it]
 72%|███████▏  | 27424/37963 [117:32:33<48:07:58, 16.44s/it]
 72%|███████▏  | 27425/37963 [117:32:47<46:25:06, 15.86s/it]
 72%|███████▏  | 27426/37963 [117:33:08<50:43:12, 17.33s/it]
 72%|███████▏  | 27427/37963 [117:33:22<47:33:18, 16.25s/it]
 72%|███████▏  | 27428/37963 [117:33:36<45:55:02, 15.69s/it]
 72%|███████▏  | 27429/37963 [117:33:50<44:48:16, 15.31s/it]
 72%|███████▏  | 27430/37963 [117:34:05<43:57:51, 15.03s/it]
                                                            
{'loss': '0.1076', 'grad_norm': '2.171', 'learning_rate': '3.774e-06', 'epoch': '0.7225'}

 72%|███████▏  | 27430/37963 [117:34:05<43:57:51, 15.03s/it]
 72%|███████▏  | 27431/37963 [117:34:19<43:22:43, 14.83s/it]
 72%|███████▏  | 27432/37963 [117:34:34<42:59:58, 14.70s/it]
 72%|███████▏  | 27433/37963 [117:34:48<42:42:16, 14.60s/it]
 72%|███████▏  | 27434/37963 [117:35:02<42:29:16, 14.53s/it]
 72%|███████▏  | 27435/37963 [117:35:16<41:51:12, 14.31s/it]
 72%|███████▏  | 27436/37963 [117:35:30<41:24:55, 14.16s/it]
 72%|███████▏  | 27437/37963 [117:35:44<41:33:08, 14.21s/it]
 72%|███████▏  | 27438/37963 [117:35:59<41:41:04, 14.26s/it]
 72%|███████▏  | 27439/37963 [117:36:13<41:40:31, 14.26s/it]
 72%|███████▏  | 27440/37963 [117:36:27<41:50:20, 14.31s/it]
                                                            
{'loss': '0.1025', 'grad_norm': '1.948', 'learning_rate': '3.767e-06', 'epoch': '0.7228'}

 72%|███████▏  | 27440/37963 [117:36:27<41:50:20, 14.31s/it]
 72%|███████▏  | 27441/37963 [117:36:42<42:02:18, 14.38s/it]
 72%|███████▏  | 27442/37963 [117:36:56<42:01:54, 14.38s/it]
 72%|███████▏  | 27443/37963 [117:37:11<42:02:29, 14.39s/it]
 72%|███████▏  | 27444/37963 [117:37:25<41:46:56, 14.30s/it]
 72%|███████▏  | 27445/37963 [117:37:39<41:30:58, 14.21s/it]
 72%|███████▏  | 27446/37963 [117:37:53<41:50:46, 14.32s/it]
 72%|███████▏  | 27447/37963 [117:38:08<41:56:16, 14.36s/it]
 72%|███████▏  | 27448/37963 [117:38:22<41:50:46, 14.33s/it]
 72%|███████▏  | 27449/37963 [117:38:36<41:48:32, 14.32s/it]
 72%|███████▏  | 27450/37963 [117:38:57<47:06:18, 16.13s/it]
                                                            
{'loss': '0.09176', 'grad_norm': '2.803', 'learning_rate': '3.76e-06', 'epoch': '0.7231'}

 72%|███████▏  | 27450/37963 [117:38:57<47:06:18, 16.13s/it]
 72%|███████▏  | 27451/37963 [117:39:11<45:32:41, 15.60s/it]
 72%|███████▏  | 27452/37963 [117:39:25<44:27:55, 15.23s/it]
 72%|███████▏  | 27453/37963 [117:39:40<43:45:07, 14.99s/it]
 72%|███████▏  | 27454/37963 [117:40:01<49:24:56, 16.93s/it]
 72%|███████▏  | 27455/37963 [117:40:22<53:00:56, 18.16s/it]
 72%|███████▏  | 27456/37963 [117:40:37<49:44:53, 17.05s/it]
 72%|███████▏  | 27457/37963 [117:40:51<47:11:55, 16.17s/it]
 72%|███████▏  | 27458/37963 [117:41:12<51:28:14, 17.64s/it]
 72%|███████▏  | 27459/37963 [117:41:26<48:41:20, 16.69s/it]
 72%|███████▏  | 27460/37963 [117:41:41<46:39:07, 15.99s/it]
                                                            
{'loss': '0.09791', 'grad_norm': '3.138', 'learning_rate': '3.754e-06', 'epoch': '0.7233'}

 72%|███████▏  | 27460/37963 [117:41:41<46:39:07, 15.99s/it]
 72%|███████▏  | 27461/37963 [117:41:55<44:39:52, 15.31s/it]
 72%|███████▏  | 27462/37963 [117:42:09<43:45:07, 15.00s/it]
 72%|███████▏  | 27463/37963 [117:42:23<43:14:07, 14.82s/it]
 72%|███████▏  | 27464/37963 [117:42:38<42:57:30, 14.73s/it]
 72%|███████▏  | 27465/37963 [117:42:52<42:24:30, 14.54s/it]
 72%|███████▏  | 27466/37963 [117:43:06<42:10:03, 14.46s/it]
 72%|███████▏  | 27467/37963 [117:43:21<42:07:12, 14.45s/it]
 72%|███████▏  | 27468/37963 [117:43:35<42:03:54, 14.43s/it]
 72%|███████▏  | 27469/37963 [117:43:56<47:31:39, 16.30s/it]
 72%|███████▏  | 27470/37963 [117:44:23<57:26:52, 19.71s/it]
                                                            
{'loss': '0.1001', 'grad_norm': '4.495', 'learning_rate': '3.747e-06', 'epoch': '0.7236'}

 72%|███████▏  | 27470/37963 [117:44:23<57:26:52, 19.71s/it]
 72%|███████▏  | 27471/37963 [117:44:38<52:57:53, 18.17s/it]
 72%|███████▏  | 27472/37963 [117:44:52<49:42:12, 17.06s/it]
 72%|███████▏  | 27473/37963 [117:45:06<47:04:55, 16.16s/it]
 72%|███████▏  | 27474/37963 [117:45:21<45:38:57, 15.67s/it]
 72%|███████▏  | 27475/37963 [117:45:42<50:24:30, 17.30s/it]
 72%|███████▏  | 27476/37963 [117:45:56<47:39:21, 16.36s/it]
 72%|███████▏  | 27477/37963 [117:46:10<45:52:50, 15.75s/it]
 72%|███████▏  | 27478/37963 [117:46:25<44:36:07, 15.31s/it]
 72%|███████▏  | 27479/37963 [117:46:39<43:57:14, 15.09s/it]
 72%|███████▏  | 27480/37963 [117:46:54<43:26:16, 14.92s/it]
                                                            
{'loss': '0.1019', 'grad_norm': '2.612', 'learning_rate': '3.74e-06', 'epoch': '0.7239'}

 72%|███████▏  | 27480/37963 [117:46:54<43:26:16, 14.92s/it]
 72%|███████▏  | 27481/37963 [117:47:08<43:00:50, 14.77s/it]
 72%|███████▏  | 27482/37963 [117:47:23<42:37:43, 14.64s/it]
 72%|███████▏  | 27483/37963 [117:47:37<42:18:00, 14.53s/it]
 72%|███████▏  | 27484/37963 [117:47:51<42:16:18, 14.52s/it]
 72%|███████▏  | 27485/37963 [117:48:05<41:54:18, 14.40s/it]
 72%|███████▏  | 27486/37963 [117:48:20<41:59:02, 14.43s/it]
 72%|███████▏  | 27487/37963 [117:48:34<41:35:16, 14.29s/it]
 72%|███████▏  | 27488/37963 [117:48:48<41:36:24, 14.30s/it]
 72%|███████▏  | 27489/37963 [117:49:03<41:41:35, 14.33s/it]
 72%|███████▏  | 27490/37963 [117:49:17<41:43:40, 14.34s/it]
                                                            
{'loss': '0.09872', 'grad_norm': '1.806', 'learning_rate': '3.734e-06', 'epoch': '0.7241'}

 72%|███████▏  | 27490/37963 [117:49:17<41:43:40, 14.34s/it]
 72%|███████▏  | 27491/37963 [117:49:32<41:55:33, 14.41s/it]
 72%|███████▏  | 27492/37963 [117:49:45<41:23:04, 14.23s/it]
 72%|███████▏  | 27493/37963 [117:50:00<41:31:42, 14.28s/it]
 72%|███████▏  | 27494/37963 [117:50:14<41:34:28, 14.30s/it]
 72%|███████▏  | 27495/37963 [117:50:29<41:39:35, 14.33s/it]
 72%|███████▏  | 27496/37963 [117:50:43<41:40:12, 14.33s/it]
 72%|███████▏  | 27497/37963 [117:50:57<41:45:24, 14.36s/it]
 72%|███████▏  | 27498/37963 [117:51:11<41:30:14, 14.28s/it]
 72%|███████▏  | 27499/37963 [117:51:26<41:25:21, 14.25s/it]
 72%|███████▏  | 27500/37963 [117:51:40<41:44:00, 14.36s/it]
                                                            
{'loss': '0.09096', 'grad_norm': '2.505', 'learning_rate': '3.727e-06', 'epoch': '0.7244'}

 72%|███████▏  | 27500/37963 [117:51:40<41:44:00, 14.36s/it]
 72%|███████▏  | 27501/37963 [117:52:01<47:32:22, 16.36s/it]
 72%|███████▏  | 27502/37963 [117:52:22<50:56:25, 17.53s/it]
 72%|███████▏  | 27503/37963 [117:52:36<48:14:32, 16.60s/it]
 72%|███████▏  | 27504/37963 [117:52:50<46:06:18, 15.87s/it]
 72%|███████▏  | 27505/37963 [117:53:11<50:05:21, 17.24s/it]
 72%|███████▏  | 27506/37963 [117:53:25<47:40:15, 16.41s/it]
 72%|███████▏  | 27507/37963 [117:53:47<52:05:50, 17.94s/it]
 72%|███████▏  | 27508/37963 [117:54:01<48:39:43, 16.76s/it]
 72%|███████▏  | 27509/37963 [117:54:14<46:06:38, 15.88s/it]
 72%|███████▏  | 27510/37963 [117:54:29<44:51:46, 15.45s/it]
                                                            
{'loss': '0.09599', 'grad_norm': '2.107', 'learning_rate': '3.72e-06', 'epoch': '0.7247'}

 72%|███████▏  | 27510/37963 [117:54:29<44:51:46, 15.45s/it]
 72%|███████▏  | 27511/37963 [117:54:43<43:58:42, 15.15s/it]
 72%|███████▏  | 27512/37963 [117:54:57<42:49:17, 14.75s/it]
 72%|███████▏  | 27513/37963 [117:55:11<42:21:57, 14.59s/it]
 72%|███████▏  | 27514/37963 [117:55:26<42:08:04, 14.52s/it]
 72%|███████▏  | 27515/37963 [117:55:40<41:57:15, 14.46s/it]
 72%|███████▏  | 27516/37963 [117:55:54<41:33:13, 14.32s/it]
 72%|███████▏  | 27517/37963 [117:56:08<41:38:43, 14.35s/it]
 72%|███████▏  | 27518/37963 [117:56:36<53:31:32, 18.45s/it]
 72%|███████▏  | 27519/37963 [117:56:57<55:26:59, 19.11s/it]
 72%|███████▏  | 27520/37963 [117:57:11<51:09:18, 17.63s/it]
                                                            
{'loss': '0.09214', 'grad_norm': '2.559', 'learning_rate': '3.714e-06', 'epoch': '0.7249'}

 72%|███████▏  | 27520/37963 [117:57:11<51:09:18, 17.63s/it]
 72%|███████▏  | 27521/37963 [117:57:25<48:01:24, 16.56s/it]
 72%|███████▏  | 27522/37963 [117:57:40<46:16:09, 15.95s/it]
 72%|███████▏  | 27523/37963 [117:57:54<44:52:02, 15.47s/it]
 73%|███████▎  | 27524/37963 [117:58:09<43:54:36, 15.14s/it]
 73%|███████▎  | 27525/37963 [117:58:29<48:45:35, 16.82s/it]
 73%|███████▎  | 27526/37963 [117:58:44<46:38:15, 16.09s/it]
 73%|███████▎  | 27527/37963 [117:58:58<44:48:08, 15.46s/it]
 73%|███████▎  | 27528/37963 [117:59:12<43:58:15, 15.17s/it]
 73%|███████▎  | 27529/37963 [117:59:26<43:02:35, 14.85s/it]
 73%|███████▎  | 27530/37963 [117:59:41<42:47:46, 14.77s/it]
                                                            
{'loss': '0.1078', 'grad_norm': '3.343', 'learning_rate': '3.707e-06', 'epoch': '0.7252'}

 73%|███████▎  | 27530/37963 [117:59:41<42:47:46, 14.77s/it]
 73%|███████▎  | 27531/37963 [117:59:55<42:27:30, 14.65s/it]
 73%|███████▎  | 27532/37963 [118:00:10<42:17:24, 14.60s/it]
 73%|███████▎  | 27533/37963 [118:00:24<41:54:31, 14.47s/it]
 73%|███████▎  | 27534/37963 [118:00:38<41:50:12, 14.44s/it]
 73%|███████▎  | 27535/37963 [118:00:52<41:28:01, 14.32s/it]
 73%|███████▎  | 27536/37963 [118:01:07<41:32:21, 14.34s/it]
 73%|███████▎  | 27537/37963 [118:01:21<41:18:35, 14.26s/it]
 73%|███████▎  | 27538/37963 [118:01:35<41:19:35, 14.27s/it]
 73%|███████▎  | 27539/37963 [118:01:49<41:23:42, 14.30s/it]
 73%|███████▎  | 27540/37963 [118:02:04<41:25:03, 14.31s/it]
                                                            
{'loss': '0.0943', 'grad_norm': '1.753', 'learning_rate': '3.701e-06', 'epoch': '0.7254'}

 73%|███████▎  | 27540/37963 [118:02:04<41:25:03, 14.31s/it]
 73%|███████▎  | 27541/37963 [118:02:18<41:29:02, 14.33s/it]
 73%|███████▎  | 27542/37963 [118:02:32<41:22:06, 14.29s/it]
 73%|███████▎  | 27543/37963 [118:02:47<41:30:02, 14.34s/it]
 73%|███████▎  | 27544/37963 [118:03:01<41:30:11, 14.34s/it]
 73%|███████▎  | 27545/37963 [118:03:15<41:06:33, 14.21s/it]
 73%|███████▎  | 27546/37963 [118:03:29<40:55:15, 14.14s/it]
 73%|███████▎  | 27547/37963 [118:03:43<41:03:37, 14.19s/it]
 73%|███████▎  | 27548/37963 [118:04:04<46:47:13, 16.17s/it]
 73%|███████▎  | 27549/37963 [118:04:19<45:21:05, 15.68s/it]
 73%|███████▎  | 27550/37963 [118:04:33<44:12:17, 15.28s/it]
                                                            
{'loss': '0.09777', 'grad_norm': '2.387', 'learning_rate': '3.694e-06', 'epoch': '0.7257'}

 73%|███████▎  | 27550/37963 [118:04:33<44:12:17, 15.28s/it]
 73%|███████▎  | 27551/37963 [118:04:54<49:24:23, 17.08s/it]
 73%|███████▎  | 27552/37963 [118:05:09<47:01:14, 16.26s/it]
 73%|███████▎  | 27553/37963 [118:05:23<45:00:22, 15.56s/it]
 73%|███████▎  | 27554/37963 [118:05:43<49:39:16, 17.17s/it]
 73%|███████▎  | 27555/37963 [118:05:58<46:57:40, 16.24s/it]
 73%|███████▎  | 27556/37963 [118:06:12<45:24:19, 15.71s/it]
 73%|███████▎  | 27557/37963 [118:06:33<50:03:13, 17.32s/it]
 73%|███████▎  | 27558/37963 [118:06:47<47:30:03, 16.43s/it]
 73%|███████▎  | 27559/37963 [118:07:02<45:43:57, 15.82s/it]
 73%|███████▎  | 27560/37963 [118:07:16<44:27:55, 15.39s/it]
                                                            
{'loss': '0.1031', 'grad_norm': '2.679', 'learning_rate': '3.687e-06', 'epoch': '0.726'}

 73%|███████▎  | 27560/37963 [118:07:16<44:27:55, 15.39s/it]
 73%|███████▎  | 27561/37963 [118:07:31<43:33:14, 15.07s/it]
 73%|███████▎  | 27562/37963 [118:07:45<43:00:53, 14.89s/it]
 73%|███████▎  | 27563/37963 [118:07:59<42:35:01, 14.74s/it]
 73%|███████▎  | 27564/37963 [118:08:14<42:13:03, 14.62s/it]
 73%|███████▎  | 27565/37963 [118:08:28<41:55:27, 14.52s/it]
 73%|███████▎  | 27566/37963 [118:08:50<48:02:38, 16.64s/it]
 73%|███████▎  | 27567/37963 [118:09:04<45:42:39, 15.83s/it]
 73%|███████▎  | 27568/37963 [118:09:24<49:55:56, 17.29s/it]
 73%|███████▎  | 27569/37963 [118:09:45<53:00:17, 18.36s/it]
 73%|███████▎  | 27570/37963 [118:09:59<49:30:23, 17.15s/it]
                                                            
{'loss': '0.1044', 'grad_norm': '1.735', 'learning_rate': '3.681e-06', 'epoch': '0.7262'}

 73%|███████▎  | 27570/37963 [118:09:59<49:30:23, 17.15s/it]
 73%|███████▎  | 27571/37963 [118:10:14<47:01:05, 16.29s/it]
 73%|███████▎  | 27572/37963 [118:10:28<45:24:32, 15.73s/it]
 73%|███████▎  | 27573/37963 [118:10:42<44:11:57, 15.31s/it]
 73%|███████▎  | 27574/37963 [118:10:56<43:05:45, 14.93s/it]
 73%|███████▎  | 27575/37963 [118:11:17<48:14:39, 16.72s/it]
 73%|███████▎  | 27576/37963 [118:11:32<46:10:59, 16.01s/it]
 73%|███████▎  | 27577/37963 [118:11:46<44:44:47, 15.51s/it]
 73%|███████▎  | 27578/37963 [118:12:00<43:28:04, 15.07s/it]
 73%|███████▎  | 27579/37963 [118:12:15<42:59:40, 14.91s/it]
 73%|███████▎  | 27580/37963 [118:12:29<42:31:19, 14.74s/it]
                                                            
{'loss': '0.1009', 'grad_norm': '1.894', 'learning_rate': '3.674e-06', 'epoch': '0.7265'}

 73%|███████▎  | 27580/37963 [118:12:29<42:31:19, 14.74s/it]
 73%|███████▎  | 27581/37963 [118:12:44<42:22:09, 14.69s/it]
 73%|███████▎  | 27582/37963 [118:12:58<42:06:15, 14.60s/it]
 73%|███████▎  | 27583/37963 [118:13:12<41:33:19, 14.41s/it]
 73%|███████▎  | 27584/37963 [118:13:26<41:27:49, 14.38s/it]
 73%|███████▎  | 27585/37963 [118:13:41<41:27:12, 14.38s/it]
 73%|███████▎  | 27586/37963 [118:13:55<41:27:25, 14.38s/it]
 73%|███████▎  | 27587/37963 [118:14:09<41:25:13, 14.37s/it]
 73%|███████▎  | 27588/37963 [118:14:24<41:23:56, 14.36s/it]
 73%|███████▎  | 27589/37963 [118:14:38<41:22:18, 14.36s/it]
 73%|███████▎  | 27590/37963 [118:14:52<41:17:41, 14.33s/it]
                                                            
{'loss': '0.09988', 'grad_norm': '1.764', 'learning_rate': '3.667e-06', 'epoch': '0.7268'}

 73%|███████▎  | 27590/37963 [118:14:52<41:17:41, 14.33s/it]
 73%|███████▎  | 27591/37963 [118:15:07<41:19:51, 14.35s/it]
 73%|███████▎  | 27592/37963 [118:15:21<41:19:43, 14.35s/it]
 73%|███████▎  | 27593/37963 [118:15:35<41:23:48, 14.37s/it]
 73%|███████▎  | 27594/37963 [118:15:50<41:24:34, 14.38s/it]
 73%|███████▎  | 27595/37963 [118:16:04<41:28:11, 14.40s/it]
 73%|███████▎  | 27596/37963 [118:16:19<41:29:44, 14.41s/it]
 73%|███████▎  | 27597/37963 [118:16:33<41:17:53, 14.34s/it]
 73%|███████▎  | 27598/37963 [118:16:54<46:54:19, 16.29s/it]
 73%|███████▎  | 27599/37963 [118:17:08<44:54:48, 15.60s/it]
 73%|███████▎  | 27600/37963 [118:17:29<49:43:55, 17.28s/it]
                                                            
{'loss': '0.09891', 'grad_norm': '2.609', 'learning_rate': '3.661e-06', 'epoch': '0.727'}

 73%|███████▎  | 27600/37963 [118:17:29<49:43:55, 17.28s/it]
 73%|███████▎  | 27601/37963 [118:17:43<46:44:42, 16.24s/it]
 73%|███████▎  | 27602/37963 [118:17:57<45:09:37, 15.69s/it]
 73%|███████▎  | 27603/37963 [118:18:12<44:01:07, 15.30s/it]
 73%|███████▎  | 27604/37963 [118:18:40<55:11:58, 19.18s/it]
 73%|███████▎  | 27605/37963 [118:18:54<50:59:38, 17.72s/it]
 73%|███████▎  | 27606/37963 [118:19:08<47:47:48, 16.61s/it]
 73%|███████▎  | 27607/37963 [118:19:23<45:52:36, 15.95s/it]
 73%|███████▎  | 27608/37963 [118:19:37<44:11:01, 15.36s/it]
 73%|███████▎  | 27609/37963 [118:19:51<43:18:02, 15.06s/it]
 73%|███████▎  | 27610/37963 [118:20:05<42:26:10, 14.76s/it]
                                                            
{'loss': '0.08958', 'grad_norm': '2.341', 'learning_rate': '3.654e-06', 'epoch': '0.7273'}

 73%|███████▎  | 27610/37963 [118:20:05<42:26:10, 14.76s/it]
 73%|███████▎  | 27611/37963 [118:20:19<42:16:26, 14.70s/it]
 73%|███████▎  | 27612/37963 [118:20:34<41:57:42, 14.59s/it]
 73%|███████▎  | 27613/37963 [118:20:55<47:19:33, 16.46s/it]
 73%|███████▎  | 27614/37963 [118:21:09<45:34:20, 15.85s/it]
 73%|███████▎  | 27615/37963 [118:21:23<43:45:27, 15.22s/it]
 73%|███████▎  | 27616/37963 [118:21:44<48:26:20, 16.85s/it]
 73%|███████▎  | 27617/37963 [118:21:58<46:21:05, 16.13s/it]
 73%|███████▎  | 27618/37963 [118:22:19<50:20:35, 17.52s/it]
 73%|███████▎  | 27619/37963 [118:22:33<47:46:24, 16.63s/it]
 73%|███████▎  | 27620/37963 [118:22:48<45:49:14, 15.95s/it]
                                                            
{'loss': '0.105', 'grad_norm': '2.482', 'learning_rate': '3.648e-06', 'epoch': '0.7276'}

 73%|███████▎  | 27620/37963 [118:22:48<45:49:14, 15.95s/it]
 73%|███████▎  | 27621/37963 [118:23:02<44:15:25, 15.41s/it]
 73%|███████▎  | 27622/37963 [118:23:16<43:25:53, 15.12s/it]
 73%|███████▎  | 27623/37963 [118:23:30<42:14:23, 14.71s/it]
 73%|███████▎  | 27624/37963 [118:23:51<47:24:48, 16.51s/it]
 73%|███████▎  | 27625/37963 [118:24:05<45:22:51, 15.80s/it]
 73%|███████▎  | 27626/37963 [118:24:19<44:08:23, 15.37s/it]
 73%|███████▎  | 27627/37963 [118:24:34<43:15:48, 15.07s/it]
 73%|███████▎  | 27628/37963 [118:24:48<42:24:46, 14.77s/it]
 73%|███████▎  | 27629/37963 [118:25:02<42:03:53, 14.65s/it]
 73%|███████▎  | 27630/37963 [118:25:16<41:48:15, 14.56s/it]
                                                            
{'loss': '0.1091', 'grad_norm': '2.537', 'learning_rate': '3.641e-06', 'epoch': '0.7278'}

 73%|███████▎  | 27630/37963 [118:25:16<41:48:15, 14.56s/it]
 73%|███████▎  | 27631/37963 [118:25:31<41:42:50, 14.53s/it]
 73%|███████▎  | 27632/37963 [118:25:45<41:47:35, 14.56s/it]
 73%|███████▎  | 27633/37963 [118:26:00<41:35:57, 14.50s/it]
 73%|███████▎  | 27634/37963 [118:26:14<41:34:49, 14.49s/it]
 73%|███████▎  | 27635/37963 [118:26:29<41:27:15, 14.45s/it]
 73%|███████▎  | 27636/37963 [118:26:43<41:24:15, 14.43s/it]
 73%|███████▎  | 27637/37963 [118:26:58<41:26:17, 14.45s/it]
 73%|███████▎  | 27638/37963 [118:27:12<41:23:01, 14.43s/it]
 73%|███████▎  | 27639/37963 [118:27:26<41:19:18, 14.41s/it]
 73%|███████▎  | 27640/37963 [118:27:41<41:18:56, 14.41s/it]
                                                            
{'loss': '0.1119', 'grad_norm': '2.052', 'learning_rate': '3.634e-06', 'epoch': '0.7281'}

 73%|███████▎  | 27640/37963 [118:27:41<41:18:56, 14.41s/it]
 73%|███████▎  | 27641/37963 [118:27:55<41:22:19, 14.43s/it]
 73%|███████▎  | 27642/37963 [118:28:10<41:22:02, 14.43s/it]
 73%|███████▎  | 27643/37963 [118:28:24<41:21:59, 14.43s/it]
 73%|███████▎  | 27644/37963 [118:28:38<41:13:44, 14.38s/it]
 73%|███████▎  | 27645/37963 [118:28:53<41:08:21, 14.35s/it]
 73%|███████▎  | 27646/37963 [118:29:07<41:20:00, 14.42s/it]
 73%|███████▎  | 27647/37963 [118:29:28<46:54:01, 16.37s/it]
 73%|███████▎  | 27648/37963 [118:29:42<45:04:47, 15.73s/it]
 73%|███████▎  | 27649/37963 [118:29:57<43:58:25, 15.35s/it]
 73%|███████▎  | 27650/37963 [118:30:18<49:06:58, 17.15s/it]
                                                            
{'loss': '0.1034', 'grad_norm': '2.257', 'learning_rate': '3.628e-06', 'epoch': '0.7283'}

 73%|███████▎  | 27650/37963 [118:30:18<49:06:58, 17.15s/it]
 73%|███████▎  | 27651/37963 [118:30:32<46:43:31, 16.31s/it]
 73%|███████▎  | 27652/37963 [118:30:46<44:46:08, 15.63s/it]
 73%|███████▎  | 27653/37963 [118:31:13<54:26:27, 19.01s/it]
 73%|███████▎  | 27654/37963 [118:31:28<50:21:12, 17.58s/it]
 73%|███████▎  | 27655/37963 [118:31:42<47:41:56, 16.66s/it]
 73%|███████▎  | 27656/37963 [118:31:57<45:47:58, 16.00s/it]
 73%|███████▎  | 27657/37963 [118:32:11<44:13:30, 15.45s/it]
 73%|███████▎  | 27658/37963 [118:32:25<43:19:02, 15.13s/it]
 73%|███████▎  | 27659/37963 [118:32:40<42:37:43, 14.89s/it]
 73%|███████▎  | 27660/37963 [118:32:54<42:08:55, 14.73s/it]
                                                            
{'loss': '0.1012', 'grad_norm': '4.239', 'learning_rate': '3.621e-06', 'epoch': '0.7286'}

 73%|███████▎  | 27660/37963 [118:32:54<42:08:55, 14.73s/it]
 73%|███████▎  | 27661/37963 [118:33:08<41:48:55, 14.61s/it]
 73%|███████▎  | 27662/37963 [118:33:23<41:33:31, 14.52s/it]
 73%|███████▎  | 27663/37963 [118:33:50<52:16:09, 18.27s/it]
 73%|███████▎  | 27664/37963 [118:34:04<48:55:19, 17.10s/it]
 73%|███████▎  | 27665/37963 [118:34:18<46:34:07, 16.28s/it]
 73%|███████▎  | 27666/37963 [118:34:39<50:32:42, 17.67s/it]
 73%|███████▎  | 27667/37963 [118:34:54<47:42:56, 16.68s/it]
 73%|███████▎  | 27668/37963 [118:35:08<45:58:11, 16.07s/it]
 73%|███████▎  | 27669/37963 [118:35:22<44:12:24, 15.46s/it]
 73%|███████▎  | 27670/37963 [118:35:36<43:10:19, 15.10s/it]
                                                            
{'loss': '0.1097', 'grad_norm': '2.549', 'learning_rate': '3.615e-06', 'epoch': '0.7289'}

 73%|███████▎  | 27670/37963 [118:35:36<43:10:19, 15.10s/it]
 73%|███████▎  | 27671/37963 [118:35:51<42:37:42, 14.91s/it]
 73%|███████▎  | 27672/37963 [118:36:05<42:16:39, 14.79s/it]
 73%|███████▎  | 27673/37963 [118:36:26<47:24:25, 16.59s/it]
 73%|███████▎  | 27674/37963 [118:36:41<45:31:15, 15.93s/it]
 73%|███████▎  | 27675/37963 [118:36:55<44:18:20, 15.50s/it]
 73%|███████▎  | 27676/37963 [118:37:10<43:25:43, 15.20s/it]
 73%|███████▎  | 27677/37963 [118:37:24<42:49:54, 14.99s/it]
 73%|███████▎  | 27678/37963 [118:37:38<41:54:57, 14.67s/it]
 73%|███████▎  | 27679/37963 [118:37:52<41:40:09, 14.59s/it]
 73%|███████▎  | 27680/37963 [118:38:07<41:26:36, 14.51s/it]
                                                            
{'loss': '0.1018', 'grad_norm': '2.717', 'learning_rate': '3.608e-06', 'epoch': '0.7291'}

 73%|███████▎  | 27680/37963 [118:38:07<41:26:36, 14.51s/it]
 73%|███████▎  | 27681/37963 [118:38:21<40:50:05, 14.30s/it]
 73%|███████▎  | 27682/37963 [118:38:34<40:24:16, 14.15s/it]
 73%|███████▎  | 27683/37963 [118:38:49<40:23:00, 14.14s/it]
 73%|███████▎  | 27684/37963 [118:39:03<40:23:27, 14.15s/it]
 73%|███████▎  | 27685/37963 [118:39:17<40:39:20, 14.24s/it]
 73%|███████▎  | 27686/37963 [118:39:32<40:47:44, 14.29s/it]
 73%|███████▎  | 27687/37963 [118:39:46<40:42:39, 14.26s/it]
 73%|███████▎  | 27688/37963 [118:40:00<40:38:52, 14.24s/it]
 73%|███████▎  | 27689/37963 [118:40:14<40:47:10, 14.29s/it]
 73%|███████▎  | 27690/37963 [118:40:29<40:49:31, 14.31s/it]
                                                            
{'loss': '0.09213', 'grad_norm': '1.782', 'learning_rate': '3.602e-06', 'epoch': '0.7294'}

 73%|███████▎  | 27690/37963 [118:40:29<40:49:31, 14.31s/it]
 73%|███████▎  | 27691/37963 [118:40:43<40:51:37, 14.32s/it]
 73%|███████▎  | 27692/37963 [118:40:57<40:54:50, 14.34s/it]
 73%|███████▎  | 27693/37963 [118:41:12<40:59:08, 14.37s/it]
 73%|███████▎  | 27694/37963 [118:41:26<40:57:36, 14.36s/it]
 73%|███████▎  | 27695/37963 [118:41:41<40:57:41, 14.36s/it]
 73%|███████▎  | 27696/37963 [118:42:02<46:47:07, 16.40s/it]
 73%|███████▎  | 27697/37963 [118:42:16<45:10:28, 15.84s/it]
 73%|███████▎  | 27698/37963 [118:42:37<49:39:33, 17.42s/it]
 73%|███████▎  | 27699/37963 [118:42:52<46:52:47, 16.44s/it]
 73%|███████▎  | 27700/37963 [118:43:06<44:57:11, 15.77s/it]
                                                            
{'loss': '0.1103', 'grad_norm': '2.325', 'learning_rate': '3.595e-06', 'epoch': '0.7297'}

 73%|███████▎  | 27700/37963 [118:43:06<44:57:11, 15.77s/it]
 73%|███████▎  | 27701/37963 [118:43:20<43:54:18, 15.40s/it]
 73%|███████▎  | 27702/37963 [118:43:48<54:16:27, 19.04s/it]
 73%|███████▎  | 27703/37963 [118:44:02<50:03:41, 17.57s/it]
 73%|███████▎  | 27704/37963 [118:44:16<47:21:06, 16.62s/it]
 73%|███████▎  | 27705/37963 [118:44:31<45:41:22, 16.03s/it]
 73%|███████▎  | 27706/37963 [118:44:45<44:15:58, 15.54s/it]
 73%|███████▎  | 27707/37963 [118:45:00<43:19:53, 15.21s/it]
 73%|███████▎  | 27708/37963 [118:45:14<42:36:13, 14.96s/it]
 73%|███████▎  | 27709/37963 [118:45:29<42:08:37, 14.80s/it]
 73%|███████▎  | 27710/37963 [118:45:43<41:46:04, 14.67s/it]
                                                            
{'loss': '0.09344', 'grad_norm': '1.747', 'learning_rate': '3.589e-06', 'epoch': '0.7299'}

 73%|███████▎  | 27710/37963 [118:45:43<41:46:04, 14.67s/it]
 73%|███████▎  | 27711/37963 [118:46:03<46:45:45, 16.42s/it]
 73%|███████▎  | 27712/37963 [118:46:18<44:52:09, 15.76s/it]
 73%|███████▎  | 27713/37963 [118:46:32<43:43:29, 15.36s/it]
 73%|███████▎  | 27714/37963 [118:46:53<48:18:12, 16.97s/it]
 73%|███████▎  | 27715/37963 [118:47:07<46:12:36, 16.23s/it]
 73%|███████▎  | 27716/37963 [118:47:21<43:53:54, 15.42s/it]
 73%|███████▎  | 27717/37963 [118:47:35<43:06:17, 15.15s/it]
 73%|███████▎  | 27718/37963 [118:47:50<42:29:12, 14.93s/it]
 73%|███████▎  | 27719/37963 [118:48:10<46:41:03, 16.41s/it]
 73%|███████▎  | 27720/37963 [118:48:24<44:56:35, 15.80s/it]
                                                            
{'loss': '0.1003', 'grad_norm': '2.783', 'learning_rate': '3.582e-06', 'epoch': '0.7302'}

 73%|███████▎  | 27720/37963 [118:48:24<44:56:35, 15.80s/it]
 73%|███████▎  | 27721/37963 [118:48:38<43:45:23, 15.38s/it]
 73%|███████▎  | 27722/37963 [118:48:53<42:53:23, 15.08s/it]
 73%|███████▎  | 27723/37963 [118:49:07<42:00:38, 14.77s/it]
 73%|███████▎  | 27724/37963 [118:49:21<41:36:51, 14.63s/it]
 73%|███████▎  | 27725/37963 [118:49:36<41:26:18, 14.57s/it]
 73%|███████▎  | 27726/37963 [118:49:50<41:23:09, 14.55s/it]
 73%|███████▎  | 27727/37963 [118:50:05<41:17:11, 14.52s/it]
 73%|███████▎  | 27728/37963 [118:50:19<41:00:28, 14.42s/it]
 73%|███████▎  | 27729/37963 [118:50:33<41:01:24, 14.43s/it]
 73%|███████▎  | 27730/37963 [118:50:48<41:01:05, 14.43s/it]
                                                            
{'loss': '0.1127', 'grad_norm': '3.818', 'learning_rate': '3.575e-06', 'epoch': '0.7305'}

 73%|███████▎  | 27730/37963 [118:50:48<41:01:05, 14.43s/it]
 73%|███████▎  | 27731/37963 [118:51:02<41:00:03, 14.43s/it]
 73%|███████▎  | 27732/37963 [118:51:16<40:58:15, 14.42s/it]
 73%|███████▎  | 27733/37963 [118:51:31<40:52:34, 14.38s/it]
 73%|███████▎  | 27734/37963 [118:51:45<40:52:37, 14.39s/it]
 73%|███████▎  | 27735/37963 [118:51:59<40:50:11, 14.37s/it]
 73%|███████▎  | 27736/37963 [118:52:14<40:54:46, 14.40s/it]
 73%|███████▎  | 27737/37963 [118:52:28<40:24:14, 14.22s/it]
 73%|███████▎  | 27738/37963 [118:52:42<40:33:35, 14.28s/it]
 73%|███████▎  | 27739/37963 [118:52:56<40:28:36, 14.25s/it]
 73%|███████▎  | 27740/37963 [118:53:11<40:34:43, 14.29s/it]
                                                            
{'loss': '0.1232', 'grad_norm': '5.085', 'learning_rate': '3.569e-06', 'epoch': '0.7307'}

 73%|███████▎  | 27740/37963 [118:53:11<40:34:43, 14.29s/it]
 73%|███████▎  | 27741/37963 [118:53:25<40:20:06, 14.21s/it]
 73%|███████▎  | 27742/37963 [118:53:39<40:05:16, 14.12s/it]
 73%|███████▎  | 27743/37963 [118:53:53<40:19:29, 14.20s/it]
 73%|███████▎  | 27744/37963 [118:54:07<40:10:19, 14.15s/it]
 73%|███████▎  | 27745/37963 [118:54:28<46:01:32, 16.22s/it]
 73%|███████▎  | 27746/37963 [118:54:50<50:36:21, 17.83s/it]
 73%|███████▎  | 27747/37963 [118:55:04<47:44:17, 16.82s/it]
 73%|███████▎  | 27748/37963 [118:55:19<45:38:31, 16.09s/it]
 73%|███████▎  | 27749/37963 [118:55:33<44:15:37, 15.60s/it]
 73%|███████▎  | 27750/37963 [118:55:54<49:00:48, 17.28s/it]
                                                            
{'loss': '0.1066', 'grad_norm': '4.18', 'learning_rate': '3.562e-06', 'epoch': '0.731'}

 73%|███████▎  | 27750/37963 [118:55:54<49:00:48, 17.28s/it]
 73%|███████▎  | 27751/37963 [118:56:15<52:00:15, 18.33s/it]
 73%|███████▎  | 27752/37963 [118:56:29<48:19:05, 17.04s/it]
 73%|███████▎  | 27753/37963 [118:56:43<45:50:58, 16.17s/it]
 73%|███████▎  | 27754/37963 [118:56:58<44:22:05, 15.65s/it]
 73%|███████▎  | 27755/37963 [118:57:12<43:14:39, 15.25s/it]
 73%|███████▎  | 27756/37963 [118:57:26<42:15:32, 14.90s/it]
 73%|███████▎  | 27757/37963 [118:57:40<41:50:44, 14.76s/it]
 73%|███████▎  | 27758/37963 [118:57:55<41:29:05, 14.63s/it]
 73%|███████▎  | 27759/37963 [118:58:22<52:26:50, 18.50s/it]
 73%|███████▎  | 27760/37963 [118:58:37<48:53:25, 17.25s/it]
                                                            
{'loss': '0.0993', 'grad_norm': '2.009', 'learning_rate': '3.556e-06', 'epoch': '0.7312'}

 73%|███████▎  | 27760/37963 [118:58:37<48:53:25, 17.25s/it]
 73%|███████▎  | 27761/37963 [118:58:50<45:50:23, 16.18s/it]
 73%|███████▎  | 27762/37963 [118:59:05<44:15:59, 15.62s/it]
 73%|███████▎  | 27763/37963 [118:59:26<48:44:12, 17.20s/it]
 73%|███████▎  | 27764/37963 [118:59:40<46:23:18, 16.37s/it]
 73%|███████▎  | 27765/37963 [118:59:54<44:39:44, 15.77s/it]
 73%|███████▎  | 27766/37963 [119:00:09<43:37:57, 15.40s/it]
 73%|███████▎  | 27767/37963 [119:00:23<42:17:31, 14.93s/it]
 73%|███████▎  | 27768/37963 [119:00:37<41:49:08, 14.77s/it]
 73%|███████▎  | 27769/37963 [119:00:57<46:18:57, 16.36s/it]
 73%|███████▎  | 27770/37963 [119:01:11<44:32:15, 15.73s/it]
                                                            
{'loss': '0.09615', 'grad_norm': '1.757', 'learning_rate': '3.549e-06', 'epoch': '0.7315'}

 73%|███████▎  | 27770/37963 [119:01:11<44:32:15, 15.73s/it]
 73%|███████▎  | 27771/37963 [119:01:25<43:06:28, 15.23s/it]
 73%|███████▎  | 27772/37963 [119:01:40<42:28:55, 15.01s/it]
 73%|███████▎  | 27773/37963 [119:01:54<41:59:09, 14.83s/it]
 73%|███████▎  | 27774/37963 [119:02:09<41:34:42, 14.69s/it]
 73%|███████▎  | 27775/37963 [119:02:23<41:19:19, 14.60s/it]
 73%|███████▎  | 27776/37963 [119:02:38<41:11:44, 14.56s/it]
 73%|███████▎  | 27777/37963 [119:02:52<40:58:40, 14.48s/it]
 73%|███████▎  | 27778/37963 [119:03:06<40:55:38, 14.47s/it]
 73%|███████▎  | 27779/37963 [119:03:21<40:52:17, 14.45s/it]
 73%|███████▎  | 27780/37963 [119:03:35<40:49:24, 14.43s/it]
                                                            
{'loss': '0.1007', 'grad_norm': '2.83', 'learning_rate': '3.543e-06', 'epoch': '0.7318'}

 73%|███████▎  | 27780/37963 [119:03:35<40:49:24, 14.43s/it]
 73%|███████▎  | 27781/37963 [119:03:50<40:55:43, 14.47s/it]
 73%|███████▎  | 27782/37963 [119:04:04<40:49:35, 14.44s/it]
 73%|███████▎  | 27783/37963 [119:04:19<40:50:34, 14.44s/it]
 73%|███████▎  | 27784/37963 [119:04:33<40:46:59, 14.42s/it]
 73%|███████▎  | 27785/37963 [119:04:47<40:52:11, 14.46s/it]
 73%|███████▎  | 27786/37963 [119:05:02<41:00:28, 14.51s/it]
 73%|███████▎  | 27787/37963 [119:05:16<40:52:29, 14.46s/it]
 73%|███████▎  | 27788/37963 [119:05:31<40:50:51, 14.45s/it]
 73%|███████▎  | 27789/37963 [119:05:45<40:54:56, 14.48s/it]
 73%|███████▎  | 27790/37963 [119:06:00<40:51:51, 14.46s/it]
                                                            
{'loss': '0.1105', 'grad_norm': '2.267', 'learning_rate': '3.536e-06', 'epoch': '0.732'}

 73%|███████▎  | 27790/37963 [119:06:00<40:51:51, 14.46s/it]
 73%|███████▎  | 27791/37963 [119:06:14<40:47:47, 14.44s/it]
 73%|███████▎  | 27792/37963 [119:06:28<40:26:54, 14.32s/it]
 73%|███████▎  | 27793/37963 [119:06:49<46:12:45, 16.36s/it]
 73%|███████▎  | 27794/37963 [119:07:10<49:56:47, 17.68s/it]
 73%|███████▎  | 27795/37963 [119:07:24<47:08:03, 16.69s/it]
 73%|███████▎  | 27796/37963 [119:07:39<45:14:59, 16.02s/it]
 73%|███████▎  | 27797/37963 [119:07:53<43:51:43, 15.53s/it]
 73%|███████▎  | 27798/37963 [119:08:21<54:06:01, 19.16s/it]
 73%|███████▎  | 27799/37963 [119:08:35<50:03:00, 17.73s/it]
 73%|███████▎  | 27800/37963 [119:08:50<47:26:37, 16.81s/it]
                                                            
{'loss': '0.105', 'grad_norm': '2.581', 'learning_rate': '3.53e-06', 'epoch': '0.7323'}

 73%|███████▎  | 27800/37963 [119:08:50<47:26:37, 16.81s/it]
 73%|███████▎  | 27801/37963 [119:09:05<45:33:13, 16.14s/it]
 73%|███████▎  | 27802/37963 [119:09:19<44:04:13, 15.61s/it]
 73%|███████▎  | 27803/37963 [119:09:33<43:06:35, 15.28s/it]
 73%|███████▎  | 27804/37963 [119:09:48<42:22:10, 15.01s/it]
 73%|███████▎  | 27805/37963 [119:10:02<41:33:46, 14.73s/it]
 73%|███████▎  | 27806/37963 [119:10:16<41:24:49, 14.68s/it]
 73%|███████▎  | 27807/37963 [119:10:37<46:44:47, 16.57s/it]
 73%|███████▎  | 27808/37963 [119:10:58<49:52:01, 17.68s/it]
 73%|███████▎  | 27809/37963 [119:11:12<47:02:56, 16.68s/it]
 73%|███████▎  | 27810/37963 [119:11:26<45:03:47, 15.98s/it]
                                                            
{'loss': '0.1089', 'grad_norm': '2.3', 'learning_rate': '3.523e-06', 'epoch': '0.7326'}

 73%|███████▎  | 27810/37963 [119:11:26<45:03:47, 15.98s/it]
 73%|███████▎  | 27811/37963 [119:11:47<48:50:07, 17.32s/it]
 73%|███████▎  | 27812/37963 [119:12:01<46:24:46, 16.46s/it]
 73%|███████▎  | 27813/37963 [119:12:16<44:42:08, 15.86s/it]
 73%|███████▎  | 27814/37963 [119:12:30<43:25:46, 15.41s/it]
 73%|███████▎  | 27815/37963 [119:12:44<41:55:21, 14.87s/it]
 73%|███████▎  | 27816/37963 [119:12:58<41:32:00, 14.74s/it]
 73%|███████▎  | 27817/37963 [119:13:13<41:15:05, 14.64s/it]
 73%|███████▎  | 27818/37963 [119:13:27<41:04:43, 14.58s/it]
 73%|███████▎  | 27819/37963 [119:13:41<40:36:02, 14.41s/it]
 73%|███████▎  | 27820/37963 [119:14:02<45:59:48, 16.33s/it]
                                                            
{'loss': '0.09824', 'grad_norm': '1.991', 'learning_rate': '3.517e-06', 'epoch': '0.7328'}

 73%|███████▎  | 27820/37963 [119:14:02<45:59:48, 16.33s/it]
 73%|███████▎  | 27821/37963 [119:14:16<44:05:19, 15.65s/it]
 73%|███████▎  | 27822/37963 [119:14:30<42:59:57, 15.26s/it]
 73%|███████▎  | 27823/37963 [119:14:44<41:57:24, 14.90s/it]
 73%|███████▎  | 27824/37963 [119:14:59<41:32:27, 14.75s/it]
 73%|███████▎  | 27825/37963 [119:15:13<41:11:36, 14.63s/it]
 73%|███████▎  | 27826/37963 [119:15:27<40:37:14, 14.43s/it]
 73%|███████▎  | 27827/37963 [119:15:41<40:34:37, 14.41s/it]
 73%|███████▎  | 27828/37963 [119:15:56<40:29:56, 14.39s/it]
 73%|███████▎  | 27829/37963 [119:16:10<40:27:58, 14.38s/it]
 73%|███████▎  | 27830/37963 [119:16:24<40:24:30, 14.36s/it]
                                                            
{'loss': '0.1019', 'grad_norm': '1.784', 'learning_rate': '3.51e-06', 'epoch': '0.7331'}

 73%|███████▎  | 27830/37963 [119:16:24<40:24:30, 14.36s/it]
 73%|███████▎  | 27831/37963 [119:16:38<39:51:16, 14.16s/it]
 73%|███████▎  | 27832/37963 [119:16:52<39:53:40, 14.18s/it]
 73%|███████▎  | 27833/37963 [119:17:07<40:03:57, 14.24s/it]
 73%|███████▎  | 27834/37963 [119:17:21<39:51:11, 14.16s/it]
 73%|███████▎  | 27835/37963 [119:17:35<39:55:14, 14.19s/it]
 73%|███████▎  | 27836/37963 [119:17:49<40:07:29, 14.26s/it]
 73%|███████▎  | 27837/37963 [119:18:03<39:44:26, 14.13s/it]
 73%|███████▎  | 27838/37963 [119:18:17<39:53:39, 14.18s/it]
 73%|███████▎  | 27839/37963 [119:18:32<40:03:04, 14.24s/it]
 73%|███████▎  | 27840/37963 [119:18:46<40:09:12, 14.28s/it]
                                                            
{'loss': '0.1066', 'grad_norm': '2.159', 'learning_rate': '3.504e-06', 'epoch': '0.7333'}

 73%|███████▎  | 27840/37963 [119:18:46<40:09:12, 14.28s/it]
 73%|███████▎  | 27841/37963 [119:19:07<45:48:21, 16.29s/it]
 73%|███████▎  | 27842/37963 [119:19:27<48:53:43, 17.39s/it]
 73%|███████▎  | 27843/37963 [119:19:42<46:22:48, 16.50s/it]
 73%|███████▎  | 27844/37963 [119:19:56<44:37:52, 15.88s/it]
 73%|███████▎  | 27845/37963 [119:20:10<43:09:36, 15.36s/it]
 73%|███████▎  | 27846/37963 [119:20:31<47:47:20, 17.01s/it]
 73%|███████▎  | 27847/37963 [119:20:45<45:19:30, 16.13s/it]
 73%|███████▎  | 27848/37963 [119:21:06<49:26:21, 17.60s/it]
 73%|███████▎  | 27849/37963 [119:21:21<46:44:22, 16.64s/it]
 73%|███████▎  | 27850/37963 [119:21:35<44:40:57, 15.91s/it]
                                                            
{'loss': '0.1018', 'grad_norm': '2.373', 'learning_rate': '3.497e-06', 'epoch': '0.7336'}

 73%|███████▎  | 27850/37963 [119:21:35<44:40:57, 15.91s/it]
 73%|███████▎  | 27851/37963 [119:21:49<42:56:50, 15.29s/it]
 73%|███████▎  | 27852/37963 [119:22:03<42:02:30, 14.97s/it]
 73%|███████▎  | 27853/37963 [119:22:17<41:34:54, 14.81s/it]
 73%|███████▎  | 27854/37963 [119:22:32<41:17:39, 14.71s/it]
 73%|███████▎  | 27855/37963 [119:22:52<46:26:11, 16.54s/it]
 73%|███████▎  | 27856/37963 [119:23:13<49:48:06, 17.74s/it]
 73%|███████▎  | 27857/37963 [119:23:27<46:48:30, 16.67s/it]
 73%|███████▎  | 27858/37963 [119:23:42<44:52:30, 15.99s/it]
 73%|███████▎  | 27859/37963 [119:23:56<43:31:36, 15.51s/it]
 73%|███████▎  | 27860/37963 [119:24:10<42:33:04, 15.16s/it]
                                                            
{'loss': '0.09826', 'grad_norm': '2.133', 'learning_rate': '3.491e-06', 'epoch': '0.7339'}

 73%|███████▎  | 27860/37963 [119:24:10<42:33:04, 15.16s/it]
 73%|███████▎  | 27861/37963 [119:24:31<47:32:12, 16.94s/it]
 73%|███████▎  | 27862/37963 [119:24:46<45:23:49, 16.18s/it]
 73%|███████▎  | 27863/37963 [119:25:00<43:34:35, 15.53s/it]
 73%|███████▎  | 27864/37963 [119:25:14<42:34:19, 15.18s/it]
 73%|███████▎  | 27865/37963 [119:25:28<41:44:06, 14.88s/it]
 73%|███████▎  | 27866/37963 [119:25:43<41:22:02, 14.75s/it]
 73%|███████▎  | 27867/37963 [119:25:57<41:02:41, 14.64s/it]
 73%|███████▎  | 27868/37963 [119:26:18<46:09:22, 16.46s/it]
 73%|███████▎  | 27869/37963 [119:26:32<44:22:17, 15.83s/it]
 73%|███████▎  | 27870/37963 [119:26:47<43:13:23, 15.42s/it]
                                                            
{'loss': '0.1026', 'grad_norm': '2.122', 'learning_rate': '3.484e-06', 'epoch': '0.7341'}

 73%|███████▎  | 27870/37963 [119:26:47<43:13:23, 15.42s/it]
 73%|███████▎  | 27871/37963 [119:27:01<42:22:57, 15.12s/it]
 73%|███████▎  | 27872/37963 [119:27:15<41:30:34, 14.81s/it]
 73%|███████▎  | 27873/37963 [119:27:29<40:59:14, 14.62s/it]
 73%|███████▎  | 27874/37963 [119:27:44<40:44:49, 14.54s/it]
 73%|███████▎  | 27875/37963 [119:27:58<40:21:11, 14.40s/it]
 73%|███████▎  | 27876/37963 [119:28:12<40:24:06, 14.42s/it]
 73%|███████▎  | 27877/37963 [119:28:27<40:24:26, 14.42s/it]
 73%|███████▎  | 27878/37963 [119:28:41<40:16:57, 14.38s/it]
 73%|███████▎  | 27879/37963 [119:28:55<39:58:10, 14.27s/it]
 73%|███████▎  | 27880/37963 [119:29:10<40:12:35, 14.36s/it]
                                                            
{'loss': '0.1008', 'grad_norm': '2.468', 'learning_rate': '3.478e-06', 'epoch': '0.7344'}

 73%|███████▎  | 27880/37963 [119:29:10<40:12:35, 14.36s/it]
 73%|███████▎  | 27881/37963 [119:29:24<40:12:17, 14.36s/it]
 73%|███████▎  | 27882/37963 [119:29:38<40:17:53, 14.39s/it]
 73%|███████▎  | 27883/37963 [119:29:53<40:12:15, 14.36s/it]
 73%|███████▎  | 27884/37963 [119:30:07<40:13:54, 14.37s/it]
 73%|███████▎  | 27885/37963 [119:30:22<40:15:12, 14.38s/it]
 73%|███████▎  | 27886/37963 [119:30:36<40:14:26, 14.38s/it]
 73%|███████▎  | 27887/37963 [119:30:50<40:14:47, 14.38s/it]
 73%|███████▎  | 27888/37963 [119:31:11<45:32:30, 16.27s/it]
 73%|███████▎  | 27889/37963 [119:31:25<43:55:57, 15.70s/it]
 73%|███████▎  | 27890/37963 [119:31:46<48:15:15, 17.25s/it]
                                                            
{'loss': '0.1049', 'grad_norm': '3.506', 'learning_rate': '3.471e-06', 'epoch': '0.7347'}

 73%|███████▎  | 27890/37963 [119:31:46<48:15:15, 17.25s/it]
 73%|███████▎  | 27891/37963 [119:32:00<45:43:59, 16.35s/it]
 73%|███████▎  | 27892/37963 [119:32:15<44:07:57, 15.78s/it]
 73%|███████▎  | 27893/37963 [119:32:29<42:56:28, 15.35s/it]
 73%|███████▎  | 27894/37963 [119:32:44<42:07:49, 15.06s/it]
 73%|███████▎  | 27895/37963 [119:33:05<47:27:58, 16.97s/it]
 73%|███████▎  | 27896/37963 [119:33:19<45:13:36, 16.17s/it]
 73%|███████▎  | 27897/37963 [119:33:34<43:33:58, 15.58s/it]
 73%|███████▎  | 27898/37963 [119:33:48<42:33:03, 15.22s/it]
 73%|███████▎  | 27899/37963 [119:34:08<46:46:32, 16.73s/it]
 73%|███████▎  | 27900/37963 [119:34:23<44:44:28, 16.01s/it]
                                                            
{'loss': '0.1033', 'grad_norm': '3.268', 'learning_rate': '3.465e-06', 'epoch': '0.7349'}

 73%|███████▎  | 27900/37963 [119:34:23<44:44:28, 16.01s/it]
 73%|███████▎  | 27901/37963 [119:34:37<43:05:59, 15.42s/it]
 73%|███████▎  | 27902/37963 [119:34:51<42:02:19, 15.04s/it]
 74%|███████▎  | 27903/37963 [119:35:11<46:36:58, 16.68s/it]
 74%|███████▎  | 27904/37963 [119:35:25<44:09:25, 15.80s/it]
 74%|███████▎  | 27905/37963 [119:35:46<48:56:06, 17.52s/it]
 74%|███████▎  | 27906/37963 [119:36:01<46:21:18, 16.59s/it]
 74%|███████▎  | 27907/37963 [119:36:15<44:30:35, 15.93s/it]
 74%|███████▎  | 27908/37963 [119:36:30<43:12:04, 15.47s/it]
 74%|███████▎  | 27909/37963 [119:36:44<42:10:32, 15.10s/it]
 74%|███████▎  | 27910/37963 [119:37:04<46:28:57, 16.65s/it]
                                                            
{'loss': '0.1026', 'grad_norm': '2.147', 'learning_rate': '3.459e-06', 'epoch': '0.7352'}

 74%|███████▎  | 27910/37963 [119:37:04<46:28:57, 16.65s/it]
 74%|███████▎  | 27911/37963 [119:37:19<44:37:39, 15.98s/it]
 74%|███████▎  | 27912/37963 [119:37:33<43:22:43, 15.54s/it]
 74%|███████▎  | 27913/37963 [119:37:48<42:25:14, 15.20s/it]
 74%|███████▎  | 27914/37963 [119:38:02<41:44:39, 14.95s/it]
 74%|███████▎  | 27915/37963 [119:38:16<41:15:08, 14.78s/it]
 74%|███████▎  | 27916/37963 [119:38:31<40:50:54, 14.64s/it]
 74%|███████▎  | 27917/37963 [119:38:51<45:50:02, 16.42s/it]
 74%|███████▎  | 27918/37963 [119:39:06<44:06:09, 15.81s/it]
 74%|███████▎  | 27919/37963 [119:39:20<42:53:59, 15.38s/it]
 74%|███████▎  | 27920/37963 [119:39:34<41:37:30, 14.92s/it]
                                                            
{'loss': '0.09279', 'grad_norm': '2.051', 'learning_rate': '3.452e-06', 'epoch': '0.7355'}

 74%|███████▎  | 27920/37963 [119:39:34<41:37:30, 14.92s/it]
 74%|███████▎  | 27921/37963 [119:39:48<41:16:10, 14.79s/it]
 74%|███████▎  | 27922/37963 [119:40:03<40:55:39, 14.67s/it]
 74%|███████▎  | 27923/37963 [119:40:17<40:41:21, 14.59s/it]
 74%|███████▎  | 27924/37963 [119:40:31<40:20:18, 14.47s/it]
 74%|███████▎  | 27925/37963 [119:40:45<39:50:02, 14.29s/it]
 74%|███████▎  | 27926/37963 [119:40:59<39:52:56, 14.30s/it]
 74%|███████▎  | 27927/37963 [119:41:13<39:34:52, 14.20s/it]
 74%|███████▎  | 27928/37963 [119:41:28<39:32:44, 14.19s/it]
 74%|███████▎  | 27929/37963 [119:41:42<39:47:36, 14.28s/it]
 74%|███████▎  | 27930/37963 [119:41:57<39:55:16, 14.32s/it]
                                                            
{'loss': '0.1004', 'grad_norm': '2.678', 'learning_rate': '3.446e-06', 'epoch': '0.7357'}

 74%|███████▎  | 27930/37963 [119:41:57<39:55:16, 14.32s/it]
 74%|███████▎  | 27931/37963 [119:42:11<40:04:01, 14.38s/it]
 74%|███████▎  | 27932/37963 [119:42:25<40:04:13, 14.38s/it]
 74%|███████▎  | 27933/37963 [119:42:40<40:10:30, 14.42s/it]
 74%|███████▎  | 27934/37963 [119:42:54<40:11:41, 14.43s/it]
 74%|███████▎  | 27935/37963 [119:43:09<40:07:43, 14.41s/it]
 74%|███████▎  | 27936/37963 [119:43:23<40:06:54, 14.40s/it]
 74%|███████▎  | 27937/37963 [119:43:44<45:40:58, 16.40s/it]
 74%|███████▎  | 27938/37963 [119:43:59<44:03:41, 15.82s/it]
 74%|███████▎  | 27939/37963 [119:44:13<42:51:07, 15.39s/it]
 74%|███████▎  | 27940/37963 [119:44:34<47:33:22, 17.08s/it]
                                                            
{'loss': '0.1215', 'grad_norm': '3.294', 'learning_rate': '3.439e-06', 'epoch': '0.736'}

 74%|███████▎  | 27940/37963 [119:44:34<47:33:22, 17.08s/it]
 74%|███████▎  | 27941/37963 [119:44:48<44:56:20, 16.14s/it]
 74%|███████▎  | 27942/37963 [119:45:02<43:07:21, 15.49s/it]
 74%|███████▎  | 27943/37963 [119:45:23<47:45:36, 17.16s/it]
 74%|███████▎  | 27944/37963 [119:45:37<45:19:10, 16.28s/it]
 74%|███████▎  | 27945/37963 [119:45:52<43:42:45, 15.71s/it]
 74%|███████▎  | 27946/37963 [119:46:06<42:35:44, 15.31s/it]
 74%|███████▎  | 27947/37963 [119:46:20<41:53:06, 15.05s/it]
 74%|███████▎  | 27948/37963 [119:46:35<41:21:31, 14.87s/it]
 74%|███████▎  | 27949/37963 [119:46:49<40:58:39, 14.73s/it]
 74%|███████▎  | 27950/37963 [119:47:04<40:41:11, 14.63s/it]
                                                            
{'loss': '0.1092', 'grad_norm': '1.856', 'learning_rate': '3.433e-06', 'epoch': '0.7362'}

 74%|███████▎  | 27950/37963 [119:47:04<40:41:11, 14.63s/it]
 74%|███████▎  | 27951/37963 [119:47:18<40:13:02, 14.46s/it]
 74%|███████▎  | 27952/37963 [119:47:39<45:33:05, 16.38s/it]
 74%|███████▎  | 27953/37963 [119:48:06<54:47:48, 19.71s/it]
 74%|███████▎  | 27954/37963 [119:48:21<50:29:26, 18.16s/it]
 74%|███████▎  | 27955/37963 [119:48:35<47:20:48, 17.03s/it]
 74%|███████▎  | 27956/37963 [119:48:49<45:05:13, 16.22s/it]
 74%|███████▎  | 27957/37963 [119:49:04<43:33:33, 15.67s/it]
 74%|███████▎  | 27958/37963 [119:49:18<42:27:41, 15.28s/it]
 74%|███████▎  | 27959/37963 [119:49:39<47:06:48, 16.95s/it]
 74%|███████▎  | 27960/37963 [119:49:53<44:39:48, 16.07s/it]
                                                            
{'loss': '0.1071', 'grad_norm': '3.063', 'learning_rate': '3.426e-06', 'epoch': '0.7365'}

 74%|███████▎  | 27960/37963 [119:49:53<44:39:48, 16.07s/it]
 74%|███████▎  | 27961/37963 [119:50:07<42:50:54, 15.42s/it]
 74%|███████▎  | 27962/37963 [119:50:21<42:07:22, 15.16s/it]
 74%|███████▎  | 27963/37963 [119:50:36<41:25:32, 14.91s/it]
 74%|███████▎  | 27964/37963 [119:50:50<40:59:19, 14.76s/it]
 74%|███████▎  | 27965/37963 [119:51:11<46:06:35, 16.60s/it]
 74%|███████▎  | 27966/37963 [119:51:26<44:18:19, 15.95s/it]
 74%|███████▎  | 27967/37963 [119:51:40<42:42:48, 15.38s/it]
 74%|███████▎  | 27968/37963 [119:51:54<42:00:00, 15.13s/it]
 74%|███████▎  | 27969/37963 [119:52:08<41:21:48, 14.90s/it]
 74%|███████▎  | 27970/37963 [119:52:23<40:59:55, 14.77s/it]
                                                            
{'loss': '0.09683', 'grad_norm': '2.843', 'learning_rate': '3.42e-06', 'epoch': '0.7368'}

 74%|███████▎  | 27970/37963 [119:52:23<40:59:55, 14.77s/it]
 74%|███████▎  | 27971/37963 [119:52:37<40:47:23, 14.70s/it]
 74%|███████▎  | 27972/37963 [119:52:51<40:03:09, 14.43s/it]
 74%|███████▎  | 27973/37963 [119:53:06<39:53:40, 14.38s/it]
 74%|███████▎  | 27974/37963 [119:53:20<40:01:54, 14.43s/it]
 74%|███████▎  | 27975/37963 [119:53:34<39:58:32, 14.41s/it]
 74%|███████▎  | 27976/37963 [119:53:49<40:01:04, 14.43s/it]
 74%|███████▎  | 27977/37963 [119:54:03<40:06:19, 14.46s/it]
 74%|███████▎  | 27978/37963 [119:54:18<40:04:18, 14.45s/it]
 74%|███████▎  | 27979/37963 [119:54:32<40:04:55, 14.45s/it]
 74%|███████▎  | 27980/37963 [119:54:47<40:05:00, 14.45s/it]
                                                            
{'loss': '0.1079', 'grad_norm': '2.92', 'learning_rate': '3.413e-06', 'epoch': '0.737'}

 74%|███████▎  | 27980/37963 [119:54:47<40:05:00, 14.45s/it]
 74%|███████▎  | 27981/37963 [119:55:01<40:02:13, 14.44s/it]
 74%|███████▎  | 27982/37963 [119:55:16<39:59:09, 14.42s/it]
 74%|███████▎  | 27983/37963 [119:55:29<39:32:56, 14.27s/it]
 74%|███████▎  | 27984/37963 [119:55:43<39:07:46, 14.12s/it]
 74%|███████▎  | 27985/37963 [119:56:04<45:01:34, 16.25s/it]
 74%|███████▎  | 27986/37963 [119:56:19<43:25:54, 15.67s/it]
 74%|███████▎  | 27987/37963 [119:56:33<42:22:33, 15.29s/it]
 74%|███████▎  | 27988/37963 [119:56:53<46:20:05, 16.72s/it]
 74%|███████▎  | 27989/37963 [119:57:07<43:51:19, 15.83s/it]
 74%|███████▎  | 27990/37963 [119:57:21<42:37:30, 15.39s/it]
                                                            
{'loss': '0.09343', 'grad_norm': '2.379', 'learning_rate': '3.407e-06', 'epoch': '0.7373'}

 74%|███████▎  | 27990/37963 [119:57:21<42:37:30, 15.39s/it]
 74%|███████▎  | 27991/37963 [119:57:42<46:53:29, 16.93s/it]
 74%|███████▎  | 27992/37963 [119:57:56<44:49:06, 16.18s/it]
 74%|███████▎  | 27993/37963 [119:58:11<43:10:57, 15.59s/it]
 74%|███████▎  | 27994/37963 [119:58:25<42:14:43, 15.26s/it]
 74%|███████▎  | 27995/37963 [119:58:39<41:31:45, 15.00s/it]
 74%|███████▎  | 27996/37963 [119:58:53<40:35:15, 14.66s/it]
 74%|███████▎  | 27997/37963 [119:59:08<40:18:21, 14.56s/it]
 74%|███████▍  | 27998/37963 [119:59:22<39:47:22, 14.37s/it]
 74%|███████▍  | 27999/37963 [119:59:36<39:44:15, 14.36s/it]
 74%|███████▍  | 28000/37963 [119:59:50<39:44:15, 14.36s/it]
                                                            
{'loss': '0.08595', 'grad_norm': '1.592', 'learning_rate': '3.401e-06', 'epoch': '0.7376'}

 74%|███████▍  | 28000/37963 [119:59:50<39:44:15, 14.36s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:13<00:00, 14.00s/it]
Writing model shards: 100%|██████████| 1/1 [00:13<00:00, 14.00s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 74%|███████▍  | 28001/37963 [120:01:42<120:23:13, 43.50s/it]
 74%|███████▍  | 28002/37963 [120:01:56<96:14:54, 34.79s/it] 
 74%|███████▍  | 28003/37963 [120:02:17<84:58:57, 30.72s/it]
 74%|███████▍  | 28004/37963 [120:02:38<76:52:37, 27.79s/it]
 74%|███████▍  | 28005/37963 [120:02:53<65:37:39, 23.73s/it]
 74%|███████▍  | 28006/37963 [120:03:07<57:47:18, 20.89s/it]
 74%|███████▍  | 28007/37963 [120:03:28<57:48:47, 20.90s/it]
 74%|███████▍  | 28008/37963 [120:03:42<52:20:16, 18.93s/it]
 74%|███████▍  | 28009/37963 [120:03:57<48:35:23, 17.57s/it]
 74%|███████▍  | 28010/37963 [120:04:11<45:52:39, 16.59s/it]
                                                            
{'loss': '0.09668', 'grad_norm': '2.212', 'learning_rate': '3.394e-06', 'epoch': '0.7378'}

 74%|███████▍  | 28010/37963 [120:04:11<45:52:39, 16.59s/it]
 74%|███████▍  | 28011/37963 [120:04:25<43:53:34, 15.88s/it]
 74%|███████▍  | 28012/37963 [120:04:39<42:11:59, 15.27s/it]
 74%|███████▍  | 28013/37963 [120:04:53<41:27:28, 15.00s/it]
 74%|███████▍  | 28014/37963 [120:05:14<46:25:14, 16.80s/it]
 74%|███████▍  | 28015/37963 [120:05:28<44:12:23, 16.00s/it]
 74%|███████▍  | 28016/37963 [120:05:43<42:49:39, 15.50s/it]
 74%|███████▍  | 28017/37963 [120:05:57<41:51:24, 15.15s/it]
 74%|███████▍  | 28018/37963 [120:06:12<41:17:00, 14.94s/it]
 74%|███████▍  | 28019/37963 [120:06:26<40:31:51, 14.67s/it]
 74%|███████▍  | 28020/37963 [120:06:40<40:18:56, 14.60s/it]
                                                            
{'loss': '0.08793', 'grad_norm': '2.155', 'learning_rate': '3.388e-06', 'epoch': '0.7381'}

 74%|███████▍  | 28020/37963 [120:06:40<40:18:56, 14.60s/it]
 74%|███████▍  | 28021/37963 [120:06:54<40:05:33, 14.52s/it]
 74%|███████▍  | 28022/37963 [120:07:09<40:00:22, 14.49s/it]
 74%|███████▍  | 28023/37963 [120:07:23<39:47:21, 14.41s/it]
 74%|███████▍  | 28024/37963 [120:07:37<39:46:23, 14.41s/it]
 74%|███████▍  | 28025/37963 [120:07:51<39:30:37, 14.31s/it]
 74%|███████▍  | 28026/37963 [120:08:06<39:30:26, 14.31s/it]
 74%|███████▍  | 28027/37963 [120:08:20<39:21:40, 14.26s/it]
 74%|███████▍  | 28028/37963 [120:08:34<39:22:58, 14.27s/it]
 74%|███████▍  | 28029/37963 [120:08:49<39:24:19, 14.28s/it]
 74%|███████▍  | 28030/37963 [120:09:03<39:19:14, 14.25s/it]
                                                            
{'loss': '0.09387', 'grad_norm': '1.606', 'learning_rate': '3.381e-06', 'epoch': '0.7384'}

 74%|███████▍  | 28030/37963 [120:09:03<39:19:14, 14.25s/it]
 74%|███████▍  | 28031/37963 [120:09:17<39:22:43, 14.27s/it]
 74%|███████▍  | 28032/37963 [120:09:31<39:26:23, 14.30s/it]
 74%|███████▍  | 28033/37963 [120:09:46<39:24:04, 14.28s/it]
 74%|███████▍  | 28034/37963 [120:10:07<44:54:30, 16.28s/it]
 74%|███████▍  | 28035/37963 [120:10:20<42:49:05, 15.53s/it]
 74%|███████▍  | 28036/37963 [120:10:35<41:48:18, 15.16s/it]
 74%|███████▍  | 28037/37963 [120:10:56<46:30:00, 16.86s/it]
 74%|███████▍  | 28038/37963 [120:11:10<44:28:47, 16.13s/it]
 74%|███████▍  | 28039/37963 [120:11:24<43:04:21, 15.62s/it]
 74%|███████▍  | 28040/37963 [120:11:39<42:09:05, 15.29s/it]
                                                            
{'loss': '0.09795', 'grad_norm': '3.544', 'learning_rate': '3.375e-06', 'epoch': '0.7386'}

 74%|███████▍  | 28040/37963 [120:11:39<42:09:05, 15.29s/it]
 74%|███████▍  | 28041/37963 [120:12:00<47:19:55, 17.17s/it]
 74%|███████▍  | 28042/37963 [120:12:14<44:42:50, 16.23s/it]
 74%|███████▍  | 28043/37963 [120:12:29<43:07:17, 15.65s/it]
 74%|███████▍  | 28044/37963 [120:12:42<41:22:30, 15.02s/it]
 74%|███████▍  | 28045/37963 [120:12:57<40:51:17, 14.83s/it]
 74%|███████▍  | 28046/37963 [120:13:11<40:30:34, 14.71s/it]
 74%|███████▍  | 28047/37963 [120:13:25<40:12:51, 14.60s/it]
 74%|███████▍  | 28048/37963 [120:13:47<45:43:54, 16.60s/it]
 74%|███████▍  | 28049/37963 [120:14:01<43:52:34, 15.93s/it]
 74%|███████▍  | 28050/37963 [120:14:15<42:09:55, 15.31s/it]
                                                            
{'loss': '0.1017', 'grad_norm': '1.343', 'learning_rate': '3.369e-06', 'epoch': '0.7389'}

 74%|███████▍  | 28050/37963 [120:14:15<42:09:55, 15.31s/it]
 74%|███████▍  | 28051/37963 [120:14:35<46:16:49, 16.81s/it]
 74%|███████▍  | 28052/37963 [120:14:50<44:18:21, 16.09s/it]
 74%|███████▍  | 28053/37963 [120:15:11<48:23:32, 17.58s/it]
 74%|███████▍  | 28054/37963 [120:15:25<45:47:05, 16.63s/it]
 74%|███████▍  | 28055/37963 [120:15:46<48:50:21, 17.75s/it]
 74%|███████▍  | 28056/37963 [120:16:00<45:45:37, 16.63s/it]
 74%|███████▍  | 28057/37963 [120:16:14<43:57:17, 15.97s/it]
 74%|███████▍  | 28058/37963 [120:16:28<42:44:17, 15.53s/it]
 74%|███████▍  | 28059/37963 [120:16:43<41:31:27, 15.09s/it]
 74%|███████▍  | 28060/37963 [120:16:57<40:53:27, 14.86s/it]
                                                            
{'loss': '0.1034', 'grad_norm': '3.021', 'learning_rate': '3.362e-06', 'epoch': '0.7391'}

 74%|███████▍  | 28060/37963 [120:16:57<40:53:27, 14.86s/it]
 74%|███████▍  | 28061/37963 [120:17:11<40:27:57, 14.71s/it]
 74%|███████▍  | 28062/37963 [120:17:25<40:03:11, 14.56s/it]
 74%|███████▍  | 28063/37963 [120:17:46<45:20:42, 16.49s/it]
 74%|███████▍  | 28064/37963 [120:18:01<43:34:54, 15.85s/it]
 74%|███████▍  | 28065/37963 [120:18:15<42:23:02, 15.42s/it]
 74%|███████▍  | 28066/37963 [120:18:30<41:41:28, 15.17s/it]
 74%|███████▍  | 28067/37963 [120:18:44<40:56:31, 14.89s/it]
 74%|███████▍  | 28068/37963 [120:18:58<40:31:43, 14.75s/it]
 74%|███████▍  | 28069/37963 [120:19:12<39:52:16, 14.51s/it]
 74%|███████▍  | 28070/37963 [120:19:27<39:43:50, 14.46s/it]
                                                            
{'loss': '0.1069', 'grad_norm': '2.475', 'learning_rate': '3.356e-06', 'epoch': '0.7394'}

 74%|███████▍  | 28070/37963 [120:19:27<39:43:50, 14.46s/it]
 74%|███████▍  | 28071/37963 [120:19:40<39:08:58, 14.25s/it]
 74%|███████▍  | 28072/37963 [120:19:55<39:23:42, 14.34s/it]
 74%|███████▍  | 28073/37963 [120:20:10<39:36:47, 14.42s/it]
 74%|███████▍  | 28074/37963 [120:20:24<39:33:34, 14.40s/it]
 74%|███████▍  | 28075/37963 [120:20:38<39:26:36, 14.36s/it]
 74%|███████▍  | 28076/37963 [120:20:52<39:11:10, 14.27s/it]
 74%|███████▍  | 28077/37963 [120:21:07<39:23:50, 14.35s/it]
 74%|███████▍  | 28078/37963 [120:21:21<39:24:48, 14.35s/it]
 74%|███████▍  | 28079/37963 [120:21:36<39:20:58, 14.33s/it]
 74%|███████▍  | 28080/37963 [120:21:50<39:22:23, 14.34s/it]
                                                            
{'loss': '0.09945', 'grad_norm': '2.787', 'learning_rate': '3.35e-06', 'epoch': '0.7397'}

 74%|███████▍  | 28080/37963 [120:21:50<39:22:23, 14.34s/it]
 74%|███████▍  | 28081/37963 [120:22:04<39:20:38, 14.33s/it]
 74%|███████▍  | 28082/37963 [120:22:25<44:42:38, 16.29s/it]
 74%|███████▍  | 28083/37963 [120:22:39<42:53:58, 15.63s/it]
 74%|███████▍  | 28084/37963 [120:22:54<41:51:37, 15.25s/it]
 74%|███████▍  | 28085/37963 [120:23:14<46:04:49, 16.79s/it]
 74%|███████▍  | 28086/37963 [120:23:28<44:05:40, 16.07s/it]
 74%|███████▍  | 28087/37963 [120:23:42<42:23:57, 15.46s/it]
 74%|███████▍  | 28088/37963 [120:24:03<46:37:58, 17.00s/it]
 74%|███████▍  | 28089/37963 [120:24:17<44:29:43, 16.22s/it]
 74%|███████▍  | 28090/37963 [120:24:32<43:03:15, 15.70s/it]
                                                            
{'loss': '0.09386', 'grad_norm': '2.107', 'learning_rate': '3.343e-06', 'epoch': '0.7399'}

 74%|███████▍  | 28090/37963 [120:24:32<43:03:15, 15.70s/it]
 74%|███████▍  | 28091/37963 [120:24:46<41:49:22, 15.25s/it]
 74%|███████▍  | 28092/37963 [120:25:00<41:01:24, 14.96s/it]
 74%|███████▍  | 28093/37963 [120:25:14<40:08:36, 14.64s/it]
 74%|███████▍  | 28094/37963 [120:25:29<39:57:36, 14.58s/it]
 74%|███████▍  | 28095/37963 [120:25:43<39:53:26, 14.55s/it]
 74%|███████▍  | 28096/37963 [120:25:57<39:33:58, 14.44s/it]
 74%|███████▍  | 28097/37963 [120:26:12<39:30:19, 14.42s/it]
 74%|███████▍  | 28098/37963 [120:26:33<44:58:50, 16.41s/it]
 74%|███████▍  | 28099/37963 [120:26:47<43:15:56, 15.79s/it]
 74%|███████▍  | 28100/37963 [120:27:01<42:07:54, 15.38s/it]
                                                            
{'loss': '0.1047', 'grad_norm': '2.767', 'learning_rate': '3.337e-06', 'epoch': '0.7402'}

 74%|███████▍  | 28100/37963 [120:27:01<42:07:54, 15.38s/it]
 74%|███████▍  | 28101/37963 [120:27:16<41:15:21, 15.06s/it]
 74%|███████▍  | 28102/37963 [120:27:43<51:15:40, 18.71s/it]
 74%|███████▍  | 28103/37963 [120:27:57<47:28:45, 17.34s/it]
 74%|███████▍  | 28104/37963 [120:28:17<49:54:02, 18.22s/it]
 74%|███████▍  | 28105/37963 [120:28:32<46:54:26, 17.13s/it]
 74%|███████▍  | 28106/37963 [120:28:46<44:29:01, 16.25s/it]
 74%|███████▍  | 28107/37963 [120:29:01<42:57:59, 15.69s/it]
 74%|███████▍  | 28108/37963 [120:29:15<42:01:45, 15.35s/it]
 74%|███████▍  | 28109/37963 [120:29:30<41:13:44, 15.06s/it]
 74%|███████▍  | 28110/37963 [120:29:44<40:26:56, 14.78s/it]
                                                            
{'loss': '0.1039', 'grad_norm': '2.527', 'learning_rate': '3.33e-06', 'epoch': '0.7405'}

 74%|███████▍  | 28110/37963 [120:29:44<40:26:56, 14.78s/it]
 74%|███████▍  | 28111/37963 [120:29:58<40:15:55, 14.71s/it]
 74%|███████▍  | 28112/37963 [120:30:19<45:24:00, 16.59s/it]
 74%|███████▍  | 28113/37963 [120:30:33<43:12:23, 15.79s/it]
 74%|███████▍  | 28114/37963 [120:30:48<42:03:37, 15.37s/it]
 74%|███████▍  | 28115/37963 [120:31:02<41:16:57, 15.09s/it]
 74%|███████▍  | 28116/37963 [120:31:17<40:53:57, 14.95s/it]
 74%|███████▍  | 28117/37963 [120:31:31<40:30:26, 14.81s/it]
 74%|███████▍  | 28118/37963 [120:31:45<39:53:00, 14.58s/it]
 74%|███████▍  | 28119/37963 [120:32:00<39:45:27, 14.54s/it]
 74%|███████▍  | 28120/37963 [120:32:14<39:39:43, 14.51s/it]
                                                            
{'loss': '0.09966', 'grad_norm': '3.106', 'learning_rate': '3.324e-06', 'epoch': '0.7407'}

 74%|███████▍  | 28120/37963 [120:32:14<39:39:43, 14.51s/it]
 74%|███████▍  | 28121/37963 [120:32:28<39:39:00, 14.50s/it]
 74%|███████▍  | 28122/37963 [120:32:43<39:34:36, 14.48s/it]
 74%|███████▍  | 28123/37963 [120:32:57<39:38:11, 14.50s/it]
 74%|███████▍  | 28124/37963 [120:33:12<39:37:43, 14.50s/it]
 74%|███████▍  | 28125/37963 [120:33:26<39:32:29, 14.47s/it]
 74%|███████▍  | 28126/37963 [120:33:41<39:26:44, 14.44s/it]
 74%|███████▍  | 28127/37963 [120:33:55<39:21:41, 14.41s/it]
 74%|███████▍  | 28128/37963 [120:34:09<39:20:34, 14.40s/it]
 74%|███████▍  | 28129/37963 [120:34:30<44:41:56, 16.36s/it]
 74%|███████▍  | 28130/37963 [120:34:45<43:01:55, 15.75s/it]
                                                            
{'loss': '0.1019', 'grad_norm': '1.622', 'learning_rate': '3.318e-06', 'epoch': '0.741'}

 74%|███████▍  | 28130/37963 [120:34:45<43:01:55, 15.75s/it]
 74%|███████▍  | 28131/37963 [120:34:58<41:22:39, 15.15s/it]
 74%|███████▍  | 28132/37963 [120:35:13<40:41:19, 14.90s/it]
 74%|███████▍  | 28133/37963 [120:35:27<40:16:43, 14.75s/it]
 74%|███████▍  | 28134/37963 [120:35:48<45:12:42, 16.56s/it]
 74%|███████▍  | 28135/37963 [120:36:02<43:16:14, 15.85s/it]
 74%|███████▍  | 28136/37963 [120:36:23<47:14:03, 17.30s/it]
 74%|███████▍  | 28137/37963 [120:36:37<44:54:36, 16.45s/it]
 74%|███████▍  | 28138/37963 [120:36:52<43:14:35, 15.84s/it]
 74%|███████▍  | 28139/37963 [120:37:06<41:55:52, 15.37s/it]
 74%|███████▍  | 28140/37963 [120:37:20<41:07:10, 15.07s/it]
                                                            
{'loss': '0.09447', 'grad_norm': '2.009', 'learning_rate': '3.311e-06', 'epoch': '0.7413'}

 74%|███████▍  | 28140/37963 [120:37:20<41:07:10, 15.07s/it]
 74%|███████▍  | 28141/37963 [120:37:34<40:07:10, 14.70s/it]
 74%|███████▍  | 28142/37963 [120:37:49<39:57:30, 14.65s/it]
 74%|███████▍  | 28143/37963 [120:38:03<39:18:51, 14.41s/it]
 74%|███████▍  | 28144/37963 [120:38:17<39:08:02, 14.35s/it]
 74%|███████▍  | 28145/37963 [120:38:31<39:08:21, 14.35s/it]
 74%|███████▍  | 28146/37963 [120:38:52<44:43:05, 16.40s/it]
 74%|███████▍  | 28147/37963 [120:39:07<43:07:25, 15.82s/it]
 74%|███████▍  | 28148/37963 [120:39:28<47:23:43, 17.38s/it]
 74%|███████▍  | 28149/37963 [120:39:49<50:16:38, 18.44s/it]
 74%|███████▍  | 28150/37963 [120:40:03<47:03:21, 17.26s/it]
                                                            
{'loss': '0.09355', 'grad_norm': '4.529', 'learning_rate': '3.305e-06', 'epoch': '0.7415'}

 74%|███████▍  | 28150/37963 [120:40:03<47:03:21, 17.26s/it]
 74%|███████▍  | 28151/37963 [120:40:18<44:51:36, 16.46s/it]
 74%|███████▍  | 28152/37963 [120:40:38<48:17:44, 17.72s/it]
 74%|███████▍  | 28153/37963 [120:40:53<45:33:29, 16.72s/it]
 74%|███████▍  | 28154/37963 [120:41:07<43:37:17, 16.01s/it]
 74%|███████▍  | 28155/37963 [120:41:22<42:15:50, 15.51s/it]
 74%|███████▍  | 28156/37963 [120:41:36<41:26:58, 15.22s/it]
 74%|███████▍  | 28157/37963 [120:41:50<40:12:10, 14.76s/it]
 74%|███████▍  | 28158/37963 [120:42:04<39:58:03, 14.67s/it]
 74%|███████▍  | 28159/37963 [120:42:19<39:45:19, 14.60s/it]
 74%|███████▍  | 28160/37963 [120:42:33<39:31:31, 14.52s/it]
                                                            
{'loss': '0.09392', 'grad_norm': '2.617', 'learning_rate': '3.299e-06', 'epoch': '0.7418'}

 74%|███████▍  | 28160/37963 [120:42:33<39:31:31, 14.52s/it]
 74%|███████▍  | 28161/37963 [120:42:54<45:00:34, 16.53s/it]
 74%|███████▍  | 28162/37963 [120:43:08<42:57:22, 15.78s/it]
 74%|███████▍  | 28163/37963 [120:43:23<41:48:19, 15.36s/it]
 74%|███████▍  | 28164/37963 [120:43:37<41:01:03, 15.07s/it]
 74%|███████▍  | 28165/37963 [120:43:51<40:09:50, 14.76s/it]
 74%|███████▍  | 28166/37963 [120:44:05<39:51:37, 14.65s/it]
 74%|███████▍  | 28167/37963 [120:44:20<39:51:02, 14.65s/it]
 74%|███████▍  | 28168/37963 [120:44:35<39:40:41, 14.58s/it]
 74%|███████▍  | 28169/37963 [120:44:49<39:32:00, 14.53s/it]
 74%|███████▍  | 28170/37963 [120:45:03<39:27:18, 14.50s/it]
                                                            
{'loss': '0.1068', 'grad_norm': '4.097', 'learning_rate': '3.292e-06', 'epoch': '0.742'}

 74%|███████▍  | 28170/37963 [120:45:03<39:27:18, 14.50s/it]
 74%|███████▍  | 28171/37963 [120:45:17<39:03:30, 14.36s/it]
 74%|███████▍  | 28172/37963 [120:45:32<39:02:38, 14.36s/it]
 74%|███████▍  | 28173/37963 [120:45:46<38:45:39, 14.25s/it]
 74%|███████▍  | 28174/37963 [120:46:00<38:37:29, 14.20s/it]
 74%|███████▍  | 28175/37963 [120:46:14<38:43:07, 14.24s/it]
 74%|███████▍  | 28176/37963 [120:46:28<38:43:18, 14.24s/it]
 74%|███████▍  | 28177/37963 [120:46:43<38:50:23, 14.29s/it]
 74%|███████▍  | 28178/37963 [120:47:04<44:26:53, 16.35s/it]
 74%|███████▍  | 28179/37963 [120:47:18<42:52:24, 15.78s/it]
 74%|███████▍  | 28180/37963 [120:47:33<41:34:52, 15.30s/it]
                                                            
{'loss': '0.09383', 'grad_norm': '2.403', 'learning_rate': '3.286e-06', 'epoch': '0.7423'}

 74%|███████▍  | 28180/37963 [120:47:33<41:34:52, 15.30s/it]
 74%|███████▍  | 28181/37963 [120:47:46<40:23:16, 14.86s/it]
 74%|███████▍  | 28182/37963 [120:48:01<39:57:25, 14.71s/it]
 74%|███████▍  | 28183/37963 [120:48:22<44:50:21, 16.51s/it]
 74%|███████▍  | 28184/37963 [120:48:36<43:09:30, 15.89s/it]
 74%|███████▍  | 28185/37963 [120:48:57<47:16:32, 17.41s/it]
 74%|███████▍  | 28186/37963 [120:49:11<44:44:17, 16.47s/it]
 74%|███████▍  | 28187/37963 [120:49:25<42:52:01, 15.79s/it]
 74%|███████▍  | 28188/37963 [120:49:40<41:46:53, 15.39s/it]
 74%|███████▍  | 28189/37963 [120:49:54<40:50:57, 15.05s/it]
 74%|███████▍  | 28190/37963 [120:50:09<40:26:37, 14.90s/it]
                                                            
{'loss': '0.09085', 'grad_norm': '2.902', 'learning_rate': '3.28e-06', 'epoch': '0.7426'}

 74%|███████▍  | 28190/37963 [120:50:09<40:26:37, 14.90s/it]
 74%|███████▍  | 28191/37963 [120:50:23<39:45:05, 14.64s/it]
 74%|███████▍  | 28192/37963 [120:50:37<39:35:41, 14.59s/it]
 74%|███████▍  | 28193/37963 [120:50:51<38:57:27, 14.35s/it]
 74%|███████▍  | 28194/37963 [120:51:04<38:15:17, 14.10s/it]
 74%|███████▍  | 28195/37963 [120:51:32<49:21:11, 18.19s/it]
 74%|███████▍  | 28196/37963 [120:51:47<46:19:34, 17.08s/it]
 74%|███████▍  | 28197/37963 [120:52:08<49:31:15, 18.25s/it]
 74%|███████▍  | 28198/37963 [120:52:22<46:22:28, 17.10s/it]
 74%|███████▍  | 28199/37963 [120:52:37<44:18:38, 16.34s/it]
 74%|███████▍  | 28200/37963 [120:52:51<42:43:50, 15.76s/it]
                                                            
{'loss': '0.08823', 'grad_norm': '1.916', 'learning_rate': '3.273e-06', 'epoch': '0.7428'}

 74%|███████▍  | 28200/37963 [120:52:51<42:43:50, 15.76s/it]
 74%|███████▍  | 28201/37963 [120:53:12<46:56:07, 17.31s/it]
 74%|███████▍  | 28202/37963 [120:53:26<44:34:10, 16.44s/it]
 74%|███████▍  | 28203/37963 [120:53:41<42:57:39, 15.85s/it]
 74%|███████▍  | 28204/37963 [120:53:55<41:26:10, 15.29s/it]
 74%|███████▍  | 28205/37963 [120:54:09<40:28:55, 14.93s/it]
 74%|███████▍  | 28206/37963 [120:54:24<40:12:19, 14.83s/it]
 74%|███████▍  | 28207/37963 [120:54:38<39:51:07, 14.71s/it]
 74%|███████▍  | 28208/37963 [120:54:52<39:40:21, 14.64s/it]
 74%|███████▍  | 28209/37963 [120:55:07<39:29:15, 14.57s/it]
 74%|███████▍  | 28210/37963 [120:55:21<39:09:16, 14.45s/it]
                                                            
{'loss': '0.1045', 'grad_norm': '2.193', 'learning_rate': '3.267e-06', 'epoch': '0.7431'}

 74%|███████▍  | 28210/37963 [120:55:21<39:09:16, 14.45s/it]
 74%|███████▍  | 28211/37963 [120:55:42<44:19:42, 16.36s/it]
 74%|███████▍  | 28212/37963 [120:55:56<42:41:48, 15.76s/it]
 74%|███████▍  | 28213/37963 [120:56:11<41:33:43, 15.35s/it]
 74%|███████▍  | 28214/37963 [120:56:25<40:47:15, 15.06s/it]
 74%|███████▍  | 28215/37963 [120:56:39<40:15:25, 14.87s/it]
 74%|███████▍  | 28216/37963 [120:56:54<39:54:47, 14.74s/it]
 74%|███████▍  | 28217/37963 [120:57:08<39:37:25, 14.64s/it]
 74%|███████▍  | 28218/37963 [120:57:22<38:51:54, 14.36s/it]
 74%|███████▍  | 28219/37963 [120:57:36<38:52:16, 14.36s/it]
 74%|███████▍  | 28220/37963 [120:57:50<38:37:37, 14.27s/it]
                                                            
{'loss': '0.09248', 'grad_norm': '1.77', 'learning_rate': '3.261e-06', 'epoch': '0.7434'}

 74%|███████▍  | 28220/37963 [120:57:50<38:37:37, 14.27s/it]
 74%|███████▍  | 28221/37963 [120:58:05<38:41:30, 14.30s/it]
 74%|███████▍  | 28222/37963 [120:58:19<38:44:31, 14.32s/it]
 74%|███████▍  | 28223/37963 [120:58:34<38:51:48, 14.36s/it]
 74%|███████▍  | 28224/37963 [120:58:48<38:54:19, 14.38s/it]
 74%|███████▍  | 28225/37963 [120:59:02<38:42:43, 14.31s/it]
 74%|███████▍  | 28226/37963 [120:59:16<38:42:49, 14.31s/it]
 74%|███████▍  | 28227/37963 [120:59:37<44:08:48, 16.32s/it]
 74%|███████▍  | 28228/37963 [120:59:52<42:33:10, 15.74s/it]
 74%|███████▍  | 28229/37963 [121:00:06<41:25:48, 15.32s/it]
 74%|███████▍  | 28230/37963 [121:00:21<40:41:54, 15.05s/it]
                                                            
{'loss': '0.1055', 'grad_norm': '2.414', 'learning_rate': '3.255e-06', 'epoch': '0.7436'}

 74%|███████▍  | 28230/37963 [121:00:21<40:41:54, 15.05s/it]
 74%|███████▍  | 28231/37963 [121:00:41<45:10:38, 16.71s/it]
 74%|███████▍  | 28232/37963 [121:00:56<43:17:36, 16.02s/it]
 74%|███████▍  | 28233/37963 [121:01:10<42:00:30, 15.54s/it]
 74%|███████▍  | 28234/37963 [121:01:31<46:22:28, 17.16s/it]
 74%|███████▍  | 28235/37963 [121:01:45<44:08:04, 16.33s/it]
 74%|███████▍  | 28236/37963 [121:02:00<42:37:22, 15.77s/it]
 74%|███████▍  | 28237/37963 [121:02:14<41:17:34, 15.28s/it]
 74%|███████▍  | 28238/37963 [121:02:28<40:36:39, 15.03s/it]
 74%|███████▍  | 28239/37963 [121:02:42<39:42:47, 14.70s/it]
 74%|███████▍  | 28240/37963 [121:02:57<39:44:51, 14.72s/it]
                                                            
{'loss': '0.09431', 'grad_norm': '2.749', 'learning_rate': '3.248e-06', 'epoch': '0.7439'}

 74%|███████▍  | 28240/37963 [121:02:57<39:44:51, 14.72s/it]
 74%|███████▍  | 28241/37963 [121:03:12<39:30:24, 14.63s/it]
 74%|███████▍  | 28242/37963 [121:03:26<39:23:23, 14.59s/it]
 74%|███████▍  | 28243/37963 [121:03:40<38:38:25, 14.31s/it]
 74%|███████▍  | 28244/37963 [121:04:00<43:46:32, 16.21s/it]
 74%|███████▍  | 28245/37963 [121:04:22<48:23:46, 17.93s/it]
 74%|███████▍  | 28246/37963 [121:04:37<45:35:09, 16.89s/it]
 74%|███████▍  | 28247/37963 [121:04:57<48:31:40, 17.98s/it]
 74%|███████▍  | 28248/37963 [121:05:12<45:36:03, 16.90s/it]
 74%|███████▍  | 28249/37963 [121:05:32<48:07:30, 17.84s/it]
 74%|███████▍  | 28250/37963 [121:05:46<45:21:24, 16.81s/it]
                                                            
{'loss': '0.09589', 'grad_norm': '1.832', 'learning_rate': '3.242e-06', 'epoch': '0.7441'}

 74%|███████▍  | 28250/37963 [121:05:46<45:21:24, 16.81s/it]
 74%|███████▍  | 28251/37963 [121:06:01<43:26:48, 16.10s/it]
 74%|███████▍  | 28252/37963 [121:06:15<41:45:55, 15.48s/it]
 74%|███████▍  | 28253/37963 [121:06:29<41:00:12, 15.20s/it]
 74%|███████▍  | 28254/37963 [121:06:44<40:24:29, 14.98s/it]
 74%|███████▍  | 28255/37963 [121:06:58<39:53:42, 14.79s/it]
 74%|███████▍  | 28256/37963 [121:07:12<39:03:35, 14.49s/it]
 74%|███████▍  | 28257/37963 [121:07:26<38:56:08, 14.44s/it]
 74%|███████▍  | 28258/37963 [121:07:40<38:55:06, 14.44s/it]
 74%|███████▍  | 28259/37963 [121:07:55<38:54:37, 14.44s/it]
 74%|███████▍  | 28260/37963 [121:08:09<38:46:18, 14.39s/it]
                                                            
{'loss': '0.1045', 'grad_norm': '2.592', 'learning_rate': '3.236e-06', 'epoch': '0.7444'}

 74%|███████▍  | 28260/37963 [121:08:09<38:46:18, 14.39s/it]
 74%|███████▍  | 28261/37963 [121:08:30<44:12:47, 16.41s/it]
 74%|███████▍  | 28262/37963 [121:08:45<42:34:15, 15.80s/it]
 74%|███████▍  | 28263/37963 [121:08:59<41:16:37, 15.32s/it]
 74%|███████▍  | 28264/37963 [121:09:13<40:30:43, 15.04s/it]
 74%|███████▍  | 28265/37963 [121:09:28<39:58:03, 14.84s/it]
 74%|███████▍  | 28266/37963 [121:09:42<39:15:06, 14.57s/it]
 74%|███████▍  | 28267/37963 [121:09:56<39:04:57, 14.51s/it]
 74%|███████▍  | 28268/37963 [121:10:10<39:02:14, 14.50s/it]
 74%|███████▍  | 28269/37963 [121:10:24<38:39:54, 14.36s/it]
 74%|███████▍  | 28270/37963 [121:10:38<38:24:00, 14.26s/it]
                                                            
{'loss': '0.08561', 'grad_norm': '1.977', 'learning_rate': '3.229e-06', 'epoch': '0.7447'}

 74%|███████▍  | 28270/37963 [121:10:38<38:24:00, 14.26s/it]
 74%|███████▍  | 28271/37963 [121:10:53<38:28:54, 14.29s/it]
 74%|███████▍  | 28272/37963 [121:11:07<38:32:21, 14.32s/it]
 74%|███████▍  | 28273/37963 [121:11:22<38:34:15, 14.33s/it]
 74%|███████▍  | 28274/37963 [121:11:36<38:24:03, 14.27s/it]
 74%|███████▍  | 28275/37963 [121:11:50<38:34:29, 14.33s/it]
 74%|███████▍  | 28276/37963 [121:12:04<38:30:42, 14.31s/it]
 74%|███████▍  | 28277/37963 [121:12:26<44:07:13, 16.40s/it]
 74%|███████▍  | 28278/37963 [121:12:40<42:29:45, 15.80s/it]
 74%|███████▍  | 28279/37963 [121:12:54<41:20:22, 15.37s/it]
 74%|███████▍  | 28280/37963 [121:13:15<45:33:31, 16.94s/it]
                                                            
{'loss': '0.08356', 'grad_norm': '2.119', 'learning_rate': '3.223e-06', 'epoch': '0.7449'}

 74%|███████▍  | 28280/37963 [121:13:15<45:33:31, 16.94s/it]
 74%|███████▍  | 28281/37963 [121:13:28<42:39:14, 15.86s/it]
 74%|███████▍  | 28282/37963 [121:13:49<46:47:03, 17.40s/it]
 75%|███████▍  | 28283/37963 [121:14:04<44:25:14, 16.52s/it]
 75%|███████▍  | 28284/37963 [121:14:18<42:46:01, 15.91s/it]
 75%|███████▍  | 28285/37963 [121:14:33<41:33:25, 15.46s/it]
 75%|███████▍  | 28286/37963 [121:14:47<40:42:19, 15.14s/it]
 75%|███████▍  | 28287/37963 [121:15:01<39:59:29, 14.88s/it]
 75%|███████▍  | 28288/37963 [121:15:16<39:33:21, 14.72s/it]
 75%|███████▍  | 28289/37963 [121:15:29<38:43:27, 14.41s/it]
 75%|███████▍  | 28290/37963 [121:15:43<38:08:36, 14.20s/it]
                                                            
{'loss': '0.1042', 'grad_norm': '2.64', 'learning_rate': '3.217e-06', 'epoch': '0.7452'}

 75%|███████▍  | 28290/37963 [121:15:43<38:08:36, 14.20s/it]
 75%|███████▍  | 28291/37963 [121:15:58<38:27:14, 14.31s/it]
 75%|███████▍  | 28292/37963 [121:16:12<38:31:25, 14.34s/it]
 75%|███████▍  | 28293/37963 [121:16:40<49:17:27, 18.35s/it]
 75%|███████▍  | 28294/37963 [121:16:54<45:49:27, 17.06s/it]
 75%|███████▍  | 28295/37963 [121:17:15<48:49:49, 18.18s/it]
 75%|███████▍  | 28296/37963 [121:17:29<45:43:45, 17.03s/it]
 75%|███████▍  | 28297/37963 [121:17:43<43:29:34, 16.20s/it]
 75%|███████▍  | 28298/37963 [121:18:04<47:02:32, 17.52s/it]
 75%|███████▍  | 28299/37963 [121:18:18<44:30:48, 16.58s/it]
 75%|███████▍  | 28300/37963 [121:18:32<42:12:52, 15.73s/it]
                                                            
{'loss': '0.09332', 'grad_norm': '5.493', 'learning_rate': '3.211e-06', 'epoch': '0.7455'}

 75%|███████▍  | 28300/37963 [121:18:32<42:12:52, 15.73s/it]
 75%|███████▍  | 28301/37963 [121:18:47<41:12:05, 15.35s/it]
 75%|███████▍  | 28302/37963 [121:19:01<40:26:27, 15.07s/it]
 75%|███████▍  | 28303/37963 [121:19:15<39:25:37, 14.69s/it]
 75%|███████▍  | 28304/37963 [121:19:29<38:48:34, 14.46s/it]
 75%|███████▍  | 28305/37963 [121:19:43<38:40:58, 14.42s/it]
 75%|███████▍  | 28306/37963 [121:19:57<38:34:36, 14.38s/it]
 75%|███████▍  | 28307/37963 [121:20:12<38:26:44, 14.33s/it]
 75%|███████▍  | 28308/37963 [121:20:26<38:26:23, 14.33s/it]
 75%|███████▍  | 28309/37963 [121:20:40<38:28:55, 14.35s/it]
 75%|███████▍  | 28310/37963 [121:21:01<43:40:07, 16.29s/it]
                                                            
{'loss': '0.1002', 'grad_norm': '2.027', 'learning_rate': '3.204e-06', 'epoch': '0.7457'}

 75%|███████▍  | 28310/37963 [121:21:01<43:40:07, 16.29s/it]
 75%|███████▍  | 28311/37963 [121:21:16<42:13:21, 15.75s/it]
 75%|███████▍  | 28312/37963 [121:21:30<40:57:34, 15.28s/it]
 75%|███████▍  | 28313/37963 [121:21:44<40:00:49, 14.93s/it]
 75%|███████▍  | 28314/37963 [121:21:58<39:38:08, 14.79s/it]
 75%|███████▍  | 28315/37963 [121:22:13<39:17:43, 14.66s/it]
 75%|███████▍  | 28316/37963 [121:22:27<39:03:55, 14.58s/it]
 75%|███████▍  | 28317/37963 [121:22:41<38:53:19, 14.51s/it]
 75%|███████▍  | 28318/37963 [121:22:56<38:50:25, 14.50s/it]
 75%|███████▍  | 28319/37963 [121:23:10<38:35:21, 14.41s/it]
 75%|███████▍  | 28320/37963 [121:23:24<38:33:31, 14.40s/it]
                                                            
{'loss': '0.09813', 'grad_norm': '3.046', 'learning_rate': '3.198e-06', 'epoch': '0.746'}

 75%|███████▍  | 28320/37963 [121:23:24<38:33:31, 14.40s/it]
 75%|███████▍  | 28321/37963 [121:23:39<38:31:57, 14.39s/it]
 75%|███████▍  | 28322/37963 [121:23:53<38:28:09, 14.36s/it]
 75%|███████▍  | 28323/37963 [121:24:07<38:11:42, 14.26s/it]
 75%|███████▍  | 28324/37963 [121:24:22<38:22:27, 14.33s/it]
 75%|███████▍  | 28325/37963 [121:24:35<37:57:06, 14.18s/it]
 75%|███████▍  | 28326/37963 [121:24:57<43:35:19, 16.28s/it]
 75%|███████▍  | 28327/37963 [121:25:11<41:43:46, 15.59s/it]
 75%|███████▍  | 28328/37963 [121:25:31<45:29:25, 17.00s/it]
 75%|███████▍  | 28329/37963 [121:25:45<43:28:47, 16.25s/it]
 75%|███████▍  | 28330/37963 [121:25:59<41:41:25, 15.58s/it]
                                                            
{'loss': '0.1074', 'grad_norm': '2.391', 'learning_rate': '3.192e-06', 'epoch': '0.7463'}

 75%|███████▍  | 28330/37963 [121:25:59<41:41:25, 15.58s/it]
 75%|███████▍  | 28331/37963 [121:26:21<46:08:06, 17.24s/it]
 75%|███████▍  | 28332/37963 [121:26:35<43:30:28, 16.26s/it]
 75%|███████▍  | 28333/37963 [121:26:49<42:02:53, 15.72s/it]
 75%|███████▍  | 28334/37963 [121:27:03<40:55:58, 15.30s/it]
 75%|███████▍  | 28335/37963 [121:27:18<40:24:42, 15.11s/it]
 75%|███████▍  | 28336/37963 [121:27:32<39:21:32, 14.72s/it]
 75%|███████▍  | 28337/37963 [121:27:46<39:03:41, 14.61s/it]
 75%|███████▍  | 28338/37963 [121:28:01<38:54:16, 14.55s/it]
 75%|███████▍  | 28339/37963 [121:28:15<38:41:21, 14.47s/it]
 75%|███████▍  | 28340/37963 [121:28:29<38:26:04, 14.38s/it]
                                                            
{'loss': '0.1097', 'grad_norm': '2.011', 'learning_rate': '3.186e-06', 'epoch': '0.7465'}

 75%|███████▍  | 28340/37963 [121:28:29<38:26:04, 14.38s/it]
 75%|███████▍  | 28341/37963 [121:28:43<38:24:33, 14.37s/it]
 75%|███████▍  | 28342/37963 [121:29:04<43:49:49, 16.40s/it]
 75%|███████▍  | 28343/37963 [121:29:25<47:08:51, 17.64s/it]
 75%|███████▍  | 28344/37963 [121:29:39<43:59:19, 16.46s/it]
 75%|███████▍  | 28345/37963 [121:29:59<47:22:28, 17.73s/it]
 75%|███████▍  | 28346/37963 [121:30:20<49:41:39, 18.60s/it]
 75%|███████▍  | 28347/37963 [121:30:34<46:21:06, 17.35s/it]
 75%|███████▍  | 28348/37963 [121:30:49<44:10:30, 16.54s/it]
 75%|███████▍  | 28349/37963 [121:31:04<42:30:53, 15.92s/it]
 75%|███████▍  | 28350/37963 [121:31:18<41:16:52, 15.46s/it]
                                                            
{'loss': '0.1046', 'grad_norm': '2.124', 'learning_rate': '3.179e-06', 'epoch': '0.7468'}

 75%|███████▍  | 28350/37963 [121:31:18<41:16:52, 15.46s/it]
 75%|███████▍  | 28351/37963 [121:31:32<40:23:29, 15.13s/it]
 75%|███████▍  | 28352/37963 [121:31:47<39:45:24, 14.89s/it]
 75%|███████▍  | 28353/37963 [121:32:01<39:19:58, 14.73s/it]
 75%|███████▍  | 28354/37963 [121:32:15<39:03:16, 14.63s/it]
 75%|███████▍  | 28355/37963 [121:32:30<38:47:06, 14.53s/it]
 75%|███████▍  | 28356/37963 [121:32:44<38:41:38, 14.50s/it]
 75%|███████▍  | 28357/37963 [121:32:58<38:14:11, 14.33s/it]
 75%|███████▍  | 28358/37963 [121:33:19<43:33:42, 16.33s/it]
 75%|███████▍  | 28359/37963 [121:33:34<42:03:44, 15.77s/it]
 75%|███████▍  | 28360/37963 [121:33:48<41:00:14, 15.37s/it]
                                                            
{'loss': '0.0984', 'grad_norm': '1.979', 'learning_rate': '3.173e-06', 'epoch': '0.747'}

 75%|███████▍  | 28360/37963 [121:33:48<41:00:14, 15.37s/it]
 75%|███████▍  | 28361/37963 [121:34:02<39:56:12, 14.97s/it]
 75%|███████▍  | 28362/37963 [121:34:16<39:28:00, 14.80s/it]
 75%|███████▍  | 28363/37963 [121:34:30<38:37:12, 14.48s/it]
 75%|███████▍  | 28364/37963 [121:34:44<38:22:52, 14.39s/it]
 75%|███████▍  | 28365/37963 [121:34:59<38:23:41, 14.40s/it]
 75%|███████▍  | 28366/37963 [121:35:13<38:23:12, 14.40s/it]
 75%|███████▍  | 28367/37963 [121:35:28<38:21:30, 14.39s/it]
 75%|███████▍  | 28368/37963 [121:35:42<38:19:56, 14.38s/it]
 75%|███████▍  | 28369/37963 [121:35:56<37:47:10, 14.18s/it]
 75%|███████▍  | 28370/37963 [121:36:10<38:06:13, 14.30s/it]
                                                            
{'loss': '0.09925', 'grad_norm': '2.088', 'learning_rate': '3.167e-06', 'epoch': '0.7473'}

 75%|███████▍  | 28370/37963 [121:36:10<38:06:13, 14.30s/it]
 75%|███████▍  | 28371/37963 [121:36:25<38:22:57, 14.41s/it]
 75%|███████▍  | 28372/37963 [121:36:39<38:03:23, 14.28s/it]
 75%|███████▍  | 28373/37963 [121:36:53<37:49:51, 14.20s/it]
 75%|███████▍  | 28374/37963 [121:37:07<37:34:32, 14.11s/it]
 75%|███████▍  | 28375/37963 [121:37:21<37:47:51, 14.19s/it]
 75%|███████▍  | 28376/37963 [121:37:43<43:40:05, 16.40s/it]
 75%|███████▍  | 28377/37963 [121:38:04<47:16:00, 17.75s/it]
 75%|███████▍  | 28378/37963 [121:38:18<44:32:04, 16.73s/it]
 75%|███████▍  | 28379/37963 [121:38:39<47:54:34, 18.00s/it]
 75%|███████▍  | 28380/37963 [121:38:53<44:48:44, 16.83s/it]
                                                            
{'loss': '0.1046', 'grad_norm': '1.605', 'learning_rate': '3.161e-06', 'epoch': '0.7476'}

 75%|███████▍  | 28380/37963 [121:38:53<44:48:44, 16.83s/it]
 75%|███████▍  | 28381/37963 [121:39:07<42:53:35, 16.12s/it]
 75%|███████▍  | 28382/37963 [121:39:22<41:34:08, 15.62s/it]
 75%|███████▍  | 28383/37963 [121:39:36<40:35:37, 15.25s/it]
 75%|███████▍  | 28384/37963 [121:39:50<39:30:53, 14.85s/it]
 75%|███████▍  | 28385/37963 [121:40:05<39:09:50, 14.72s/it]
 75%|███████▍  | 28386/37963 [121:40:19<38:45:52, 14.57s/it]
 75%|███████▍  | 28387/37963 [121:40:33<38:37:00, 14.52s/it]
 75%|███████▍  | 28388/37963 [121:40:47<38:23:17, 14.43s/it]
 75%|███████▍  | 28389/37963 [121:41:02<38:21:49, 14.43s/it]
 75%|███████▍  | 28390/37963 [121:41:16<38:23:12, 14.44s/it]
                                                            
{'loss': '0.08303', 'grad_norm': '2.227', 'learning_rate': '3.154e-06', 'epoch': '0.7478'}

 75%|███████▍  | 28390/37963 [121:41:16<38:23:12, 14.44s/it]
 75%|███████▍  | 28391/37963 [121:41:31<38:23:51, 14.44s/it]
 75%|███████▍  | 28392/37963 [121:41:45<38:26:18, 14.46s/it]
 75%|███████▍  | 28393/37963 [121:42:19<54:03:55, 20.34s/it]
 75%|███████▍  | 28394/37963 [121:42:34<49:21:48, 18.57s/it]
 75%|███████▍  | 28395/37963 [121:42:48<46:03:55, 17.33s/it]
 75%|███████▍  | 28396/37963 [121:43:08<48:21:04, 18.19s/it]
 75%|███████▍  | 28397/37963 [121:43:23<45:25:12, 17.09s/it]
 75%|███████▍  | 28398/37963 [121:43:37<43:04:11, 16.21s/it]
 75%|███████▍  | 28399/37963 [121:43:52<41:39:01, 15.68s/it]
 75%|███████▍  | 28400/37963 [121:44:05<40:14:00, 15.15s/it]
                                                            
{'loss': '0.0998', 'grad_norm': '3.184', 'learning_rate': '3.148e-06', 'epoch': '0.7481'}

 75%|███████▍  | 28400/37963 [121:44:05<40:14:00, 15.15s/it]
 75%|███████▍  | 28401/37963 [121:44:19<39:10:32, 14.75s/it]
 75%|███████▍  | 28402/37963 [121:44:34<38:49:07, 14.62s/it]
 75%|███████▍  | 28403/37963 [121:44:48<38:35:26, 14.53s/it]
 75%|███████▍  | 28404/37963 [121:45:02<38:35:40, 14.54s/it]
 75%|███████▍  | 28405/37963 [121:45:17<38:30:49, 14.51s/it]
 75%|███████▍  | 28406/37963 [121:45:31<38:19:27, 14.44s/it]
 75%|███████▍  | 28407/37963 [121:45:45<38:09:50, 14.38s/it]
 75%|███████▍  | 28408/37963 [121:46:06<43:21:33, 16.34s/it]
 75%|███████▍  | 28409/37963 [121:46:21<41:54:13, 15.79s/it]
 75%|███████▍  | 28410/37963 [121:46:35<40:56:04, 15.43s/it]
                                                            
{'loss': '0.09587', 'grad_norm': '3', 'learning_rate': '3.142e-06', 'epoch': '0.7484'}

 75%|███████▍  | 28410/37963 [121:46:35<40:56:04, 15.43s/it]
 75%|███████▍  | 28411/37963 [121:46:50<39:57:19, 15.06s/it]
 75%|███████▍  | 28412/37963 [121:47:04<39:22:49, 14.84s/it]
 75%|███████▍  | 28413/37963 [121:47:18<38:59:43, 14.70s/it]
 75%|███████▍  | 28414/37963 [121:47:32<38:31:25, 14.52s/it]
 75%|███████▍  | 28415/37963 [121:47:47<38:25:18, 14.49s/it]
 75%|███████▍  | 28416/37963 [121:48:01<38:18:40, 14.45s/it]
 75%|███████▍  | 28417/37963 [121:48:16<38:20:40, 14.46s/it]
 75%|███████▍  | 28418/37963 [121:48:30<38:07:36, 14.38s/it]
 75%|███████▍  | 28419/37963 [121:48:44<38:17:39, 14.44s/it]
 75%|███████▍  | 28420/37963 [121:48:59<37:58:15, 14.32s/it]
                                                            
{'loss': '0.0965', 'grad_norm': '1.919', 'learning_rate': '3.136e-06', 'epoch': '0.7486'}

 75%|███████▍  | 28420/37963 [121:48:59<37:58:15, 14.32s/it]
 75%|███████▍  | 28421/37963 [121:49:12<37:34:48, 14.18s/it]
 75%|███████▍  | 28422/37963 [121:49:33<43:03:25, 16.25s/it]
 75%|███████▍  | 28423/37963 [121:49:48<41:37:58, 15.71s/it]
 75%|███████▍  | 28424/37963 [121:50:02<40:07:06, 15.14s/it]
 75%|███████▍  | 28425/37963 [121:50:16<39:29:30, 14.91s/it]
 75%|███████▍  | 28426/37963 [121:50:30<38:36:43, 14.58s/it]
 75%|███████▍  | 28427/37963 [121:50:51<43:40:36, 16.49s/it]
 75%|███████▍  | 28428/37963 [121:51:05<41:58:49, 15.85s/it]
 75%|███████▍  | 28429/37963 [121:51:26<46:11:31, 17.44s/it]
 75%|███████▍  | 28430/37963 [121:51:40<43:18:35, 16.36s/it]
                                                            
{'loss': '0.1129', 'grad_norm': '3.011', 'learning_rate': '3.13e-06', 'epoch': '0.7489'}

 75%|███████▍  | 28430/37963 [121:51:40<43:18:35, 16.36s/it]
 75%|███████▍  | 28431/37963 [121:51:54<41:22:06, 15.62s/it]
 75%|███████▍  | 28432/37963 [121:52:08<39:52:36, 15.06s/it]
 75%|███████▍  | 28433/37963 [121:52:22<39:08:32, 14.79s/it]
 75%|███████▍  | 28434/37963 [121:52:37<38:57:26, 14.72s/it]
 75%|███████▍  | 28435/37963 [121:52:51<38:43:05, 14.63s/it]
 75%|███████▍  | 28436/37963 [121:53:05<38:05:07, 14.39s/it]
 75%|███████▍  | 28437/37963 [121:53:19<38:07:47, 14.41s/it]
 75%|███████▍  | 28438/37963 [121:53:34<38:09:44, 14.42s/it]
 75%|███████▍  | 28439/37963 [121:53:48<38:06:21, 14.40s/it]
 75%|███████▍  | 28440/37963 [121:54:02<37:56:17, 14.34s/it]
                                                            
{'loss': '0.1028', 'grad_norm': '6.94', 'learning_rate': '3.123e-06', 'epoch': '0.7492'}

 75%|███████▍  | 28440/37963 [121:54:02<37:56:17, 14.34s/it]
 75%|███████▍  | 28441/37963 [121:54:23<43:12:23, 16.34s/it]
 75%|███████▍  | 28442/37963 [121:54:38<41:37:48, 15.74s/it]
 75%|███████▍  | 28443/37963 [121:54:59<45:48:35, 17.32s/it]
 75%|███████▍  | 28444/37963 [121:55:13<43:25:04, 16.42s/it]
 75%|███████▍  | 28445/37963 [121:55:34<46:54:12, 17.74s/it]
 75%|███████▍  | 28446/37963 [121:55:48<44:14:43, 16.74s/it]
 75%|███████▍  | 28447/37963 [121:56:03<42:25:41, 16.05s/it]
 75%|███████▍  | 28448/37963 [121:56:17<41:08:32, 15.57s/it]
 75%|███████▍  | 28449/37963 [121:56:31<39:50:47, 15.08s/it]
 75%|███████▍  | 28450/37963 [121:56:45<39:18:18, 14.87s/it]
                                                            
{'loss': '0.08872', 'grad_norm': '2.246', 'learning_rate': '3.117e-06', 'epoch': '0.7494'}

 75%|███████▍  | 28450/37963 [121:56:45<39:18:18, 14.87s/it]
 75%|███████▍  | 28451/37963 [121:57:00<38:52:20, 14.71s/it]
 75%|███████▍  | 28452/37963 [121:57:14<38:41:22, 14.64s/it]
 75%|███████▍  | 28453/37963 [121:57:29<38:30:28, 14.58s/it]
 75%|███████▍  | 28454/37963 [121:57:43<38:23:32, 14.53s/it]
 75%|███████▍  | 28455/37963 [121:57:57<38:19:13, 14.51s/it]
 75%|███████▍  | 28456/37963 [121:58:12<38:15:06, 14.48s/it]
 75%|███████▍  | 28457/37963 [121:58:33<43:17:47, 16.40s/it]
 75%|███████▍  | 28458/37963 [121:58:47<41:42:01, 15.79s/it]
 75%|███████▍  | 28459/37963 [121:59:02<40:39:02, 15.40s/it]
 75%|███████▍  | 28460/37963 [121:59:16<39:50:47, 15.10s/it]
                                                            
{'loss': '0.08177', 'grad_norm': '2.073', 'learning_rate': '3.111e-06', 'epoch': '0.7497'}

 75%|███████▍  | 28460/37963 [121:59:16<39:50:47, 15.10s/it]
 75%|███████▍  | 28461/37963 [121:59:30<39:18:57, 14.90s/it]
 75%|███████▍  | 28462/37963 [121:59:45<39:01:00, 14.78s/it]
 75%|███████▍  | 28463/37963 [121:59:59<38:39:29, 14.65s/it]
 75%|███████▍  | 28464/37963 [122:00:14<38:19:36, 14.53s/it]
 75%|███████▍  | 28465/37963 [122:00:28<38:15:01, 14.50s/it]
 75%|███████▍  | 28466/37963 [122:00:42<37:52:04, 14.35s/it]
 75%|███████▍  | 28467/37963 [122:00:56<37:50:19, 14.34s/it]
 75%|███████▍  | 28468/37963 [122:01:10<37:26:19, 14.19s/it]
 75%|███████▍  | 28469/37963 [122:01:24<37:22:26, 14.17s/it]
 75%|███████▍  | 28470/37963 [122:01:38<37:02:33, 14.05s/it]
                                                            
{'loss': '0.1021', 'grad_norm': '2.035', 'learning_rate': '3.105e-06', 'epoch': '0.7499'}

 75%|███████▍  | 28470/37963 [122:01:38<37:02:33, 14.05s/it]
 75%|███████▍  | 28471/37963 [122:01:52<36:54:40, 14.00s/it]
 75%|███████▍  | 28472/37963 [122:02:13<42:35:48, 16.16s/it]
 75%|███████▌  | 28473/37963 [122:02:28<41:13:26, 15.64s/it]
 75%|███████▌  | 28474/37963 [122:02:42<40:14:52, 15.27s/it]
 75%|███████▌  | 28475/37963 [122:03:03<44:27:15, 16.87s/it]
 75%|███████▌  | 28476/37963 [122:03:16<42:04:54, 15.97s/it]
 75%|███████▌  | 28477/37963 [122:03:37<45:23:18, 17.23s/it]
 75%|███████▌  | 28478/37963 [122:03:51<42:49:06, 16.25s/it]
 75%|███████▌  | 28479/37963 [122:04:05<41:09:45, 15.62s/it]
 75%|███████▌  | 28480/37963 [122:04:19<40:21:08, 15.32s/it]
                                                            
{'loss': '0.09554', 'grad_norm': '2.672', 'learning_rate': '3.099e-06', 'epoch': '0.7502'}

 75%|███████▌  | 28480/37963 [122:04:19<40:21:08, 15.32s/it]
 75%|███████▌  | 28481/37963 [122:04:33<39:14:29, 14.90s/it]
 75%|███████▌  | 28482/37963 [122:04:48<38:51:20, 14.75s/it]
 75%|███████▌  | 28483/37963 [122:05:02<38:32:09, 14.63s/it]
 75%|███████▌  | 28484/37963 [122:05:16<38:10:20, 14.50s/it]
 75%|███████▌  | 28485/37963 [122:05:31<38:02:39, 14.45s/it]
 75%|███████▌  | 28486/37963 [122:05:45<37:59:29, 14.43s/it]
 75%|███████▌  | 28487/37963 [122:05:59<37:59:30, 14.43s/it]
 75%|███████▌  | 28488/37963 [122:06:14<38:00:25, 14.44s/it]
 75%|███████▌  | 28489/37963 [122:06:28<37:57:36, 14.42s/it]
 75%|███████▌  | 28490/37963 [122:06:48<42:26:52, 16.13s/it]
                                                            
{'loss': '0.1084', 'grad_norm': '2.668', 'learning_rate': '3.092e-06', 'epoch': '0.7505'}

 75%|███████▌  | 28490/37963 [122:06:48<42:26:52, 16.13s/it]
 75%|███████▌  | 28491/37963 [122:07:10<46:34:35, 17.70s/it]
 75%|███████▌  | 28492/37963 [122:07:31<49:06:26, 18.67s/it]
 75%|███████▌  | 28493/37963 [122:07:45<45:59:02, 17.48s/it]
 75%|███████▌  | 28494/37963 [122:08:06<48:34:05, 18.47s/it]
 75%|███████▌  | 28495/37963 [122:08:21<45:26:45, 17.28s/it]
 75%|███████▌  | 28496/37963 [122:08:35<42:57:08, 16.33s/it]
 75%|███████▌  | 28497/37963 [122:08:49<41:26:17, 15.76s/it]
 75%|███████▌  | 28498/37963 [122:09:03<40:04:39, 15.24s/it]
 75%|███████▌  | 28499/37963 [122:09:17<39:14:17, 14.93s/it]
 75%|███████▌  | 28500/37963 [122:09:32<38:40:39, 14.71s/it]
                                                            
{'loss': '0.09263', 'grad_norm': '1.82', 'learning_rate': '3.086e-06', 'epoch': '0.7507'}

 75%|███████▌  | 28500/37963 [122:09:32<38:40:39, 14.71s/it]
 75%|███████▌  | 28501/37963 [122:09:46<38:30:52, 14.65s/it]
 75%|███████▌  | 28502/37963 [122:10:00<38:19:05, 14.58s/it]
 75%|███████▌  | 28503/37963 [122:10:15<38:05:16, 14.49s/it]
 75%|███████▌  | 28504/37963 [122:10:29<37:54:12, 14.43s/it]
 75%|███████▌  | 28505/37963 [122:10:44<37:56:21, 14.44s/it]
 75%|███████▌  | 28506/37963 [122:11:06<44:19:39, 16.87s/it]
 75%|███████▌  | 28507/37963 [122:11:20<42:20:59, 16.12s/it]
 75%|███████▌  | 28508/37963 [122:11:34<40:42:45, 15.50s/it]
 75%|███████▌  | 28509/37963 [122:11:49<39:51:57, 15.18s/it]
 75%|███████▌  | 28510/37963 [122:12:03<39:06:51, 14.90s/it]
                                                            
{'loss': '0.1073', 'grad_norm': '3.279', 'learning_rate': '3.08e-06', 'epoch': '0.751'}

 75%|███████▌  | 28510/37963 [122:12:03<39:06:51, 14.90s/it]
 75%|███████▌  | 28511/37963 [122:12:18<38:55:34, 14.83s/it]
 75%|███████▌  | 28512/37963 [122:12:32<38:39:55, 14.73s/it]
 75%|███████▌  | 28513/37963 [122:12:47<38:26:27, 14.64s/it]
 75%|███████▌  | 28514/37963 [122:13:01<38:15:16, 14.57s/it]
 75%|███████▌  | 28515/37963 [122:13:15<37:46:25, 14.39s/it]
 75%|███████▌  | 28516/37963 [122:13:29<37:36:52, 14.33s/it]
 75%|███████▌  | 28517/37963 [122:13:44<37:36:28, 14.33s/it]
 75%|███████▌  | 28518/37963 [122:13:58<37:47:38, 14.41s/it]
 75%|███████▌  | 28519/37963 [122:14:13<37:46:05, 14.40s/it]
 75%|███████▌  | 28520/37963 [122:14:27<37:42:14, 14.37s/it]
                                                            
{'loss': '0.08091', 'grad_norm': '3.155', 'learning_rate': '3.074e-06', 'epoch': '0.7513'}

 75%|███████▌  | 28520/37963 [122:14:27<37:42:14, 14.37s/it]
 75%|███████▌  | 28521/37963 [122:14:41<37:27:54, 14.28s/it]
 75%|███████▌  | 28522/37963 [122:15:02<42:55:31, 16.37s/it]
 75%|███████▌  | 28523/37963 [122:15:17<41:21:24, 15.77s/it]
 75%|███████▌  | 28524/37963 [122:15:38<45:22:04, 17.30s/it]
 75%|███████▌  | 28525/37963 [122:15:51<42:37:17, 16.26s/it]
 75%|███████▌  | 28526/37963 [122:16:12<46:17:02, 17.66s/it]
 75%|███████▌  | 28527/37963 [122:16:27<43:45:54, 16.70s/it]
 75%|███████▌  | 28528/37963 [122:16:41<41:55:04, 15.99s/it]
 75%|███████▌  | 28529/37963 [122:16:55<40:28:48, 15.45s/it]
 75%|███████▌  | 28530/37963 [122:17:09<39:16:43, 14.99s/it]
                                                            
{'loss': '0.1062', 'grad_norm': '3.486', 'learning_rate': '3.068e-06', 'epoch': '0.7515'}

 75%|███████▌  | 28530/37963 [122:17:09<39:16:43, 14.99s/it]
 75%|███████▌  | 28531/37963 [122:17:23<38:30:01, 14.69s/it]
 75%|███████▌  | 28532/37963 [122:17:37<37:54:49, 14.47s/it]
 75%|███████▌  | 28533/37963 [122:17:51<37:48:26, 14.43s/it]
 75%|███████▌  | 28534/37963 [122:18:06<37:39:52, 14.38s/it]
 75%|███████▌  | 28535/37963 [122:18:20<37:58:12, 14.50s/it]
 75%|███████▌  | 28536/37963 [122:18:35<37:50:25, 14.45s/it]
 75%|███████▌  | 28537/37963 [122:18:49<37:53:41, 14.47s/it]
 75%|███████▌  | 28538/37963 [122:19:10<42:52:47, 16.38s/it]
 75%|███████▌  | 28539/37963 [122:19:24<40:59:00, 15.66s/it]
 75%|███████▌  | 28540/37963 [122:19:45<45:15:32, 17.29s/it]
                                                            
{'loss': '0.09228', 'grad_norm': '2.949', 'learning_rate': '3.062e-06', 'epoch': '0.7518'}

 75%|███████▌  | 28540/37963 [122:19:45<45:15:32, 17.29s/it]
 75%|███████▌  | 28541/37963 [122:20:06<48:12:02, 18.42s/it]
 75%|███████▌  | 28542/37963 [122:20:21<45:03:10, 17.22s/it]
 75%|███████▌  | 28543/37963 [122:20:42<47:58:13, 18.33s/it]
 75%|███████▌  | 28544/37963 [122:20:56<44:32:22, 17.02s/it]
 75%|███████▌  | 28545/37963 [122:21:10<42:30:23, 16.25s/it]
 75%|███████▌  | 28546/37963 [122:21:24<40:36:21, 15.52s/it]
 75%|███████▌  | 28547/37963 [122:21:38<39:34:03, 15.13s/it]
 75%|███████▌  | 28548/37963 [122:21:53<39:01:00, 14.92s/it]
 75%|███████▌  | 28549/37963 [122:22:06<38:07:35, 14.58s/it]
 75%|███████▌  | 28550/37963 [122:22:21<37:57:02, 14.51s/it]
                                                            
{'loss': '0.09957', 'grad_norm': '1.704', 'learning_rate': '3.056e-06', 'epoch': '0.7521'}

 75%|███████▌  | 28550/37963 [122:22:21<37:57:02, 14.51s/it]
 75%|███████▌  | 28551/37963 [122:22:35<37:57:24, 14.52s/it]
 75%|███████▌  | 28552/37963 [122:22:50<37:50:45, 14.48s/it]
 75%|███████▌  | 28553/37963 [122:23:04<37:50:54, 14.48s/it]
 75%|███████▌  | 28554/37963 [122:23:25<43:03:08, 16.47s/it]
 75%|███████▌  | 28555/37963 [122:23:39<41:20:25, 15.82s/it]
 75%|███████▌  | 28556/37963 [122:23:53<39:39:34, 15.18s/it]
 75%|███████▌  | 28557/37963 [122:24:08<39:03:42, 14.95s/it]
 75%|███████▌  | 28558/37963 [122:24:22<38:34:53, 14.77s/it]
 75%|███████▌  | 28559/37963 [122:24:36<38:13:11, 14.63s/it]
 75%|███████▌  | 28560/37963 [122:24:51<38:04:06, 14.57s/it]
                                                            
{'loss': '0.09764', 'grad_norm': '4.263', 'learning_rate': '3.049e-06', 'epoch': '0.7523'}

 75%|███████▌  | 28560/37963 [122:24:51<38:04:06, 14.57s/it]
 75%|███████▌  | 28561/37963 [122:25:04<37:21:09, 14.30s/it]
 75%|███████▌  | 28562/37963 [122:25:19<37:22:43, 14.31s/it]
 75%|███████▌  | 28563/37963 [122:25:33<37:16:28, 14.28s/it]
 75%|███████▌  | 28564/37963 [122:25:47<37:23:20, 14.32s/it]
 75%|███████▌  | 28565/37963 [122:26:02<37:31:28, 14.37s/it]
 75%|███████▌  | 28566/37963 [122:26:16<37:28:29, 14.36s/it]
 75%|███████▌  | 28567/37963 [122:26:30<37:28:33, 14.36s/it]
 75%|███████▌  | 28568/37963 [122:26:45<37:30:39, 14.37s/it]
 75%|███████▌  | 28569/37963 [122:26:59<37:35:56, 14.41s/it]
 75%|███████▌  | 28570/37963 [122:27:14<37:32:57, 14.39s/it]
                                                            
{'loss': '0.09299', 'grad_norm': '3.021', 'learning_rate': '3.043e-06', 'epoch': '0.7526'}

 75%|███████▌  | 28570/37963 [122:27:14<37:32:57, 14.39s/it]
 75%|███████▌  | 28571/37963 [122:27:42<48:18:36, 18.52s/it]
 75%|███████▌  | 28572/37963 [122:27:56<45:05:53, 17.29s/it]
 75%|███████▌  | 28573/37963 [122:28:10<42:31:16, 16.30s/it]
 75%|███████▌  | 28574/37963 [122:28:31<45:52:35, 17.59s/it]
 75%|███████▌  | 28575/37963 [122:28:45<43:23:32, 16.64s/it]
 75%|███████▌  | 28576/37963 [122:29:00<41:40:50, 15.98s/it]
 75%|███████▌  | 28577/37963 [122:29:14<40:21:16, 15.48s/it]
 75%|███████▌  | 28578/37963 [122:29:28<39:29:19, 15.15s/it]
 75%|███████▌  | 28579/37963 [122:29:43<39:05:16, 15.00s/it]
 75%|███████▌  | 28580/37963 [122:29:57<38:35:13, 14.80s/it]
                                                            
{'loss': '0.09339', 'grad_norm': '2.984', 'learning_rate': '3.037e-06', 'epoch': '0.7528'}

 75%|███████▌  | 28580/37963 [122:29:57<38:35:13, 14.80s/it]
 75%|███████▌  | 28581/37963 [122:30:12<38:15:18, 14.68s/it]
 75%|███████▌  | 28582/37963 [122:30:26<37:44:57, 14.49s/it]
 75%|███████▌  | 28583/37963 [122:30:40<37:41:56, 14.47s/it]
 75%|███████▌  | 28584/37963 [122:30:55<37:42:41, 14.48s/it]
 75%|███████▌  | 28585/37963 [122:31:09<37:43:05, 14.48s/it]
 75%|███████▌  | 28586/37963 [122:31:24<37:34:25, 14.43s/it]
 75%|███████▌  | 28587/37963 [122:31:38<37:33:49, 14.42s/it]
 75%|███████▌  | 28588/37963 [122:31:59<42:39:03, 16.38s/it]
 75%|███████▌  | 28589/37963 [122:32:26<51:08:11, 19.64s/it]
 75%|███████▌  | 28590/37963 [122:32:40<46:54:28, 18.02s/it]
                                                            
{'loss': '0.09848', 'grad_norm': '3.155', 'learning_rate': '3.031e-06', 'epoch': '0.7531'}

 75%|███████▌  | 28590/37963 [122:32:40<46:54:28, 18.02s/it]
 75%|███████▌  | 28591/37963 [122:32:55<43:57:32, 16.89s/it]
 75%|███████▌  | 28592/37963 [122:33:15<46:55:13, 18.03s/it]
 75%|███████▌  | 28593/37963 [122:33:30<44:07:55, 16.96s/it]
 75%|███████▌  | 28594/37963 [122:33:44<41:43:35, 16.03s/it]
 75%|███████▌  | 28595/37963 [122:33:58<40:27:37, 15.55s/it]
 75%|███████▌  | 28596/37963 [122:34:12<39:29:47, 15.18s/it]
 75%|███████▌  | 28597/37963 [122:34:26<38:37:25, 14.85s/it]
 75%|███████▌  | 28598/37963 [122:34:40<37:38:17, 14.47s/it]
 75%|███████▌  | 28599/37963 [122:34:54<37:32:26, 14.43s/it]
 75%|███████▌  | 28600/37963 [122:35:09<37:19:34, 14.35s/it]
                                                            
{'loss': '0.1047', 'grad_norm': '3.145', 'learning_rate': '3.025e-06', 'epoch': '0.7534'}

 75%|███████▌  | 28600/37963 [122:35:09<37:19:34, 14.35s/it]
 75%|███████▌  | 28601/37963 [122:35:23<37:10:47, 14.30s/it]
 75%|███████▌  | 28602/37963 [122:35:37<37:00:12, 14.23s/it]
 75%|███████▌  | 28603/37963 [122:35:57<41:50:33, 16.09s/it]
 75%|███████▌  | 28604/37963 [122:36:12<40:38:24, 15.63s/it]
 75%|███████▌  | 28605/37963 [122:36:26<39:39:21, 15.26s/it]
 75%|███████▌  | 28606/37963 [122:36:41<38:59:36, 15.00s/it]
 75%|███████▌  | 28607/37963 [122:36:55<38:33:51, 14.84s/it]
 75%|███████▌  | 28608/37963 [122:37:10<38:14:34, 14.72s/it]
 75%|███████▌  | 28609/37963 [122:37:24<37:42:45, 14.51s/it]
 75%|███████▌  | 28610/37963 [122:37:37<37:09:57, 14.31s/it]
                                                            
{'loss': '0.07634', 'grad_norm': '1.582', 'learning_rate': '3.019e-06', 'epoch': '0.7536'}

 75%|███████▌  | 28610/37963 [122:37:37<37:09:57, 14.31s/it]
 75%|███████▌  | 28611/37963 [122:37:52<37:13:30, 14.33s/it]
 75%|███████▌  | 28612/37963 [122:38:06<37:16:18, 14.35s/it]
 75%|███████▌  | 28613/37963 [122:38:20<37:15:31, 14.35s/it]
 75%|███████▌  | 28614/37963 [122:38:35<37:17:30, 14.36s/it]
 75%|███████▌  | 28615/37963 [122:38:49<37:18:57, 14.37s/it]
 75%|███████▌  | 28616/37963 [122:39:04<37:21:43, 14.39s/it]
 75%|███████▌  | 28617/37963 [122:39:18<37:22:47, 14.40s/it]
 75%|███████▌  | 28618/37963 [122:39:33<37:22:07, 14.40s/it]
 75%|███████▌  | 28619/37963 [122:39:47<37:07:01, 14.30s/it]
 75%|███████▌  | 28620/37963 [122:40:14<47:28:43, 18.29s/it]
                                                            
{'loss': '0.09137', 'grad_norm': '2.141', 'learning_rate': '3.013e-06', 'epoch': '0.7539'}

 75%|███████▌  | 28620/37963 [122:40:14<47:28:43, 18.29s/it]
 75%|███████▌  | 28621/37963 [122:40:29<44:32:53, 17.17s/it]
 75%|███████▌  | 28622/37963 [122:40:43<42:21:05, 16.32s/it]
 75%|███████▌  | 28623/37963 [122:41:04<46:04:21, 17.76s/it]
 75%|███████▌  | 28624/37963 [122:41:18<43:17:20, 16.69s/it]
 75%|███████▌  | 28625/37963 [122:41:33<41:32:59, 16.02s/it]
 75%|███████▌  | 28626/37963 [122:41:47<40:18:06, 15.54s/it]
 75%|███████▌  | 28627/37963 [122:42:02<39:24:13, 15.19s/it]
 75%|███████▌  | 28628/37963 [122:42:16<38:46:58, 14.96s/it]
 75%|███████▌  | 28629/37963 [122:42:31<38:26:42, 14.83s/it]
 75%|███████▌  | 28630/37963 [122:42:45<38:07:24, 14.71s/it]
                                                            
{'loss': '0.08655', 'grad_norm': '2.991', 'learning_rate': '3.007e-06', 'epoch': '0.7542'}

 75%|███████▌  | 28630/37963 [122:42:45<38:07:24, 14.71s/it]
 75%|███████▌  | 28631/37963 [122:42:59<37:26:39, 14.44s/it]
 75%|███████▌  | 28632/37963 [122:43:13<37:25:02, 14.44s/it]
 75%|███████▌  | 28633/37963 [122:43:28<37:24:33, 14.43s/it]
 75%|███████▌  | 28634/37963 [122:43:42<37:22:38, 14.42s/it]
 75%|███████▌  | 28635/37963 [122:43:57<37:23:50, 14.43s/it]
 75%|███████▌  | 28636/37963 [122:44:11<37:13:38, 14.37s/it]
 75%|███████▌  | 28637/37963 [122:44:38<47:11:20, 18.22s/it]
 75%|███████▌  | 28638/37963 [122:44:59<49:44:19, 19.20s/it]
 75%|███████▌  | 28639/37963 [122:45:13<45:41:42, 17.64s/it]
 75%|███████▌  | 28640/37963 [122:45:28<43:13:12, 16.69s/it]
                                                            
{'loss': '0.09311', 'grad_norm': '2.743', 'learning_rate': '3e-06', 'epoch': '0.7544'}

 75%|███████▌  | 28640/37963 [122:45:28<43:13:12, 16.69s/it]
 75%|███████▌  | 28641/37963 [122:45:42<41:23:43, 15.99s/it]
 75%|███████▌  | 28642/37963 [122:45:57<40:07:11, 15.50s/it]
 75%|███████▌  | 28643/37963 [122:46:17<44:17:30, 17.11s/it]
 75%|███████▌  | 28644/37963 [122:46:32<41:53:51, 16.19s/it]
 75%|███████▌  | 28645/37963 [122:46:46<40:25:16, 15.62s/it]
 75%|███████▌  | 28646/37963 [122:47:00<39:24:42, 15.23s/it]
 75%|███████▌  | 28647/37963 [122:47:15<38:44:43, 14.97s/it]
 75%|███████▌  | 28648/37963 [122:47:29<38:07:54, 14.74s/it]
 75%|███████▌  | 28649/37963 [122:47:43<37:27:45, 14.48s/it]
 75%|███████▌  | 28650/37963 [122:47:57<37:21:30, 14.44s/it]
                                                            
{'loss': '0.1097', 'grad_norm': '2.928', 'learning_rate': '2.994e-06', 'epoch': '0.7547'}

 75%|███████▌  | 28650/37963 [122:47:57<37:21:30, 14.44s/it]
 75%|███████▌  | 28651/37963 [122:48:11<37:24:37, 14.46s/it]
 75%|███████▌  | 28652/37963 [122:48:33<42:36:12, 16.47s/it]
 75%|███████▌  | 28653/37963 [122:48:47<40:53:58, 15.82s/it]
 75%|███████▌  | 28654/37963 [122:49:01<39:53:23, 15.43s/it]
 75%|███████▌  | 28655/37963 [122:49:15<38:50:57, 15.03s/it]
 75%|███████▌  | 28656/37963 [122:49:30<38:05:27, 14.73s/it]
 75%|███████▌  | 28657/37963 [122:49:44<37:49:22, 14.63s/it]
 75%|███████▌  | 28658/37963 [122:49:58<37:41:16, 14.58s/it]
 75%|███████▌  | 28659/37963 [122:50:13<37:30:33, 14.51s/it]
 75%|███████▌  | 28660/37963 [122:50:27<37:24:59, 14.48s/it]
                                                            
{'loss': '0.09134', 'grad_norm': '2.348', 'learning_rate': '2.988e-06', 'epoch': '0.7549'}

 75%|███████▌  | 28660/37963 [122:50:27<37:24:59, 14.48s/it]
 75%|███████▌  | 28661/37963 [122:50:42<37:18:30, 14.44s/it]
 75%|███████▌  | 28662/37963 [122:50:56<37:07:01, 14.37s/it]
 76%|███████▌  | 28663/37963 [122:51:10<37:12:11, 14.40s/it]
 76%|███████▌  | 28664/37963 [122:51:24<36:56:10, 14.30s/it]
 76%|███████▌  | 28665/37963 [122:51:39<37:01:07, 14.33s/it]
 76%|███████▌  | 28666/37963 [122:51:53<37:06:39, 14.37s/it]
 76%|███████▌  | 28667/37963 [122:52:14<42:22:16, 16.41s/it]
 76%|███████▌  | 28668/37963 [122:52:35<45:40:38, 17.69s/it]
 76%|███████▌  | 28669/37963 [122:52:49<43:09:23, 16.72s/it]
 76%|███████▌  | 28670/37963 [122:53:04<41:10:58, 15.95s/it]
                                                            
{'loss': '0.08869', 'grad_norm': '2.551', 'learning_rate': '2.982e-06', 'epoch': '0.7552'}

 76%|███████▌  | 28670/37963 [122:53:04<41:10:58, 15.95s/it]
 76%|███████▌  | 28671/37963 [122:53:18<39:58:03, 15.48s/it]
 76%|███████▌  | 28672/37963 [122:53:38<43:39:15, 16.91s/it]
 76%|███████▌  | 28673/37963 [122:53:53<41:42:30, 16.16s/it]
 76%|███████▌  | 28674/37963 [122:54:06<39:43:35, 15.40s/it]
 76%|███████▌  | 28675/37963 [122:54:21<39:05:46, 15.15s/it]
 76%|███████▌  | 28676/37963 [122:54:35<38:30:01, 14.92s/it]
 76%|███████▌  | 28677/37963 [122:54:49<37:40:54, 14.61s/it]
 76%|███████▌  | 28678/37963 [122:55:03<37:31:03, 14.55s/it]
 76%|███████▌  | 28679/37963 [122:55:18<37:21:15, 14.48s/it]
 76%|███████▌  | 28680/37963 [122:55:32<37:16:07, 14.45s/it]
                                                            
{'loss': '0.09564', 'grad_norm': '2.841', 'learning_rate': '2.976e-06', 'epoch': '0.7555'}

 76%|███████▌  | 28680/37963 [122:55:32<37:16:07, 14.45s/it]
 76%|███████▌  | 28681/37963 [122:55:47<37:12:43, 14.43s/it]
 76%|███████▌  | 28682/37963 [122:56:01<37:15:43, 14.45s/it]
 76%|███████▌  | 28683/37963 [122:56:15<37:11:47, 14.43s/it]
 76%|███████▌  | 28684/37963 [122:56:30<37:10:31, 14.42s/it]
 76%|███████▌  | 28685/37963 [122:56:50<41:23:17, 16.06s/it]
 76%|███████▌  | 28686/37963 [122:57:17<49:59:07, 19.40s/it]
 76%|███████▌  | 28687/37963 [122:57:31<46:08:25, 17.91s/it]
 76%|███████▌  | 28688/37963 [122:57:46<43:18:00, 16.81s/it]
 76%|███████▌  | 28689/37963 [122:58:00<41:16:26, 16.02s/it]
 76%|███████▌  | 28690/37963 [122:58:14<40:05:17, 15.56s/it]
                                                            
{'loss': '0.08655', 'grad_norm': '2.207', 'learning_rate': '2.97e-06', 'epoch': '0.7557'}

 76%|███████▌  | 28690/37963 [122:58:14<40:05:17, 15.56s/it]
 76%|███████▌  | 28691/37963 [122:58:28<38:55:27, 15.11s/it]
 76%|███████▌  | 28692/37963 [122:58:49<43:29:02, 16.89s/it]
 76%|███████▌  | 28693/37963 [122:59:04<41:30:11, 16.12s/it]
 76%|███████▌  | 28694/37963 [122:59:18<40:13:55, 15.63s/it]
 76%|███████▌  | 28695/37963 [122:59:33<39:14:48, 15.24s/it]
 76%|███████▌  | 28696/37963 [122:59:47<38:40:53, 15.03s/it]
 76%|███████▌  | 28697/37963 [123:00:02<38:18:50, 14.89s/it]
 76%|███████▌  | 28698/37963 [123:00:16<37:56:30, 14.74s/it]
 76%|███████▌  | 28699/37963 [123:00:37<42:49:02, 16.64s/it]
 76%|███████▌  | 28700/37963 [123:00:52<41:06:33, 15.98s/it]
                                                            
{'loss': '0.09434', 'grad_norm': '2.447', 'learning_rate': '2.964e-06', 'epoch': '0.756'}

 76%|███████▌  | 28700/37963 [123:00:52<41:06:33, 15.98s/it]
 76%|███████▌  | 28701/37963 [123:01:06<39:49:46, 15.48s/it]
 76%|███████▌  | 28702/37963 [123:01:20<38:57:23, 15.14s/it]
 76%|███████▌  | 28703/37963 [123:01:35<38:21:36, 14.91s/it]
 76%|███████▌  | 28704/37963 [123:01:49<37:56:55, 14.75s/it]
 76%|███████▌  | 28705/37963 [123:02:03<37:40:47, 14.65s/it]
 76%|███████▌  | 28706/37963 [123:02:18<37:21:04, 14.53s/it]
 76%|███████▌  | 28707/37963 [123:02:32<37:14:53, 14.49s/it]
 76%|███████▌  | 28708/37963 [123:02:46<37:12:20, 14.47s/it]
 76%|███████▌  | 28709/37963 [123:03:01<37:12:14, 14.47s/it]
 76%|███████▌  | 28710/37963 [123:03:15<37:14:02, 14.49s/it]
                                                            
{'loss': '0.0928', 'grad_norm': '3.596', 'learning_rate': '2.958e-06', 'epoch': '0.7563'}

 76%|███████▌  | 28710/37963 [123:03:15<37:14:02, 14.49s/it]
 76%|███████▌  | 28711/37963 [123:03:29<36:51:05, 14.34s/it]
 76%|███████▌  | 28712/37963 [123:03:44<36:52:47, 14.35s/it]
 76%|███████▌  | 28713/37963 [123:03:58<36:42:07, 14.28s/it]
 76%|███████▌  | 28714/37963 [123:04:12<36:37:21, 14.25s/it]
 76%|███████▌  | 28715/37963 [123:04:26<36:42:49, 14.29s/it]
 76%|███████▌  | 28716/37963 [123:04:48<42:00:18, 16.35s/it]
 76%|███████▌  | 28717/37963 [123:05:02<40:37:51, 15.82s/it]
 76%|███████▌  | 28718/37963 [123:05:23<44:19:06, 17.26s/it]
 76%|███████▌  | 28719/37963 [123:05:37<41:49:01, 16.29s/it]
 76%|███████▌  | 28720/37963 [123:05:58<45:15:19, 17.63s/it]
                                                            
{'loss': '0.09703', 'grad_norm': '2.691', 'learning_rate': '2.952e-06', 'epoch': '0.7565'}

 76%|███████▌  | 28720/37963 [123:05:58<45:15:19, 17.63s/it]
 76%|███████▌  | 28721/37963 [123:06:12<42:45:27, 16.66s/it]
 76%|███████▌  | 28722/37963 [123:06:26<40:58:13, 15.96s/it]
 76%|███████▌  | 28723/37963 [123:06:40<39:22:57, 15.34s/it]
 76%|███████▌  | 28724/37963 [123:06:55<38:36:43, 15.05s/it]
 76%|███████▌  | 28725/37963 [123:07:09<37:52:14, 14.76s/it]
 76%|███████▌  | 28726/37963 [123:07:23<37:41:35, 14.69s/it]
 76%|███████▌  | 28727/37963 [123:07:38<37:26:04, 14.59s/it]
 76%|███████▌  | 28728/37963 [123:07:52<37:16:13, 14.53s/it]
 76%|███████▌  | 28729/37963 [123:08:06<36:53:46, 14.38s/it]
 76%|███████▌  | 28730/37963 [123:08:20<36:26:39, 14.21s/it]
                                                            
{'loss': '0.1011', 'grad_norm': '1.288', 'learning_rate': '2.946e-06', 'epoch': '0.7568'}

 76%|███████▌  | 28730/37963 [123:08:20<36:26:39, 14.21s/it]
 76%|███████▌  | 28731/37963 [123:08:34<36:37:20, 14.28s/it]
 76%|███████▌  | 28732/37963 [123:08:55<41:13:29, 16.08s/it]
 76%|███████▌  | 28733/37963 [123:09:09<39:54:08, 15.56s/it]
 76%|███████▌  | 28734/37963 [123:09:23<38:59:37, 15.21s/it]
 76%|███████▌  | 28735/37963 [123:09:44<43:22:30, 16.92s/it]
 76%|███████▌  | 28736/37963 [123:09:59<41:25:33, 16.16s/it]
 76%|███████▌  | 28737/37963 [123:10:19<44:58:41, 17.55s/it]
 76%|███████▌  | 28738/37963 [123:10:34<42:34:37, 16.62s/it]
 76%|███████▌  | 28739/37963 [123:10:48<40:54:47, 15.97s/it]
 76%|███████▌  | 28740/37963 [123:11:03<39:47:49, 15.53s/it]
                                                            
{'loss': '0.109', 'grad_norm': '2.566', 'learning_rate': '2.94e-06', 'epoch': '0.7571'}

 76%|███████▌  | 28740/37963 [123:11:03<39:47:49, 15.53s/it]
 76%|███████▌  | 28741/37963 [123:11:17<38:52:51, 15.18s/it]
 76%|███████▌  | 28742/37963 [123:11:38<43:06:55, 16.83s/it]
 76%|███████▌  | 28743/37963 [123:11:52<41:06:28, 16.05s/it]
 76%|███████▌  | 28744/37963 [123:12:06<39:45:13, 15.52s/it]
 76%|███████▌  | 28745/37963 [123:12:21<38:56:59, 15.21s/it]
 76%|███████▌  | 28746/37963 [123:12:35<38:11:59, 14.92s/it]
 76%|███████▌  | 28747/37963 [123:12:49<37:44:20, 14.74s/it]
 76%|███████▌  | 28748/37963 [123:13:04<37:20:21, 14.59s/it]
 76%|███████▌  | 28749/37963 [123:13:18<37:09:49, 14.52s/it]
 76%|███████▌  | 28750/37963 [123:13:39<42:25:07, 16.58s/it]
                                                            
{'loss': '0.09466', 'grad_norm': '2.626', 'learning_rate': '2.934e-06', 'epoch': '0.7573'}

 76%|███████▌  | 28750/37963 [123:13:39<42:25:07, 16.58s/it]
 76%|███████▌  | 28751/37963 [123:13:53<40:02:04, 15.65s/it]
 76%|███████▌  | 28752/37963 [123:14:07<38:36:32, 15.09s/it]
 76%|███████▌  | 28753/37963 [123:14:21<38:05:40, 14.89s/it]
 76%|███████▌  | 28754/37963 [123:14:35<37:43:00, 14.74s/it]
 76%|███████▌  | 28755/37963 [123:14:50<37:30:43, 14.67s/it]
 76%|███████▌  | 28756/37963 [123:15:04<37:01:14, 14.48s/it]
 76%|███████▌  | 28757/37963 [123:15:18<36:56:45, 14.45s/it]
 76%|███████▌  | 28758/37963 [123:15:33<36:52:42, 14.42s/it]
 76%|███████▌  | 28759/37963 [123:15:47<36:40:51, 14.35s/it]
 76%|███████▌  | 28760/37963 [123:16:01<36:40:46, 14.35s/it]
                                                            
{'loss': '0.09703', 'grad_norm': '2.45', 'learning_rate': '2.928e-06', 'epoch': '0.7576'}

 76%|███████▌  | 28760/37963 [123:16:01<36:40:46, 14.35s/it]
 76%|███████▌  | 28761/37963 [123:16:15<36:16:27, 14.19s/it]
 76%|███████▌  | 28762/37963 [123:16:29<36:15:27, 14.19s/it]
 76%|███████▌  | 28763/37963 [123:16:44<36:24:02, 14.24s/it]
 76%|███████▌  | 28764/37963 [123:16:57<36:06:00, 14.13s/it]
 76%|███████▌  | 28765/37963 [123:17:18<41:13:02, 16.13s/it]
 76%|███████▌  | 28766/37963 [123:17:39<44:52:26, 17.57s/it]
 76%|███████▌  | 28767/37963 [123:17:54<42:37:50, 16.69s/it]
 76%|███████▌  | 28768/37963 [123:18:08<40:49:56, 15.99s/it]
 76%|███████▌  | 28769/37963 [123:18:29<44:52:32, 17.57s/it]
 76%|███████▌  | 28770/37963 [123:18:44<42:24:46, 16.61s/it]
                                                            
{'loss': '0.09597', 'grad_norm': '2.397', 'learning_rate': '2.922e-06', 'epoch': '0.7578'}

 76%|███████▌  | 28770/37963 [123:18:44<42:24:46, 16.61s/it]
 76%|███████▌  | 28771/37963 [123:18:58<40:43:44, 15.95s/it]
 76%|███████▌  | 28772/37963 [123:19:12<39:09:23, 15.34s/it]
 76%|███████▌  | 28773/37963 [123:19:27<38:32:25, 15.10s/it]
 76%|███████▌  | 28774/37963 [123:19:41<37:59:10, 14.88s/it]
 76%|███████▌  | 28775/37963 [123:19:55<37:36:18, 14.73s/it]
 76%|███████▌  | 28776/37963 [123:20:09<37:02:48, 14.52s/it]
 76%|███████▌  | 28777/37963 [123:20:24<36:55:57, 14.47s/it]
 76%|███████▌  | 28778/37963 [123:20:38<36:52:54, 14.46s/it]
 76%|███████▌  | 28779/37963 [123:20:53<36:48:42, 14.43s/it]
 76%|███████▌  | 28780/37963 [123:21:14<41:57:27, 16.45s/it]
                                                            
{'loss': '0.09282', 'grad_norm': '3.509', 'learning_rate': '2.916e-06', 'epoch': '0.7581'}

 76%|███████▌  | 28780/37963 [123:21:14<41:57:27, 16.45s/it]
 76%|███████▌  | 28781/37963 [123:21:28<40:24:24, 15.84s/it]
 76%|███████▌  | 28782/37963 [123:21:43<39:19:51, 15.42s/it]
 76%|███████▌  | 28783/37963 [123:22:03<43:13:08, 16.95s/it]
 76%|███████▌  | 28784/37963 [123:22:18<41:14:25, 16.17s/it]
 76%|███████▌  | 28785/37963 [123:22:31<39:25:10, 15.46s/it]
 76%|███████▌  | 28786/37963 [123:22:46<38:33:38, 15.13s/it]
 76%|███████▌  | 28787/37963 [123:23:07<43:19:14, 17.00s/it]
 76%|███████▌  | 28788/37963 [123:23:21<40:53:08, 16.04s/it]
 76%|███████▌  | 28789/37963 [123:23:35<39:13:02, 15.39s/it]
 76%|███████▌  | 28790/37963 [123:23:56<43:22:03, 17.02s/it]
                                                            
{'loss': '0.09388', 'grad_norm': '1.898', 'learning_rate': '2.91e-06', 'epoch': '0.7584'}

 76%|███████▌  | 28790/37963 [123:23:56<43:22:03, 17.02s/it]
 76%|███████▌  | 28791/37963 [123:24:10<41:25:09, 16.26s/it]
 76%|███████▌  | 28792/37963 [123:24:24<39:56:35, 15.68s/it]
 76%|███████▌  | 28793/37963 [123:24:39<39:00:28, 15.31s/it]
 76%|███████▌  | 28794/37963 [123:24:53<38:20:34, 15.05s/it]
 76%|███████▌  | 28795/37963 [123:25:08<37:46:28, 14.83s/it]
 76%|███████▌  | 28796/37963 [123:25:22<37:24:33, 14.69s/it]
 76%|███████▌  | 28797/37963 [123:25:36<36:50:01, 14.47s/it]
 76%|███████▌  | 28798/37963 [123:25:57<41:58:19, 16.49s/it]
 76%|███████▌  | 28799/37963 [123:26:12<40:27:14, 15.89s/it]
 76%|███████▌  | 28800/37963 [123:26:26<39:15:33, 15.42s/it]
                                                            
{'loss': '0.08442', 'grad_norm': '2.712', 'learning_rate': '2.904e-06', 'epoch': '0.7586'}

 76%|███████▌  | 28800/37963 [123:26:26<39:15:33, 15.42s/it]
 76%|███████▌  | 28801/37963 [123:26:40<38:05:53, 14.97s/it]
 76%|███████▌  | 28802/37963 [123:26:54<37:30:05, 14.74s/it]
 76%|███████▌  | 28803/37963 [123:27:08<36:55:10, 14.51s/it]
 76%|███████▌  | 28804/37963 [123:27:22<36:53:16, 14.50s/it]
 76%|███████▌  | 28805/37963 [123:27:37<36:47:18, 14.46s/it]
 76%|███████▌  | 28806/37963 [123:27:51<36:48:09, 14.47s/it]
 76%|███████▌  | 28807/37963 [123:28:05<36:19:39, 14.28s/it]
 76%|███████▌  | 28808/37963 [123:28:19<36:16:19, 14.26s/it]
 76%|███████▌  | 28809/37963 [123:28:34<36:23:44, 14.31s/it]
 76%|███████▌  | 28810/37963 [123:28:48<36:30:26, 14.36s/it]
                                                            
{'loss': '0.09119', 'grad_norm': '2.133', 'learning_rate': '2.898e-06', 'epoch': '0.7589'}

 76%|███████▌  | 28810/37963 [123:28:48<36:30:26, 14.36s/it]
 76%|███████▌  | 28811/37963 [123:29:03<36:25:08, 14.33s/it]
 76%|███████▌  | 28812/37963 [123:29:17<36:25:36, 14.33s/it]
 76%|███████▌  | 28813/37963 [123:29:31<36:08:03, 14.22s/it]
 76%|███████▌  | 28814/37963 [123:29:52<41:09:30, 16.20s/it]
 76%|███████▌  | 28815/37963 [123:30:12<44:39:04, 17.57s/it]
 76%|███████▌  | 28816/37963 [123:30:27<42:16:59, 16.64s/it]
 76%|███████▌  | 28817/37963 [123:30:41<40:26:34, 15.92s/it]
 76%|███████▌  | 28818/37963 [123:31:02<44:20:58, 17.46s/it]
 76%|███████▌  | 28819/37963 [123:31:17<41:59:50, 16.53s/it]
 76%|███████▌  | 28820/37963 [123:31:30<39:56:20, 15.73s/it]
                                                            
{'loss': '0.094', 'grad_norm': '2.263', 'learning_rate': '2.892e-06', 'epoch': '0.7592'}

 76%|███████▌  | 28820/37963 [123:31:30<39:56:20, 15.73s/it]
 76%|███████▌  | 28821/37963 [123:31:45<38:54:16, 15.32s/it]
 76%|███████▌  | 28822/37963 [123:31:59<38:14:04, 15.06s/it]
 76%|███████▌  | 28823/37963 [123:32:14<37:40:59, 14.84s/it]
 76%|███████▌  | 28824/37963 [123:32:28<37:23:18, 14.73s/it]
 76%|███████▌  | 28825/37963 [123:32:42<37:09:36, 14.64s/it]
 76%|███████▌  | 28826/37963 [123:32:57<37:05:16, 14.61s/it]
 76%|███████▌  | 28827/37963 [123:33:11<36:48:00, 14.50s/it]
 76%|███████▌  | 28828/37963 [123:33:26<36:43:43, 14.47s/it]
 76%|███████▌  | 28829/37963 [123:33:40<36:38:13, 14.44s/it]
 76%|███████▌  | 28830/37963 [123:34:01<41:36:00, 16.40s/it]
                                                            
{'loss': '0.1075', 'grad_norm': '1.765', 'learning_rate': '2.886e-06', 'epoch': '0.7594'}

 76%|███████▌  | 28830/37963 [123:34:01<41:36:00, 16.40s/it]
 76%|███████▌  | 28831/37963 [123:34:15<40:05:05, 15.80s/it]
 76%|███████▌  | 28832/37963 [123:34:36<43:51:27, 17.29s/it]
 76%|███████▌  | 28833/37963 [123:34:51<41:39:40, 16.43s/it]
 76%|███████▌  | 28834/37963 [123:35:05<39:58:29, 15.76s/it]
 76%|███████▌  | 28835/37963 [123:35:19<38:47:43, 15.30s/it]
 76%|███████▌  | 28836/37963 [123:35:40<43:12:05, 17.04s/it]
 76%|███████▌  | 28837/37963 [123:35:54<40:46:12, 16.08s/it]
 76%|███████▌  | 28838/37963 [123:36:08<39:31:17, 15.59s/it]
 76%|███████▌  | 28839/37963 [123:36:29<43:25:18, 17.13s/it]
 76%|███████▌  | 28840/37963 [123:36:43<41:03:20, 16.20s/it]
                                                            
{'loss': '0.1043', 'grad_norm': '2.835', 'learning_rate': '2.88e-06', 'epoch': '0.7597'}

 76%|███████▌  | 28840/37963 [123:36:43<41:03:20, 16.20s/it]
 76%|███████▌  | 28841/37963 [123:36:58<39:40:57, 15.66s/it]
 76%|███████▌  | 28842/37963 [123:37:12<38:42:12, 15.28s/it]
 76%|███████▌  | 28843/37963 [123:37:26<38:02:24, 15.02s/it]
 76%|███████▌  | 28844/37963 [123:37:41<37:35:02, 14.84s/it]
 76%|███████▌  | 28845/37963 [123:37:55<36:59:03, 14.60s/it]
 76%|███████▌  | 28846/37963 [123:38:09<36:48:53, 14.54s/it]
 76%|███████▌  | 28847/37963 [123:38:24<36:44:39, 14.51s/it]
 76%|███████▌  | 28848/37963 [123:38:38<36:44:28, 14.51s/it]
 76%|███████▌  | 28849/37963 [123:38:59<41:51:13, 16.53s/it]
 76%|███████▌  | 28850/37963 [123:39:14<40:11:08, 15.87s/it]
                                                            
{'loss': '0.09069', 'grad_norm': '2.144', 'learning_rate': '2.874e-06', 'epoch': '0.76'}

 76%|███████▌  | 28850/37963 [123:39:14<40:11:08, 15.87s/it]
 76%|███████▌  | 28851/37963 [123:39:28<38:46:11, 15.32s/it]
 76%|███████▌  | 28852/37963 [123:39:42<38:06:12, 15.06s/it]
 76%|███████▌  | 28853/37963 [123:39:56<37:29:40, 14.82s/it]
 76%|███████▌  | 28854/37963 [123:40:11<37:09:46, 14.69s/it]
 76%|███████▌  | 28855/37963 [123:40:25<36:54:12, 14.59s/it]
 76%|███████▌  | 28856/37963 [123:40:40<36:42:13, 14.51s/it]
 76%|███████▌  | 28857/37963 [123:40:54<36:36:00, 14.47s/it]
 76%|███████▌  | 28858/37963 [123:41:08<36:33:10, 14.45s/it]
 76%|███████▌  | 28859/37963 [123:41:22<36:12:40, 14.32s/it]
 76%|███████▌  | 28860/37963 [123:41:37<36:15:18, 14.34s/it]
                                                            
{'loss': '0.09295', 'grad_norm': '3.19', 'learning_rate': '2.868e-06', 'epoch': '0.7602'}

 76%|███████▌  | 28860/37963 [123:41:37<36:15:18, 14.34s/it]
 76%|███████▌  | 28861/37963 [123:41:50<35:46:27, 14.15s/it]
 76%|███████▌  | 28862/37963 [123:42:18<46:16:41, 18.31s/it]
 76%|███████▌  | 28863/37963 [123:42:32<42:51:53, 16.96s/it]
 76%|███████▌  | 28864/37963 [123:42:46<40:29:34, 16.02s/it]
 76%|███████▌  | 28865/37963 [123:43:00<39:15:06, 15.53s/it]
 76%|███████▌  | 28866/37963 [123:43:15<38:21:46, 15.18s/it]
 76%|███████▌  | 28867/37963 [123:43:36<42:53:45, 16.98s/it]
 76%|███████▌  | 28868/37963 [123:43:50<40:17:04, 15.95s/it]
 76%|███████▌  | 28869/37963 [123:44:03<38:44:11, 15.33s/it]
 76%|███████▌  | 28870/37963 [123:44:18<37:57:03, 15.03s/it]
                                                            
{'loss': '0.09901', 'grad_norm': '2.374', 'learning_rate': '2.862e-06', 'epoch': '0.7605'}

 76%|███████▌  | 28870/37963 [123:44:18<37:57:03, 15.03s/it]
 76%|███████▌  | 28871/37963 [123:44:32<37:26:10, 14.82s/it]
 76%|███████▌  | 28872/37963 [123:44:46<37:06:22, 14.69s/it]
 76%|███████▌  | 28873/37963 [123:45:00<36:25:48, 14.43s/it]
 76%|███████▌  | 28874/37963 [123:45:15<36:24:40, 14.42s/it]
 76%|███████▌  | 28875/37963 [123:45:29<36:27:22, 14.44s/it]
 76%|███████▌  | 28876/37963 [123:45:43<36:21:03, 14.40s/it]
 76%|███████▌  | 28877/37963 [123:45:58<36:27:47, 14.45s/it]
 76%|███████▌  | 28878/37963 [123:46:19<41:23:14, 16.40s/it]
 76%|███████▌  | 28879/37963 [123:46:33<39:53:47, 15.81s/it]
 76%|███████▌  | 28880/37963 [123:46:48<38:46:12, 15.37s/it]
                                                            
{'loss': '0.08794', 'grad_norm': '1.688', 'learning_rate': '2.856e-06', 'epoch': '0.7607'}

 76%|███████▌  | 28880/37963 [123:46:48<38:46:12, 15.37s/it]
 76%|███████▌  | 28881/37963 [123:47:02<38:00:54, 15.07s/it]
 76%|███████▌  | 28882/37963 [123:47:16<36:58:16, 14.66s/it]
 76%|███████▌  | 28883/37963 [123:47:36<41:29:11, 16.45s/it]
 76%|███████▌  | 28884/37963 [123:47:58<45:01:01, 17.85s/it]
 76%|███████▌  | 28885/37963 [123:48:12<42:26:01, 16.83s/it]
 76%|███████▌  | 28886/37963 [123:48:26<40:27:39, 16.05s/it]
 76%|███████▌  | 28887/37963 [123:48:47<43:48:44, 17.38s/it]
 76%|███████▌  | 28888/37963 [123:49:01<41:26:04, 16.44s/it]
 76%|███████▌  | 28889/37963 [123:49:15<39:50:37, 15.81s/it]
 76%|███████▌  | 28890/37963 [123:49:30<38:44:05, 15.37s/it]
                                                            
{'loss': '0.07671', 'grad_norm': '1.884', 'learning_rate': '2.85e-06', 'epoch': '0.761'}

 76%|███████▌  | 28890/37963 [123:49:30<38:44:05, 15.37s/it]
 76%|███████▌  | 28891/37963 [123:49:44<37:59:08, 15.07s/it]
 76%|███████▌  | 28892/37963 [123:49:58<37:18:25, 14.81s/it]
 76%|███████▌  | 28893/37963 [123:50:12<36:45:22, 14.59s/it]
 76%|███████▌  | 28894/37963 [123:50:26<36:08:19, 14.35s/it]
 76%|███████▌  | 28895/37963 [123:50:40<36:08:22, 14.35s/it]
 76%|███████▌  | 28896/37963 [123:50:55<36:09:16, 14.35s/it]
 76%|███████▌  | 28897/37963 [123:51:09<36:01:31, 14.31s/it]
 76%|███████▌  | 28898/37963 [123:51:30<41:23:11, 16.44s/it]
 76%|███████▌  | 28899/37963 [123:51:45<39:51:29, 15.83s/it]
 76%|███████▌  | 28900/37963 [123:51:59<38:45:48, 15.40s/it]
                                                            
{'loss': '0.08875', 'grad_norm': '2.214', 'learning_rate': '2.844e-06', 'epoch': '0.7613'}

 76%|███████▌  | 28900/37963 [123:51:59<38:45:48, 15.40s/it]
 76%|███████▌  | 28901/37963 [123:52:14<38:00:53, 15.10s/it]
 76%|███████▌  | 28902/37963 [123:52:28<37:27:27, 14.88s/it]
 76%|███████▌  | 28903/37963 [123:52:43<37:10:04, 14.77s/it]
 76%|███████▌  | 28904/37963 [123:52:56<36:34:12, 14.53s/it]
 76%|███████▌  | 28905/37963 [123:53:11<36:27:10, 14.49s/it]
 76%|███████▌  | 28906/37963 [123:53:25<36:31:42, 14.52s/it]
 76%|███████▌  | 28907/37963 [123:53:40<36:29:03, 14.50s/it]
 76%|███████▌  | 28908/37963 [123:53:54<36:05:18, 14.35s/it]
 76%|███████▌  | 28909/37963 [123:54:08<36:08:48, 14.37s/it]
 76%|███████▌  | 28910/37963 [123:54:22<35:57:00, 14.30s/it]
                                                            
{'loss': '0.08589', 'grad_norm': '2.866', 'learning_rate': '2.838e-06', 'epoch': '0.7615'}

 76%|███████▌  | 28910/37963 [123:54:22<35:57:00, 14.30s/it]
 76%|███████▌  | 28911/37963 [123:54:44<41:14:37, 16.40s/it]
 76%|███████▌  | 28912/37963 [123:55:03<43:42:47, 17.39s/it]
 76%|███████▌  | 28913/37963 [123:55:18<41:25:21, 16.48s/it]
 76%|███████▌  | 28914/37963 [123:55:32<39:20:25, 15.65s/it]
 76%|███████▌  | 28915/37963 [123:55:52<42:39:57, 16.98s/it]
 76%|███████▌  | 28916/37963 [123:56:06<40:43:12, 16.20s/it]
 76%|███████▌  | 28917/37963 [123:56:20<39:23:01, 15.67s/it]
 76%|███████▌  | 28918/37963 [123:56:35<38:33:54, 15.35s/it]
 76%|███████▌  | 28919/37963 [123:56:49<37:48:59, 15.05s/it]
 76%|███████▌  | 28920/37963 [123:57:03<37:03:13, 14.75s/it]
                                                            
{'loss': '0.08863', 'grad_norm': '3.236', 'learning_rate': '2.832e-06', 'epoch': '0.7618'}

 76%|███████▌  | 28920/37963 [123:57:03<37:03:13, 14.75s/it]
 76%|███████▌  | 28921/37963 [123:57:18<36:38:31, 14.59s/it]
 76%|███████▌  | 28922/37963 [123:57:32<36:13:08, 14.42s/it]
 76%|███████▌  | 28923/37963 [123:57:46<36:09:40, 14.40s/it]
 76%|███████▌  | 28924/37963 [123:58:00<35:48:10, 14.26s/it]
 76%|███████▌  | 28925/37963 [123:58:14<35:53:30, 14.30s/it]
 76%|███████▌  | 28926/37963 [123:58:29<36:00:03, 14.34s/it]
 76%|███████▌  | 28927/37963 [123:58:49<40:09:32, 16.00s/it]
 76%|███████▌  | 28928/37963 [123:59:02<38:22:55, 15.29s/it]
 76%|███████▌  | 28929/37963 [123:59:17<37:43:17, 15.03s/it]
 76%|███████▌  | 28930/37963 [123:59:31<37:14:43, 14.84s/it]
                                                            
{'loss': '0.09602', 'grad_norm': '2.349', 'learning_rate': '2.826e-06', 'epoch': '0.7621'}

 76%|███████▌  | 28930/37963 [123:59:31<37:14:43, 14.84s/it]
 76%|███████▌  | 28931/37963 [123:59:45<36:37:39, 14.60s/it]
 76%|███████▌  | 28932/37963 [124:00:06<41:14:38, 16.44s/it]
 76%|███████▌  | 28933/37963 [124:00:20<39:46:44, 15.86s/it]
 76%|███████▌  | 28934/37963 [124:00:42<43:53:44, 17.50s/it]
 76%|███████▌  | 28935/37963 [124:00:56<41:27:23, 16.53s/it]
 76%|███████▌  | 28936/37963 [124:01:17<44:40:49, 17.82s/it]
 76%|███████▌  | 28937/37963 [124:01:31<42:05:20, 16.79s/it]
 76%|███████▌  | 28938/37963 [124:01:46<40:15:43, 16.06s/it]
 76%|███████▌  | 28939/37963 [124:02:00<38:43:14, 15.45s/it]
 76%|███████▌  | 28940/37963 [124:02:14<37:54:31, 15.12s/it]
                                                            
{'loss': '0.09832', 'grad_norm': '2.196', 'learning_rate': '2.82e-06', 'epoch': '0.7623'}

 76%|███████▌  | 28940/37963 [124:02:14<37:54:31, 15.12s/it]
 76%|███████▌  | 28941/37963 [124:02:28<37:11:19, 14.84s/it]
 76%|███████▌  | 28942/37963 [124:02:42<36:40:37, 14.64s/it]
 76%|███████▌  | 28943/37963 [124:02:57<36:26:50, 14.55s/it]
 76%|███████▌  | 28944/37963 [124:03:11<36:17:04, 14.48s/it]
 76%|███████▌  | 28945/37963 [124:03:25<36:12:11, 14.45s/it]
 76%|███████▌  | 28946/37963 [124:03:40<36:11:07, 14.45s/it]
 76%|███████▋  | 28947/37963 [124:04:01<40:54:44, 16.34s/it]
 76%|███████▋  | 28948/37963 [124:04:15<39:33:50, 15.80s/it]
 76%|███████▋  | 28949/37963 [124:04:29<38:29:17, 15.37s/it]
 76%|███████▋  | 28950/37963 [124:04:44<37:36:42, 15.02s/it]
                                                            
{'loss': '0.09242', 'grad_norm': '4.624', 'learning_rate': '2.814e-06', 'epoch': '0.7626'}

 76%|███████▋  | 28950/37963 [124:04:44<37:36:42, 15.02s/it]
 76%|███████▋  | 28951/37963 [124:04:58<37:06:40, 14.82s/it]
 76%|███████▋  | 28952/37963 [124:05:12<36:44:33, 14.68s/it]
 76%|███████▋  | 28953/37963 [124:05:27<36:33:18, 14.61s/it]
 76%|███████▋  | 28954/37963 [124:05:41<36:27:10, 14.57s/it]
 76%|███████▋  | 28955/37963 [124:05:55<35:46:14, 14.30s/it]
 76%|███████▋  | 28956/37963 [124:06:09<35:50:34, 14.33s/it]
 76%|███████▋  | 28957/37963 [124:06:23<35:34:43, 14.22s/it]
 76%|███████▋  | 28958/37963 [124:06:37<35:18:20, 14.11s/it]
 76%|███████▋  | 28959/37963 [124:06:51<34:53:09, 13.95s/it]
 76%|███████▋  | 28960/37963 [124:07:11<39:21:19, 15.74s/it]
                                                            
{'loss': '0.09429', 'grad_norm': '3.095', 'learning_rate': '2.808e-06', 'epoch': '0.7629'}

 76%|███████▋  | 28960/37963 [124:07:11<39:21:19, 15.74s/it]
 76%|███████▋  | 28961/37963 [124:07:25<38:01:07, 15.20s/it]
 76%|███████▋  | 28962/37963 [124:07:46<42:21:51, 16.94s/it]
 76%|███████▋  | 28963/37963 [124:08:00<40:25:47, 16.17s/it]
 76%|███████▋  | 28964/37963 [124:08:22<44:34:42, 17.83s/it]
 76%|███████▋  | 28965/37963 [124:08:36<41:43:20, 16.69s/it]
 76%|███████▋  | 28966/37963 [124:08:50<39:57:55, 15.99s/it]
 76%|███████▋  | 28967/37963 [124:09:05<38:48:09, 15.53s/it]
 76%|███████▋  | 28968/37963 [124:09:18<37:28:31, 15.00s/it]
 76%|███████▋  | 28969/37963 [124:09:32<36:35:35, 14.65s/it]
 76%|███████▋  | 28970/37963 [124:09:47<36:28:07, 14.60s/it]
                                                            
{'loss': '0.08244', 'grad_norm': '1.715', 'learning_rate': '2.802e-06', 'epoch': '0.7631'}

 76%|███████▋  | 28970/37963 [124:09:47<36:28:07, 14.60s/it]
 76%|███████▋  | 28971/37963 [124:10:01<36:21:04, 14.55s/it]
 76%|███████▋  | 28972/37963 [124:10:15<36:13:01, 14.50s/it]
 76%|███████▋  | 28973/37963 [124:10:29<35:47:53, 14.34s/it]
 76%|███████▋  | 28974/37963 [124:10:44<35:45:21, 14.32s/it]
 76%|███████▋  | 28975/37963 [124:10:58<35:46:31, 14.33s/it]
 76%|███████▋  | 28976/37963 [124:11:12<35:46:36, 14.33s/it]
 76%|███████▋  | 28977/37963 [124:11:34<40:55:44, 16.40s/it]
 76%|███████▋  | 28978/37963 [124:11:54<44:07:23, 17.68s/it]
 76%|███████▋  | 28979/37963 [124:12:09<41:38:28, 16.69s/it]
 76%|███████▋  | 28980/37963 [124:12:23<39:54:26, 15.99s/it]
                                                            
{'loss': '0.1085', 'grad_norm': '3.37', 'learning_rate': '2.796e-06', 'epoch': '0.7634'}

 76%|███████▋  | 28980/37963 [124:12:23<39:54:26, 15.99s/it]
 76%|███████▋  | 28981/37963 [124:12:37<38:46:25, 15.54s/it]
 76%|███████▋  | 28982/37963 [124:12:52<37:56:16, 15.21s/it]
 76%|███████▋  | 28983/37963 [124:13:06<37:17:38, 14.95s/it]
 76%|███████▋  | 28984/37963 [124:13:28<42:03:31, 16.86s/it]
 76%|███████▋  | 28985/37963 [124:13:48<45:03:25, 18.07s/it]
 76%|███████▋  | 28986/37963 [124:14:03<42:05:40, 16.88s/it]
 76%|███████▋  | 28987/37963 [124:14:17<40:16:11, 16.15s/it]
 76%|███████▋  | 28988/37963 [124:14:31<38:59:00, 15.64s/it]
 76%|███████▋  | 28989/37963 [124:14:46<38:03:09, 15.27s/it]
 76%|███████▋  | 28990/37963 [124:15:00<37:22:58, 15.00s/it]
                                                            
{'loss': '0.08753', 'grad_norm': '1.892', 'learning_rate': '2.79e-06', 'epoch': '0.7636'}

 76%|███████▋  | 28990/37963 [124:15:00<37:22:58, 15.00s/it]
 76%|███████▋  | 28991/37963 [124:15:14<36:29:59, 14.65s/it]
 76%|███████▋  | 28992/37963 [124:15:28<36:16:08, 14.55s/it]
 76%|███████▋  | 28993/37963 [124:15:43<36:10:36, 14.52s/it]
 76%|███████▋  | 28994/37963 [124:15:57<36:07:16, 14.50s/it]
 76%|███████▋  | 28995/37963 [124:16:12<35:58:58, 14.44s/it]
 76%|███████▋  | 28996/37963 [124:16:33<41:13:35, 16.55s/it]
 76%|███████▋  | 28997/37963 [124:16:47<39:34:42, 15.89s/it]
 76%|███████▋  | 28998/37963 [124:17:02<38:26:07, 15.43s/it]
 76%|███████▋  | 28999/37963 [124:17:16<37:37:06, 15.11s/it]
 76%|███████▋  | 29000/37963 [124:17:31<37:07:11, 14.91s/it]
                                                            
{'loss': '0.08407', 'grad_norm': '4.606', 'learning_rate': '2.784e-06', 'epoch': '0.7639'}

 76%|███████▋  | 29000/37963 [124:17:31<37:07:11, 14.91s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.29s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.29s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 76%|███████▋  | 29001/37963 [124:19:16<105:05:01, 42.21s/it]
 76%|███████▋  | 29002/37963 [124:19:31<84:16:32, 33.86s/it] 
 76%|███████▋  | 29003/37963 [124:19:45<69:41:19, 28.00s/it]
 76%|███████▋  | 29004/37963 [124:20:00<59:37:31, 23.96s/it]
 76%|███████▋  | 29005/37963 [124:20:14<52:25:54, 21.07s/it]
 76%|███████▋  | 29006/37963 [124:20:35<52:18:27, 21.02s/it]
 76%|███████▋  | 29007/37963 [124:20:49<47:22:51, 19.05s/it]
 76%|███████▋  | 29008/37963 [124:21:03<43:40:13, 17.56s/it]
 76%|███████▋  | 29009/37963 [124:21:18<41:15:43, 16.59s/it]
 76%|███████▋  | 29010/37963 [124:21:39<44:39:12, 17.96s/it]
                                                            
{'loss': '0.09659', 'grad_norm': '2.191', 'learning_rate': '2.779e-06', 'epoch': '0.7642'}

 76%|███████▋  | 29010/37963 [124:21:39<44:39:12, 17.96s/it]
 76%|███████▋  | 29011/37963 [124:21:53<41:58:59, 16.88s/it]
 76%|███████▋  | 29012/37963 [124:22:15<45:14:56, 18.20s/it]
 76%|███████▋  | 29013/37963 [124:22:29<42:17:14, 17.01s/it]
 76%|███████▋  | 29014/37963 [124:22:43<40:11:42, 16.17s/it]
 76%|███████▋  | 29015/37963 [124:22:57<38:50:10, 15.62s/it]
 76%|███████▋  | 29016/37963 [124:23:12<37:48:58, 15.22s/it]
 76%|███████▋  | 29017/37963 [124:23:26<37:12:38, 14.97s/it]
 76%|███████▋  | 29018/37963 [124:23:40<36:45:34, 14.79s/it]
 76%|███████▋  | 29019/37963 [124:23:55<36:18:37, 14.62s/it]
 76%|███████▋  | 29020/37963 [124:24:09<36:05:51, 14.53s/it]
                                                            
{'loss': '0.09954', 'grad_norm': '2.528', 'learning_rate': '2.773e-06', 'epoch': '0.7644'}

 76%|███████▋  | 29020/37963 [124:24:09<36:05:51, 14.53s/it]
 76%|███████▋  | 29021/37963 [124:24:23<36:04:31, 14.52s/it]
 76%|███████▋  | 29022/37963 [124:24:38<35:56:08, 14.47s/it]
 76%|███████▋  | 29023/37963 [124:24:52<35:35:32, 14.33s/it]
 76%|███████▋  | 29024/37963 [124:25:06<35:38:44, 14.36s/it]
 76%|███████▋  | 29025/37963 [124:25:27<40:25:35, 16.28s/it]
 76%|███████▋  | 29026/37963 [124:25:48<43:42:35, 17.61s/it]
 76%|███████▋  | 29027/37963 [124:26:02<41:08:49, 16.58s/it]
 76%|███████▋  | 29028/37963 [124:26:16<39:13:15, 15.80s/it]
 76%|███████▋  | 29029/37963 [124:26:30<38:09:19, 15.37s/it]
 76%|███████▋  | 29030/37963 [124:26:45<37:27:32, 15.10s/it]
                                                            
{'loss': '0.09423', 'grad_norm': '2.218', 'learning_rate': '2.767e-06', 'epoch': '0.7647'}

 76%|███████▋  | 29030/37963 [124:26:45<37:27:32, 15.10s/it]
 76%|███████▋  | 29031/37963 [124:27:05<41:40:42, 16.80s/it]
 76%|███████▋  | 29032/37963 [124:27:26<44:12:50, 17.82s/it]
 76%|███████▋  | 29033/37963 [124:27:40<41:38:57, 16.79s/it]
 76%|███████▋  | 29034/37963 [124:27:55<39:54:30, 16.09s/it]
 76%|███████▋  | 29035/37963 [124:28:09<38:36:13, 15.57s/it]
 76%|███████▋  | 29036/37963 [124:28:23<37:40:02, 15.19s/it]
 76%|███████▋  | 29037/37963 [124:28:37<36:53:23, 14.88s/it]
 76%|███████▋  | 29038/37963 [124:28:52<36:30:19, 14.72s/it]
 76%|███████▋  | 29039/37963 [124:29:06<36:18:42, 14.65s/it]
 76%|███████▋  | 29040/37963 [124:29:21<36:09:01, 14.59s/it]
                                                            
{'loss': '0.09209', 'grad_norm': '2.63', 'learning_rate': '2.761e-06', 'epoch': '0.765'}

 76%|███████▋  | 29040/37963 [124:29:21<36:09:01, 14.59s/it]
 76%|███████▋  | 29041/37963 [124:29:35<36:03:08, 14.55s/it]
 77%|███████▋  | 29042/37963 [124:29:49<35:53:59, 14.49s/it]
 77%|███████▋  | 29043/37963 [124:30:03<35:19:04, 14.25s/it]
 77%|███████▋  | 29044/37963 [124:30:17<35:02:21, 14.14s/it]
 77%|███████▋  | 29045/37963 [124:30:31<35:11:59, 14.21s/it]
 77%|███████▋  | 29046/37963 [124:30:53<40:26:33, 16.33s/it]
 77%|███████▋  | 29047/37963 [124:31:07<38:44:47, 15.64s/it]
 77%|███████▋  | 29048/37963 [124:31:21<37:45:47, 15.25s/it]
 77%|███████▋  | 29049/37963 [124:31:35<36:58:01, 14.93s/it]
 77%|███████▋  | 29050/37963 [124:31:50<36:35:59, 14.78s/it]
                                                            
{'loss': '0.08461', 'grad_norm': '2.141', 'learning_rate': '2.755e-06', 'epoch': '0.7652'}

 77%|███████▋  | 29050/37963 [124:31:50<36:35:59, 14.78s/it]
 77%|███████▋  | 29051/37963 [124:32:04<36:22:16, 14.69s/it]
 77%|███████▋  | 29052/37963 [124:32:18<35:57:07, 14.52s/it]
 77%|███████▋  | 29053/37963 [124:32:32<35:33:47, 14.37s/it]
 77%|███████▋  | 29054/37963 [124:32:47<35:33:59, 14.37s/it]
 77%|███████▋  | 29055/37963 [124:33:08<40:29:26, 16.36s/it]
 77%|███████▋  | 29056/37963 [124:33:22<38:53:06, 15.72s/it]
 77%|███████▋  | 29057/37963 [124:33:36<37:52:10, 15.31s/it]
 77%|███████▋  | 29058/37963 [124:33:51<37:23:41, 15.12s/it]
 77%|███████▋  | 29059/37963 [124:34:05<36:52:50, 14.91s/it]
 77%|███████▋  | 29060/37963 [124:34:33<46:34:29, 18.83s/it]
                                                            
{'loss': '0.09687', 'grad_norm': '2.926', 'learning_rate': '2.749e-06', 'epoch': '0.7655'}

 77%|███████▋  | 29060/37963 [124:34:33<46:34:29, 18.83s/it]
 77%|███████▋  | 29061/37963 [124:34:48<43:20:33, 17.53s/it]
 77%|███████▋  | 29062/37963 [124:35:02<41:00:08, 16.58s/it]
 77%|███████▋  | 29063/37963 [124:35:17<39:20:33, 15.91s/it]
 77%|███████▋  | 29064/37963 [124:35:31<38:09:53, 15.44s/it]
 77%|███████▋  | 29065/37963 [124:35:45<36:55:38, 14.94s/it]
 77%|███████▋  | 29066/37963 [124:35:59<36:16:05, 14.68s/it]
 77%|███████▋  | 29067/37963 [124:36:13<36:07:46, 14.62s/it]
 77%|███████▋  | 29068/37963 [124:36:28<35:59:32, 14.57s/it]
 77%|███████▋  | 29069/37963 [124:36:42<35:44:53, 14.47s/it]
 77%|███████▋  | 29070/37963 [124:36:56<35:39:53, 14.44s/it]
                                                            
{'loss': '0.08892', 'grad_norm': '1.934', 'learning_rate': '2.743e-06', 'epoch': '0.7657'}

 77%|███████▋  | 29070/37963 [124:36:56<35:39:53, 14.44s/it]
 77%|███████▋  | 29071/37963 [124:37:11<35:38:58, 14.43s/it]
 77%|███████▋  | 29072/37963 [124:37:25<35:36:47, 14.42s/it]
 77%|███████▋  | 29073/37963 [124:37:46<40:33:47, 16.43s/it]
 77%|███████▋  | 29074/37963 [124:38:06<43:16:31, 17.53s/it]
 77%|███████▋  | 29075/37963 [124:38:20<40:36:13, 16.45s/it]
 77%|███████▋  | 29076/37963 [124:38:35<39:06:44, 15.84s/it]
 77%|███████▋  | 29077/37963 [124:38:49<38:02:48, 15.41s/it]
 77%|███████▋  | 29078/37963 [124:39:03<37:18:58, 15.12s/it]
 77%|███████▋  | 29079/37963 [124:39:18<36:43:46, 14.88s/it]
 77%|███████▋  | 29080/37963 [124:39:32<36:22:47, 14.74s/it]
                                                            
{'loss': '0.09712', 'grad_norm': '3.113', 'learning_rate': '2.737e-06', 'epoch': '0.766'}

 77%|███████▋  | 29080/37963 [124:39:32<36:22:47, 14.74s/it]
 77%|███████▋  | 29081/37963 [124:39:53<41:00:58, 16.62s/it]
 77%|███████▋  | 29082/37963 [124:40:14<44:21:11, 17.98s/it]
 77%|███████▋  | 29083/37963 [124:40:29<41:42:45, 16.91s/it]
 77%|███████▋  | 29084/37963 [124:40:43<39:46:46, 16.13s/it]
 77%|███████▋  | 29085/37963 [124:40:57<38:28:35, 15.60s/it]
 77%|███████▋  | 29086/37963 [124:41:12<37:26:51, 15.19s/it]
 77%|███████▋  | 29087/37963 [124:41:26<36:48:37, 14.93s/it]
 77%|███████▋  | 29088/37963 [124:41:40<36:24:13, 14.77s/it]
 77%|███████▋  | 29089/37963 [124:41:54<35:50:55, 14.54s/it]
 77%|███████▋  | 29090/37963 [124:42:09<35:41:01, 14.48s/it]
                                                            
{'loss': '0.09757', 'grad_norm': '2.532', 'learning_rate': '2.732e-06', 'epoch': '0.7663'}

 77%|███████▋  | 29090/37963 [124:42:09<35:41:01, 14.48s/it]
 77%|███████▋  | 29091/37963 [124:42:23<35:37:06, 14.45s/it]
 77%|███████▋  | 29092/37963 [124:42:37<34:58:12, 14.19s/it]
 77%|███████▋  | 29093/37963 [124:42:51<35:04:20, 14.23s/it]
 77%|███████▋  | 29094/37963 [124:43:11<39:32:50, 16.05s/it]
 77%|███████▋  | 29095/37963 [124:43:26<38:16:13, 15.54s/it]
 77%|███████▋  | 29096/37963 [124:43:40<37:18:17, 15.15s/it]
 77%|███████▋  | 29097/37963 [124:43:54<36:29:24, 14.82s/it]
 77%|███████▋  | 29098/37963 [124:44:08<36:10:02, 14.69s/it]
 77%|███████▋  | 29099/37963 [124:44:23<35:53:50, 14.58s/it]
 77%|███████▋  | 29100/37963 [124:44:37<35:30:23, 14.42s/it]
                                                            
{'loss': '0.09318', 'grad_norm': '1.552', 'learning_rate': '2.726e-06', 'epoch': '0.7665'}

 77%|███████▋  | 29100/37963 [124:44:37<35:30:23, 14.42s/it]
 77%|███████▋  | 29101/37963 [124:44:51<35:05:18, 14.25s/it]
 77%|███████▋  | 29102/37963 [124:45:05<34:58:46, 14.21s/it]
 77%|███████▋  | 29103/37963 [124:45:19<35:17:24, 14.34s/it]
 77%|███████▋  | 29104/37963 [124:45:40<39:52:30, 16.20s/it]
 77%|███████▋  | 29105/37963 [124:45:54<38:32:29, 15.66s/it]
 77%|███████▋  | 29106/37963 [124:46:09<37:28:40, 15.23s/it]
 77%|███████▋  | 29107/37963 [124:46:23<36:50:19, 14.98s/it]
 77%|███████▋  | 29108/37963 [124:46:44<41:24:45, 16.84s/it]
 77%|███████▋  | 29109/37963 [124:47:05<44:21:43, 18.04s/it]
 77%|███████▋  | 29110/37963 [124:47:19<41:38:21, 16.93s/it]
                                                            
{'loss': '0.1053', 'grad_norm': '3.49', 'learning_rate': '2.72e-06', 'epoch': '0.7668'}

 77%|███████▋  | 29110/37963 [124:47:19<41:38:21, 16.93s/it]
 77%|███████▋  | 29111/37963 [124:47:34<39:48:25, 16.19s/it]
 77%|███████▋  | 29112/37963 [124:47:48<38:29:49, 15.66s/it]
 77%|███████▋  | 29113/37963 [124:48:03<37:34:23, 15.28s/it]
 77%|███████▋  | 29114/37963 [124:48:17<36:59:34, 15.05s/it]
 77%|███████▋  | 29115/37963 [124:48:31<36:29:04, 14.84s/it]
 77%|███████▋  | 29116/37963 [124:48:46<36:06:31, 14.69s/it]
 77%|███████▋  | 29117/37963 [124:49:00<35:53:50, 14.61s/it]
 77%|███████▋  | 29118/37963 [124:49:15<35:43:45, 14.54s/it]
 77%|███████▋  | 29119/37963 [124:49:28<35:04:05, 14.27s/it]
 77%|███████▋  | 29120/37963 [124:49:42<34:47:21, 14.16s/it]
                                                            
{'loss': '0.08483', 'grad_norm': '1.935', 'learning_rate': '2.714e-06', 'epoch': '0.7671'}

 77%|███████▋  | 29120/37963 [124:49:42<34:47:21, 14.16s/it]
 77%|███████▋  | 29121/37963 [124:50:03<39:54:33, 16.25s/it]
 77%|███████▋  | 29122/37963 [124:50:18<38:28:55, 15.67s/it]
 77%|███████▋  | 29123/37963 [124:50:32<37:26:16, 15.25s/it]
 77%|███████▋  | 29124/37963 [124:50:46<36:50:21, 15.00s/it]
 77%|███████▋  | 29125/37963 [124:51:00<36:09:35, 14.73s/it]
 77%|███████▋  | 29126/37963 [124:51:21<40:36:39, 16.54s/it]
 77%|███████▋  | 29127/37963 [124:51:36<39:04:01, 15.92s/it]
 77%|███████▋  | 29128/37963 [124:51:50<37:55:14, 15.45s/it]
 77%|███████▋  | 29129/37963 [124:52:11<42:11:20, 17.19s/it]
 77%|███████▋  | 29130/37963 [124:52:32<44:38:49, 18.20s/it]
                                                            
{'loss': '0.08957', 'grad_norm': '2.699', 'learning_rate': '2.708e-06', 'epoch': '0.7673'}

 77%|███████▋  | 29130/37963 [124:52:32<44:38:49, 18.20s/it]
 77%|███████▋  | 29131/37963 [124:52:46<41:51:53, 17.06s/it]
 77%|███████▋  | 29132/37963 [124:53:00<39:52:08, 16.25s/it]
 77%|███████▋  | 29133/37963 [124:53:14<38:04:57, 15.53s/it]
 77%|███████▋  | 29134/37963 [124:53:29<37:12:03, 15.17s/it]
 77%|███████▋  | 29135/37963 [124:53:43<36:15:13, 14.78s/it]
 77%|███████▋  | 29136/37963 [124:53:57<36:03:45, 14.71s/it]
 77%|███████▋  | 29137/37963 [124:54:11<35:49:17, 14.61s/it]
 77%|███████▋  | 29138/37963 [124:54:26<35:38:31, 14.54s/it]
 77%|███████▋  | 29139/37963 [124:54:40<35:31:01, 14.49s/it]
 77%|███████▋  | 29140/37963 [124:54:54<35:09:04, 14.34s/it]
                                                            
{'loss': '0.09113', 'grad_norm': '1.884', 'learning_rate': '2.702e-06', 'epoch': '0.7676'}

 77%|███████▋  | 29140/37963 [124:54:54<35:09:04, 14.34s/it]
 77%|███████▋  | 29141/37963 [124:55:09<35:11:41, 14.36s/it]
 77%|███████▋  | 29142/37963 [124:55:23<34:51:10, 14.22s/it]
 77%|███████▋  | 29143/37963 [124:55:44<39:59:06, 16.32s/it]
 77%|███████▋  | 29144/37963 [124:55:58<38:32:37, 15.73s/it]
 77%|███████▋  | 29145/37963 [124:56:12<37:31:01, 15.32s/it]
 77%|███████▋  | 29146/37963 [124:56:27<36:35:43, 14.94s/it]
 77%|███████▋  | 29147/37963 [124:56:41<36:15:21, 14.81s/it]
 77%|███████▋  | 29148/37963 [124:56:55<35:59:44, 14.70s/it]
 77%|███████▋  | 29149/37963 [124:57:10<35:47:16, 14.62s/it]
 77%|███████▋  | 29150/37963 [124:57:24<35:41:40, 14.58s/it]
                                                            
{'loss': '0.09308', 'grad_norm': '1.999', 'learning_rate': '2.696e-06', 'epoch': '0.7679'}

 77%|███████▋  | 29150/37963 [124:57:24<35:41:40, 14.58s/it]
 77%|███████▋  | 29151/37963 [124:57:39<35:30:57, 14.51s/it]
 77%|███████▋  | 29152/37963 [124:57:53<35:27:24, 14.49s/it]
 77%|███████▋  | 29153/37963 [124:58:07<35:08:09, 14.36s/it]
 77%|███████▋  | 29154/37963 [124:58:28<39:42:48, 16.23s/it]
 77%|███████▋  | 29155/37963 [124:58:42<38:24:27, 15.70s/it]
 77%|███████▋  | 29156/37963 [124:58:57<37:25:21, 15.30s/it]
 77%|███████▋  | 29157/37963 [124:59:24<46:38:14, 19.07s/it]
 77%|███████▋  | 29158/37963 [124:59:39<43:14:34, 17.68s/it]
 77%|███████▋  | 29159/37963 [124:59:53<40:37:24, 16.61s/it]
 77%|███████▋  | 29160/37963 [125:00:07<38:58:08, 15.94s/it]
                                                            
{'loss': '0.07966', 'grad_norm': '2.377', 'learning_rate': '2.691e-06', 'epoch': '0.7681'}

 77%|███████▋  | 29160/37963 [125:00:07<38:58:08, 15.94s/it]
 77%|███████▋  | 29161/37963 [125:00:22<37:49:09, 15.47s/it]
 77%|███████▋  | 29162/37963 [125:00:36<37:01:13, 15.14s/it]
 77%|███████▋  | 29163/37963 [125:00:50<36:25:08, 14.90s/it]
 77%|███████▋  | 29164/37963 [125:01:05<36:04:32, 14.76s/it]
 77%|███████▋  | 29165/37963 [125:01:19<35:51:26, 14.67s/it]
 77%|███████▋  | 29166/37963 [125:01:34<35:36:57, 14.58s/it]
 77%|███████▋  | 29167/37963 [125:01:48<35:30:16, 14.53s/it]
 77%|███████▋  | 29168/37963 [125:02:09<40:13:10, 16.46s/it]
 77%|███████▋  | 29169/37963 [125:02:23<38:38:51, 15.82s/it]
 77%|███████▋  | 29170/37963 [125:02:37<37:19:12, 15.28s/it]
                                                            
{'loss': '0.0808', 'grad_norm': '2.868', 'learning_rate': '2.685e-06', 'epoch': '0.7684'}

 77%|███████▋  | 29170/37963 [125:02:37<37:19:12, 15.28s/it]
 77%|███████▋  | 29171/37963 [125:02:52<36:41:05, 15.02s/it]
 77%|███████▋  | 29172/37963 [125:03:06<35:46:59, 14.65s/it]
 77%|███████▋  | 29173/37963 [125:03:20<35:11:33, 14.41s/it]
 77%|███████▋  | 29174/37963 [125:03:34<35:00:51, 14.34s/it]
 77%|███████▋  | 29175/37963 [125:03:54<39:38:30, 16.24s/it]
 77%|███████▋  | 29176/37963 [125:04:09<38:17:38, 15.69s/it]
 77%|███████▋  | 29177/37963 [125:04:23<37:19:48, 15.30s/it]
 77%|███████▋  | 29178/37963 [125:04:44<41:36:07, 17.05s/it]
 77%|███████▋  | 29179/37963 [125:05:05<44:02:41, 18.05s/it]
 77%|███████▋  | 29180/37963 [125:05:19<41:07:26, 16.86s/it]
                                                            
{'loss': '0.09014', 'grad_norm': '2.054', 'learning_rate': '2.679e-06', 'epoch': '0.7686'}

 77%|███████▋  | 29180/37963 [125:05:19<41:07:26, 16.86s/it]
 77%|███████▋  | 29181/37963 [125:05:33<39:20:06, 16.12s/it]
 77%|███████▋  | 29182/37963 [125:05:47<37:54:05, 15.54s/it]
 77%|███████▋  | 29183/37963 [125:06:02<37:03:42, 15.20s/it]
 77%|███████▋  | 29184/37963 [125:06:16<36:26:31, 14.94s/it]
 77%|███████▋  | 29185/37963 [125:06:30<35:56:32, 14.74s/it]
 77%|███████▋  | 29186/37963 [125:06:45<35:41:25, 14.64s/it]
 77%|███████▋  | 29187/37963 [125:06:59<35:30:10, 14.56s/it]
 77%|███████▋  | 29188/37963 [125:07:13<35:03:04, 14.38s/it]
 77%|███████▋  | 29189/37963 [125:07:28<35:04:22, 14.39s/it]
 77%|███████▋  | 29190/37963 [125:07:42<35:09:20, 14.43s/it]
                                                            
{'loss': '0.08508', 'grad_norm': '2.095', 'learning_rate': '2.673e-06', 'epoch': '0.7689'}

 77%|███████▋  | 29190/37963 [125:07:42<35:09:20, 14.43s/it]
 77%|███████▋  | 29191/37963 [125:07:56<35:08:02, 14.42s/it]
 77%|███████▋  | 29192/37963 [125:08:18<40:09:34, 16.48s/it]
 77%|███████▋  | 29193/37963 [125:08:32<38:37:27, 15.85s/it]
 77%|███████▋  | 29194/37963 [125:08:46<37:31:25, 15.40s/it]
 77%|███████▋  | 29195/37963 [125:09:01<36:49:36, 15.12s/it]
 77%|███████▋  | 29196/37963 [125:09:15<36:08:15, 14.84s/it]
 77%|███████▋  | 29197/37963 [125:09:29<35:32:57, 14.60s/it]
 77%|███████▋  | 29198/37963 [125:09:44<35:23:45, 14.54s/it]
 77%|███████▋  | 29199/37963 [125:09:58<35:04:18, 14.41s/it]
 77%|███████▋  | 29200/37963 [125:10:12<35:03:14, 14.40s/it]
                                                            
{'loss': '0.07917', 'grad_norm': '3.922', 'learning_rate': '2.667e-06', 'epoch': '0.7692'}

 77%|███████▋  | 29200/37963 [125:10:12<35:03:14, 14.40s/it]
 77%|███████▋  | 29201/37963 [125:10:32<39:22:19, 16.18s/it]
 77%|███████▋  | 29202/37963 [125:10:47<38:05:19, 15.65s/it]
 77%|███████▋  | 29203/37963 [125:11:01<37:14:04, 15.30s/it]
 77%|███████▋  | 29204/37963 [125:11:15<36:22:04, 14.95s/it]
 77%|███████▋  | 29205/37963 [125:11:37<40:51:46, 16.80s/it]
 77%|███████▋  | 29206/37963 [125:11:51<39:08:55, 16.09s/it]
 77%|███████▋  | 29207/37963 [125:12:12<42:57:15, 17.66s/it]
 77%|███████▋  | 29208/37963 [125:12:27<40:37:32, 16.70s/it]
 77%|███████▋  | 29209/37963 [125:12:41<38:47:11, 15.95s/it]
 77%|███████▋  | 29210/37963 [125:12:55<37:38:27, 15.48s/it]
                                                            
{'loss': '0.09084', 'grad_norm': '3.527', 'learning_rate': '2.662e-06', 'epoch': '0.7694'}

 77%|███████▋  | 29210/37963 [125:12:55<37:38:27, 15.48s/it]
 77%|███████▋  | 29211/37963 [125:13:10<36:45:07, 15.12s/it]
 77%|███████▋  | 29212/37963 [125:13:23<35:43:28, 14.70s/it]
 77%|███████▋  | 29213/37963 [125:13:37<35:04:30, 14.43s/it]
 77%|███████▋  | 29214/37963 [125:13:51<34:53:11, 14.35s/it]
 77%|███████▋  | 29215/37963 [125:14:05<34:42:32, 14.28s/it]
 77%|███████▋  | 29216/37963 [125:14:20<34:47:53, 14.32s/it]
 77%|███████▋  | 29217/37963 [125:14:41<39:33:24, 16.28s/it]
 77%|███████▋  | 29218/37963 [125:14:55<38:07:39, 15.70s/it]
 77%|███████▋  | 29219/37963 [125:15:09<37:08:48, 15.29s/it]
 77%|███████▋  | 29220/37963 [125:15:24<36:29:03, 15.02s/it]
                                                            
{'loss': '0.1024', 'grad_norm': '2.53', 'learning_rate': '2.656e-06', 'epoch': '0.7697'}

 77%|███████▋  | 29220/37963 [125:15:24<36:29:03, 15.02s/it]
 77%|███████▋  | 29221/37963 [125:15:38<36:11:19, 14.90s/it]
 77%|███████▋  | 29222/37963 [125:15:52<35:35:27, 14.66s/it]
 77%|███████▋  | 29223/37963 [125:16:13<40:07:04, 16.52s/it]
 77%|███████▋  | 29224/37963 [125:16:28<38:26:24, 15.84s/it]
 77%|███████▋  | 29225/37963 [125:16:42<37:24:41, 15.41s/it]
 77%|███████▋  | 29226/37963 [125:16:56<36:41:16, 15.12s/it]
 77%|███████▋  | 29227/37963 [125:17:18<41:10:45, 16.97s/it]
 77%|███████▋  | 29228/37963 [125:17:32<39:20:23, 16.21s/it]
 77%|███████▋  | 29229/37963 [125:17:47<38:00:52, 15.67s/it]
 77%|███████▋  | 29230/37963 [125:18:07<41:20:28, 17.04s/it]
                                                            
{'loss': '0.0868', 'grad_norm': '1.546', 'learning_rate': '2.65e-06', 'epoch': '0.77'}

 77%|███████▋  | 29230/37963 [125:18:07<41:20:28, 17.04s/it]
 77%|███████▋  | 29231/37963 [125:18:21<39:21:57, 16.23s/it]
 77%|███████▋  | 29232/37963 [125:18:36<38:03:10, 15.69s/it]
 77%|███████▋  | 29233/37963 [125:18:50<37:09:01, 15.32s/it]
 77%|███████▋  | 29234/37963 [125:19:04<36:24:02, 15.01s/it]
 77%|███████▋  | 29235/37963 [125:19:19<35:56:28, 14.82s/it]
 77%|███████▋  | 29236/37963 [125:19:33<35:40:50, 14.72s/it]
 77%|███████▋  | 29237/37963 [125:19:48<35:28:13, 14.63s/it]
 77%|███████▋  | 29238/37963 [125:20:02<35:19:04, 14.57s/it]
 77%|███████▋  | 29239/37963 [125:20:16<35:02:50, 14.46s/it]
 77%|███████▋  | 29240/37963 [125:20:31<35:00:45, 14.45s/it]
                                                            
{'loss': '0.08968', 'grad_norm': '3.474', 'learning_rate': '2.644e-06', 'epoch': '0.7702'}

 77%|███████▋  | 29240/37963 [125:20:31<35:00:45, 14.45s/it]
 77%|███████▋  | 29241/37963 [125:20:53<40:30:06, 16.72s/it]
 77%|███████▋  | 29242/37963 [125:21:07<38:40:50, 15.97s/it]
 77%|███████▋  | 29243/37963 [125:21:21<37:36:27, 15.53s/it]
 77%|███████▋  | 29244/37963 [125:21:35<36:21:28, 15.01s/it]
 77%|███████▋  | 29245/37963 [125:21:50<35:56:08, 14.84s/it]
 77%|███████▋  | 29246/37963 [125:22:04<35:35:47, 14.70s/it]
 77%|███████▋  | 29247/37963 [125:22:18<35:20:39, 14.60s/it]
 77%|███████▋  | 29248/37963 [125:22:33<35:09:34, 14.52s/it]
 77%|███████▋  | 29249/37963 [125:22:47<35:08:14, 14.52s/it]
 77%|███████▋  | 29250/37963 [125:23:08<39:33:50, 16.35s/it]
                                                            
{'loss': '0.08896', 'grad_norm': '1.993', 'learning_rate': '2.638e-06', 'epoch': '0.7705'}

 77%|███████▋  | 29250/37963 [125:23:08<39:33:50, 16.35s/it]
 77%|███████▋  | 29251/37963 [125:23:22<38:07:57, 15.76s/it]
 77%|███████▋  | 29252/37963 [125:23:37<37:08:35, 15.35s/it]
 77%|███████▋  | 29253/37963 [125:23:51<36:28:02, 15.07s/it]
 77%|███████▋  | 29254/37963 [125:24:19<45:42:28, 18.89s/it]
 77%|███████▋  | 29255/37963 [125:24:33<42:24:10, 17.53s/it]
 77%|███████▋  | 29256/37963 [125:24:47<39:28:36, 16.32s/it]
 77%|███████▋  | 29257/37963 [125:25:01<38:00:42, 15.72s/it]
 77%|███████▋  | 29258/37963 [125:25:15<36:53:46, 15.26s/it]
 77%|███████▋  | 29259/37963 [125:25:29<36:08:30, 14.95s/it]
 77%|███████▋  | 29260/37963 [125:25:43<35:27:22, 14.67s/it]
                                                            
{'loss': '0.09209', 'grad_norm': '1.936', 'learning_rate': '2.633e-06', 'epoch': '0.7708'}

 77%|███████▋  | 29260/37963 [125:25:43<35:27:22, 14.67s/it]
 77%|███████▋  | 29261/37963 [125:25:58<35:01:30, 14.49s/it]
 77%|███████▋  | 29262/37963 [125:26:12<34:50:21, 14.41s/it]
 77%|███████▋  | 29263/37963 [125:26:26<34:39:38, 14.34s/it]
 77%|███████▋  | 29264/37963 [125:26:40<34:43:19, 14.37s/it]
 77%|███████▋  | 29265/37963 [125:26:54<34:20:37, 14.21s/it]
 77%|███████▋  | 29266/37963 [125:27:09<34:25:47, 14.25s/it]
 77%|███████▋  | 29267/37963 [125:27:23<34:33:41, 14.31s/it]
 77%|███████▋  | 29268/37963 [125:27:44<39:17:55, 16.27s/it]
 77%|███████▋  | 29269/37963 [125:27:58<37:56:12, 15.71s/it]
 77%|███████▋  | 29270/37963 [125:28:13<36:56:37, 15.30s/it]
                                                            
{'loss': '0.08988', 'grad_norm': '2.357', 'learning_rate': '2.627e-06', 'epoch': '0.771'}

 77%|███████▋  | 29270/37963 [125:28:13<36:56:37, 15.30s/it]
 77%|███████▋  | 29271/37963 [125:28:33<40:43:18, 16.87s/it]
 77%|███████▋  | 29272/37963 [125:28:48<39:03:17, 16.18s/it]
 77%|███████▋  | 29273/37963 [125:29:02<37:21:39, 15.48s/it]
 77%|███████▋  | 29274/37963 [125:29:16<36:31:23, 15.13s/it]
 77%|███████▋  | 29275/37963 [125:29:30<35:45:39, 14.82s/it]
 77%|███████▋  | 29276/37963 [125:29:51<40:23:02, 16.74s/it]
 77%|███████▋  | 29277/37963 [125:30:06<38:40:13, 16.03s/it]
 77%|███████▋  | 29278/37963 [125:30:20<37:21:40, 15.49s/it]
 77%|███████▋  | 29279/37963 [125:30:41<41:18:01, 17.12s/it]
 77%|███████▋  | 29280/37963 [125:30:55<39:21:20, 16.32s/it]
                                                            
{'loss': '0.08521', 'grad_norm': '1.934', 'learning_rate': '2.621e-06', 'epoch': '0.7713'}

 77%|███████▋  | 29280/37963 [125:30:55<39:21:20, 16.32s/it]
 77%|███████▋  | 29281/37963 [125:31:09<37:51:25, 15.70s/it]
 77%|███████▋  | 29282/37963 [125:31:24<36:57:30, 15.33s/it]
 77%|███████▋  | 29283/37963 [125:31:38<36:15:35, 15.04s/it]
 77%|███████▋  | 29284/37963 [125:31:53<35:47:06, 14.84s/it]
 77%|███████▋  | 29285/37963 [125:32:07<35:17:58, 14.64s/it]
 77%|███████▋  | 29286/37963 [125:32:21<35:06:04, 14.56s/it]
 77%|███████▋  | 29287/37963 [125:32:36<34:56:22, 14.50s/it]
 77%|███████▋  | 29288/37963 [125:32:50<34:55:01, 14.49s/it]
 77%|███████▋  | 29289/37963 [125:33:12<40:13:32, 16.70s/it]
 77%|███████▋  | 29290/37963 [125:33:26<38:23:40, 15.94s/it]
                                                            
{'loss': '0.09122', 'grad_norm': '2.661', 'learning_rate': '2.615e-06', 'epoch': '0.7715'}

 77%|███████▋  | 29290/37963 [125:33:26<38:23:40, 15.94s/it]
 77%|███████▋  | 29291/37963 [125:33:40<37:08:48, 15.42s/it]
 77%|███████▋  | 29292/37963 [125:33:55<36:20:30, 15.09s/it]
 77%|███████▋  | 29293/37963 [125:34:09<35:39:59, 14.81s/it]
 77%|███████▋  | 29294/37963 [125:34:23<35:19:13, 14.67s/it]
 77%|███████▋  | 29295/37963 [125:34:37<35:06:14, 14.58s/it]
 77%|███████▋  | 29296/37963 [125:34:52<34:58:42, 14.53s/it]
 77%|███████▋  | 29297/37963 [125:35:06<34:49:32, 14.47s/it]
 77%|███████▋  | 29298/37963 [125:35:26<39:00:24, 16.21s/it]
 77%|███████▋  | 29299/37963 [125:35:40<37:14:01, 15.47s/it]
 77%|███████▋  | 29300/37963 [125:35:54<36:11:01, 15.04s/it]
                                                            
{'loss': '0.08025', 'grad_norm': '2.675', 'learning_rate': '2.61e-06', 'epoch': '0.7718'}

 77%|███████▋  | 29300/37963 [125:35:54<36:11:01, 15.04s/it]
 77%|███████▋  | 29301/37963 [125:36:09<35:45:04, 14.86s/it]
 77%|███████▋  | 29302/37963 [125:36:30<40:08:02, 16.68s/it]
 77%|███████▋  | 29303/37963 [125:36:50<42:56:35, 17.85s/it]
 77%|███████▋  | 29304/37963 [125:37:04<40:19:25, 16.76s/it]
 77%|███████▋  | 29305/37963 [125:37:19<38:34:26, 16.04s/it]
 77%|███████▋  | 29306/37963 [125:37:33<37:17:03, 15.50s/it]
 77%|███████▋  | 29307/37963 [125:37:47<36:30:11, 15.18s/it]
 77%|███████▋  | 29308/37963 [125:38:02<35:56:22, 14.95s/it]
 77%|███████▋  | 29309/37963 [125:38:15<35:01:02, 14.57s/it]
 77%|███████▋  | 29310/37963 [125:38:30<34:55:58, 14.53s/it]
                                                            
{'loss': '0.1018', 'grad_norm': '3.558', 'learning_rate': '2.604e-06', 'epoch': '0.7721'}

 77%|███████▋  | 29310/37963 [125:38:30<34:55:58, 14.53s/it]
 77%|███████▋  | 29311/37963 [125:38:44<34:46:20, 14.47s/it]
 77%|███████▋  | 29312/37963 [125:38:59<34:46:07, 14.47s/it]
 77%|███████▋  | 29313/37963 [125:39:13<34:39:22, 14.42s/it]
 77%|███████▋  | 29314/37963 [125:39:27<34:30:56, 14.37s/it]
 77%|███████▋  | 29315/37963 [125:39:42<34:41:42, 14.44s/it]
 77%|███████▋  | 29316/37963 [125:39:56<34:38:20, 14.42s/it]
 77%|███████▋  | 29317/37963 [125:40:17<39:18:47, 16.37s/it]
 77%|███████▋  | 29318/37963 [125:40:32<37:51:56, 15.77s/it]
 77%|███████▋  | 29319/37963 [125:40:46<36:57:05, 15.39s/it]
 77%|███████▋  | 29320/37963 [125:41:00<36:00:53, 15.00s/it]
                                                            
{'loss': '0.09203', 'grad_norm': '1.53', 'learning_rate': '2.598e-06', 'epoch': '0.7723'}

 77%|███████▋  | 29320/37963 [125:41:00<36:00:53, 15.00s/it]
 77%|███████▋  | 29321/37963 [125:41:14<35:33:23, 14.81s/it]
 77%|███████▋  | 29322/37963 [125:41:35<39:52:44, 16.61s/it]
 77%|███████▋  | 29323/37963 [125:41:50<38:21:40, 15.98s/it]
 77%|███████▋  | 29324/37963 [125:42:11<42:07:35, 17.55s/it]
 77%|███████▋  | 29325/37963 [125:42:25<39:51:20, 16.61s/it]
 77%|███████▋  | 29326/37963 [125:42:40<38:13:20, 15.93s/it]
 77%|███████▋  | 29327/37963 [125:42:54<36:42:32, 15.30s/it]
 77%|███████▋  | 29328/37963 [125:43:08<36:03:49, 15.04s/it]
 77%|███████▋  | 29329/37963 [125:43:29<40:02:34, 16.70s/it]
 77%|███████▋  | 29330/37963 [125:43:43<38:14:25, 15.95s/it]
                                                            
{'loss': '0.08629', 'grad_norm': '3.042', 'learning_rate': '2.592e-06', 'epoch': '0.7726'}

 77%|███████▋  | 29330/37963 [125:43:43<38:14:25, 15.95s/it]
 77%|███████▋  | 29331/37963 [125:43:57<37:08:05, 15.49s/it]
 77%|███████▋  | 29332/37963 [125:44:11<36:14:21, 15.12s/it]
 77%|███████▋  | 29333/37963 [125:44:26<35:41:12, 14.89s/it]
 77%|███████▋  | 29334/37963 [125:44:40<35:19:37, 14.74s/it]
 77%|███████▋  | 29335/37963 [125:44:55<35:14:07, 14.70s/it]
 77%|███████▋  | 29336/37963 [125:45:09<34:45:34, 14.51s/it]
 77%|███████▋  | 29337/37963 [125:45:30<39:38:13, 16.54s/it]
 77%|███████▋  | 29338/37963 [125:45:45<38:08:53, 15.92s/it]
 77%|███████▋  | 29339/37963 [125:45:59<36:55:32, 15.41s/it]
 77%|███████▋  | 29340/37963 [125:46:13<36:14:25, 15.13s/it]
                                                            
{'loss': '0.1013', 'grad_norm': '2.9', 'learning_rate': '2.587e-06', 'epoch': '0.7729'}

 77%|███████▋  | 29340/37963 [125:46:13<36:14:25, 15.13s/it]
 77%|███████▋  | 29341/37963 [125:46:28<35:33:27, 14.85s/it]
 77%|███████▋  | 29342/37963 [125:46:42<34:58:32, 14.61s/it]
 77%|███████▋  | 29343/37963 [125:46:56<34:47:31, 14.53s/it]
 77%|███████▋  | 29344/37963 [125:47:10<34:41:31, 14.49s/it]
 77%|███████▋  | 29345/37963 [125:47:25<34:40:20, 14.48s/it]
 77%|███████▋  | 29346/37963 [125:47:39<34:35:34, 14.45s/it]
 77%|███████▋  | 29347/37963 [125:48:00<39:05:05, 16.33s/it]
 77%|███████▋  | 29348/37963 [125:48:14<37:41:00, 15.75s/it]
 77%|███████▋  | 29349/37963 [125:48:28<36:28:44, 15.25s/it]
 77%|███████▋  | 29350/37963 [125:48:43<35:52:02, 14.99s/it]
                                                            
{'loss': '0.08748', 'grad_norm': '2.556', 'learning_rate': '2.581e-06', 'epoch': '0.7731'}

 77%|███████▋  | 29350/37963 [125:48:43<35:52:02, 14.99s/it]
 77%|███████▋  | 29351/37963 [125:49:04<40:15:58, 16.83s/it]
 77%|███████▋  | 29352/37963 [125:49:25<43:14:20, 18.08s/it]
 77%|███████▋  | 29353/37963 [125:49:39<40:21:44, 16.88s/it]
 77%|███████▋  | 29354/37963 [125:49:53<38:34:34, 16.13s/it]
 77%|███████▋  | 29355/37963 [125:50:08<37:18:51, 15.61s/it]
 77%|███████▋  | 29356/37963 [125:50:22<36:25:44, 15.24s/it]
 77%|███████▋  | 29357/37963 [125:50:36<35:45:12, 14.96s/it]
 77%|███████▋  | 29358/37963 [125:50:51<35:18:49, 14.77s/it]
 77%|███████▋  | 29359/37963 [125:51:05<35:01:07, 14.65s/it]
 77%|███████▋  | 29360/37963 [125:51:20<34:49:48, 14.57s/it]
                                                            
{'loss': '0.08505', 'grad_norm': '3.663', 'learning_rate': '2.575e-06', 'epoch': '0.7734'}

 77%|███████▋  | 29360/37963 [125:51:20<34:49:48, 14.57s/it]
 77%|███████▋  | 29361/37963 [125:51:34<34:40:15, 14.51s/it]
 77%|███████▋  | 29362/37963 [125:51:48<34:35:00, 14.48s/it]
 77%|███████▋  | 29363/37963 [125:52:02<34:10:12, 14.30s/it]
 77%|███████▋  | 29364/37963 [125:52:23<38:49:21, 16.25s/it]
 77%|███████▋  | 29365/37963 [125:52:37<37:23:27, 15.66s/it]
 77%|███████▋  | 29366/37963 [125:52:52<36:30:36, 15.29s/it]
 77%|███████▋  | 29367/37963 [125:53:06<35:51:39, 15.02s/it]
 77%|███████▋  | 29368/37963 [125:53:21<35:27:44, 14.85s/it]
 77%|███████▋  | 29369/37963 [125:53:35<35:07:36, 14.71s/it]
 77%|███████▋  | 29370/37963 [125:53:56<39:29:37, 16.55s/it]
                                                            
{'loss': '0.07822', 'grad_norm': '3.021', 'learning_rate': '2.57e-06', 'epoch': '0.7737'}

 77%|███████▋  | 29370/37963 [125:53:56<39:29:37, 16.55s/it]
 77%|███████▋  | 29371/37963 [125:54:10<37:57:50, 15.91s/it]
 77%|███████▋  | 29372/37963 [125:54:31<41:39:28, 17.46s/it]
 77%|███████▋  | 29373/37963 [125:54:46<39:28:52, 16.55s/it]
 77%|███████▋  | 29374/37963 [125:55:00<38:00:38, 15.93s/it]
 77%|███████▋  | 29375/37963 [125:55:15<36:57:28, 15.49s/it]
 77%|███████▋  | 29376/37963 [125:55:29<36:17:45, 15.22s/it]
 77%|███████▋  | 29377/37963 [125:55:43<35:34:36, 14.92s/it]
 77%|███████▋  | 29378/37963 [125:55:58<35:13:48, 14.77s/it]
 77%|███████▋  | 29379/37963 [125:56:19<39:28:36, 16.56s/it]
 77%|███████▋  | 29380/37963 [125:56:33<38:03:47, 15.96s/it]
                                                            
{'loss': '0.08755', 'grad_norm': '3.708', 'learning_rate': '2.564e-06', 'epoch': '0.7739'}

 77%|███████▋  | 29380/37963 [125:56:33<38:03:47, 15.96s/it]
 77%|███████▋  | 29381/37963 [125:56:48<36:56:23, 15.50s/it]
 77%|███████▋  | 29382/37963 [125:57:02<36:06:17, 15.15s/it]
 77%|███████▋  | 29383/37963 [125:57:16<35:29:43, 14.89s/it]
 77%|███████▋  | 29384/37963 [125:57:30<35:05:16, 14.72s/it]
 77%|███████▋  | 29385/37963 [125:57:52<39:47:37, 16.70s/it]
 77%|███████▋  | 29386/37963 [125:58:06<37:59:42, 15.95s/it]
 77%|███████▋  | 29387/37963 [125:58:20<36:45:10, 15.43s/it]
 77%|███████▋  | 29388/37963 [125:58:35<35:58:48, 15.11s/it]
 77%|███████▋  | 29389/37963 [125:58:49<35:31:11, 14.91s/it]
 77%|███████▋  | 29390/37963 [125:59:03<34:53:40, 14.65s/it]
                                                            
{'loss': '0.08723', 'grad_norm': '2.045', 'learning_rate': '2.558e-06', 'epoch': '0.7742'}

 77%|███████▋  | 29390/37963 [125:59:03<34:53:40, 14.65s/it]
 77%|███████▋  | 29391/37963 [125:59:17<34:40:13, 14.56s/it]
 77%|███████▋  | 29392/37963 [125:59:31<33:56:58, 14.26s/it]
 77%|███████▋  | 29393/37963 [125:59:45<34:03:49, 14.31s/it]
 77%|███████▋  | 29394/37963 [126:00:00<34:09:13, 14.35s/it]
 77%|███████▋  | 29395/37963 [126:00:14<33:57:57, 14.27s/it]
 77%|███████▋  | 29396/37963 [126:00:35<38:35:11, 16.21s/it]
 77%|███████▋  | 29397/37963 [126:00:49<37:18:53, 15.68s/it]
 77%|███████▋  | 29398/37963 [126:01:04<36:24:17, 15.30s/it]
 77%|███████▋  | 29399/37963 [126:01:25<40:56:06, 17.21s/it]
 77%|███████▋  | 29400/37963 [126:01:40<38:55:44, 16.37s/it]
                                                            
{'loss': '0.08082', 'grad_norm': '2.182', 'learning_rate': '2.552e-06', 'epoch': '0.7744'}

 77%|███████▋  | 29400/37963 [126:01:40<38:55:44, 16.37s/it]
 77%|███████▋  | 29401/37963 [126:02:00<42:05:00, 17.69s/it]
 77%|███████▋  | 29402/37963 [126:02:14<39:15:16, 16.51s/it]
 77%|███████▋  | 29403/37963 [126:02:29<37:45:11, 15.88s/it]
 77%|███████▋  | 29404/37963 [126:02:43<36:33:09, 15.37s/it]
 77%|███████▋  | 29405/37963 [126:02:57<35:25:33, 14.90s/it]
 77%|███████▋  | 29406/37963 [126:03:11<35:02:35, 14.74s/it]
 77%|███████▋  | 29407/37963 [126:03:25<34:43:03, 14.61s/it]
 77%|███████▋  | 29408/37963 [126:03:40<34:33:02, 14.54s/it]
 77%|███████▋  | 29409/37963 [126:03:54<34:28:58, 14.51s/it]
 77%|███████▋  | 29410/37963 [126:04:08<33:51:20, 14.25s/it]
                                                            
{'loss': '0.08727', 'grad_norm': '2.13', 'learning_rate': '2.547e-06', 'epoch': '0.7747'}

 77%|███████▋  | 29410/37963 [126:04:08<33:51:20, 14.25s/it]
 77%|███████▋  | 29411/37963 [126:04:22<33:53:21, 14.27s/it]
 77%|███████▋  | 29412/37963 [126:04:43<38:45:04, 16.31s/it]
 77%|███████▋  | 29413/37963 [126:04:57<37:06:19, 15.62s/it]
 77%|███████▋  | 29414/37963 [126:05:11<36:11:31, 15.24s/it]
 77%|███████▋  | 29415/37963 [126:05:26<35:33:43, 14.98s/it]
 77%|███████▋  | 29416/37963 [126:05:40<35:07:48, 14.80s/it]
 77%|███████▋  | 29417/37963 [126:05:55<34:49:57, 14.67s/it]
 77%|███████▋  | 29418/37963 [126:06:09<34:40:09, 14.61s/it]
 77%|███████▋  | 29419/37963 [126:06:23<34:31:47, 14.55s/it]
 77%|███████▋  | 29420/37963 [126:06:45<39:17:32, 16.56s/it]
                                                            
{'loss': '0.1041', 'grad_norm': '3.18', 'learning_rate': '2.541e-06', 'epoch': '0.775'}

 77%|███████▋  | 29420/37963 [126:06:45<39:17:32, 16.56s/it]
 77%|███████▋  | 29421/37963 [126:07:05<41:41:29, 17.57s/it]
 78%|███████▊  | 29422/37963 [126:07:19<39:25:13, 16.62s/it]
 78%|███████▊  | 29423/37963 [126:07:33<37:50:27, 15.95s/it]
 78%|███████▊  | 29424/37963 [126:07:48<36:34:48, 15.42s/it]
 78%|███████▊  | 29425/37963 [126:08:02<35:41:08, 15.05s/it]
 78%|███████▊  | 29426/37963 [126:08:16<35:14:56, 14.86s/it]
 78%|███████▊  | 29427/37963 [126:08:30<34:39:04, 14.61s/it]
 78%|███████▊  | 29428/37963 [126:08:44<34:20:24, 14.48s/it]
 78%|███████▊  | 29429/37963 [126:09:06<39:04:00, 16.48s/it]
 78%|███████▊  | 29430/37963 [126:09:20<37:40:12, 15.89s/it]
                                                            
{'loss': '0.08497', 'grad_norm': '2.763', 'learning_rate': '2.535e-06', 'epoch': '0.7752'}

 78%|███████▊  | 29430/37963 [126:09:20<37:40:12, 15.89s/it]
 78%|███████▊  | 29431/37963 [126:09:34<36:34:23, 15.43s/it]
 78%|███████▊  | 29432/37963 [126:09:49<35:52:25, 15.14s/it]
 78%|███████▊  | 29433/37963 [126:10:03<34:53:49, 14.73s/it]
 78%|███████▊  | 29434/37963 [126:10:17<34:40:55, 14.64s/it]
 78%|███████▊  | 29435/37963 [126:10:31<34:29:14, 14.56s/it]
 78%|███████▊  | 29436/37963 [126:10:53<39:08:39, 16.53s/it]
 78%|███████▊  | 29437/37963 [126:11:07<37:37:40, 15.89s/it]
 78%|███████▊  | 29438/37963 [126:11:21<36:28:45, 15.40s/it]
 78%|███████▊  | 29439/37963 [126:11:35<35:14:43, 14.89s/it]
 78%|███████▊  | 29440/37963 [126:11:49<34:56:05, 14.76s/it]
                                                            
{'loss': '0.09238', 'grad_norm': '2.911', 'learning_rate': '2.53e-06', 'epoch': '0.7755'}

 78%|███████▊  | 29440/37963 [126:11:49<34:56:05, 14.76s/it]
 78%|███████▊  | 29441/37963 [126:12:04<34:41:33, 14.66s/it]
 78%|███████▊  | 29442/37963 [126:12:18<34:16:38, 14.48s/it]
 78%|███████▊  | 29443/37963 [126:12:32<34:11:57, 14.45s/it]
 78%|███████▊  | 29444/37963 [126:12:47<34:08:42, 14.43s/it]
 78%|███████▊  | 29445/37963 [126:13:01<34:05:32, 14.41s/it]
 78%|███████▊  | 29446/37963 [126:13:15<34:02:30, 14.39s/it]
 78%|███████▊  | 29447/37963 [126:13:43<43:26:54, 18.37s/it]
 78%|███████▊  | 29448/37963 [126:13:57<40:34:28, 17.15s/it]
 78%|███████▊  | 29449/37963 [126:14:18<42:56:57, 18.16s/it]
 78%|███████▊  | 29450/37963 [126:14:32<40:14:14, 17.02s/it]
                                                            
{'loss': '0.09485', 'grad_norm': '3.631', 'learning_rate': '2.524e-06', 'epoch': '0.7758'}

 78%|███████▊  | 29450/37963 [126:14:32<40:14:14, 17.02s/it]
 78%|███████▊  | 29451/37963 [126:14:46<37:56:17, 16.05s/it]
 78%|███████▊  | 29452/37963 [126:15:00<36:45:26, 15.55s/it]
 78%|███████▊  | 29453/37963 [126:15:14<35:46:03, 15.13s/it]
 78%|███████▊  | 29454/37963 [126:15:29<35:14:43, 14.91s/it]
 78%|███████▊  | 29455/37963 [126:15:43<34:53:06, 14.76s/it]
 78%|███████▊  | 29456/37963 [126:15:58<34:33:54, 14.63s/it]
 78%|███████▊  | 29457/37963 [126:16:12<34:21:40, 14.54s/it]
 78%|███████▊  | 29458/37963 [126:16:26<34:10:54, 14.47s/it]
 78%|███████▊  | 29459/37963 [126:16:40<33:51:48, 14.34s/it]
 78%|███████▊  | 29460/37963 [126:16:54<33:25:47, 14.15s/it]
                                                            
{'loss': '0.08627', 'grad_norm': '2.922', 'learning_rate': '2.518e-06', 'epoch': '0.776'}

 78%|███████▊  | 29460/37963 [126:16:54<33:25:47, 14.15s/it]
 78%|███████▊  | 29461/37963 [126:17:08<33:36:27, 14.23s/it]
 78%|███████▊  | 29462/37963 [126:17:30<38:33:55, 16.33s/it]
 78%|███████▊  | 29463/37963 [126:17:44<37:10:06, 15.74s/it]
 78%|███████▊  | 29464/37963 [126:17:58<35:57:26, 15.23s/it]
 78%|███████▊  | 29465/37963 [126:18:12<35:12:16, 14.91s/it]
 78%|███████▊  | 29466/37963 [126:18:27<34:54:56, 14.79s/it]
 78%|███████▊  | 29467/37963 [126:18:41<34:35:16, 14.66s/it]
 78%|███████▊  | 29468/37963 [126:18:55<34:26:00, 14.59s/it]
 78%|███████▊  | 29469/37963 [126:19:09<33:51:21, 14.35s/it]
 78%|███████▊  | 29470/37963 [126:19:31<38:48:50, 16.45s/it]
                                                            
{'loss': '0.08838', 'grad_norm': '2.375', 'learning_rate': '2.513e-06', 'epoch': '0.7763'}

 78%|███████▊  | 29470/37963 [126:19:31<38:48:50, 16.45s/it]
 78%|███████▊  | 29471/37963 [126:19:52<41:56:57, 17.78s/it]
 78%|███████▊  | 29472/37963 [126:20:06<39:33:51, 16.77s/it]
 78%|███████▊  | 29473/37963 [126:20:20<37:51:41, 16.05s/it]
 78%|███████▊  | 29474/37963 [126:20:35<36:39:48, 15.55s/it]
 78%|███████▊  | 29475/37963 [126:20:49<35:51:27, 15.21s/it]
 78%|███████▊  | 29476/37963 [126:21:03<35:14:32, 14.95s/it]
 78%|███████▊  | 29477/37963 [126:21:24<39:00:55, 16.55s/it]
 78%|███████▊  | 29478/37963 [126:21:38<37:29:19, 15.91s/it]
 78%|███████▊  | 29479/37963 [126:21:52<36:24:01, 15.45s/it]
 78%|███████▊  | 29480/37963 [126:22:07<35:40:13, 15.14s/it]
                                                            
{'loss': '0.08501', 'grad_norm': '2.769', 'learning_rate': '2.507e-06', 'epoch': '0.7765'}

 78%|███████▊  | 29480/37963 [126:22:07<35:40:13, 15.14s/it]
 78%|███████▊  | 29481/37963 [126:22:21<35:07:30, 14.91s/it]
 78%|███████▊  | 29482/37963 [126:22:36<34:48:36, 14.78s/it]
 78%|███████▊  | 29483/37963 [126:22:50<34:32:49, 14.67s/it]
 78%|███████▊  | 29484/37963 [126:23:12<39:18:41, 16.69s/it]
 78%|███████▊  | 29485/37963 [126:23:26<37:41:29, 16.00s/it]
 78%|███████▊  | 29486/37963 [126:23:40<36:34:01, 15.53s/it]
 78%|███████▊  | 29487/37963 [126:23:55<35:44:00, 15.18s/it]
 78%|███████▊  | 29488/37963 [126:24:09<34:47:49, 14.78s/it]
 78%|███████▊  | 29489/37963 [126:24:23<34:31:02, 14.66s/it]
 78%|███████▊  | 29490/37963 [126:24:37<34:14:31, 14.55s/it]
                                                            
{'loss': '0.09619', 'grad_norm': '2.027', 'learning_rate': '2.501e-06', 'epoch': '0.7768'}

 78%|███████▊  | 29490/37963 [126:24:37<34:14:31, 14.55s/it]
 78%|███████▊  | 29491/37963 [126:24:51<33:32:24, 14.25s/it]
 78%|███████▊  | 29492/37963 [126:25:05<33:37:02, 14.29s/it]
 78%|███████▊  | 29493/37963 [126:25:19<33:14:16, 14.13s/it]
 78%|███████▊  | 29494/37963 [126:25:33<33:23:30, 14.19s/it]
 78%|███████▊  | 29495/37963 [126:25:54<37:56:19, 16.13s/it]
 78%|███████▊  | 29496/37963 [126:26:14<40:56:53, 17.41s/it]
 78%|███████▊  | 29497/37963 [126:26:35<43:24:35, 18.46s/it]
 78%|███████▊  | 29498/37963 [126:26:50<40:35:08, 17.26s/it]
 78%|███████▊  | 29499/37963 [126:27:04<38:31:54, 16.39s/it]
 78%|███████▊  | 29500/37963 [126:27:19<37:15:45, 15.85s/it]
                                                            
{'loss': '0.09921', 'grad_norm': '2.594', 'learning_rate': '2.496e-06', 'epoch': '0.7771'}

 78%|███████▊  | 29500/37963 [126:27:19<37:15:45, 15.85s/it]
 78%|███████▊  | 29501/37963 [126:27:33<35:52:48, 15.26s/it]
 78%|███████▊  | 29502/37963 [126:27:47<35:16:38, 15.01s/it]
 78%|███████▊  | 29503/37963 [126:28:01<34:49:24, 14.82s/it]
 78%|███████▊  | 29504/37963 [126:28:16<34:30:48, 14.69s/it]
 78%|███████▊  | 29505/37963 [126:28:30<34:19:38, 14.61s/it]
 78%|███████▊  | 29506/37963 [126:28:45<34:12:07, 14.56s/it]
 78%|███████▊  | 29507/37963 [126:28:59<34:04:31, 14.51s/it]
 78%|███████▊  | 29508/37963 [126:29:13<34:00:31, 14.48s/it]
 78%|███████▊  | 29509/37963 [126:29:34<38:35:41, 16.43s/it]
 78%|███████▊  | 29510/37963 [126:29:49<37:06:43, 15.81s/it]
                                                            
{'loss': '0.09187', 'grad_norm': '2.013', 'learning_rate': '2.49e-06', 'epoch': '0.7773'}

 78%|███████▊  | 29510/37963 [126:29:49<37:06:43, 15.81s/it]
 78%|███████▊  | 29511/37963 [126:30:03<35:40:49, 15.20s/it]
 78%|███████▊  | 29512/37963 [126:30:17<35:06:55, 14.96s/it]
 78%|███████▊  | 29513/37963 [126:30:31<34:23:52, 14.65s/it]
 78%|███████▊  | 29514/37963 [126:30:45<34:10:59, 14.56s/it]
 78%|███████▊  | 29515/37963 [126:31:00<34:04:08, 14.52s/it]
 78%|███████▊  | 29516/37963 [126:31:14<33:58:56, 14.48s/it]
 78%|███████▊  | 29517/37963 [126:31:28<33:36:44, 14.33s/it]
 78%|███████▊  | 29518/37963 [126:31:50<38:40:28, 16.49s/it]
 78%|███████▊  | 29519/37963 [126:32:04<37:13:23, 15.87s/it]
 78%|███████▊  | 29520/37963 [126:32:18<35:43:28, 15.23s/it]
                                                            
{'loss': '0.0931', 'grad_norm': '2.348', 'learning_rate': '2.485e-06', 'epoch': '0.7776'}

 78%|███████▊  | 29520/37963 [126:32:18<35:43:28, 15.23s/it]
 78%|███████▊  | 29521/37963 [126:32:38<39:33:35, 16.87s/it]
 78%|███████▊  | 29522/37963 [126:32:53<37:48:44, 16.13s/it]
 78%|███████▊  | 29523/37963 [126:33:07<36:37:15, 15.62s/it]
 78%|███████▊  | 29524/37963 [126:33:21<35:25:07, 15.11s/it]
 78%|███████▊  | 29525/37963 [126:33:42<39:16:44, 16.76s/it]
 78%|███████▊  | 29526/37963 [126:33:56<37:38:15, 16.06s/it]
 78%|███████▊  | 29527/37963 [126:34:10<36:23:59, 15.53s/it]
 78%|███████▊  | 29528/37963 [126:34:25<35:45:25, 15.26s/it]
 78%|███████▊  | 29529/37963 [126:34:39<35:07:33, 14.99s/it]
 78%|███████▊  | 29530/37963 [126:34:54<34:42:34, 14.82s/it]
                                                            
{'loss': '0.083', 'grad_norm': '2.518', 'learning_rate': '2.479e-06', 'epoch': '0.7779'}

 78%|███████▊  | 29530/37963 [126:34:54<34:42:34, 14.82s/it]
 78%|███████▊  | 29531/37963 [126:35:08<34:25:27, 14.70s/it]
 78%|███████▊  | 29532/37963 [126:35:30<39:00:22, 16.66s/it]
 78%|███████▊  | 29533/37963 [126:35:44<37:24:57, 15.98s/it]
 78%|███████▊  | 29534/37963 [126:35:58<36:17:30, 15.50s/it]
 78%|███████▊  | 29535/37963 [126:36:13<35:29:40, 15.16s/it]
 78%|███████▊  | 29536/37963 [126:36:27<34:55:27, 14.92s/it]
 78%|███████▊  | 29537/37963 [126:36:42<34:47:55, 14.87s/it]
 78%|███████▊  | 29538/37963 [126:36:56<34:05:15, 14.57s/it]
 78%|███████▊  | 29539/37963 [126:37:10<33:52:46, 14.48s/it]
 78%|███████▊  | 29540/37963 [126:37:24<33:47:29, 14.44s/it]
                                                            
{'loss': '0.09249', 'grad_norm': '2.928', 'learning_rate': '2.473e-06', 'epoch': '0.7781'}

 78%|███████▊  | 29540/37963 [126:37:24<33:47:29, 14.44s/it]
 78%|███████▊  | 29541/37963 [126:37:38<33:36:02, 14.36s/it]
 78%|███████▊  | 29542/37963 [126:37:53<33:36:29, 14.37s/it]
 78%|███████▊  | 29543/37963 [126:38:13<38:00:30, 16.25s/it]
 78%|███████▊  | 29544/37963 [126:38:34<40:51:44, 17.47s/it]
 78%|███████▊  | 29545/37963 [126:38:55<43:25:07, 18.57s/it]
 78%|███████▊  | 29546/37963 [126:39:09<40:27:03, 17.30s/it]
 78%|███████▊  | 29547/37963 [126:39:24<38:24:02, 16.43s/it]
 78%|███████▊  | 29548/37963 [126:39:38<36:58:17, 15.82s/it]
 78%|███████▊  | 29549/37963 [126:39:53<36:00:21, 15.41s/it]
 78%|███████▊  | 29550/37963 [126:40:07<35:22:00, 15.13s/it]
                                                            
{'loss': '0.08382', 'grad_norm': '2.448', 'learning_rate': '2.468e-06', 'epoch': '0.7784'}

 78%|███████▊  | 29550/37963 [126:40:07<35:22:00, 15.13s/it]
 78%|███████▊  | 29551/37963 [126:40:21<34:48:45, 14.90s/it]
 78%|███████▊  | 29552/37963 [126:40:36<34:27:56, 14.75s/it]
 78%|███████▊  | 29553/37963 [126:40:50<34:07:13, 14.61s/it]
 78%|███████▊  | 29554/37963 [126:41:04<33:57:46, 14.54s/it]
 78%|███████▊  | 29555/37963 [126:41:19<33:47:20, 14.47s/it]
 78%|███████▊  | 29556/37963 [126:41:33<33:46:38, 14.46s/it]
 78%|███████▊  | 29557/37963 [126:41:48<33:45:06, 14.45s/it]
 78%|███████▊  | 29558/37963 [126:42:02<33:40:11, 14.42s/it]
 78%|███████▊  | 29559/37963 [126:42:23<38:03:15, 16.30s/it]
 78%|███████▊  | 29560/37963 [126:42:37<36:41:00, 15.72s/it]
                                                            
{'loss': '0.09056', 'grad_norm': '2.974', 'learning_rate': '2.462e-06', 'epoch': '0.7787'}

 78%|███████▊  | 29560/37963 [126:42:37<36:41:00, 15.72s/it]
 78%|███████▊  | 29561/37963 [126:42:51<35:23:22, 15.16s/it]
 78%|███████▊  | 29562/37963 [126:43:05<34:55:20, 14.97s/it]
 78%|███████▊  | 29563/37963 [126:43:20<34:23:29, 14.74s/it]
 78%|███████▊  | 29564/37963 [126:43:34<34:11:42, 14.66s/it]
 78%|███████▊  | 29565/37963 [126:43:48<33:51:58, 14.52s/it]
 78%|███████▊  | 29566/37963 [126:44:09<38:33:29, 16.53s/it]
 78%|███████▊  | 29567/37963 [126:44:24<37:04:32, 15.90s/it]
 78%|███████▊  | 29568/37963 [126:44:38<35:57:27, 15.42s/it]
 78%|███████▊  | 29569/37963 [126:44:53<35:12:50, 15.10s/it]
 78%|███████▊  | 29570/37963 [126:45:13<38:57:35, 16.71s/it]
                                                            
{'loss': '0.09068', 'grad_norm': '2.226', 'learning_rate': '2.456e-06', 'epoch': '0.7789'}

 78%|███████▊  | 29570/37963 [126:45:13<38:57:35, 16.71s/it]
 78%|███████▊  | 29571/37963 [126:45:27<37:23:01, 16.04s/it]
 78%|███████▊  | 29572/37963 [126:45:42<36:23:57, 15.62s/it]
 78%|███████▊  | 29573/37963 [126:45:56<35:31:48, 15.25s/it]
 78%|███████▊  | 29574/37963 [126:46:11<34:58:21, 15.01s/it]
 78%|███████▊  | 29575/37963 [126:46:25<34:31:51, 14.82s/it]
 78%|███████▊  | 29576/37963 [126:46:46<38:43:23, 16.62s/it]
 78%|███████▊  | 29577/37963 [126:47:01<37:08:13, 15.94s/it]
 78%|███████▊  | 29578/37963 [126:47:15<36:04:35, 15.49s/it]
 78%|███████▊  | 29579/37963 [126:47:29<35:03:04, 15.05s/it]
 78%|███████▊  | 29580/37963 [126:47:43<34:26:53, 14.79s/it]
                                                            
{'loss': '0.08458', 'grad_norm': '2.391', 'learning_rate': '2.451e-06', 'epoch': '0.7792'}

 78%|███████▊  | 29580/37963 [126:47:43<34:26:53, 14.79s/it]
 78%|███████▊  | 29581/37963 [126:48:05<39:01:50, 16.76s/it]
 78%|███████▊  | 29582/37963 [126:48:19<37:15:02, 16.00s/it]
 78%|███████▊  | 29583/37963 [126:48:33<36:21:33, 15.62s/it]
 78%|███████▊  | 29584/37963 [126:48:48<35:21:43, 15.19s/it]
 78%|███████▊  | 29585/37963 [126:49:02<34:49:26, 14.96s/it]
 78%|███████▊  | 29586/37963 [126:49:16<34:20:52, 14.76s/it]
 78%|███████▊  | 29587/37963 [126:49:31<34:06:54, 14.66s/it]
 78%|███████▊  | 29588/37963 [126:49:45<33:55:46, 14.58s/it]
 78%|███████▊  | 29589/37963 [126:50:00<33:47:39, 14.53s/it]
 78%|███████▊  | 29590/37963 [126:50:14<33:40:34, 14.48s/it]
                                                            
{'loss': '0.07497', 'grad_norm': '1.96', 'learning_rate': '2.445e-06', 'epoch': '0.7794'}

 78%|███████▊  | 29590/37963 [126:50:14<33:40:34, 14.48s/it]
 78%|███████▊  | 29591/37963 [126:50:35<37:59:34, 16.34s/it]
 78%|███████▊  | 29592/37963 [126:50:55<41:04:25, 17.66s/it]
 78%|███████▊  | 29593/37963 [126:51:10<38:37:24, 16.61s/it]
 78%|███████▊  | 29594/37963 [126:51:30<41:11:12, 17.72s/it]
 78%|███████▊  | 29595/37963 [126:51:44<38:54:36, 16.74s/it]
 78%|███████▊  | 29596/37963 [126:51:58<37:02:36, 15.94s/it]
 78%|███████▊  | 29597/37963 [126:52:12<35:32:38, 15.30s/it]
 78%|███████▊  | 29598/37963 [126:52:27<34:53:25, 15.02s/it]
 78%|███████▊  | 29599/37963 [126:52:41<34:24:51, 14.81s/it]
 78%|███████▊  | 29600/37963 [126:52:55<34:09:13, 14.70s/it]
                                                            
{'loss': '0.08756', 'grad_norm': '2.424', 'learning_rate': '2.44e-06', 'epoch': '0.7797'}

 78%|███████▊  | 29600/37963 [126:52:55<34:09:13, 14.70s/it]
 78%|███████▊  | 29601/37963 [126:53:09<33:28:12, 14.41s/it]
 78%|███████▊  | 29602/37963 [126:53:23<33:13:55, 14.31s/it]
 78%|███████▊  | 29603/37963 [126:53:37<32:53:52, 14.17s/it]
 78%|███████▊  | 29604/37963 [126:53:51<32:33:49, 14.02s/it]
 78%|███████▊  | 29605/37963 [126:54:05<32:26:37, 13.97s/it]
 78%|███████▊  | 29606/37963 [126:54:18<32:15:21, 13.90s/it]
 78%|███████▊  | 29607/37963 [126:54:39<37:07:04, 15.99s/it]
 78%|███████▊  | 29608/37963 [126:54:53<35:57:01, 15.49s/it]
 78%|███████▊  | 29609/37963 [126:55:08<35:09:33, 15.15s/it]
 78%|███████▊  | 29610/37963 [126:55:22<34:11:00, 14.73s/it]
                                                            
{'loss': '0.1009', 'grad_norm': '3.692', 'learning_rate': '2.434e-06', 'epoch': '0.78'}

 78%|███████▊  | 29610/37963 [126:55:22<34:11:00, 14.73s/it]
 78%|███████▊  | 29611/37963 [126:55:36<33:58:04, 14.64s/it]
 78%|███████▊  | 29612/37963 [126:55:50<33:45:49, 14.56s/it]
 78%|███████▊  | 29613/37963 [126:56:04<33:12:21, 14.32s/it]
 78%|███████▊  | 29614/37963 [126:56:25<37:45:59, 16.28s/it]
 78%|███████▊  | 29615/37963 [126:56:39<36:01:31, 15.54s/it]
 78%|███████▊  | 29616/37963 [126:56:53<35:12:10, 15.18s/it]
 78%|███████▊  | 29617/37963 [126:57:08<34:43:40, 14.98s/it]
 78%|███████▊  | 29618/37963 [126:57:22<34:17:50, 14.80s/it]
 78%|███████▊  | 29619/37963 [126:57:36<33:59:26, 14.67s/it]
 78%|███████▊  | 29620/37963 [126:57:51<33:44:55, 14.56s/it]
                                                            
{'loss': '0.09399', 'grad_norm': '2.882', 'learning_rate': '2.429e-06', 'epoch': '0.7802'}

 78%|███████▊  | 29620/37963 [126:57:51<33:44:55, 14.56s/it]
 78%|███████▊  | 29621/37963 [126:58:05<33:29:18, 14.45s/it]
 78%|███████▊  | 29622/37963 [126:58:26<37:51:04, 16.34s/it]
 78%|███████▊  | 29623/37963 [126:58:40<36:31:19, 15.76s/it]
 78%|███████▊  | 29624/37963 [126:58:54<35:33:08, 15.35s/it]
 78%|███████▊  | 29625/37963 [126:59:15<39:13:23, 16.93s/it]
 78%|███████▊  | 29626/37963 [126:59:29<37:07:41, 16.03s/it]
 78%|███████▊  | 29627/37963 [126:59:43<35:44:22, 15.43s/it]
 78%|███████▊  | 29628/37963 [126:59:58<35:06:31, 15.16s/it]
 78%|███████▊  | 29629/37963 [127:00:12<34:34:13, 14.93s/it]
 78%|███████▊  | 29630/37963 [127:00:33<38:52:20, 16.79s/it]
                                                            
{'loss': '0.09272', 'grad_norm': '1.844', 'learning_rate': '2.423e-06', 'epoch': '0.7805'}

 78%|███████▊  | 29630/37963 [127:00:33<38:52:20, 16.79s/it]
 78%|███████▊  | 29631/37963 [127:00:48<37:13:29, 16.08s/it]
 78%|███████▊  | 29632/37963 [127:01:02<35:52:03, 15.50s/it]
 78%|███████▊  | 29633/37963 [127:01:15<34:42:18, 15.00s/it]
 78%|███████▊  | 29634/37963 [127:01:30<34:08:18, 14.76s/it]
 78%|███████▊  | 29635/37963 [127:01:44<33:55:30, 14.67s/it]
 78%|███████▊  | 29636/37963 [127:01:59<33:44:00, 14.58s/it]
 78%|███████▊  | 29637/37963 [127:02:13<33:24:49, 14.45s/it]
 78%|███████▊  | 29638/37963 [127:02:27<33:17:34, 14.40s/it]
 78%|███████▊  | 29639/37963 [127:02:48<37:47:31, 16.34s/it]
 78%|███████▊  | 29640/37963 [127:03:02<36:21:06, 15.72s/it]
                                                            
{'loss': '0.08381', 'grad_norm': '3.245', 'learning_rate': '2.417e-06', 'epoch': '0.7808'}

 78%|███████▊  | 29640/37963 [127:03:02<36:21:06, 15.72s/it]
 78%|███████▊  | 29641/37963 [127:03:23<40:03:30, 17.33s/it]
 78%|███████▊  | 29642/37963 [127:03:44<42:34:08, 18.42s/it]
 78%|███████▊  | 29643/37963 [127:03:59<39:46:48, 17.21s/it]
 78%|███████▊  | 29644/37963 [127:04:13<37:50:33, 16.38s/it]
 78%|███████▊  | 29645/37963 [127:04:27<36:31:06, 15.81s/it]
 78%|███████▊  | 29646/37963 [127:04:42<35:31:58, 15.38s/it]
 78%|███████▊  | 29647/37963 [127:04:56<34:43:38, 15.03s/it]
 78%|███████▊  | 29648/37963 [127:05:10<34:19:16, 14.86s/it]
 78%|███████▊  | 29649/37963 [127:05:24<33:42:58, 14.60s/it]
 78%|███████▊  | 29650/37963 [127:05:39<33:32:25, 14.52s/it]
                                                            
{'loss': '0.08659', 'grad_norm': '2.787', 'learning_rate': '2.412e-06', 'epoch': '0.781'}

 78%|███████▊  | 29650/37963 [127:05:39<33:32:25, 14.52s/it]
 78%|███████▊  | 29651/37963 [127:05:53<32:58:14, 14.28s/it]
 78%|███████▊  | 29652/37963 [127:06:07<33:00:52, 14.30s/it]
 78%|███████▊  | 29653/37963 [127:06:21<33:10:04, 14.37s/it]
 78%|███████▊  | 29654/37963 [127:06:36<33:04:09, 14.33s/it]
 78%|███████▊  | 29655/37963 [127:06:50<33:05:01, 14.34s/it]
 78%|███████▊  | 29656/37963 [127:07:11<37:48:32, 16.39s/it]
 78%|███████▊  | 29657/37963 [127:07:25<36:22:05, 15.76s/it]
 78%|███████▊  | 29658/37963 [127:07:40<35:31:12, 15.40s/it]
 78%|███████▊  | 29659/37963 [127:07:54<34:49:36, 15.10s/it]
 78%|███████▊  | 29660/37963 [127:08:09<34:18:50, 14.88s/it]
                                                            
{'loss': '0.08501', 'grad_norm': '2.786', 'learning_rate': '2.406e-06', 'epoch': '0.7813'}

 78%|███████▊  | 29660/37963 [127:08:09<34:18:50, 14.88s/it]
 78%|███████▊  | 29661/37963 [127:08:23<33:59:53, 14.74s/it]
 78%|███████▊  | 29662/37963 [127:08:37<33:25:17, 14.49s/it]
 78%|███████▊  | 29663/37963 [127:08:51<33:18:31, 14.45s/it]
 78%|███████▊  | 29664/37963 [127:09:13<38:02:46, 16.50s/it]
 78%|███████▊  | 29665/37963 [127:09:27<36:33:55, 15.86s/it]
 78%|███████▊  | 29666/37963 [127:09:42<35:32:42, 15.42s/it]
 78%|███████▊  | 29667/37963 [127:09:56<34:50:06, 15.12s/it]
 78%|███████▊  | 29668/37963 [127:10:10<34:04:19, 14.79s/it]
 78%|███████▊  | 29669/37963 [127:10:24<33:46:18, 14.66s/it]
 78%|███████▊  | 29670/37963 [127:10:44<37:26:26, 16.25s/it]
                                                            
{'loss': '0.08732', 'grad_norm': '2.238', 'learning_rate': '2.401e-06', 'epoch': '0.7816'}

 78%|███████▊  | 29670/37963 [127:10:44<37:26:26, 16.25s/it]
 78%|███████▊  | 29671/37963 [127:11:05<40:24:19, 17.54s/it]
 78%|███████▊  | 29672/37963 [127:11:19<38:14:35, 16.61s/it]
 78%|███████▊  | 29673/37963 [127:11:34<36:45:04, 15.96s/it]
 78%|███████▊  | 29674/37963 [127:11:48<35:40:50, 15.50s/it]
 78%|███████▊  | 29675/37963 [127:12:03<34:56:34, 15.18s/it]
 78%|███████▊  | 29676/37963 [127:12:17<34:24:22, 14.95s/it]
 78%|███████▊  | 29677/37963 [127:12:31<34:02:17, 14.79s/it]
 78%|███████▊  | 29678/37963 [127:12:46<33:48:12, 14.69s/it]
 78%|███████▊  | 29679/37963 [127:13:00<33:33:04, 14.58s/it]
 78%|███████▊  | 29680/37963 [127:13:21<38:07:12, 16.57s/it]
                                                            
{'loss': '0.08876', 'grad_norm': '2.117', 'learning_rate': '2.395e-06', 'epoch': '0.7818'}

 78%|███████▊  | 29680/37963 [127:13:21<38:07:12, 16.57s/it]
 78%|███████▊  | 29681/37963 [127:13:36<36:35:55, 15.91s/it]
 78%|███████▊  | 29682/37963 [127:13:50<35:31:57, 15.45s/it]
 78%|███████▊  | 29683/37963 [127:14:05<34:50:34, 15.15s/it]
 78%|███████▊  | 29684/37963 [127:14:19<34:19:40, 14.93s/it]
 78%|███████▊  | 29685/37963 [127:14:33<34:00:46, 14.79s/it]
 78%|███████▊  | 29686/37963 [127:14:48<33:41:26, 14.65s/it]
 78%|███████▊  | 29687/37963 [127:15:08<37:47:51, 16.44s/it]
 78%|███████▊  | 29688/37963 [127:15:23<36:29:41, 15.88s/it]
 78%|███████▊  | 29689/37963 [127:15:37<35:27:24, 15.43s/it]
 78%|███████▊  | 29690/37963 [127:16:05<44:00:59, 19.15s/it]
                                                            
{'loss': '0.09177', 'grad_norm': '3.959', 'learning_rate': '2.39e-06', 'epoch': '0.7821'}

 78%|███████▊  | 29690/37963 [127:16:05<44:00:59, 19.15s/it]
 78%|███████▊  | 29691/37963 [127:16:20<40:45:16, 17.74s/it]
 78%|███████▊  | 29692/37963 [127:16:34<38:23:06, 16.71s/it]
 78%|███████▊  | 29693/37963 [127:16:48<36:48:32, 16.02s/it]
 78%|███████▊  | 29694/37963 [127:17:03<35:48:02, 15.59s/it]
 78%|███████▊  | 29695/37963 [127:17:17<34:58:12, 15.23s/it]
 78%|███████▊  | 29696/37963 [127:17:32<34:19:23, 14.95s/it]
 78%|███████▊  | 29697/37963 [127:17:46<33:55:04, 14.77s/it]
 78%|███████▊  | 29698/37963 [127:18:00<33:37:58, 14.65s/it]
 78%|███████▊  | 29699/37963 [127:18:15<33:30:56, 14.60s/it]
 78%|███████▊  | 29700/37963 [127:18:29<33:21:13, 14.53s/it]
                                                            
{'loss': '0.08198', 'grad_norm': '3.228', 'learning_rate': '2.384e-06', 'epoch': '0.7823'}

 78%|███████▊  | 29700/37963 [127:18:29<33:21:13, 14.53s/it]
 78%|███████▊  | 29701/37963 [127:18:44<33:21:12, 14.53s/it]
 78%|███████▊  | 29702/37963 [127:18:57<32:37:28, 14.22s/it]
 78%|███████▊  | 29703/37963 [127:19:11<32:40:16, 14.24s/it]
 78%|███████▊  | 29704/37963 [127:19:33<37:21:35, 16.28s/it]
 78%|███████▊  | 29705/37963 [127:19:47<36:06:12, 15.74s/it]
 78%|███████▊  | 29706/37963 [127:20:01<35:00:27, 15.26s/it]
 78%|███████▊  | 29707/37963 [127:20:16<34:24:49, 15.01s/it]
 78%|███████▊  | 29708/37963 [127:20:30<33:59:41, 14.83s/it]
 78%|███████▊  | 29709/37963 [127:20:44<33:39:49, 14.68s/it]
 78%|███████▊  | 29710/37963 [127:20:59<33:25:24, 14.58s/it]
                                                            
{'loss': '0.09044', 'grad_norm': '2.148', 'learning_rate': '2.379e-06', 'epoch': '0.7826'}

 78%|███████▊  | 29710/37963 [127:20:59<33:25:24, 14.58s/it]
 78%|███████▊  | 29711/37963 [127:21:13<33:17:40, 14.52s/it]
 78%|███████▊  | 29712/37963 [127:21:27<33:12:23, 14.49s/it]
 78%|███████▊  | 29713/37963 [127:21:48<37:25:46, 16.33s/it]
 78%|███████▊  | 29714/37963 [127:22:02<36:05:10, 15.75s/it]
 78%|███████▊  | 29715/37963 [127:22:17<35:05:23, 15.32s/it]
 78%|███████▊  | 29716/37963 [127:22:31<34:28:48, 15.05s/it]
 78%|███████▊  | 29717/37963 [127:22:45<33:56:45, 14.82s/it]
 78%|███████▊  | 29718/37963 [127:23:00<33:35:54, 14.67s/it]
 78%|███████▊  | 29719/37963 [127:23:20<37:24:55, 16.34s/it]
 78%|███████▊  | 29720/37963 [127:23:34<36:06:32, 15.77s/it]
                                                            
{'loss': '0.09785', 'grad_norm': '2.691', 'learning_rate': '2.373e-06', 'epoch': '0.7829'}

 78%|███████▊  | 29720/37963 [127:23:34<36:06:32, 15.77s/it]
 78%|███████▊  | 29721/37963 [127:23:55<39:24:42, 17.21s/it]
 78%|███████▊  | 29722/37963 [127:24:09<37:25:50, 16.35s/it]
 78%|███████▊  | 29723/37963 [127:24:24<36:08:21, 15.79s/it]
 78%|███████▊  | 29724/37963 [127:24:38<35:04:06, 15.32s/it]
 78%|███████▊  | 29725/37963 [127:24:52<34:04:27, 14.89s/it]
 78%|███████▊  | 29726/37963 [127:25:06<33:41:29, 14.72s/it]
 78%|███████▊  | 29727/37963 [127:25:21<33:25:43, 14.61s/it]
 78%|███████▊  | 29728/37963 [127:25:42<38:02:42, 16.63s/it]
 78%|███████▊  | 29729/37963 [127:25:57<36:42:54, 16.05s/it]
 78%|███████▊  | 29730/37963 [127:26:11<35:33:51, 15.55s/it]
                                                            
{'loss': '0.09478', 'grad_norm': '2.619', 'learning_rate': '2.368e-06', 'epoch': '0.7831'}

 78%|███████▊  | 29730/37963 [127:26:11<35:33:51, 15.55s/it]
 78%|███████▊  | 29731/37963 [127:26:25<34:38:35, 15.15s/it]
 78%|███████▊  | 29732/37963 [127:26:40<34:14:43, 14.98s/it]
 78%|███████▊  | 29733/37963 [127:26:54<33:25:50, 14.62s/it]
 78%|███████▊  | 29734/37963 [127:27:08<32:57:25, 14.42s/it]
 78%|███████▊  | 29735/37963 [127:27:28<37:00:37, 16.19s/it]
 78%|███████▊  | 29736/37963 [127:27:42<35:45:54, 15.65s/it]
 78%|███████▊  | 29737/37963 [127:27:56<34:31:46, 15.11s/it]
 78%|███████▊  | 29738/37963 [127:28:11<33:59:34, 14.88s/it]
 78%|███████▊  | 29739/37963 [127:28:38<42:40:02, 18.68s/it]
 78%|███████▊  | 29740/37963 [127:28:52<39:06:26, 17.12s/it]
                                                            
{'loss': '0.09327', 'grad_norm': '2.456', 'learning_rate': '2.362e-06', 'epoch': '0.7834'}

 78%|███████▊  | 29740/37963 [127:28:52<39:06:26, 17.12s/it]
 78%|███████▊  | 29741/37963 [127:29:06<37:13:35, 16.30s/it]
 78%|███████▊  | 29742/37963 [127:29:20<35:28:35, 15.54s/it]
 78%|███████▊  | 29743/37963 [127:29:34<34:43:16, 15.21s/it]
 78%|███████▊  | 29744/37963 [127:29:49<34:13:04, 14.99s/it]
 78%|███████▊  | 29745/37963 [127:30:03<33:47:13, 14.80s/it]
 78%|███████▊  | 29746/37963 [127:30:17<33:29:35, 14.67s/it]
 78%|███████▊  | 29747/37963 [127:30:32<33:18:35, 14.60s/it]
 78%|███████▊  | 29748/37963 [127:30:46<33:10:57, 14.54s/it]
 78%|███████▊  | 29749/37963 [127:31:01<33:02:16, 14.48s/it]
 78%|███████▊  | 29750/37963 [127:31:15<33:00:10, 14.47s/it]
                                                            
{'loss': '0.08717', 'grad_norm': '2.382', 'learning_rate': '2.357e-06', 'epoch': '0.7837'}

 78%|███████▊  | 29750/37963 [127:31:15<33:00:10, 14.47s/it]
 78%|███████▊  | 29751/37963 [127:31:29<32:57:36, 14.45s/it]
 78%|███████▊  | 29752/37963 [127:31:44<32:53:05, 14.42s/it]
 78%|███████▊  | 29753/37963 [127:32:05<37:15:40, 16.34s/it]
 78%|███████▊  | 29754/37963 [127:32:19<35:53:47, 15.74s/it]
 78%|███████▊  | 29755/37963 [127:32:33<34:55:40, 15.32s/it]
 78%|███████▊  | 29756/37963 [127:32:48<34:18:07, 15.05s/it]
 78%|███████▊  | 29757/37963 [127:33:02<33:52:01, 14.86s/it]
 78%|███████▊  | 29758/37963 [127:33:17<33:37:05, 14.75s/it]
 78%|███████▊  | 29759/37963 [127:33:31<33:26:22, 14.67s/it]
 78%|███████▊  | 29760/37963 [127:33:45<33:10:20, 14.56s/it]
                                                            
{'loss': '0.08374', 'grad_norm': '2.45', 'learning_rate': '2.351e-06', 'epoch': '0.7839'}

 78%|███████▊  | 29760/37963 [127:33:45<33:10:20, 14.56s/it]
 78%|███████▊  | 29761/37963 [127:34:06<37:35:24, 16.50s/it]
 78%|███████▊  | 29762/37963 [127:34:21<36:05:45, 15.85s/it]
 78%|███████▊  | 29763/37963 [127:34:35<35:02:20, 15.38s/it]
 78%|███████▊  | 29764/37963 [127:34:49<34:23:33, 15.10s/it]
 78%|███████▊  | 29765/37963 [127:35:04<33:44:48, 14.82s/it]
 78%|███████▊  | 29766/37963 [127:35:18<33:27:42, 14.70s/it]
 78%|███████▊  | 29767/37963 [127:35:38<37:09:47, 16.32s/it]
 78%|███████▊  | 29768/37963 [127:35:59<40:09:04, 17.64s/it]
 78%|███████▊  | 29769/37963 [127:36:13<38:02:01, 16.71s/it]
 78%|███████▊  | 29770/37963 [127:36:27<36:05:04, 15.86s/it]
                                                            
{'loss': '0.0818', 'grad_norm': '2.166', 'learning_rate': '2.346e-06', 'epoch': '0.7842'}

 78%|███████▊  | 29770/37963 [127:36:27<36:05:04, 15.86s/it]
 78%|███████▊  | 29771/37963 [127:36:42<35:08:08, 15.44s/it]
 78%|███████▊  | 29772/37963 [127:36:56<34:31:16, 15.17s/it]
 78%|███████▊  | 29773/37963 [127:37:11<34:01:32, 14.96s/it]
 78%|███████▊  | 29774/37963 [127:37:25<33:18:55, 14.65s/it]
 78%|███████▊  | 29775/37963 [127:37:39<33:00:05, 14.51s/it]
 78%|███████▊  | 29776/37963 [127:37:53<33:03:38, 14.54s/it]
 78%|███████▊  | 29777/37963 [127:38:08<32:55:23, 14.48s/it]
 78%|███████▊  | 29778/37963 [127:38:29<37:18:21, 16.41s/it]
 78%|███████▊  | 29779/37963 [127:38:43<35:44:48, 15.72s/it]
 78%|███████▊  | 29780/37963 [127:38:57<34:55:49, 15.37s/it]
                                                            
{'loss': '0.09449', 'grad_norm': '1.896', 'learning_rate': '2.34e-06', 'epoch': '0.7845'}

 78%|███████▊  | 29780/37963 [127:38:57<34:55:49, 15.37s/it]
 78%|███████▊  | 29781/37963 [127:39:12<34:18:49, 15.10s/it]
 78%|███████▊  | 29782/37963 [127:39:26<33:50:13, 14.89s/it]
 78%|███████▊  | 29783/37963 [127:39:41<33:31:24, 14.75s/it]
 78%|███████▊  | 29784/37963 [127:39:55<33:14:20, 14.63s/it]
 78%|███████▊  | 29785/37963 [127:40:10<33:15:10, 14.64s/it]
 78%|███████▊  | 29786/37963 [127:40:30<37:09:19, 16.36s/it]
 78%|███████▊  | 29787/37963 [127:40:44<35:40:51, 15.71s/it]
 78%|███████▊  | 29788/37963 [127:41:05<39:04:30, 17.21s/it]
 78%|███████▊  | 29789/37963 [127:41:26<41:47:36, 18.41s/it]
 78%|███████▊  | 29790/37963 [127:41:40<39:00:56, 17.19s/it]
                                                            
{'loss': '0.0817', 'grad_norm': '4.738', 'learning_rate': '2.335e-06', 'epoch': '0.7847'}

 78%|███████▊  | 29790/37963 [127:41:40<39:00:56, 17.19s/it]
 78%|███████▊  | 29791/37963 [127:41:55<37:00:44, 16.31s/it]
 78%|███████▊  | 29792/37963 [127:42:09<35:42:52, 15.74s/it]
 78%|███████▊  | 29793/37963 [127:42:24<34:48:54, 15.34s/it]
 78%|███████▊  | 29794/37963 [127:42:38<34:14:08, 15.09s/it]
 78%|███████▊  | 29795/37963 [127:42:52<33:44:44, 14.87s/it]
 78%|███████▊  | 29796/37963 [127:43:07<33:18:51, 14.68s/it]
 78%|███████▊  | 29797/37963 [127:43:21<33:10:03, 14.62s/it]
 78%|███████▊  | 29798/37963 [127:43:36<33:00:36, 14.55s/it]
 78%|███████▊  | 29799/37963 [127:43:49<32:27:26, 14.31s/it]
 78%|███████▊  | 29800/37963 [127:44:04<32:28:26, 14.32s/it]
                                                            
{'loss': '0.08391', 'grad_norm': '3.004', 'learning_rate': '2.329e-06', 'epoch': '0.785'}

 78%|███████▊  | 29800/37963 [127:44:04<32:28:26, 14.32s/it]
 79%|███████▊  | 29801/37963 [127:44:18<32:29:44, 14.33s/it]
 79%|███████▊  | 29802/37963 [127:44:32<32:04:50, 14.15s/it]
 79%|███████▊  | 29803/37963 [127:44:53<36:45:53, 16.22s/it]
 79%|███████▊  | 29804/37963 [127:45:07<35:28:20, 15.65s/it]
 79%|███████▊  | 29805/37963 [127:45:22<34:38:44, 15.29s/it]
 79%|███████▊  | 29806/37963 [127:45:35<33:39:23, 14.85s/it]
 79%|███████▊  | 29807/37963 [127:45:50<33:20:24, 14.72s/it]
 79%|███████▊  | 29808/37963 [127:46:04<32:57:41, 14.55s/it]
 79%|███████▊  | 29809/37963 [127:46:18<32:37:24, 14.40s/it]
 79%|███████▊  | 29810/37963 [127:46:32<32:29:39, 14.35s/it]
                                                            
{'loss': '0.08037', 'grad_norm': '2.674', 'learning_rate': '2.324e-06', 'epoch': '0.7852'}

 79%|███████▊  | 29810/37963 [127:46:32<32:29:39, 14.35s/it]
 79%|███████▊  | 29811/37963 [127:46:54<37:30:19, 16.56s/it]
 79%|███████▊  | 29812/37963 [127:47:08<36:02:41, 15.92s/it]
 79%|███████▊  | 29813/37963 [127:47:23<35:01:34, 15.47s/it]
 79%|███████▊  | 29814/37963 [127:47:37<34:01:07, 15.03s/it]
 79%|███████▊  | 29815/37963 [127:47:58<37:53:45, 16.74s/it]
 79%|███████▊  | 29816/37963 [127:48:18<40:41:15, 17.98s/it]
 79%|███████▊  | 29817/37963 [127:48:33<38:18:06, 16.93s/it]
 79%|███████▊  | 29818/37963 [127:48:47<36:33:11, 16.16s/it]
 79%|███████▊  | 29819/37963 [127:49:02<35:21:21, 15.63s/it]
 79%|███████▊  | 29820/37963 [127:49:16<34:30:04, 15.25s/it]
                                                            
{'loss': '0.08787', 'grad_norm': '2.454', 'learning_rate': '2.318e-06', 'epoch': '0.7855'}

 79%|███████▊  | 29820/37963 [127:49:16<34:30:04, 15.25s/it]
 79%|███████▊  | 29821/37963 [127:49:30<33:51:49, 14.97s/it]
 79%|███████▊  | 29822/37963 [127:49:44<33:06:04, 14.64s/it]
 79%|███████▊  | 29823/37963 [127:49:59<32:56:57, 14.57s/it]
 79%|███████▊  | 29824/37963 [127:50:20<37:44:55, 16.70s/it]
 79%|███████▊  | 29825/37963 [127:50:34<35:42:04, 15.79s/it]
 79%|███████▊  | 29826/37963 [127:50:48<34:36:09, 15.31s/it]
 79%|███████▊  | 29827/37963 [127:51:03<34:02:23, 15.06s/it]
 79%|███████▊  | 29828/37963 [127:51:17<33:36:59, 14.88s/it]
 79%|███████▊  | 29829/37963 [127:51:31<33:20:12, 14.75s/it]
 79%|███████▊  | 29830/37963 [127:51:46<33:05:01, 14.64s/it]
                                                            
{'loss': '0.07733', 'grad_norm': '2.654', 'learning_rate': '2.313e-06', 'epoch': '0.7858'}

 79%|███████▊  | 29830/37963 [127:51:46<33:05:01, 14.64s/it]
 79%|███████▊  | 29831/37963 [127:52:00<32:53:19, 14.56s/it]
 79%|███████▊  | 29832/37963 [127:52:15<32:46:26, 14.51s/it]
 79%|███████▊  | 29833/37963 [127:52:35<37:01:46, 16.40s/it]
 79%|███████▊  | 29834/37963 [127:52:50<35:40:56, 15.80s/it]
 79%|███████▊  | 29835/37963 [127:53:04<34:45:03, 15.39s/it]
 79%|███████▊  | 29836/37963 [127:53:25<38:17:45, 16.96s/it]
 79%|███████▊  | 29837/37963 [127:53:46<40:47:42, 18.07s/it]
 79%|███████▊  | 29838/37963 [127:54:00<38:16:41, 16.96s/it]
 79%|███████▊  | 29839/37963 [127:54:14<36:35:08, 16.21s/it]
 79%|███████▊  | 29840/37963 [127:54:29<35:19:04, 15.65s/it]
                                                            
{'loss': '0.1151', 'grad_norm': '3.927', 'learning_rate': '2.307e-06', 'epoch': '0.786'}

 79%|███████▊  | 29840/37963 [127:54:29<35:19:04, 15.65s/it]
 79%|███████▊  | 29841/37963 [127:54:43<34:28:59, 15.28s/it]
 79%|███████▊  | 29842/37963 [127:54:58<33:56:10, 15.04s/it]
 79%|███████▊  | 29843/37963 [127:55:12<33:28:51, 14.84s/it]
 79%|███████▊  | 29844/37963 [127:55:26<33:11:15, 14.72s/it]
 79%|███████▊  | 29845/37963 [127:55:41<32:58:15, 14.62s/it]
 79%|███████▊  | 29846/37963 [127:55:55<32:49:11, 14.56s/it]
 79%|███████▊  | 29847/37963 [127:56:10<32:44:14, 14.52s/it]
 79%|███████▊  | 29848/37963 [127:56:23<32:14:33, 14.30s/it]
 79%|███████▊  | 29849/37963 [127:56:38<32:21:26, 14.36s/it]
 79%|███████▊  | 29850/37963 [127:56:59<36:46:26, 16.32s/it]
                                                            
{'loss': '0.08772', 'grad_norm': '2.135', 'learning_rate': '2.302e-06', 'epoch': '0.7863'}

 79%|███████▊  | 29850/37963 [127:56:59<36:46:26, 16.32s/it]
 79%|███████▊  | 29851/37963 [127:57:13<35:33:20, 15.78s/it]
 79%|███████▊  | 29852/37963 [127:57:28<34:34:29, 15.35s/it]
 79%|███████▊  | 29853/37963 [127:57:42<33:41:25, 14.96s/it]
 79%|███████▊  | 29854/37963 [127:57:56<32:55:24, 14.62s/it]
 79%|███████▊  | 29855/37963 [127:58:10<32:35:16, 14.47s/it]
 79%|███████▊  | 29856/37963 [127:58:24<32:33:44, 14.46s/it]
 79%|███████▊  | 29857/37963 [127:58:38<32:24:44, 14.39s/it]
 79%|███████▊  | 29858/37963 [127:59:00<36:57:52, 16.42s/it]
 79%|███████▊  | 29859/37963 [127:59:14<35:33:59, 15.80s/it]
 79%|███████▊  | 29860/37963 [127:59:28<34:44:47, 15.44s/it]
                                                            
{'loss': '0.09406', 'grad_norm': '3.695', 'learning_rate': '2.296e-06', 'epoch': '0.7866'}

 79%|███████▊  | 29860/37963 [127:59:28<34:44:47, 15.44s/it]
 79%|███████▊  | 29861/37963 [127:59:43<33:54:47, 15.07s/it]
 79%|███████▊  | 29862/37963 [127:59:57<33:27:00, 14.86s/it]
 79%|███████▊  | 29863/37963 [128:00:11<33:07:06, 14.72s/it]
 79%|███████▊  | 29864/37963 [128:00:26<32:45:17, 14.56s/it]
 79%|███████▊  | 29865/37963 [128:00:46<36:58:42, 16.44s/it]
 79%|███████▊  | 29866/37963 [128:01:07<39:59:36, 17.78s/it]
 79%|███████▊  | 29867/37963 [128:01:22<37:41:06, 16.76s/it]
 79%|███████▊  | 29868/37963 [128:01:36<35:57:08, 15.99s/it]
 79%|███████▊  | 29869/37963 [128:01:50<34:52:41, 15.51s/it]
 79%|███████▊  | 29870/37963 [128:02:05<34:16:26, 15.25s/it]
                                                            
{'loss': '0.09516', 'grad_norm': '2.727', 'learning_rate': '2.291e-06', 'epoch': '0.7868'}

 79%|███████▊  | 29870/37963 [128:02:05<34:16:26, 15.25s/it]
 79%|███████▊  | 29871/37963 [128:02:19<33:25:49, 14.87s/it]
 79%|███████▊  | 29872/37963 [128:02:33<33:06:54, 14.73s/it]
 79%|███████▊  | 29873/37963 [128:02:55<37:28:09, 16.67s/it]
 79%|███████▊  | 29874/37963 [128:03:09<35:55:32, 15.99s/it]
 79%|███████▊  | 29875/37963 [128:03:23<34:39:06, 15.42s/it]
 79%|███████▊  | 29876/37963 [128:03:37<33:56:49, 15.11s/it]
 79%|███████▊  | 29877/37963 [128:03:52<33:28:43, 14.91s/it]
 79%|███████▊  | 29878/37963 [128:04:06<33:09:21, 14.76s/it]
 79%|███████▊  | 29879/37963 [128:04:21<32:54:44, 14.66s/it]
 79%|███████▊  | 29880/37963 [128:04:35<32:44:26, 14.58s/it]
                                                            
{'loss': '0.07854', 'grad_norm': '2.304', 'learning_rate': '2.285e-06', 'epoch': '0.7871'}

 79%|███████▊  | 29880/37963 [128:04:35<32:44:26, 14.58s/it]
 79%|███████▊  | 29881/37963 [128:04:50<32:54:31, 14.66s/it]
 79%|███████▊  | 29882/37963 [128:05:04<32:30:40, 14.48s/it]
 79%|███████▊  | 29883/37963 [128:05:25<36:42:53, 16.36s/it]
 79%|███████▊  | 29884/37963 [128:05:39<35:14:49, 15.71s/it]
 79%|███████▊  | 29885/37963 [128:06:00<38:52:10, 17.32s/it]
 79%|███████▊  | 29886/37963 [128:06:21<41:13:48, 18.38s/it]
 79%|███████▊  | 29887/37963 [128:06:35<38:38:47, 17.23s/it]
 79%|███████▊  | 29888/37963 [128:06:50<36:41:46, 16.36s/it]
 79%|███████▊  | 29889/37963 [128:07:04<35:20:20, 15.76s/it]
 79%|███████▊  | 29890/37963 [128:07:19<34:25:39, 15.35s/it]
                                                            
{'loss': '0.1034', 'grad_norm': '2.548', 'learning_rate': '2.28e-06', 'epoch': '0.7873'}

 79%|███████▊  | 29890/37963 [128:07:19<34:25:39, 15.35s/it]
 79%|███████▊  | 29891/37963 [128:07:32<33:15:32, 14.83s/it]
 79%|███████▊  | 29892/37963 [128:07:46<32:42:26, 14.59s/it]
 79%|███████▊  | 29893/37963 [128:08:00<32:19:12, 14.42s/it]
 79%|███████▊  | 29894/37963 [128:08:15<32:18:13, 14.41s/it]
 79%|███████▊  | 29895/37963 [128:08:29<32:16:34, 14.40s/it]
 79%|███████▉  | 29896/37963 [128:08:43<32:20:22, 14.43s/it]
 79%|███████▉  | 29897/37963 [128:08:58<32:23:41, 14.46s/it]
 79%|███████▉  | 29898/37963 [128:09:12<32:22:51, 14.45s/it]
 79%|███████▉  | 29899/37963 [128:09:27<32:19:58, 14.43s/it]
 79%|███████▉  | 29900/37963 [128:09:41<32:17:30, 14.42s/it]
                                                            
{'loss': '0.08893', 'grad_norm': '2.807', 'learning_rate': '2.275e-06', 'epoch': '0.7876'}

 79%|███████▉  | 29900/37963 [128:09:41<32:17:30, 14.42s/it]
 79%|███████▉  | 29901/37963 [128:10:02<36:30:33, 16.30s/it]
 79%|███████▉  | 29902/37963 [128:10:16<35:12:03, 15.72s/it]
 79%|███████▉  | 29903/37963 [128:10:31<34:17:01, 15.31s/it]
 79%|███████▉  | 29904/37963 [128:10:45<33:19:16, 14.88s/it]
 79%|███████▉  | 29905/37963 [128:11:06<37:27:19, 16.73s/it]
 79%|███████▉  | 29906/37963 [128:11:20<35:58:57, 16.08s/it]
 79%|███████▉  | 29907/37963 [128:11:34<34:29:05, 15.41s/it]
 79%|███████▉  | 29908/37963 [128:11:48<33:48:45, 15.11s/it]
 79%|███████▉  | 29909/37963 [128:12:03<33:17:21, 14.88s/it]
 79%|███████▉  | 29910/37963 [128:12:17<32:34:33, 14.56s/it]
                                                            
{'loss': '0.08329', 'grad_norm': '1.866', 'learning_rate': '2.269e-06', 'epoch': '0.7879'}

 79%|███████▉  | 29910/37963 [128:12:17<32:34:33, 14.56s/it]
 79%|███████▉  | 29911/37963 [128:12:30<32:08:08, 14.37s/it]
 79%|███████▉  | 29912/37963 [128:12:51<35:57:30, 16.08s/it]
 79%|███████▉  | 29913/37963 [128:13:04<34:23:47, 15.38s/it]
 79%|███████▉  | 29914/37963 [128:13:19<33:38:46, 15.05s/it]
 79%|███████▉  | 29915/37963 [128:13:40<37:38:25, 16.84s/it]
 79%|███████▉  | 29916/37963 [128:13:54<35:52:26, 16.05s/it]
 79%|███████▉  | 29917/37963 [128:14:08<34:52:34, 15.60s/it]
 79%|███████▉  | 29918/37963 [128:14:23<34:04:33, 15.25s/it]
 79%|███████▉  | 29919/37963 [128:14:37<33:21:29, 14.93s/it]
 79%|███████▉  | 29920/37963 [128:14:51<33:04:01, 14.80s/it]
                                                            
{'loss': '0.0915', 'grad_norm': '2.519', 'learning_rate': '2.264e-06', 'epoch': '0.7881'}

 79%|███████▉  | 29920/37963 [128:14:51<33:04:01, 14.80s/it]
 79%|███████▉  | 29921/37963 [128:15:13<37:21:33, 16.72s/it]
 79%|███████▉  | 29922/37963 [128:15:27<35:39:40, 15.97s/it]
 79%|███████▉  | 29923/37963 [128:15:41<34:31:45, 15.46s/it]
 79%|███████▉  | 29924/37963 [128:15:56<33:49:27, 15.15s/it]
 79%|███████▉  | 29925/37963 [128:16:10<33:11:43, 14.87s/it]
 79%|███████▉  | 29926/37963 [128:16:24<32:53:13, 14.73s/it]
 79%|███████▉  | 29927/37963 [128:16:39<32:41:37, 14.65s/it]
 79%|███████▉  | 29928/37963 [128:16:53<32:35:46, 14.60s/it]
 79%|███████▉  | 29929/37963 [128:17:08<32:33:18, 14.59s/it]
 79%|███████▉  | 29930/37963 [128:17:22<32:24:00, 14.52s/it]
                                                            
{'loss': '0.09199', 'grad_norm': '4.058', 'learning_rate': '2.258e-06', 'epoch': '0.7884'}

 79%|███████▉  | 29930/37963 [128:17:22<32:24:00, 14.52s/it]
 79%|███████▉  | 29931/37963 [128:17:42<36:14:30, 16.24s/it]
 79%|███████▉  | 29932/37963 [128:17:57<34:59:57, 15.69s/it]
 79%|███████▉  | 29933/37963 [128:18:11<33:54:37, 15.20s/it]
 79%|███████▉  | 29934/37963 [128:18:38<41:50:37, 18.76s/it]
 79%|███████▉  | 29935/37963 [128:18:52<38:41:53, 17.35s/it]
 79%|███████▉  | 29936/37963 [128:19:06<36:45:01, 16.48s/it]
 79%|███████▉  | 29937/37963 [128:19:21<35:26:55, 15.90s/it]
 79%|███████▉  | 29938/37963 [128:19:35<34:27:08, 15.46s/it]
 79%|███████▉  | 29939/37963 [128:19:50<33:37:56, 15.09s/it]
 79%|███████▉  | 29940/37963 [128:20:04<33:11:02, 14.89s/it]
                                                            
{'loss': '0.09281', 'grad_norm': '2.113', 'learning_rate': '2.253e-06', 'epoch': '0.7887'}

 79%|███████▉  | 29940/37963 [128:20:04<33:11:02, 14.89s/it]
 79%|███████▉  | 29941/37963 [128:20:18<32:52:04, 14.75s/it]
 79%|███████▉  | 29942/37963 [128:20:33<32:40:15, 14.66s/it]
 79%|███████▉  | 29943/37963 [128:20:47<32:27:27, 14.57s/it]
 79%|███████▉  | 29944/37963 [128:21:01<32:06:13, 14.41s/it]
 79%|███████▉  | 29945/37963 [128:21:16<32:06:18, 14.41s/it]
 79%|███████▉  | 29946/37963 [128:21:30<32:04:59, 14.41s/it]
 79%|███████▉  | 29947/37963 [128:21:44<32:03:03, 14.39s/it]
 79%|███████▉  | 29948/37963 [128:21:59<32:03:26, 14.40s/it]
 79%|███████▉  | 29949/37963 [128:22:13<32:05:10, 14.41s/it]
 79%|███████▉  | 29950/37963 [128:22:27<31:55:23, 14.34s/it]
                                                            
{'loss': '0.08771', 'grad_norm': '2.27', 'learning_rate': '2.248e-06', 'epoch': '0.7889'}

 79%|███████▉  | 29950/37963 [128:22:27<31:55:23, 14.34s/it]
 79%|███████▉  | 29951/37963 [128:22:42<31:53:11, 14.33s/it]
 79%|███████▉  | 29952/37963 [128:23:03<36:14:48, 16.29s/it]
 79%|███████▉  | 29953/37963 [128:23:17<34:46:08, 15.63s/it]
 79%|███████▉  | 29954/37963 [128:23:31<33:57:31, 15.26s/it]
 79%|███████▉  | 29955/37963 [128:23:52<37:23:48, 16.81s/it]
 79%|███████▉  | 29956/37963 [128:24:06<35:44:05, 16.07s/it]
 79%|███████▉  | 29957/37963 [128:24:20<34:39:11, 15.58s/it]
 79%|███████▉  | 29958/37963 [128:24:41<37:59:13, 17.08s/it]
 79%|███████▉  | 29959/37963 [128:24:55<36:13:18, 16.29s/it]
 79%|███████▉  | 29960/37963 [128:25:09<34:46:53, 15.65s/it]
                                                            
{'loss': '0.08591', 'grad_norm': '2.693', 'learning_rate': '2.242e-06', 'epoch': '0.7892'}

 79%|███████▉  | 29960/37963 [128:25:09<34:46:53, 15.65s/it]
 79%|███████▉  | 29961/37963 [128:25:24<33:44:00, 15.18s/it]
 79%|███████▉  | 29962/37963 [128:25:38<33:14:09, 14.95s/it]
 79%|███████▉  | 29963/37963 [128:25:58<36:54:29, 16.61s/it]
 79%|███████▉  | 29964/37963 [128:26:13<35:17:49, 15.89s/it]
 79%|███████▉  | 29965/37963 [128:26:27<34:17:46, 15.44s/it]
 79%|███████▉  | 29966/37963 [128:26:41<33:35:32, 15.12s/it]
 79%|███████▉  | 29967/37963 [128:26:56<33:05:17, 14.90s/it]
 79%|███████▉  | 29968/37963 [128:27:10<32:46:01, 14.75s/it]
 79%|███████▉  | 29969/37963 [128:27:25<32:30:30, 14.64s/it]
 79%|███████▉  | 29970/37963 [128:27:46<37:02:03, 16.68s/it]
                                                            
{'loss': '0.08609', 'grad_norm': '2.778', 'learning_rate': '2.237e-06', 'epoch': '0.7895'}

 79%|███████▉  | 29970/37963 [128:27:46<37:02:03, 16.68s/it]
 79%|███████▉  | 29971/37963 [128:28:01<35:33:10, 16.01s/it]
 79%|███████▉  | 29972/37963 [128:28:15<34:22:25, 15.49s/it]
 79%|███████▉  | 29973/37963 [128:28:29<33:38:55, 15.16s/it]
 79%|███████▉  | 29974/37963 [128:28:44<33:05:38, 14.91s/it]
 79%|███████▉  | 29975/37963 [128:28:57<32:25:41, 14.61s/it]
 79%|███████▉  | 29976/37963 [128:29:11<31:51:46, 14.36s/it]
 79%|███████▉  | 29977/37963 [128:29:32<36:19:31, 16.38s/it]
 79%|███████▉  | 29978/37963 [128:29:47<35:00:55, 15.79s/it]
 79%|███████▉  | 29979/37963 [128:30:01<33:55:48, 15.30s/it]
 79%|███████▉  | 29980/37963 [128:30:15<33:18:20, 15.02s/it]
                                                            
{'loss': '0.08569', 'grad_norm': '2.39', 'learning_rate': '2.231e-06', 'epoch': '0.7897'}

 79%|███████▉  | 29980/37963 [128:30:15<33:18:20, 15.02s/it]
 79%|███████▉  | 29981/37963 [128:30:30<32:57:04, 14.86s/it]
 79%|███████▉  | 29982/37963 [128:30:51<37:05:58, 16.73s/it]
 79%|███████▉  | 29983/37963 [128:31:12<40:15:38, 18.16s/it]
 79%|███████▉  | 29984/37963 [128:31:27<37:42:54, 17.02s/it]
 79%|███████▉  | 29985/37963 [128:31:41<35:50:03, 16.17s/it]
 79%|███████▉  | 29986/37963 [128:31:55<34:29:35, 15.57s/it]
 79%|███████▉  | 29987/37963 [128:32:09<33:25:10, 15.08s/it]
 79%|███████▉  | 29988/37963 [128:32:23<33:00:33, 14.90s/it]
 79%|███████▉  | 29989/37963 [128:32:38<32:36:11, 14.72s/it]
 79%|███████▉  | 29990/37963 [128:32:52<31:59:03, 14.44s/it]
                                                            
{'loss': '0.08829', 'grad_norm': '1.452', 'learning_rate': '2.226e-06', 'epoch': '0.79'}

 79%|███████▉  | 29990/37963 [128:32:52<31:59:03, 14.44s/it]
 79%|███████▉  | 29991/37963 [128:33:06<31:58:44, 14.44s/it]
 79%|███████▉  | 29992/37963 [128:33:20<31:56:11, 14.42s/it]
 79%|███████▉  | 29993/37963 [128:33:35<31:53:41, 14.41s/it]
 79%|███████▉  | 29994/37963 [128:33:49<31:42:28, 14.32s/it]
 79%|███████▉  | 29995/37963 [128:34:03<31:37:23, 14.29s/it]
 79%|███████▉  | 29996/37963 [128:34:17<31:38:56, 14.30s/it]
 79%|███████▉  | 29997/37963 [128:34:38<36:02:14, 16.29s/it]
 79%|███████▉  | 29998/37963 [128:34:53<34:49:45, 15.74s/it]
 79%|███████▉  | 29999/37963 [128:35:07<33:57:07, 15.35s/it]
 79%|███████▉  | 30000/37963 [128:35:21<33:05:29, 14.96s/it]
                                                            
{'loss': '0.08616', 'grad_norm': '2.626', 'learning_rate': '2.221e-06', 'epoch': '0.7902'}

 79%|███████▉  | 30000/37963 [128:35:21<33:05:29, 14.96s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.61s/it]
Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.62s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 79%|███████▉  | 30001/37963 [128:37:09<94:27:39, 42.71s/it]
 79%|███████▉  | 30002/37963 [128:37:30<80:15:54, 36.30s/it]
 79%|███████▉  | 30003/37963 [128:37:44<65:36:44, 29.67s/it]
 79%|███████▉  | 30004/37963 [128:37:59<55:29:50, 25.10s/it]
 79%|███████▉  | 30005/37963 [128:38:13<48:22:59, 21.89s/it]
 79%|███████▉  | 30006/37963 [128:38:27<43:24:48, 19.64s/it]
 79%|███████▉  | 30007/37963 [128:38:42<39:57:25, 18.08s/it]
 79%|███████▉  | 30008/37963 [128:38:56<37:32:32, 16.99s/it]
 79%|███████▉  | 30009/37963 [128:39:17<39:55:58, 18.07s/it]
 79%|███████▉  | 30010/37963 [128:39:31<37:29:25, 16.97s/it]
                                                            
{'loss': '0.09075', 'grad_norm': '2.901', 'learning_rate': '2.215e-06', 'epoch': '0.7905'}

 79%|███████▉  | 30010/37963 [128:39:31<37:29:25, 16.97s/it]
 79%|███████▉  | 30011/37963 [128:39:46<35:49:10, 16.22s/it]
 79%|███████▉  | 30012/37963 [128:40:07<39:10:56, 17.74s/it]
 79%|███████▉  | 30013/37963 [128:40:22<36:56:59, 16.73s/it]
 79%|███████▉  | 30014/37963 [128:40:36<35:23:36, 16.03s/it]
 79%|███████▉  | 30015/37963 [128:40:50<34:18:52, 15.54s/it]
 79%|███████▉  | 30016/37963 [128:41:05<33:33:25, 15.20s/it]
 79%|███████▉  | 30017/37963 [128:41:19<33:01:04, 14.96s/it]
 79%|███████▉  | 30018/37963 [128:41:41<37:17:28, 16.90s/it]
 79%|███████▉  | 30019/37963 [128:41:55<35:43:54, 16.19s/it]
 79%|███████▉  | 30020/37963 [128:42:09<34:20:03, 15.56s/it]
                                                            
{'loss': '0.08644', 'grad_norm': '1.96', 'learning_rate': '2.21e-06', 'epoch': '0.7908'}

 79%|███████▉  | 30020/37963 [128:42:09<34:20:03, 15.56s/it]
 79%|███████▉  | 30021/37963 [128:42:23<33:26:34, 15.16s/it]
 79%|███████▉  | 30022/37963 [128:42:38<32:52:11, 14.90s/it]
 79%|███████▉  | 30023/37963 [128:42:52<32:17:01, 14.64s/it]
 79%|███████▉  | 30024/37963 [128:43:06<32:11:21, 14.60s/it]
 79%|███████▉  | 30025/37963 [128:43:21<32:06:56, 14.56s/it]
 79%|███████▉  | 30026/37963 [128:43:35<32:02:25, 14.53s/it]
 79%|███████▉  | 30027/37963 [128:43:57<36:35:33, 16.60s/it]
 79%|███████▉  | 30028/37963 [128:44:11<35:10:45, 15.96s/it]
 79%|███████▉  | 30029/37963 [128:44:32<38:20:54, 17.40s/it]
 79%|███████▉  | 30030/37963 [128:44:46<36:23:24, 16.51s/it]
                                                            
{'loss': '0.08393', 'grad_norm': '3.072', 'learning_rate': '2.205e-06', 'epoch': '0.791'}

 79%|███████▉  | 30030/37963 [128:44:46<36:23:24, 16.51s/it]
 79%|███████▉  | 30031/37963 [128:45:07<39:29:39, 17.92s/it]
 79%|███████▉  | 30032/37963 [128:45:22<37:10:01, 16.87s/it]
 79%|███████▉  | 30033/37963 [128:45:36<35:22:45, 16.06s/it]
 79%|███████▉  | 30034/37963 [128:45:51<34:19:33, 15.58s/it]
 79%|███████▉  | 30035/37963 [128:46:05<33:37:24, 15.27s/it]
 79%|███████▉  | 30036/37963 [128:46:20<33:05:03, 15.03s/it]
 79%|███████▉  | 30037/37963 [128:46:34<32:37:32, 14.82s/it]
 79%|███████▉  | 30038/37963 [128:46:48<32:19:52, 14.69s/it]
 79%|███████▉  | 30039/37963 [128:47:03<32:06:52, 14.59s/it]
 79%|███████▉  | 30040/37963 [128:47:17<31:59:25, 14.54s/it]
                                                            
{'loss': '0.08721', 'grad_norm': '2.705', 'learning_rate': '2.199e-06', 'epoch': '0.7913'}

 79%|███████▉  | 30040/37963 [128:47:17<31:59:25, 14.54s/it]
 79%|███████▉  | 30041/37963 [128:47:31<31:56:31, 14.52s/it]
 79%|███████▉  | 30042/37963 [128:47:46<31:38:24, 14.38s/it]
 79%|███████▉  | 30043/37963 [128:48:00<31:41:30, 14.41s/it]
 79%|███████▉  | 30044/37963 [128:48:15<31:48:28, 14.46s/it]
 79%|███████▉  | 30045/37963 [128:48:29<31:47:49, 14.46s/it]
 79%|███████▉  | 30046/37963 [128:48:43<31:33:48, 14.35s/it]
 79%|███████▉  | 30047/37963 [128:48:57<31:32:56, 14.35s/it]
 79%|███████▉  | 30048/37963 [128:49:12<31:34:21, 14.36s/it]
 79%|███████▉  | 30049/37963 [128:49:33<36:06:09, 16.42s/it]
 79%|███████▉  | 30050/37963 [128:49:53<38:41:38, 17.60s/it]
                                                            
{'loss': '0.08971', 'grad_norm': '2.722', 'learning_rate': '2.194e-06', 'epoch': '0.7916'}

 79%|███████▉  | 30050/37963 [128:49:53<38:41:38, 17.60s/it]
 79%|███████▉  | 30051/37963 [128:50:08<36:34:39, 16.64s/it]
 79%|███████▉  | 30052/37963 [128:50:22<35:11:06, 16.01s/it]
 79%|███████▉  | 30053/37963 [128:50:37<34:08:52, 15.54s/it]
 79%|███████▉  | 30054/37963 [128:50:51<33:21:47, 15.19s/it]
 79%|███████▉  | 30055/37963 [128:51:06<32:53:22, 14.97s/it]
 79%|███████▉  | 30056/37963 [128:51:20<32:31:42, 14.81s/it]
 79%|███████▉  | 30057/37963 [128:51:35<32:17:07, 14.70s/it]
 79%|███████▉  | 30058/37963 [128:51:56<36:24:07, 16.58s/it]
 79%|███████▉  | 30059/37963 [128:52:10<34:57:33, 15.92s/it]
 79%|███████▉  | 30060/37963 [128:52:24<33:58:42, 15.48s/it]
                                                            
{'loss': '0.08764', 'grad_norm': '1.81', 'learning_rate': '2.189e-06', 'epoch': '0.7918'}

 79%|███████▉  | 30060/37963 [128:52:24<33:58:42, 15.48s/it]
 79%|███████▉  | 30061/37963 [128:52:39<33:14:01, 15.14s/it]
 79%|███████▉  | 30062/37963 [128:52:53<32:43:51, 14.91s/it]
 79%|███████▉  | 30063/37963 [128:53:13<36:16:53, 16.53s/it]
 79%|███████▉  | 30064/37963 [128:53:27<34:28:46, 15.71s/it]
 79%|███████▉  | 30065/37963 [128:53:42<33:37:05, 15.32s/it]
 79%|███████▉  | 30066/37963 [128:53:56<32:58:35, 15.03s/it]
 79%|███████▉  | 30067/37963 [128:54:17<37:05:03, 16.91s/it]
 79%|███████▉  | 30068/37963 [128:54:32<35:24:49, 16.15s/it]
 79%|███████▉  | 30069/37963 [128:54:46<34:15:18, 15.62s/it]
 79%|███████▉  | 30070/37963 [128:55:00<33:25:54, 15.25s/it]
                                                            
{'loss': '0.08594', 'grad_norm': '2.581', 'learning_rate': '2.183e-06', 'epoch': '0.7921'}

 79%|███████▉  | 30070/37963 [128:55:00<33:25:54, 15.25s/it]
 79%|███████▉  | 30071/37963 [128:55:15<32:49:36, 14.97s/it]
 79%|███████▉  | 30072/37963 [128:55:29<32:24:48, 14.79s/it]
 79%|███████▉  | 30073/37963 [128:55:43<31:47:16, 14.50s/it]
 79%|███████▉  | 30074/37963 [128:56:03<35:38:51, 16.27s/it]
 79%|███████▉  | 30075/37963 [128:56:18<34:23:41, 15.70s/it]
 79%|███████▉  | 30076/37963 [128:56:32<33:33:38, 15.32s/it]
 79%|███████▉  | 30077/37963 [128:56:46<32:49:29, 14.98s/it]
 79%|███████▉  | 30078/37963 [128:57:01<32:26:14, 14.81s/it]
 79%|███████▉  | 30079/37963 [128:57:15<32:10:24, 14.69s/it]
 79%|███████▉  | 30080/37963 [128:57:43<40:48:26, 18.64s/it]
                                                            
{'loss': '0.07707', 'grad_norm': '3.483', 'learning_rate': '2.178e-06', 'epoch': '0.7924'}

 79%|███████▉  | 30080/37963 [128:57:43<40:48:26, 18.64s/it]
 79%|███████▉  | 30081/37963 [128:57:57<37:42:52, 17.23s/it]
 79%|███████▉  | 30082/37963 [128:58:11<35:53:46, 16.40s/it]
 79%|███████▉  | 30083/37963 [128:58:26<34:35:28, 15.80s/it]
 79%|███████▉  | 30084/37963 [128:58:40<33:42:03, 15.40s/it]
 79%|███████▉  | 30085/37963 [128:58:55<33:01:27, 15.09s/it]
 79%|███████▉  | 30086/37963 [128:59:09<32:34:56, 14.89s/it]
 79%|███████▉  | 30087/37963 [128:59:23<32:03:11, 14.65s/it]
 79%|███████▉  | 30088/37963 [128:59:37<31:41:43, 14.49s/it]
 79%|███████▉  | 30089/37963 [128:59:52<31:41:37, 14.49s/it]
 79%|███████▉  | 30090/37963 [129:00:06<31:35:50, 14.45s/it]
                                                            
{'loss': '0.09225', 'grad_norm': '2.477', 'learning_rate': '2.173e-06', 'epoch': '0.7926'}

 79%|███████▉  | 30090/37963 [129:00:06<31:35:50, 14.45s/it]
 79%|███████▉  | 30091/37963 [129:00:20<31:14:36, 14.29s/it]
 79%|███████▉  | 30092/37963 [129:00:34<31:16:20, 14.30s/it]
 79%|███████▉  | 30093/37963 [129:00:49<31:17:45, 14.32s/it]
 79%|███████▉  | 30094/37963 [129:01:03<31:23:46, 14.36s/it]
 79%|███████▉  | 30095/37963 [129:01:17<31:08:44, 14.25s/it]
 79%|███████▉  | 30096/37963 [129:01:32<31:18:46, 14.33s/it]
 79%|███████▉  | 30097/37963 [129:01:46<31:16:42, 14.32s/it]
 79%|███████▉  | 30098/37963 [129:02:07<35:40:05, 16.33s/it]
 79%|███████▉  | 30099/37963 [129:02:29<39:19:51, 18.01s/it]
 79%|███████▉  | 30100/37963 [129:02:42<36:24:16, 16.67s/it]
                                                            
{'loss': '0.08523', 'grad_norm': '1.763', 'learning_rate': '2.167e-06', 'epoch': '0.7929'}

 79%|███████▉  | 30100/37963 [129:02:42<36:24:16, 16.67s/it]
 79%|███████▉  | 30101/37963 [129:02:56<34:40:21, 15.88s/it]
 79%|███████▉  | 30102/37963 [129:03:11<33:45:35, 15.46s/it]
 79%|███████▉  | 30103/37963 [129:03:25<33:08:12, 15.18s/it]
 79%|███████▉  | 30104/37963 [129:03:40<32:31:44, 14.90s/it]
 79%|███████▉  | 30105/37963 [129:03:54<32:10:46, 14.74s/it]
 79%|███████▉  | 30106/37963 [129:04:08<31:35:50, 14.48s/it]
 79%|███████▉  | 30107/37963 [129:04:29<35:43:23, 16.37s/it]
 79%|███████▉  | 30108/37963 [129:04:43<34:26:03, 15.78s/it]
 79%|███████▉  | 30109/37963 [129:04:57<33:12:13, 15.22s/it]
 79%|███████▉  | 30110/37963 [129:05:11<32:38:23, 14.96s/it]
                                                            
{'loss': '0.09826', 'grad_norm': '3.272', 'learning_rate': '2.162e-06', 'epoch': '0.7931'}

 79%|███████▉  | 30110/37963 [129:05:11<32:38:23, 14.96s/it]
 79%|███████▉  | 30111/37963 [129:05:26<32:15:30, 14.79s/it]
 79%|███████▉  | 30112/37963 [129:05:40<32:06:30, 14.72s/it]
 79%|███████▉  | 30113/37963 [129:06:01<36:10:31, 16.59s/it]
 79%|███████▉  | 30114/37963 [129:06:15<34:30:41, 15.83s/it]
 79%|███████▉  | 30115/37963 [129:06:29<33:20:49, 15.30s/it]
 79%|███████▉  | 30116/37963 [129:06:51<37:26:40, 17.18s/it]
 79%|███████▉  | 30117/37963 [129:07:05<35:40:27, 16.37s/it]
 79%|███████▉  | 30118/37963 [129:07:20<34:15:58, 15.72s/it]
 79%|███████▉  | 30119/37963 [129:07:33<32:56:58, 15.12s/it]
 79%|███████▉  | 30120/37963 [129:07:48<32:20:56, 14.85s/it]
                                                            
{'loss': '0.07591', 'grad_norm': '3.664', 'learning_rate': '2.157e-06', 'epoch': '0.7934'}

 79%|███████▉  | 30120/37963 [129:07:48<32:20:56, 14.85s/it]
 79%|███████▉  | 30121/37963 [129:08:02<32:02:20, 14.71s/it]
 79%|███████▉  | 30122/37963 [129:08:17<31:56:23, 14.66s/it]
 79%|███████▉  | 30123/37963 [129:08:37<35:53:23, 16.48s/it]
 79%|███████▉  | 30124/37963 [129:08:52<34:36:10, 15.89s/it]
 79%|███████▉  | 30125/37963 [129:09:06<33:42:36, 15.48s/it]
 79%|███████▉  | 30126/37963 [129:09:21<33:03:23, 15.18s/it]
 79%|███████▉  | 30127/37963 [129:09:35<32:35:48, 14.98s/it]
 79%|███████▉  | 30128/37963 [129:09:56<36:27:36, 16.75s/it]
 79%|███████▉  | 30129/37963 [129:10:11<34:54:26, 16.04s/it]
 79%|███████▉  | 30130/37963 [129:10:25<33:50:50, 15.56s/it]
                                                            
{'loss': '0.09184', 'grad_norm': '3.049', 'learning_rate': '2.152e-06', 'epoch': '0.7937'}

 79%|███████▉  | 30130/37963 [129:10:25<33:50:50, 15.56s/it]
 79%|███████▉  | 30131/37963 [129:10:47<37:46:49, 17.37s/it]
 79%|███████▉  | 30132/37963 [129:11:00<35:25:36, 16.29s/it]
 79%|███████▉  | 30133/37963 [129:11:15<34:11:13, 15.72s/it]
 79%|███████▉  | 30134/37963 [129:11:29<33:19:23, 15.32s/it]
 79%|███████▉  | 30135/37963 [129:11:44<32:43:23, 15.05s/it]
 79%|███████▉  | 30136/37963 [129:11:57<31:49:34, 14.64s/it]
 79%|███████▉  | 30137/37963 [129:12:12<31:38:53, 14.56s/it]
 79%|███████▉  | 30138/37963 [129:12:26<31:24:18, 14.45s/it]
 79%|███████▉  | 30139/37963 [129:12:40<31:00:23, 14.27s/it]
 79%|███████▉  | 30140/37963 [129:12:54<31:03:43, 14.29s/it]
                                                            
{'loss': '0.08338', 'grad_norm': '2.878', 'learning_rate': '2.146e-06', 'epoch': '0.7939'}

 79%|███████▉  | 30140/37963 [129:12:54<31:03:43, 14.29s/it]
 79%|███████▉  | 30141/37963 [129:13:08<31:07:10, 14.32s/it]
 79%|███████▉  | 30142/37963 [129:13:23<31:13:39, 14.37s/it]
 79%|███████▉  | 30143/37963 [129:13:37<31:10:23, 14.35s/it]
 79%|███████▉  | 30144/37963 [129:13:52<31:10:41, 14.35s/it]
 79%|███████▉  | 30145/37963 [129:14:06<31:10:34, 14.36s/it]
 79%|███████▉  | 30146/37963 [129:14:27<35:23:19, 16.30s/it]
 79%|███████▉  | 30147/37963 [129:14:41<33:53:01, 15.61s/it]
 79%|███████▉  | 30148/37963 [129:15:02<37:48:36, 17.42s/it]
 79%|███████▉  | 30149/37963 [129:15:17<35:51:19, 16.52s/it]
 79%|███████▉  | 30150/37963 [129:15:31<34:17:31, 15.80s/it]
                                                            
{'loss': '0.08268', 'grad_norm': '2.319', 'learning_rate': '2.141e-06', 'epoch': '0.7942'}

 79%|███████▉  | 30150/37963 [129:15:31<34:17:31, 15.80s/it]
 79%|███████▉  | 30151/37963 [129:15:45<33:15:18, 15.32s/it]
 79%|███████▉  | 30152/37963 [129:16:00<32:37:53, 15.04s/it]
 79%|███████▉  | 30153/37963 [129:16:14<32:12:31, 14.85s/it]
 79%|███████▉  | 30154/37963 [129:16:28<31:51:24, 14.69s/it]
 79%|███████▉  | 30155/37963 [129:16:43<31:37:06, 14.58s/it]
 79%|███████▉  | 30156/37963 [129:16:57<31:28:17, 14.51s/it]
 79%|███████▉  | 30157/37963 [129:17:18<35:33:51, 16.40s/it]
 79%|███████▉  | 30158/37963 [129:17:32<34:15:48, 15.80s/it]
 79%|███████▉  | 30159/37963 [129:17:47<33:23:28, 15.40s/it]
 79%|███████▉  | 30160/37963 [129:18:01<32:35:20, 15.04s/it]
                                                            
{'loss': '0.08665', 'grad_norm': '2.446', 'learning_rate': '2.136e-06', 'epoch': '0.7945'}

 79%|███████▉  | 30160/37963 [129:18:01<32:35:20, 15.04s/it]
 79%|███████▉  | 30161/37963 [129:18:15<32:15:20, 14.88s/it]
 79%|███████▉  | 30162/37963 [129:18:30<31:57:46, 14.75s/it]
 79%|███████▉  | 30163/37963 [129:18:44<31:30:06, 14.54s/it]
 79%|███████▉  | 30164/37963 [129:19:05<35:31:35, 16.40s/it]
 79%|███████▉  | 30165/37963 [129:19:26<38:48:41, 17.92s/it]
 79%|███████▉  | 30166/37963 [129:19:40<36:32:21, 16.87s/it]
 79%|███████▉  | 30167/37963 [129:19:54<34:32:24, 15.95s/it]
 79%|███████▉  | 30168/37963 [129:20:09<33:35:40, 15.52s/it]
 79%|███████▉  | 30169/37963 [129:20:23<32:51:38, 15.18s/it]
 79%|███████▉  | 30170/37963 [129:20:37<32:18:44, 14.93s/it]
                                                            
{'loss': '0.07774', 'grad_norm': '2.397', 'learning_rate': '2.13e-06', 'epoch': '0.7947'}

 79%|███████▉  | 30170/37963 [129:20:37<32:18:44, 14.93s/it]
 79%|███████▉  | 30171/37963 [129:20:52<31:59:10, 14.78s/it]
 79%|███████▉  | 30172/37963 [129:21:06<31:43:42, 14.66s/it]
 79%|███████▉  | 30173/37963 [129:21:21<31:33:28, 14.58s/it]
 79%|███████▉  | 30174/37963 [129:21:41<35:24:30, 16.37s/it]
 79%|███████▉  | 30175/37963 [129:21:56<34:06:53, 15.77s/it]
 79%|███████▉  | 30176/37963 [129:22:17<37:33:48, 17.37s/it]
 79%|███████▉  | 30177/37963 [129:22:30<35:11:08, 16.27s/it]
 79%|███████▉  | 30178/37963 [129:22:45<33:56:38, 15.70s/it]
 79%|███████▉  | 30179/37963 [129:22:59<33:09:23, 15.33s/it]
 79%|███████▉  | 30180/37963 [129:23:13<32:11:11, 14.89s/it]
                                                            
{'loss': '0.08699', 'grad_norm': '2.118', 'learning_rate': '2.125e-06', 'epoch': '0.795'}

 79%|███████▉  | 30180/37963 [129:23:13<32:11:11, 14.89s/it]
 80%|███████▉  | 30181/37963 [129:23:27<31:49:43, 14.72s/it]
 80%|███████▉  | 30182/37963 [129:23:48<35:55:16, 16.62s/it]
 80%|███████▉  | 30183/37963 [129:24:03<34:29:36, 15.96s/it]
 80%|███████▉  | 30184/37963 [129:24:17<33:35:21, 15.54s/it]
 80%|███████▉  | 30185/37963 [129:24:32<32:48:07, 15.18s/it]
 80%|███████▉  | 30186/37963 [129:24:46<32:18:33, 14.96s/it]
 80%|███████▉  | 30187/37963 [129:25:00<31:29:57, 14.58s/it]
 80%|███████▉  | 30188/37963 [129:25:14<31:19:19, 14.50s/it]
 80%|███████▉  | 30189/37963 [129:25:29<31:14:49, 14.47s/it]
 80%|███████▉  | 30190/37963 [129:25:43<31:19:43, 14.51s/it]
                                                            
{'loss': '0.08707', 'grad_norm': '3.417', 'learning_rate': '2.12e-06', 'epoch': '0.7953'}

 80%|███████▉  | 30190/37963 [129:25:43<31:19:43, 14.51s/it]
 80%|███████▉  | 30191/37963 [129:25:58<31:12:56, 14.46s/it]
 80%|███████▉  | 30192/37963 [129:26:11<30:50:42, 14.29s/it]
 80%|███████▉  | 30193/37963 [129:26:26<30:52:51, 14.31s/it]
 80%|███████▉  | 30194/37963 [129:26:40<30:58:58, 14.36s/it]
 80%|███████▉  | 30195/37963 [129:27:01<35:20:11, 16.38s/it]
 80%|███████▉  | 30196/37963 [129:27:22<38:07:53, 17.67s/it]
 80%|███████▉  | 30197/37963 [129:27:36<35:56:56, 16.66s/it]
 80%|███████▉  | 30198/37963 [129:27:51<34:28:01, 15.98s/it]
 80%|███████▉  | 30199/37963 [129:28:05<33:25:43, 15.50s/it]
 80%|███████▉  | 30200/37963 [129:28:19<32:24:13, 15.03s/it]
                                                            
{'loss': '0.09', 'grad_norm': '2.363', 'learning_rate': '2.115e-06', 'epoch': '0.7955'}

 80%|███████▉  | 30200/37963 [129:28:19<32:24:13, 15.03s/it]
 80%|███████▉  | 30201/37963 [129:28:33<31:57:40, 14.82s/it]
 80%|███████▉  | 30202/37963 [129:28:48<31:43:45, 14.72s/it]
 80%|███████▉  | 30203/37963 [129:29:02<31:25:10, 14.58s/it]
 80%|███████▉  | 30204/37963 [129:29:16<31:02:52, 14.41s/it]
 80%|███████▉  | 30205/37963 [129:29:31<31:08:00, 14.45s/it]
 80%|███████▉  | 30206/37963 [129:29:52<35:19:01, 16.39s/it]
 80%|███████▉  | 30207/37963 [129:30:06<33:59:43, 15.78s/it]
 80%|███████▉  | 30208/37963 [129:30:20<33:09:53, 15.40s/it]
 80%|███████▉  | 30209/37963 [129:30:35<32:31:59, 15.10s/it]
 80%|███████▉  | 30210/37963 [129:30:49<32:02:42, 14.88s/it]
                                                            
{'loss': '0.08577', 'grad_norm': '2.978', 'learning_rate': '2.109e-06', 'epoch': '0.7958'}

 80%|███████▉  | 30210/37963 [129:30:49<32:02:42, 14.88s/it]
 80%|███████▉  | 30211/37963 [129:31:04<31:43:14, 14.73s/it]
 80%|███████▉  | 30212/37963 [129:31:24<35:33:29, 16.52s/it]
 80%|███████▉  | 30213/37963 [129:31:39<34:12:03, 15.89s/it]
 80%|███████▉  | 30214/37963 [129:32:00<37:33:32, 17.45s/it]
 80%|███████▉  | 30215/37963 [129:32:14<35:33:38, 16.52s/it]
 80%|███████▉  | 30216/37963 [129:32:28<34:00:00, 15.80s/it]
 80%|███████▉  | 30217/37963 [129:32:43<33:03:09, 15.36s/it]
 80%|███████▉  | 30218/37963 [129:32:57<32:23:52, 15.06s/it]
 80%|███████▉  | 30219/37963 [129:33:11<31:54:42, 14.83s/it]
 80%|███████▉  | 30220/37963 [129:33:26<31:35:38, 14.69s/it]
                                                            
{'loss': '0.085', 'grad_norm': '3.443', 'learning_rate': '2.104e-06', 'epoch': '0.796'}

 80%|███████▉  | 30220/37963 [129:33:26<31:35:38, 14.69s/it]
 80%|███████▉  | 30221/37963 [129:33:40<31:25:16, 14.61s/it]
 80%|███████▉  | 30222/37963 [129:33:54<31:15:49, 14.54s/it]
 80%|███████▉  | 30223/37963 [129:34:09<31:10:24, 14.50s/it]
 80%|███████▉  | 30224/37963 [129:34:30<35:22:25, 16.46s/it]
 80%|███████▉  | 30225/37963 [129:34:44<33:48:36, 15.73s/it]
 80%|███████▉  | 30226/37963 [129:35:04<36:42:44, 17.08s/it]
 80%|███████▉  | 30227/37963 [129:35:19<35:01:37, 16.30s/it]
 80%|███████▉  | 30228/37963 [129:35:33<33:47:37, 15.73s/it]
 80%|███████▉  | 30229/37963 [129:35:54<37:23:44, 17.41s/it]
 80%|███████▉  | 30230/37963 [129:36:09<35:29:07, 16.52s/it]
                                                            
{'loss': '0.09014', 'grad_norm': '3.125', 'learning_rate': '2.099e-06', 'epoch': '0.7963'}

 80%|███████▉  | 30230/37963 [129:36:09<35:29:07, 16.52s/it]
 80%|███████▉  | 30231/37963 [129:36:23<33:49:28, 15.75s/it]
 80%|███████▉  | 30232/37963 [129:36:37<32:55:31, 15.33s/it]
 80%|███████▉  | 30233/37963 [129:36:51<32:04:28, 14.94s/it]
 80%|███████▉  | 30234/37963 [129:37:06<31:42:53, 14.77s/it]
 80%|███████▉  | 30235/37963 [129:37:19<31:03:57, 14.47s/it]
 80%|███████▉  | 30236/37963 [129:37:34<31:00:46, 14.45s/it]
 80%|███████▉  | 30237/37963 [129:37:48<31:02:55, 14.47s/it]
 80%|███████▉  | 30238/37963 [129:38:03<31:08:09, 14.51s/it]
 80%|███████▉  | 30239/37963 [129:38:17<31:00:03, 14.45s/it]
 80%|███████▉  | 30240/37963 [129:38:31<30:44:03, 14.33s/it]
                                                            
{'loss': '0.09181', 'grad_norm': '2.806', 'learning_rate': '2.094e-06', 'epoch': '0.7966'}

 80%|███████▉  | 30240/37963 [129:38:31<30:44:03, 14.33s/it]
 80%|███████▉  | 30241/37963 [129:38:46<30:45:09, 14.34s/it]
 80%|███████▉  | 30242/37963 [129:39:00<30:50:41, 14.38s/it]
 80%|███████▉  | 30243/37963 [129:39:14<30:44:16, 14.33s/it]
 80%|███████▉  | 30244/37963 [129:39:29<30:46:27, 14.35s/it]
 80%|███████▉  | 30245/37963 [129:39:50<35:21:38, 16.49s/it]
 80%|███████▉  | 30246/37963 [129:40:05<34:03:37, 15.89s/it]
 80%|███████▉  | 30247/37963 [129:40:25<37:13:19, 17.37s/it]
 80%|███████▉  | 30248/37963 [129:40:39<35:03:16, 16.36s/it]
 80%|███████▉  | 30249/37963 [129:40:53<33:22:54, 15.58s/it]
 80%|███████▉  | 30250/37963 [129:41:07<32:22:24, 15.11s/it]
                                                            
{'loss': '0.08854', 'grad_norm': '3.401', 'learning_rate': '2.089e-06', 'epoch': '0.7968'}

 80%|███████▉  | 30250/37963 [129:41:07<32:22:24, 15.11s/it]
 80%|███████▉  | 30251/37963 [129:41:22<31:59:20, 14.93s/it]
 80%|███████▉  | 30252/37963 [129:41:36<31:18:43, 14.62s/it]
 80%|███████▉  | 30253/37963 [129:41:50<31:15:01, 14.59s/it]
 80%|███████▉  | 30254/37963 [129:42:05<31:07:48, 14.54s/it]
 80%|███████▉  | 30255/37963 [129:42:25<35:07:57, 16.41s/it]
 80%|███████▉  | 30256/37963 [129:42:39<33:34:47, 15.69s/it]
 80%|███████▉  | 30257/37963 [129:42:54<32:46:19, 15.31s/it]
 80%|███████▉  | 30258/37963 [129:43:08<32:11:33, 15.04s/it]
 80%|███████▉  | 30259/37963 [129:43:23<31:45:44, 14.84s/it]
 80%|███████▉  | 30260/37963 [129:43:37<31:29:13, 14.72s/it]
                                                            
{'loss': '0.07751', 'grad_norm': '1.792', 'learning_rate': '2.083e-06', 'epoch': '0.7971'}

 80%|███████▉  | 30260/37963 [129:43:37<31:29:13, 14.72s/it]
 80%|███████▉  | 30261/37963 [129:43:58<35:15:18, 16.48s/it]
 80%|███████▉  | 30262/37963 [129:44:19<38:38:24, 18.06s/it]
 80%|███████▉  | 30263/37963 [129:44:33<35:48:19, 16.74s/it]
 80%|███████▉  | 30264/37963 [129:44:47<34:17:42, 16.04s/it]
 80%|███████▉  | 30265/37963 [129:45:02<33:17:41, 15.57s/it]
 80%|███████▉  | 30266/37963 [129:45:16<32:36:52, 15.25s/it]
 80%|███████▉  | 30267/37963 [129:45:31<31:56:50, 14.94s/it]
 80%|███████▉  | 30268/37963 [129:45:45<31:26:24, 14.71s/it]
 80%|███████▉  | 30269/37963 [129:45:59<31:01:29, 14.52s/it]
 80%|███████▉  | 30270/37963 [129:46:13<30:38:19, 14.34s/it]
                                                            
{'loss': '0.0835', 'grad_norm': '2.446', 'learning_rate': '2.078e-06', 'epoch': '0.7974'}

 80%|███████▉  | 30270/37963 [129:46:13<30:38:19, 14.34s/it]
 80%|███████▉  | 30271/37963 [129:46:27<30:45:20, 14.39s/it]
 80%|███████▉  | 30272/37963 [129:46:42<30:48:01, 14.42s/it]
 80%|███████▉  | 30273/37963 [129:47:03<35:01:10, 16.39s/it]
 80%|███████▉  | 30274/37963 [129:47:24<37:52:45, 17.74s/it]
 80%|███████▉  | 30275/37963 [129:47:38<35:43:18, 16.73s/it]
 80%|███████▉  | 30276/37963 [129:47:52<34:13:10, 16.03s/it]
 80%|███████▉  | 30277/37963 [129:48:13<36:55:26, 17.29s/it]
 80%|███████▉  | 30278/37963 [129:48:27<35:03:31, 16.42s/it]
 80%|███████▉  | 30279/37963 [129:48:41<33:46:13, 15.82s/it]
 80%|███████▉  | 30280/37963 [129:48:55<32:37:13, 15.28s/it]
                                                            
{'loss': '0.09353', 'grad_norm': '4.031', 'learning_rate': '2.073e-06', 'epoch': '0.7976'}

 80%|███████▉  | 30280/37963 [129:48:55<32:37:13, 15.28s/it]
 80%|███████▉  | 30281/37963 [129:49:09<31:41:26, 14.85s/it]
 80%|███████▉  | 30282/37963 [129:49:23<31:16:46, 14.66s/it]
 80%|███████▉  | 30283/37963 [129:49:38<31:07:23, 14.59s/it]
 80%|███████▉  | 30284/37963 [129:49:52<30:33:04, 14.32s/it]
 80%|███████▉  | 30285/37963 [129:50:06<30:27:02, 14.28s/it]
 80%|███████▉  | 30286/37963 [129:50:20<30:29:51, 14.30s/it]
 80%|███████▉  | 30287/37963 [129:50:34<30:10:51, 14.15s/it]
 80%|███████▉  | 30288/37963 [129:50:48<30:07:15, 14.13s/it]
 80%|███████▉  | 30289/37963 [129:51:02<30:17:01, 14.21s/it]
 80%|███████▉  | 30290/37963 [129:51:16<30:03:39, 14.10s/it]
                                                            
{'loss': '0.08051', 'grad_norm': '2.977', 'learning_rate': '2.068e-06', 'epoch': '0.7979'}

 80%|███████▉  | 30290/37963 [129:51:16<30:03:39, 14.10s/it]
 80%|███████▉  | 30291/37963 [129:51:31<30:13:24, 14.18s/it]
 80%|███████▉  | 30292/37963 [129:51:45<30:23:28, 14.26s/it]
 80%|███████▉  | 30293/37963 [129:52:00<30:31:35, 14.33s/it]
 80%|███████▉  | 30294/37963 [129:52:21<34:52:30, 16.37s/it]
 80%|███████▉  | 30295/37963 [129:52:35<33:39:18, 15.80s/it]
 80%|███████▉  | 30296/37963 [129:52:56<37:04:12, 17.41s/it]
 80%|███████▉  | 30297/37963 [129:53:11<35:13:37, 16.54s/it]
 80%|███████▉  | 30298/37963 [129:53:25<33:54:20, 15.92s/it]
 80%|███████▉  | 30299/37963 [129:53:40<32:56:38, 15.47s/it]
 80%|███████▉  | 30300/37963 [129:53:54<32:17:08, 15.17s/it]
                                                            
{'loss': '0.09099', 'grad_norm': '2.64', 'learning_rate': '2.062e-06', 'epoch': '0.7981'}

 80%|███████▉  | 30300/37963 [129:53:54<32:17:08, 15.17s/it]
 80%|███████▉  | 30301/37963 [129:54:09<31:57:14, 15.01s/it]
 80%|███████▉  | 30302/37963 [129:54:23<31:20:14, 14.73s/it]
 80%|███████▉  | 30303/37963 [129:54:44<35:07:20, 16.51s/it]
 80%|███████▉  | 30304/37963 [129:54:58<33:49:48, 15.90s/it]
 80%|███████▉  | 30305/37963 [129:55:13<32:56:27, 15.49s/it]
 80%|███████▉  | 30306/37963 [129:55:27<32:16:54, 15.18s/it]
 80%|███████▉  | 30307/37963 [129:55:41<31:47:22, 14.95s/it]
 80%|███████▉  | 30308/37963 [129:55:55<31:07:52, 14.64s/it]
 80%|███████▉  | 30309/37963 [129:56:10<30:58:44, 14.57s/it]
 80%|███████▉  | 30310/37963 [129:56:31<35:30:50, 16.71s/it]
                                                            
{'loss': '0.09336', 'grad_norm': '2.964', 'learning_rate': '2.057e-06', 'epoch': '0.7984'}

 80%|███████▉  | 30310/37963 [129:56:31<35:30:50, 16.71s/it]
 80%|███████▉  | 30311/37963 [129:56:52<37:54:47, 17.84s/it]
 80%|███████▉  | 30312/37963 [129:57:06<35:28:26, 16.69s/it]
 80%|███████▉  | 30313/37963 [129:57:20<33:58:24, 15.99s/it]
 80%|███████▉  | 30314/37963 [129:57:34<32:41:57, 15.39s/it]
 80%|███████▉  | 30315/37963 [129:57:48<31:48:46, 14.97s/it]
 80%|███████▉  | 30316/37963 [129:58:02<31:00:38, 14.60s/it]
 80%|███████▉  | 30317/37963 [129:58:16<30:51:48, 14.53s/it]
 80%|███████▉  | 30318/37963 [129:58:31<30:45:48, 14.49s/it]
 80%|███████▉  | 30319/37963 [129:58:45<30:36:31, 14.42s/it]
 80%|███████▉  | 30320/37963 [129:58:59<30:34:17, 14.40s/it]
                                                            
{'loss': '0.08781', 'grad_norm': '2.731', 'learning_rate': '2.052e-06', 'epoch': '0.7987'}

 80%|███████▉  | 30320/37963 [129:58:59<30:34:17, 14.40s/it]
 80%|███████▉  | 30321/37963 [129:59:14<30:33:32, 14.40s/it]
 80%|███████▉  | 30322/37963 [129:59:35<34:45:20, 16.37s/it]
 80%|███████▉  | 30323/37963 [129:59:49<33:21:23, 15.72s/it]
 80%|███████▉  | 30324/37963 [130:00:10<36:34:08, 17.23s/it]
 80%|███████▉  | 30325/37963 [130:00:24<34:37:58, 16.32s/it]
 80%|███████▉  | 30326/37963 [130:00:45<37:40:15, 17.76s/it]
 80%|███████▉  | 30327/37963 [130:00:59<35:31:31, 16.75s/it]
 80%|███████▉  | 30328/37963 [130:01:14<33:59:08, 16.02s/it]
 80%|███████▉  | 30329/37963 [130:01:28<32:50:23, 15.49s/it]
 80%|███████▉  | 30330/37963 [130:01:42<31:51:05, 15.02s/it]
                                                            
{'loss': '0.08577', 'grad_norm': '3.169', 'learning_rate': '2.047e-06', 'epoch': '0.7989'}

 80%|███████▉  | 30330/37963 [130:01:42<31:51:05, 15.02s/it]
 80%|███████▉  | 30331/37963 [130:01:56<31:26:08, 14.83s/it]
 80%|███████▉  | 30332/37963 [130:02:11<31:13:00, 14.73s/it]
 80%|███████▉  | 30333/37963 [130:02:24<30:27:58, 14.37s/it]
 80%|███████▉  | 30334/37963 [130:02:38<30:17:56, 14.30s/it]
 80%|███████▉  | 30335/37963 [130:02:53<30:32:14, 14.41s/it]
 80%|███████▉  | 30336/37963 [130:03:07<30:17:11, 14.30s/it]
 80%|███████▉  | 30337/37963 [130:03:21<30:16:50, 14.29s/it]
 80%|███████▉  | 30338/37963 [130:03:36<30:09:36, 14.24s/it]
 80%|███████▉  | 30339/37963 [130:03:50<30:19:03, 14.32s/it]
 80%|███████▉  | 30340/37963 [130:04:04<30:19:27, 14.32s/it]
                                                            
{'loss': '0.0972', 'grad_norm': '3.219', 'learning_rate': '2.042e-06', 'epoch': '0.7992'}

 80%|███████▉  | 30340/37963 [130:04:04<30:19:27, 14.32s/it]
 80%|███████▉  | 30341/37963 [130:04:19<30:13:39, 14.28s/it]
 80%|███████▉  | 30342/37963 [130:04:33<30:12:18, 14.27s/it]
 80%|███████▉  | 30343/37963 [130:04:54<34:34:42, 16.34s/it]
 80%|███████▉  | 30344/37963 [130:05:14<37:10:04, 17.56s/it]
 80%|███████▉  | 30345/37963 [130:05:29<35:10:52, 16.63s/it]
 80%|███████▉  | 30346/37963 [130:05:43<33:48:20, 15.98s/it]
 80%|███████▉  | 30347/37963 [130:05:58<32:49:35, 15.52s/it]
 80%|███████▉  | 30348/37963 [130:06:12<32:07:16, 15.19s/it]
 80%|███████▉  | 30349/37963 [130:06:33<35:22:43, 16.73s/it]
 80%|███████▉  | 30350/37963 [130:06:47<33:42:16, 15.94s/it]
                                                            
{'loss': '0.08743', 'grad_norm': '2.721', 'learning_rate': '2.037e-06', 'epoch': '0.7995'}

 80%|███████▉  | 30350/37963 [130:06:47<33:42:16, 15.94s/it]
 80%|███████▉  | 30351/37963 [130:07:01<32:36:23, 15.42s/it]
 80%|███████▉  | 30352/37963 [130:07:15<32:02:55, 15.16s/it]
 80%|███████▉  | 30353/37963 [130:07:29<31:21:47, 14.84s/it]
 80%|███████▉  | 30354/37963 [130:07:44<31:02:55, 14.69s/it]
 80%|███████▉  | 30355/37963 [130:07:58<30:52:58, 14.61s/it]
 80%|███████▉  | 30356/37963 [130:08:13<30:46:21, 14.56s/it]
 80%|███████▉  | 30357/37963 [130:08:33<34:39:48, 16.41s/it]
 80%|███████▉  | 30358/37963 [130:08:55<37:51:16, 17.92s/it]
 80%|███████▉  | 30359/37963 [130:09:09<35:39:14, 16.88s/it]
 80%|███████▉  | 30360/37963 [130:09:24<34:07:04, 16.15s/it]
                                                            
{'loss': '0.08432', 'grad_norm': '2.945', 'learning_rate': '2.031e-06', 'epoch': '0.7997'}

 80%|███████▉  | 30360/37963 [130:09:24<34:07:04, 16.15s/it]
 80%|███████▉  | 30361/37963 [130:09:38<32:48:15, 15.53s/it]
 80%|███████▉  | 30362/37963 [130:09:52<32:09:30, 15.23s/it]
 80%|███████▉  | 30363/37963 [130:10:07<31:39:31, 15.00s/it]
 80%|███████▉  | 30364/37963 [130:10:21<31:16:53, 14.82s/it]
 80%|███████▉  | 30365/37963 [130:10:35<30:54:31, 14.64s/it]
 80%|███████▉  | 30366/37963 [130:10:50<30:45:53, 14.58s/it]
 80%|███████▉  | 30367/37963 [130:11:04<30:41:28, 14.55s/it]
 80%|███████▉  | 30368/37963 [130:11:18<30:14:07, 14.33s/it]
 80%|███████▉  | 30369/37963 [130:11:39<34:24:57, 16.32s/it]
 80%|███████▉  | 30370/37963 [130:12:00<37:32:06, 17.80s/it]
                                                            
{'loss': '0.08807', 'grad_norm': '3.995', 'learning_rate': '2.026e-06', 'epoch': '0.8'}

 80%|███████▉  | 30370/37963 [130:12:00<37:32:06, 17.80s/it]
 80%|████████  | 30371/37963 [130:12:15<35:23:38, 16.78s/it]
 80%|████████  | 30372/37963 [130:12:29<33:53:49, 16.08s/it]
 80%|████████  | 30373/37963 [130:12:44<32:52:55, 15.60s/it]
 80%|████████  | 30374/37963 [130:13:05<36:18:48, 17.23s/it]
 80%|████████  | 30375/37963 [130:13:19<34:20:04, 16.29s/it]
 80%|████████  | 30376/37963 [130:13:33<33:02:52, 15.68s/it]
 80%|████████  | 30377/37963 [130:13:47<32:09:55, 15.26s/it]
 80%|████████  | 30378/37963 [130:14:02<31:29:40, 14.95s/it]
 80%|████████  | 30379/37963 [130:14:16<31:06:22, 14.77s/it]
 80%|████████  | 30380/37963 [130:14:30<30:52:46, 14.66s/it]
                                                            
{'loss': '0.08321', 'grad_norm': '3.075', 'learning_rate': '2.021e-06', 'epoch': '0.8003'}

 80%|████████  | 30380/37963 [130:14:30<30:52:46, 14.66s/it]
 80%|████████  | 30381/37963 [130:14:45<30:46:37, 14.61s/it]
 80%|████████  | 30382/37963 [130:14:59<30:29:53, 14.48s/it]
 80%|████████  | 30383/37963 [130:15:13<30:28:28, 14.47s/it]
 80%|████████  | 30384/37963 [130:15:28<30:25:17, 14.45s/it]
 80%|████████  | 30385/37963 [130:15:42<30:21:53, 14.43s/it]
 80%|████████  | 30386/37963 [130:15:57<30:22:46, 14.43s/it]
 80%|████████  | 30387/37963 [130:16:11<30:18:23, 14.40s/it]
 80%|████████  | 30388/37963 [130:16:25<30:18:12, 14.40s/it]
 80%|████████  | 30389/37963 [130:16:40<30:12:37, 14.36s/it]
 80%|████████  | 30390/37963 [130:16:54<30:12:25, 14.36s/it]
                                                            
{'loss': '0.08797', 'grad_norm': '1.679', 'learning_rate': '2.016e-06', 'epoch': '0.8005'}

 80%|████████  | 30390/37963 [130:16:54<30:12:25, 14.36s/it]
 80%|████████  | 30391/37963 [130:17:09<30:17:15, 14.40s/it]
 80%|████████  | 30392/37963 [130:17:23<30:15:21, 14.39s/it]
 80%|████████  | 30393/37963 [130:17:44<34:37:05, 16.46s/it]
 80%|████████  | 30394/37963 [130:17:58<33:10:10, 15.78s/it]
 80%|████████  | 30395/37963 [130:18:19<36:14:19, 17.24s/it]
 80%|████████  | 30396/37963 [130:18:33<34:18:45, 16.32s/it]
 80%|████████  | 30397/37963 [130:18:47<32:59:08, 15.69s/it]
 80%|████████  | 30398/37963 [130:19:02<32:16:28, 15.36s/it]
 80%|████████  | 30399/37963 [130:19:16<31:40:15, 15.07s/it]
 80%|████████  | 30400/37963 [130:19:31<31:17:56, 14.90s/it]
                                                            
{'loss': '0.09323', 'grad_norm': '2.532', 'learning_rate': '2.011e-06', 'epoch': '0.8008'}

 80%|████████  | 30400/37963 [130:19:31<31:17:56, 14.90s/it]
 80%|████████  | 30401/37963 [130:19:52<35:04:59, 16.70s/it]
 80%|████████  | 30402/37963 [130:20:06<33:36:11, 16.00s/it]
 80%|████████  | 30403/37963 [130:20:21<32:37:23, 15.53s/it]
 80%|████████  | 30404/37963 [130:20:35<31:56:14, 15.21s/it]
 80%|████████  | 30405/37963 [130:20:57<35:50:45, 17.07s/it]
 80%|████████  | 30406/37963 [130:21:11<34:08:22, 16.26s/it]
 80%|████████  | 30407/37963 [130:21:32<37:10:25, 17.71s/it]
 80%|████████  | 30408/37963 [130:21:46<35:06:29, 16.73s/it]
 80%|████████  | 30409/37963 [130:22:01<33:32:04, 15.98s/it]
 80%|████████  | 30410/37963 [130:22:15<32:38:00, 15.55s/it]
                                                            
{'loss': '0.07969', 'grad_norm': '2.151', 'learning_rate': '2.006e-06', 'epoch': '0.801'}

 80%|████████  | 30410/37963 [130:22:15<32:38:00, 15.55s/it]
 80%|████████  | 30411/37963 [130:22:30<31:58:06, 15.24s/it]
 80%|████████  | 30412/37963 [130:22:44<31:26:46, 14.99s/it]
 80%|████████  | 30413/37963 [130:22:58<31:02:32, 14.80s/it]
 80%|████████  | 30414/37963 [130:23:13<30:40:32, 14.63s/it]
 80%|████████  | 30415/37963 [130:23:27<30:24:42, 14.50s/it]
 80%|████████  | 30416/37963 [130:23:41<30:19:18, 14.46s/it]
 80%|████████  | 30417/37963 [130:24:02<34:12:10, 16.32s/it]
 80%|████████  | 30418/37963 [130:24:16<32:45:33, 15.63s/it]
 80%|████████  | 30419/37963 [130:24:37<36:13:11, 17.28s/it]
 80%|████████  | 30420/37963 [130:24:51<34:16:16, 16.36s/it]
                                                            
{'loss': '0.07941', 'grad_norm': '2.654', 'learning_rate': '2.001e-06', 'epoch': '0.8013'}

 80%|████████  | 30420/37963 [130:24:51<34:16:16, 16.36s/it]
 80%|████████  | 30421/37963 [130:25:12<37:11:34, 17.75s/it]
 80%|████████  | 30422/37963 [130:25:26<34:42:23, 16.57s/it]
 80%|████████  | 30423/37963 [130:25:41<33:22:34, 15.94s/it]
 80%|████████  | 30424/37963 [130:25:54<32:04:26, 15.32s/it]
 80%|████████  | 30425/37963 [130:26:09<31:16:34, 14.94s/it]
 80%|████████  | 30426/37963 [130:26:23<30:47:55, 14.71s/it]
 80%|████████  | 30427/37963 [130:26:37<30:35:06, 14.61s/it]
 80%|████████  | 30428/37963 [130:26:52<30:29:29, 14.57s/it]
 80%|████████  | 30429/37963 [130:27:05<30:05:45, 14.38s/it]
 80%|████████  | 30430/37963 [130:27:20<30:03:31, 14.36s/it]
                                                            
{'loss': '0.08616', 'grad_norm': '3.403', 'learning_rate': '1.996e-06', 'epoch': '0.8016'}

 80%|████████  | 30430/37963 [130:27:20<30:03:31, 14.36s/it]
 80%|████████  | 30431/37963 [130:27:34<29:56:58, 14.31s/it]
 80%|████████  | 30432/37963 [130:27:48<29:58:06, 14.33s/it]
 80%|████████  | 30433/37963 [130:28:03<29:57:31, 14.32s/it]
 80%|████████  | 30434/37963 [130:28:17<29:58:29, 14.33s/it]
 80%|████████  | 30435/37963 [130:28:31<29:59:54, 14.35s/it]
 80%|████████  | 30436/37963 [130:28:46<30:04:36, 14.39s/it]
 80%|████████  | 30437/37963 [130:29:00<30:01:32, 14.36s/it]
 80%|████████  | 30438/37963 [130:29:14<29:57:55, 14.34s/it]
 80%|████████  | 30439/37963 [130:29:29<30:00:14, 14.36s/it]
 80%|████████  | 30440/37963 [130:29:43<30:01:27, 14.37s/it]
                                                            
{'loss': '0.07742', 'grad_norm': '2.654', 'learning_rate': '1.99e-06', 'epoch': '0.8018'}

 80%|████████  | 30440/37963 [130:29:43<30:01:27, 14.37s/it]
 80%|████████  | 30441/37963 [130:30:04<33:55:01, 16.23s/it]
 80%|████████  | 30442/37963 [130:30:18<32:46:36, 15.69s/it]
 80%|████████  | 30443/37963 [130:30:33<31:58:19, 15.31s/it]
 80%|████████  | 30444/37963 [130:30:46<30:52:07, 14.78s/it]
 80%|████████  | 30445/37963 [130:31:01<30:40:30, 14.69s/it]
 80%|████████  | 30446/37963 [130:31:22<34:50:03, 16.68s/it]
 80%|████████  | 30447/37963 [130:31:37<33:31:52, 16.06s/it]
 80%|████████  | 30448/37963 [130:31:51<32:36:31, 15.62s/it]
 80%|████████  | 30449/37963 [130:32:06<31:52:32, 15.27s/it]
 80%|████████  | 30450/37963 [130:32:20<31:23:28, 15.04s/it]
                                                            
{'loss': '0.08061', 'grad_norm': '2.075', 'learning_rate': '1.985e-06', 'epoch': '0.8021'}

 80%|████████  | 30450/37963 [130:32:20<31:23:28, 15.04s/it]
 80%|████████  | 30451/37963 [130:32:40<34:33:09, 16.56s/it]
 80%|████████  | 30452/37963 [130:32:54<33:02:24, 15.84s/it]
 80%|████████  | 30453/37963 [130:33:16<36:25:21, 17.46s/it]
 80%|████████  | 30454/37963 [130:33:30<34:32:39, 16.56s/it]
 80%|████████  | 30455/37963 [130:33:45<33:14:08, 15.94s/it]
 80%|████████  | 30456/37963 [130:33:59<32:18:58, 15.50s/it]
 80%|████████  | 30457/37963 [130:34:14<31:38:07, 15.17s/it]
 80%|████████  | 30458/37963 [130:34:28<31:12:09, 14.97s/it]
 80%|████████  | 30459/37963 [130:34:49<34:45:35, 16.68s/it]
 80%|████████  | 30460/37963 [130:35:03<33:20:59, 16.00s/it]
                                                            
{'loss': '0.08234', 'grad_norm': '2.95', 'learning_rate': '1.98e-06', 'epoch': '0.8024'}

 80%|████████  | 30460/37963 [130:35:03<33:20:59, 16.00s/it]
 80%|████████  | 30461/37963 [130:35:18<32:20:29, 15.52s/it]
 80%|████████  | 30462/37963 [130:35:32<31:35:57, 15.17s/it]
 80%|████████  | 30463/37963 [130:35:46<31:08:50, 14.95s/it]
 80%|████████  | 30464/37963 [130:36:07<34:42:54, 16.67s/it]
 80%|████████  | 30465/37963 [130:36:21<33:18:36, 15.99s/it]
 80%|████████  | 30466/37963 [130:36:35<31:54:28, 15.32s/it]
 80%|████████  | 30467/37963 [130:36:50<31:18:16, 15.03s/it]
 80%|████████  | 30468/37963 [130:37:04<30:53:42, 14.84s/it]
 80%|████████  | 30469/37963 [130:37:25<35:05:59, 16.86s/it]
 80%|████████  | 30470/37963 [130:37:40<33:35:34, 16.14s/it]
                                                            
{'loss': '0.08521', 'grad_norm': '3.107', 'learning_rate': '1.975e-06', 'epoch': '0.8026'}

 80%|████████  | 30470/37963 [130:37:40<33:35:34, 16.14s/it]
 80%|████████  | 30471/37963 [130:38:01<36:39:37, 17.62s/it]
 80%|████████  | 30472/37963 [130:38:15<34:40:28, 16.66s/it]
 80%|████████  | 30473/37963 [130:38:30<33:15:32, 15.99s/it]
 80%|████████  | 30474/37963 [130:38:44<32:18:34, 15.53s/it]
 80%|████████  | 30475/37963 [130:38:59<31:37:00, 15.20s/it]
 80%|████████  | 30476/37963 [130:39:13<30:58:25, 14.89s/it]
 80%|████████  | 30477/37963 [130:39:27<30:37:32, 14.73s/it]
 80%|████████  | 30478/37963 [130:39:41<30:10:32, 14.51s/it]
 80%|████████  | 30479/37963 [130:39:56<30:03:45, 14.46s/it]
 80%|████████  | 30480/37963 [130:40:10<29:49:52, 14.35s/it]
                                                            
{'loss': '0.07271', 'grad_norm': '2.094', 'learning_rate': '1.97e-06', 'epoch': '0.8029'}

 80%|████████  | 30480/37963 [130:40:10<29:49:52, 14.35s/it]
 80%|████████  | 30481/37963 [130:40:24<29:51:44, 14.37s/it]
 80%|████████  | 30482/37963 [130:40:38<29:33:25, 14.22s/it]
 80%|████████  | 30483/37963 [130:40:52<29:38:26, 14.27s/it]
 80%|████████  | 30484/37963 [130:41:07<29:42:29, 14.30s/it]
 80%|████████  | 30485/37963 [130:41:21<29:39:12, 14.28s/it]
 80%|████████  | 30486/37963 [130:41:35<29:30:00, 14.20s/it]
 80%|████████  | 30487/37963 [130:41:49<29:14:07, 14.08s/it]
 80%|████████  | 30488/37963 [130:42:03<29:26:14, 14.18s/it]
 80%|████████  | 30489/37963 [130:42:25<33:53:20, 16.32s/it]
 80%|████████  | 30490/37963 [130:42:39<32:37:50, 15.72s/it]
                                                            
{'loss': '0.09022', 'grad_norm': '5.079', 'learning_rate': '1.965e-06', 'epoch': '0.8032'}

 80%|████████  | 30490/37963 [130:42:39<32:37:50, 15.72s/it]
 80%|████████  | 30491/37963 [130:42:53<31:33:15, 15.20s/it]
 80%|████████  | 30492/37963 [130:43:07<30:43:12, 14.80s/it]
 80%|████████  | 30493/37963 [130:43:21<30:30:29, 14.70s/it]
 80%|████████  | 30494/37963 [130:43:42<34:18:54, 16.54s/it]
 80%|████████  | 30495/37963 [130:43:56<32:59:34, 15.90s/it]
 80%|████████  | 30496/37963 [130:44:11<32:04:48, 15.47s/it]
 80%|████████  | 30497/37963 [130:44:25<31:26:56, 15.16s/it]
 80%|████████  | 30498/37963 [130:44:40<30:58:14, 14.94s/it]
 80%|████████  | 30499/37963 [130:45:01<34:39:56, 16.72s/it]
 80%|████████  | 30500/37963 [130:45:15<33:00:59, 15.93s/it]
                                                            
{'loss': '0.07615', 'grad_norm': '2.121', 'learning_rate': '1.96e-06', 'epoch': '0.8034'}

 80%|████████  | 30500/37963 [130:45:15<33:00:59, 15.93s/it]
 80%|████████  | 30501/37963 [130:45:29<32:01:54, 15.45s/it]
 80%|████████  | 30502/37963 [130:45:51<36:01:12, 17.38s/it]
 80%|████████  | 30503/37963 [130:46:05<33:55:20, 16.37s/it]
 80%|████████  | 30504/37963 [130:46:19<32:42:20, 15.79s/it]
 80%|████████  | 30505/37963 [130:46:34<31:51:06, 15.38s/it]
 80%|████████  | 30506/37963 [130:46:48<31:11:46, 15.06s/it]
 80%|████████  | 30507/37963 [130:47:02<30:33:58, 14.76s/it]
 80%|████████  | 30508/37963 [130:47:23<34:32:06, 16.68s/it]
 80%|████████  | 30509/37963 [130:47:38<33:10:38, 16.02s/it]
 80%|████████  | 30510/37963 [130:47:52<32:13:35, 15.57s/it]
                                                            
{'loss': '0.08678', 'grad_norm': '1.888', 'learning_rate': '1.955e-06', 'epoch': '0.8037'}

 80%|████████  | 30510/37963 [130:47:52<32:13:35, 15.57s/it]
 80%|████████  | 30511/37963 [130:48:07<31:29:55, 15.22s/it]
 80%|████████  | 30512/37963 [130:48:21<30:55:34, 14.94s/it]
 80%|████████  | 30513/37963 [130:48:42<34:36:47, 16.73s/it]
 80%|████████  | 30514/37963 [130:48:56<32:41:56, 15.80s/it]
 80%|████████  | 30515/37963 [130:49:10<31:36:34, 15.28s/it]
 80%|████████  | 30516/37963 [130:49:31<35:13:09, 17.03s/it]
 80%|████████  | 30517/37963 [130:49:45<33:14:11, 16.07s/it]
 80%|████████  | 30518/37963 [130:50:06<36:28:33, 17.64s/it]
 80%|████████  | 30519/37963 [130:50:20<34:25:33, 16.65s/it]
 80%|████████  | 30520/37963 [130:50:34<32:47:35, 15.86s/it]
                                                            
{'loss': '0.07695', 'grad_norm': '2.016', 'learning_rate': '1.95e-06', 'epoch': '0.8039'}

 80%|████████  | 30520/37963 [130:50:34<32:47:35, 15.86s/it]
 80%|████████  | 30521/37963 [130:50:49<31:51:25, 15.41s/it]
 80%|████████  | 30522/37963 [130:51:03<31:10:15, 15.08s/it]
 80%|████████  | 30523/37963 [130:51:17<30:50:03, 14.92s/it]
 80%|████████  | 30524/37963 [130:51:31<30:13:20, 14.63s/it]
 80%|████████  | 30525/37963 [130:51:46<30:01:31, 14.53s/it]
 80%|████████  | 30526/37963 [130:52:00<29:58:44, 14.51s/it]
 80%|████████  | 30527/37963 [130:52:14<29:50:58, 14.45s/it]
 80%|████████  | 30528/37963 [130:52:29<29:47:26, 14.42s/it]
 80%|████████  | 30529/37963 [130:52:43<29:45:32, 14.41s/it]
 80%|████████  | 30530/37963 [130:52:58<29:48:12, 14.43s/it]
                                                            
{'loss': '0.09081', 'grad_norm': '3.862', 'learning_rate': '1.945e-06', 'epoch': '0.8042'}

 80%|████████  | 30530/37963 [130:52:58<29:48:12, 14.43s/it]
 80%|████████  | 30531/37963 [130:53:12<29:55:47, 14.50s/it]
 80%|████████  | 30532/37963 [130:53:26<29:33:02, 14.32s/it]
 80%|████████  | 30533/37963 [130:53:40<29:24:48, 14.25s/it]
 80%|████████  | 30534/37963 [130:53:55<29:33:06, 14.32s/it]
 80%|████████  | 30535/37963 [130:54:09<29:25:48, 14.26s/it]
 80%|████████  | 30536/37963 [130:54:23<29:11:49, 14.15s/it]
 80%|████████  | 30537/37963 [130:54:37<29:23:30, 14.25s/it]
 80%|████████  | 30538/37963 [130:54:52<29:28:52, 14.29s/it]
 80%|████████  | 30539/37963 [130:55:13<33:34:47, 16.28s/it]
 80%|████████  | 30540/37963 [130:55:27<32:25:02, 15.72s/it]
                                                            
{'loss': '0.08258', 'grad_norm': '5.263', 'learning_rate': '1.94e-06', 'epoch': '0.8045'}

 80%|████████  | 30540/37963 [130:55:27<32:25:02, 15.72s/it]
 80%|████████  | 30541/37963 [130:55:41<31:20:21, 15.20s/it]
 80%|████████  | 30542/37963 [130:55:55<30:36:04, 14.84s/it]
 80%|████████  | 30543/37963 [130:56:09<30:04:57, 14.60s/it]
 80%|████████  | 30544/37963 [130:56:23<29:39:57, 14.40s/it]
 80%|████████  | 30545/37963 [130:56:37<29:38:26, 14.38s/it]
 80%|████████  | 30546/37963 [130:56:52<29:31:17, 14.33s/it]
 80%|████████  | 30547/37963 [130:57:12<33:32:15, 16.28s/it]
 80%|████████  | 30548/37963 [130:57:33<36:15:45, 17.61s/it]
 80%|████████  | 30549/37963 [130:57:47<34:16:55, 16.65s/it]
 80%|████████  | 30550/37963 [130:58:02<32:54:37, 15.98s/it]
                                                            
{'loss': '0.08222', 'grad_norm': '3.17', 'learning_rate': '1.935e-06', 'epoch': '0.8047'}

 80%|████████  | 30550/37963 [130:58:02<32:54:37, 15.98s/it]
 80%|████████  | 30551/37963 [130:58:16<31:56:36, 15.51s/it]
 80%|████████  | 30552/37963 [130:58:38<35:31:00, 17.25s/it]
 80%|████████  | 30553/37963 [130:58:52<33:40:01, 16.36s/it]
 80%|████████  | 30554/37963 [130:59:06<32:32:41, 15.81s/it]
 80%|████████  | 30555/37963 [130:59:20<31:26:31, 15.28s/it]
 80%|████████  | 30556/37963 [130:59:41<34:50:05, 16.93s/it]
 80%|████████  | 30557/37963 [130:59:56<33:13:38, 16.15s/it]
 80%|████████  | 30558/37963 [131:00:10<32:08:56, 15.63s/it]
 80%|████████  | 30559/37963 [131:00:24<31:24:12, 15.27s/it]
 80%|████████  | 30560/37963 [131:00:39<30:46:32, 14.97s/it]
                                                            
{'loss': '0.08514', 'grad_norm': '3.254', 'learning_rate': '1.93e-06', 'epoch': '0.805'}

 80%|████████  | 30560/37963 [131:00:39<30:46:32, 14.97s/it]
 81%|████████  | 30561/37963 [131:01:00<34:27:04, 16.76s/it]
 81%|████████  | 30562/37963 [131:01:14<32:58:45, 16.04s/it]
 81%|████████  | 30563/37963 [131:01:28<31:59:18, 15.56s/it]
 81%|████████  | 30564/37963 [131:01:50<35:44:55, 17.39s/it]
 81%|████████  | 30565/37963 [131:02:04<33:50:45, 16.47s/it]
 81%|████████  | 30566/37963 [131:02:18<32:17:09, 15.71s/it]
 81%|████████  | 30567/37963 [131:02:39<35:30:05, 17.28s/it]
 81%|████████  | 30568/37963 [131:02:53<33:12:31, 16.17s/it]
 81%|████████  | 30569/37963 [131:03:06<31:32:43, 15.36s/it]
 81%|████████  | 30570/37963 [131:03:21<30:56:36, 15.07s/it]
                                                            
{'loss': '0.0699', 'grad_norm': '2.954', 'learning_rate': '1.924e-06', 'epoch': '0.8053'}

 81%|████████  | 30570/37963 [131:03:21<30:56:36, 15.07s/it]
 81%|████████  | 30571/37963 [131:03:35<30:23:33, 14.80s/it]
 81%|████████  | 30572/37963 [131:03:49<29:51:49, 14.55s/it]
 81%|████████  | 30573/37963 [131:04:03<29:31:23, 14.38s/it]
 81%|████████  | 30574/37963 [131:04:17<29:20:36, 14.30s/it]
 81%|████████  | 30575/37963 [131:04:31<29:22:29, 14.31s/it]
 81%|████████  | 30576/37963 [131:04:46<29:28:36, 14.37s/it]
 81%|████████  | 30577/37963 [131:05:00<29:09:43, 14.21s/it]
 81%|████████  | 30578/37963 [131:05:14<29:17:31, 14.28s/it]
 81%|████████  | 30579/37963 [131:05:28<29:21:40, 14.31s/it]
 81%|████████  | 30580/37963 [131:05:43<29:22:10, 14.32s/it]
                                                            
{'loss': '0.07911', 'grad_norm': '3.147', 'learning_rate': '1.919e-06', 'epoch': '0.8055'}

 81%|████████  | 30580/37963 [131:05:43<29:22:10, 14.32s/it]
 81%|████████  | 30581/37963 [131:05:57<29:25:29, 14.35s/it]
 81%|████████  | 30582/37963 [131:06:12<29:26:07, 14.36s/it]
 81%|████████  | 30583/37963 [131:06:26<29:24:32, 14.35s/it]
 81%|████████  | 30584/37963 [131:06:40<29:26:44, 14.37s/it]
 81%|████████  | 30585/37963 [131:06:55<29:26:03, 14.36s/it]
 81%|████████  | 30586/37963 [131:07:09<29:26:00, 14.36s/it]
 81%|████████  | 30587/37963 [131:07:24<29:30:02, 14.40s/it]
 81%|████████  | 30588/37963 [131:07:38<29:15:07, 14.28s/it]
 81%|████████  | 30589/37963 [131:07:52<29:19:04, 14.31s/it]
 81%|████████  | 30590/37963 [131:08:13<33:31:06, 16.37s/it]
                                                            
{'loss': '0.08686', 'grad_norm': '2.693', 'learning_rate': '1.914e-06', 'epoch': '0.8058'}

 81%|████████  | 30590/37963 [131:08:13<33:31:06, 16.37s/it]
 81%|████████  | 30591/37963 [131:08:27<32:16:51, 15.76s/it]
 81%|████████  | 30592/37963 [131:08:42<31:31:44, 15.40s/it]
 81%|████████  | 30593/37963 [131:08:56<30:54:10, 15.10s/it]
 81%|████████  | 30594/37963 [131:09:17<34:20:49, 16.78s/it]
 81%|████████  | 30595/37963 [131:09:31<32:53:16, 16.07s/it]
 81%|████████  | 30596/37963 [131:09:46<31:51:39, 15.57s/it]
 81%|████████  | 30597/37963 [131:10:07<35:10:02, 17.19s/it]
 81%|████████  | 30598/37963 [131:10:21<33:07:07, 16.19s/it]
 81%|████████  | 30599/37963 [131:10:42<36:14:39, 17.72s/it]
 81%|████████  | 30600/37963 [131:10:56<34:14:23, 16.74s/it]
                                                            
{'loss': '0.07715', 'grad_norm': '2.435', 'learning_rate': '1.909e-06', 'epoch': '0.8061'}

 81%|████████  | 30600/37963 [131:10:56<34:14:23, 16.74s/it]
 81%|████████  | 30601/37963 [131:11:11<32:52:45, 16.08s/it]
 81%|████████  | 30602/37963 [131:11:25<31:48:43, 15.56s/it]
 81%|████████  | 30603/37963 [131:11:40<31:07:29, 15.22s/it]
 81%|████████  | 30604/37963 [131:11:54<30:13:12, 14.78s/it]
 81%|████████  | 30605/37963 [131:12:15<34:08:54, 16.71s/it]
 81%|████████  | 30606/37963 [131:12:29<32:42:14, 16.00s/it]
 81%|████████  | 30607/37963 [131:12:44<31:44:06, 15.53s/it]
 81%|████████  | 30608/37963 [131:12:58<30:57:13, 15.15s/it]
 81%|████████  | 30609/37963 [131:13:18<34:11:33, 16.74s/it]
 81%|████████  | 30610/37963 [131:13:33<32:48:22, 16.06s/it]
                                                            
{'loss': '0.07657', 'grad_norm': '2.455', 'learning_rate': '1.904e-06', 'epoch': '0.8063'}

 81%|████████  | 30610/37963 [131:13:33<32:48:22, 16.06s/it]
 81%|████████  | 30611/37963 [131:13:47<31:44:12, 15.54s/it]
 81%|████████  | 30612/37963 [131:14:08<35:00:38, 17.15s/it]
 81%|████████  | 30613/37963 [131:14:23<33:26:52, 16.38s/it]
 81%|████████  | 30614/37963 [131:14:37<32:09:20, 15.75s/it]
 81%|████████  | 30615/37963 [131:14:58<35:21:51, 17.33s/it]
 81%|████████  | 30616/37963 [131:15:12<33:23:25, 16.36s/it]
 81%|████████  | 30617/37963 [131:15:26<32:11:36, 15.78s/it]
 81%|████████  | 30618/37963 [131:15:40<30:53:45, 15.14s/it]
 81%|████████  | 30619/37963 [131:15:54<30:21:43, 14.88s/it]
 81%|████████  | 30620/37963 [131:16:09<30:00:30, 14.71s/it]
                                                            
{'loss': '0.08229', 'grad_norm': '2.823', 'learning_rate': '1.899e-06', 'epoch': '0.8066'}

 81%|████████  | 30620/37963 [131:16:09<30:00:30, 14.71s/it]
 81%|████████  | 30621/37963 [131:16:22<29:22:34, 14.40s/it]
 81%|████████  | 30622/37963 [131:16:37<29:17:13, 14.36s/it]
 81%|████████  | 30623/37963 [131:16:51<29:16:21, 14.36s/it]
 81%|████████  | 30624/37963 [131:17:05<29:17:57, 14.37s/it]
 81%|████████  | 30625/37963 [131:17:20<29:20:13, 14.39s/it]
 81%|████████  | 30626/37963 [131:17:34<29:18:08, 14.38s/it]
 81%|████████  | 30627/37963 [131:17:48<29:12:28, 14.33s/it]
 81%|████████  | 30628/37963 [131:18:03<29:13:46, 14.35s/it]
 81%|████████  | 30629/37963 [131:18:17<29:18:04, 14.38s/it]
 81%|████████  | 30630/37963 [131:18:32<29:16:52, 14.38s/it]
                                                            
{'loss': '0.08946', 'grad_norm': '2.544', 'learning_rate': '1.894e-06', 'epoch': '0.8068'}

 81%|████████  | 30630/37963 [131:18:32<29:16:52, 14.38s/it]
 81%|████████  | 30631/37963 [131:18:46<29:15:53, 14.37s/it]
 81%|████████  | 30632/37963 [131:19:00<29:03:39, 14.27s/it]
 81%|████████  | 30633/37963 [131:19:14<29:08:24, 14.31s/it]
 81%|████████  | 30634/37963 [131:19:28<28:50:41, 14.17s/it]
 81%|████████  | 30635/37963 [131:19:43<29:01:10, 14.26s/it]
 81%|████████  | 30636/37963 [131:19:57<29:12:01, 14.35s/it]
 81%|████████  | 30637/37963 [131:20:11<29:08:05, 14.32s/it]
 81%|████████  | 30638/37963 [131:20:33<33:23:16, 16.41s/it]
 81%|████████  | 30639/37963 [131:20:47<32:11:56, 15.83s/it]
 81%|████████  | 30640/37963 [131:21:02<31:19:02, 15.40s/it]
                                                            
{'loss': '0.08379', 'grad_norm': '3.03', 'learning_rate': '1.889e-06', 'epoch': '0.8071'}

 81%|████████  | 30640/37963 [131:21:02<31:19:02, 15.40s/it]
 81%|████████  | 30641/37963 [131:21:22<34:39:17, 17.04s/it]
 81%|████████  | 30642/37963 [131:21:37<33:00:52, 16.23s/it]
 81%|████████  | 30643/37963 [131:21:51<31:50:40, 15.66s/it]
 81%|████████  | 30644/37963 [131:22:05<30:54:37, 15.20s/it]
 81%|████████  | 30645/37963 [131:22:26<34:30:01, 16.97s/it]
 81%|████████  | 30646/37963 [131:22:41<33:00:03, 16.24s/it]
 81%|████████  | 30647/37963 [131:22:55<31:55:43, 15.71s/it]
 81%|████████  | 30648/37963 [131:23:17<35:19:11, 17.38s/it]
 81%|████████  | 30649/37963 [131:23:31<33:32:15, 16.51s/it]
 81%|████████  | 30650/37963 [131:23:46<32:15:16, 15.88s/it]
                                                            
{'loss': '0.07839', 'grad_norm': '2.574', 'learning_rate': '1.884e-06', 'epoch': '0.8074'}

 81%|████████  | 30650/37963 [131:23:46<32:15:16, 15.88s/it]
 81%|████████  | 30651/37963 [131:24:00<31:22:31, 15.45s/it]
 81%|████████  | 30652/37963 [131:24:21<34:35:57, 17.04s/it]
 81%|████████  | 30653/37963 [131:24:35<33:00:47, 16.26s/it]
 81%|████████  | 30654/37963 [131:24:49<31:43:28, 15.63s/it]
 81%|████████  | 30655/37963 [131:25:04<30:59:47, 15.27s/it]
 81%|████████  | 30656/37963 [131:25:18<30:13:46, 14.89s/it]
 81%|████████  | 30657/37963 [131:25:38<33:43:54, 16.62s/it]
 81%|████████  | 30658/37963 [131:25:52<32:02:22, 15.79s/it]
 81%|████████  | 30659/37963 [131:26:06<30:50:39, 15.20s/it]
 81%|████████  | 30660/37963 [131:26:27<34:27:44, 16.99s/it]
                                                            
{'loss': '0.0809', 'grad_norm': '2.405', 'learning_rate': '1.879e-06', 'epoch': '0.8076'}

 81%|████████  | 30660/37963 [131:26:27<34:27:44, 16.99s/it]
 81%|████████  | 30661/37963 [131:26:42<32:52:56, 16.21s/it]
 81%|████████  | 30662/37963 [131:26:56<31:45:00, 15.66s/it]
 81%|████████  | 30663/37963 [131:27:10<30:37:22, 15.10s/it]
 81%|████████  | 30664/37963 [131:27:31<34:18:23, 16.92s/it]
 81%|████████  | 30665/37963 [131:27:46<32:51:30, 16.21s/it]
 81%|████████  | 30666/37963 [131:28:00<31:51:13, 15.72s/it]
 81%|████████  | 30667/37963 [131:28:14<31:01:59, 15.31s/it]
 81%|████████  | 30668/37963 [131:28:29<30:25:55, 15.02s/it]
 81%|████████  | 30669/37963 [131:28:43<30:08:00, 14.87s/it]
 81%|████████  | 30670/37963 [131:28:57<29:35:20, 14.61s/it]
                                                            
{'loss': '0.09045', 'grad_norm': '2.286', 'learning_rate': '1.874e-06', 'epoch': '0.8079'}

 81%|████████  | 30670/37963 [131:28:57<29:35:20, 14.61s/it]
 81%|████████  | 30671/37963 [131:29:12<29:30:48, 14.57s/it]
 81%|████████  | 30672/37963 [131:29:26<29:23:30, 14.51s/it]
 81%|████████  | 30673/37963 [131:29:41<29:19:16, 14.48s/it]
 81%|████████  | 30674/37963 [131:29:55<29:21:06, 14.50s/it]
 81%|████████  | 30675/37963 [131:30:09<28:58:22, 14.31s/it]
 81%|████████  | 30676/37963 [131:30:23<28:55:09, 14.29s/it]
 81%|████████  | 30677/37963 [131:30:38<28:58:20, 14.32s/it]
 81%|████████  | 30678/37963 [131:30:52<28:49:08, 14.24s/it]
 81%|████████  | 30679/37963 [131:31:06<29:01:02, 14.34s/it]
 81%|████████  | 30680/37963 [131:31:20<28:56:26, 14.31s/it]
                                                            
{'loss': '0.07754', 'grad_norm': '4.305', 'learning_rate': '1.87e-06', 'epoch': '0.8082'}

 81%|████████  | 30680/37963 [131:31:20<28:56:26, 14.31s/it]
 81%|████████  | 30681/37963 [131:31:35<28:57:20, 14.31s/it]
 81%|████████  | 30682/37963 [131:31:49<29:01:06, 14.35s/it]
 81%|████████  | 30683/37963 [131:32:03<28:51:44, 14.27s/it]
 81%|████████  | 30684/37963 [131:32:17<28:44:25, 14.21s/it]
 81%|████████  | 30685/37963 [131:32:32<28:53:53, 14.29s/it]
 81%|████████  | 30686/37963 [131:32:53<33:03:31, 16.35s/it]
 81%|████████  | 30687/37963 [131:33:07<31:42:03, 15.68s/it]
 81%|████████  | 30688/37963 [131:33:22<30:55:02, 15.30s/it]
 81%|████████  | 30689/37963 [131:33:42<33:56:31, 16.80s/it]
 81%|████████  | 30690/37963 [131:33:56<32:13:37, 15.95s/it]
                                                            
{'loss': '0.07737', 'grad_norm': '2.94', 'learning_rate': '1.865e-06', 'epoch': '0.8084'}

 81%|████████  | 30690/37963 [131:33:56<32:13:37, 15.95s/it]
 81%|████████  | 30691/37963 [131:34:10<31:17:13, 15.49s/it]
 81%|████████  | 30692/37963 [131:34:25<30:36:51, 15.16s/it]
 81%|████████  | 30693/37963 [131:34:39<30:08:54, 14.93s/it]
 81%|████████  | 30694/37963 [131:34:53<29:50:54, 14.78s/it]
 81%|████████  | 30695/37963 [131:35:08<29:26:30, 14.58s/it]
 81%|████████  | 30696/37963 [131:35:22<29:15:16, 14.49s/it]
 81%|████████  | 30697/37963 [131:35:49<37:08:03, 18.40s/it]
 81%|████████  | 30698/37963 [131:36:10<38:22:49, 19.02s/it]
 81%|████████  | 30699/37963 [131:36:24<35:33:34, 17.62s/it]
 81%|████████  | 30700/37963 [131:36:38<33:12:20, 16.46s/it]
                                                            
{'loss': '0.09048', 'grad_norm': '5.132', 'learning_rate': '1.86e-06', 'epoch': '0.8087'}

 81%|████████  | 30700/37963 [131:36:38<33:12:20, 16.46s/it]
 81%|████████  | 30701/37963 [131:36:52<31:36:32, 15.67s/it]
 81%|████████  | 30702/37963 [131:37:06<30:44:13, 15.24s/it]
 81%|████████  | 30703/37963 [131:37:20<30:11:32, 14.97s/it]
 81%|████████  | 30704/37963 [131:37:35<29:51:46, 14.81s/it]
 81%|████████  | 30705/37963 [131:37:56<33:33:28, 16.64s/it]
 81%|████████  | 30706/37963 [131:38:10<32:11:02, 15.97s/it]
 81%|████████  | 30707/37963 [131:38:24<30:53:35, 15.33s/it]
 81%|████████  | 30708/37963 [131:38:38<30:19:28, 15.05s/it]
 81%|████████  | 30709/37963 [131:38:59<33:57:50, 16.86s/it]
 81%|████████  | 30710/37963 [131:39:13<32:01:54, 15.90s/it]
                                                            
{'loss': '0.07931', 'grad_norm': '3.202', 'learning_rate': '1.855e-06', 'epoch': '0.8089'}

 81%|████████  | 30710/37963 [131:39:13<32:01:54, 15.90s/it]
 81%|████████  | 30711/37963 [131:39:27<30:58:34, 15.38s/it]
 81%|████████  | 30712/37963 [131:39:42<30:22:23, 15.08s/it]
 81%|████████  | 30713/37963 [131:40:02<33:43:22, 16.75s/it]
 81%|████████  | 30714/37963 [131:40:17<32:15:03, 16.02s/it]
 81%|████████  | 30715/37963 [131:40:31<31:02:44, 15.42s/it]
 81%|████████  | 30716/37963 [131:40:44<30:05:47, 14.95s/it]
 81%|████████  | 30717/37963 [131:40:59<29:42:49, 14.76s/it]
 81%|████████  | 30718/37963 [131:41:13<29:22:57, 14.60s/it]
 81%|████████  | 30719/37963 [131:41:27<29:13:57, 14.53s/it]
 81%|████████  | 30720/37963 [131:41:42<29:05:12, 14.46s/it]
                                                            
{'loss': '0.07871', 'grad_norm': '2.792', 'learning_rate': '1.85e-06', 'epoch': '0.8092'}

 81%|████████  | 30720/37963 [131:41:42<29:05:12, 14.46s/it]
 81%|████████  | 30721/37963 [131:41:56<29:03:31, 14.45s/it]
 81%|████████  | 30722/37963 [131:42:10<28:59:11, 14.41s/it]
 81%|████████  | 30723/37963 [131:42:25<28:59:53, 14.42s/it]
 81%|████████  | 30724/37963 [131:42:39<29:00:07, 14.42s/it]
 81%|████████  | 30725/37963 [131:42:54<29:06:56, 14.48s/it]
 81%|████████  | 30726/37963 [131:43:08<29:07:02, 14.48s/it]
 81%|████████  | 30727/37963 [131:43:23<29:07:27, 14.49s/it]
 81%|████████  | 30728/37963 [131:43:37<29:02:50, 14.45s/it]
 81%|████████  | 30729/37963 [131:43:51<28:49:13, 14.34s/it]
 81%|████████  | 30730/37963 [131:44:06<28:53:07, 14.38s/it]
                                                            
{'loss': '0.09381', 'grad_norm': '2.815', 'learning_rate': '1.845e-06', 'epoch': '0.8095'}

 81%|████████  | 30730/37963 [131:44:06<28:53:07, 14.38s/it]
 81%|████████  | 30731/37963 [131:44:20<28:54:49, 14.39s/it]
 81%|████████  | 30732/37963 [131:44:35<28:53:50, 14.39s/it]
 81%|████████  | 30733/37963 [131:44:49<28:55:53, 14.41s/it]
 81%|████████  | 30734/37963 [131:45:10<32:58:32, 16.42s/it]
 81%|████████  | 30735/37963 [131:45:24<31:42:55, 15.80s/it]
 81%|████████  | 30736/37963 [131:45:39<30:52:01, 15.38s/it]
 81%|████████  | 30737/37963 [131:45:53<30:09:21, 15.02s/it]
 81%|████████  | 30738/37963 [131:46:07<29:45:24, 14.83s/it]
 81%|████████  | 30739/37963 [131:46:28<33:01:23, 16.46s/it]
 81%|████████  | 30740/37963 [131:46:42<31:42:32, 15.80s/it]
                                                            
{'loss': '0.08462', 'grad_norm': '2.149', 'learning_rate': '1.84e-06', 'epoch': '0.8097'}

 81%|████████  | 30740/37963 [131:46:42<31:42:32, 15.80s/it]
 81%|████████  | 30741/37963 [131:46:57<30:55:53, 15.42s/it]
 81%|████████  | 30742/37963 [131:47:18<34:16:57, 17.09s/it]
 81%|████████  | 30743/37963 [131:47:32<32:39:15, 16.28s/it]
 81%|████████  | 30744/37963 [131:47:53<35:18:06, 17.60s/it]
 81%|████████  | 30745/37963 [131:48:07<33:19:28, 16.62s/it]
 81%|████████  | 30746/37963 [131:48:21<31:58:24, 15.95s/it]
 81%|████████  | 30747/37963 [131:48:42<34:40:52, 17.30s/it]
 81%|████████  | 30748/37963 [131:48:56<32:55:41, 16.43s/it]
 81%|████████  | 30749/37963 [131:49:11<31:41:08, 15.81s/it]
 81%|████████  | 30750/37963 [131:49:25<30:36:11, 15.27s/it]
                                                            
{'loss': '0.09137', 'grad_norm': '2.322', 'learning_rate': '1.835e-06', 'epoch': '0.81'}

 81%|████████  | 30750/37963 [131:49:25<30:36:11, 15.27s/it]
 81%|████████  | 30751/37963 [131:49:39<30:13:14, 15.09s/it]
 81%|████████  | 30752/37963 [131:49:53<29:27:23, 14.71s/it]
 81%|████████  | 30753/37963 [131:50:07<29:17:37, 14.63s/it]
 81%|████████  | 30754/37963 [131:50:28<32:38:10, 16.30s/it]
 81%|████████  | 30755/37963 [131:50:42<31:30:51, 15.74s/it]
 81%|████████  | 30756/37963 [131:50:56<30:41:43, 15.33s/it]
 81%|████████  | 30757/37963 [131:51:10<29:54:05, 14.94s/it]
 81%|████████  | 30758/37963 [131:51:31<33:28:49, 16.73s/it]
 81%|████████  | 30759/37963 [131:51:46<32:02:26, 16.01s/it]
 81%|████████  | 30760/37963 [131:52:00<31:07:26, 15.56s/it]
                                                            
{'loss': '0.08152', 'grad_norm': '2.208', 'learning_rate': '1.83e-06', 'epoch': '0.8103'}

 81%|████████  | 30760/37963 [131:52:00<31:07:26, 15.56s/it]
 81%|████████  | 30761/37963 [131:52:15<30:24:43, 15.20s/it]
 81%|████████  | 30762/37963 [131:52:36<34:02:49, 17.02s/it]
 81%|████████  | 30763/37963 [131:52:51<32:37:20, 16.31s/it]
 81%|████████  | 30764/37963 [131:53:05<31:27:34, 15.73s/it]
 81%|████████  | 30765/37963 [131:53:19<30:38:40, 15.33s/it]
 81%|████████  | 30766/37963 [131:53:34<30:07:05, 15.07s/it]
 81%|████████  | 30767/37963 [131:53:48<29:30:08, 14.76s/it]
 81%|████████  | 30768/37963 [131:54:02<29:18:24, 14.66s/it]
 81%|████████  | 30769/37963 [131:54:17<29:09:55, 14.59s/it]
 81%|████████  | 30770/37963 [131:54:31<29:05:11, 14.56s/it]
                                                            
{'loss': '0.08254', 'grad_norm': '3.662', 'learning_rate': '1.825e-06', 'epoch': '0.8105'}

 81%|████████  | 30770/37963 [131:54:31<29:05:11, 14.56s/it]
 81%|████████  | 30771/37963 [131:54:46<28:58:31, 14.50s/it]
 81%|████████  | 30772/37963 [131:55:00<28:50:19, 14.44s/it]
 81%|████████  | 30773/37963 [131:55:14<28:47:14, 14.41s/it]
 81%|████████  | 30774/37963 [131:55:29<28:48:42, 14.43s/it]
 81%|████████  | 30775/37963 [131:55:43<28:45:29, 14.40s/it]
 81%|████████  | 30776/37963 [131:55:57<28:44:16, 14.39s/it]
 81%|████████  | 30777/37963 [131:56:12<28:48:43, 14.43s/it]
 81%|████████  | 30778/37963 [131:56:26<28:46:12, 14.42s/it]
 81%|████████  | 30779/37963 [131:56:41<28:44:04, 14.40s/it]
 81%|████████  | 30780/37963 [131:56:55<28:38:49, 14.36s/it]
                                                            
{'loss': '0.08873', 'grad_norm': '2.54', 'learning_rate': '1.82e-06', 'epoch': '0.8108'}

 81%|████████  | 30780/37963 [131:56:55<28:38:49, 14.36s/it]
 81%|████████  | 30781/37963 [131:57:09<28:41:50, 14.38s/it]
 81%|████████  | 30782/37963 [131:57:24<28:44:07, 14.41s/it]
 81%|████████  | 30783/37963 [131:57:38<28:43:59, 14.41s/it]
 81%|████████  | 30784/37963 [131:57:59<32:50:14, 16.47s/it]
 81%|████████  | 30785/37963 [131:58:14<31:39:06, 15.87s/it]
 81%|████████  | 30786/37963 [131:58:29<30:57:26, 15.53s/it]
 81%|████████  | 30787/37963 [131:58:43<30:20:27, 15.22s/it]
 81%|████████  | 30788/37963 [131:58:57<29:33:19, 14.83s/it]
 81%|████████  | 30789/37963 [131:59:12<29:18:59, 14.71s/it]
 81%|████████  | 30790/37963 [131:59:32<32:42:16, 16.41s/it]
                                                            
{'loss': '0.09693', 'grad_norm': '2.59', 'learning_rate': '1.815e-06', 'epoch': '0.8111'}

 81%|████████  | 30790/37963 [131:59:32<32:42:16, 16.41s/it]
 81%|████████  | 30791/37963 [131:59:46<31:29:36, 15.81s/it]
 81%|████████  | 30792/37963 [132:00:07<34:29:48, 17.32s/it]
 81%|████████  | 30793/37963 [132:00:21<32:42:26, 16.42s/it]
 81%|████████  | 30794/37963 [132:00:36<31:34:02, 15.85s/it]
 81%|████████  | 30795/37963 [132:00:57<34:21:10, 17.25s/it]
 81%|████████  | 30796/37963 [132:01:18<36:44:04, 18.45s/it]
 81%|████████  | 30797/37963 [132:01:32<34:18:48, 17.24s/it]
 81%|████████  | 30798/37963 [132:01:46<32:23:28, 16.27s/it]
 81%|████████  | 30799/37963 [132:02:01<31:17:28, 15.72s/it]
 81%|████████  | 30800/37963 [132:02:15<30:31:33, 15.34s/it]
                                                            
{'loss': '0.08578', 'grad_norm': '2.779', 'learning_rate': '1.81e-06', 'epoch': '0.8113'}

 81%|████████  | 30800/37963 [132:02:15<30:31:33, 15.34s/it]
 81%|████████  | 30801/37963 [132:02:35<33:31:42, 16.85s/it]
 81%|████████  | 30802/37963 [132:02:50<32:00:48, 16.09s/it]
 81%|████████  | 30803/37963 [132:03:04<30:57:45, 15.57s/it]
 81%|████████  | 30804/37963 [132:03:18<30:13:03, 15.20s/it]
 81%|████████  | 30805/37963 [132:03:33<29:49:31, 15.00s/it]
 81%|████████  | 30806/37963 [132:03:55<33:43:48, 16.97s/it]
 81%|████████  | 30807/37963 [132:04:09<32:10:23, 16.19s/it]
 81%|████████  | 30808/37963 [132:04:23<30:54:17, 15.55s/it]
 81%|████████  | 30809/37963 [132:04:37<29:49:11, 15.01s/it]
 81%|████████  | 30810/37963 [132:04:58<33:21:55, 16.79s/it]
                                                            
{'loss': '0.08391', 'grad_norm': '2.297', 'learning_rate': '1.805e-06', 'epoch': '0.8116'}

 81%|████████  | 30810/37963 [132:04:58<33:21:55, 16.79s/it]
 81%|████████  | 30811/37963 [132:05:12<31:54:34, 16.06s/it]
 81%|████████  | 30812/37963 [132:05:26<30:52:35, 15.54s/it]
 81%|████████  | 30813/37963 [132:05:41<30:13:42, 15.22s/it]
 81%|████████  | 30814/37963 [132:05:55<29:45:06, 14.98s/it]
 81%|████████  | 30815/37963 [132:06:10<29:22:20, 14.79s/it]
 81%|████████  | 30816/37963 [132:06:23<28:45:42, 14.49s/it]
 81%|████████  | 30817/37963 [132:06:38<28:41:46, 14.46s/it]
 81%|████████  | 30818/37963 [132:06:52<28:37:19, 14.42s/it]
 81%|████████  | 30819/37963 [132:07:06<28:34:01, 14.40s/it]
 81%|████████  | 30820/37963 [132:07:21<28:39:52, 14.45s/it]
                                                            
{'loss': '0.08061', 'grad_norm': '2.124', 'learning_rate': '1.801e-06', 'epoch': '0.8118'}

 81%|████████  | 30820/37963 [132:07:21<28:39:52, 14.45s/it]
 81%|████████  | 30821/37963 [132:07:35<28:37:56, 14.43s/it]
 81%|████████  | 30822/37963 [132:07:50<28:26:08, 14.34s/it]
 81%|████████  | 30823/37963 [132:08:04<28:19:16, 14.28s/it]
 81%|████████  | 30824/37963 [132:08:18<28:26:25, 14.34s/it]
 81%|████████  | 30825/37963 [132:08:32<28:25:10, 14.33s/it]
 81%|████████  | 30826/37963 [132:08:47<28:28:04, 14.36s/it]
 81%|████████  | 30827/37963 [132:09:01<28:23:23, 14.32s/it]
 81%|████████  | 30828/37963 [132:09:16<28:25:45, 14.34s/it]
 81%|████████  | 30829/37963 [132:09:30<28:27:21, 14.36s/it]
 81%|████████  | 30830/37963 [132:09:44<28:32:00, 14.40s/it]
                                                            
{'loss': '0.07539', 'grad_norm': '2.508', 'learning_rate': '1.796e-06', 'epoch': '0.8121'}

 81%|████████  | 30830/37963 [132:09:44<28:32:00, 14.40s/it]
 81%|████████  | 30831/37963 [132:09:59<28:32:18, 14.41s/it]
 81%|████████  | 30832/37963 [132:10:13<28:33:17, 14.42s/it]
 81%|████████  | 30833/37963 [132:10:28<28:39:16, 14.47s/it]
 81%|████████  | 30834/37963 [132:10:49<32:52:50, 16.60s/it]
 81%|████████  | 30835/37963 [132:11:04<31:34:35, 15.95s/it]
 81%|████████  | 30836/37963 [132:11:18<30:33:06, 15.43s/it]
 81%|████████  | 30837/37963 [132:11:32<29:54:57, 15.11s/it]
 81%|████████  | 30838/37963 [132:11:53<33:11:57, 16.77s/it]
 81%|████████  | 30839/37963 [132:12:14<35:31:34, 17.95s/it]
 81%|████████  | 30840/37963 [132:12:28<33:25:33, 16.89s/it]
                                                            
{'loss': '0.08183', 'grad_norm': '2.537', 'learning_rate': '1.791e-06', 'epoch': '0.8124'}

 81%|████████  | 30840/37963 [132:12:28<33:25:33, 16.89s/it]
 81%|████████  | 30841/37963 [132:12:42<31:47:46, 16.07s/it]
 81%|████████  | 30842/37963 [132:12:57<30:41:19, 15.51s/it]
 81%|████████  | 30843/37963 [132:13:17<33:42:59, 17.05s/it]
 81%|████████  | 30844/37963 [132:13:39<36:15:42, 18.34s/it]
 81%|████████▏ | 30845/37963 [132:13:53<33:55:47, 17.16s/it]
 81%|████████▏ | 30846/37963 [132:14:07<32:16:04, 16.32s/it]
 81%|████████▏ | 30847/37963 [132:14:22<30:58:51, 15.67s/it]
 81%|████████▏ | 30848/37963 [132:14:36<30:13:14, 15.29s/it]
 81%|████████▏ | 30849/37963 [132:14:50<29:42:00, 15.03s/it]
 81%|████████▏ | 30850/37963 [132:15:11<33:02:58, 16.73s/it]
                                                            
{'loss': '0.09056', 'grad_norm': '4.514', 'learning_rate': '1.786e-06', 'epoch': '0.8126'}

 81%|████████▏ | 30850/37963 [132:15:11<33:02:58, 16.73s/it]
 81%|████████▏ | 30851/37963 [132:15:25<31:37:08, 16.01s/it]
 81%|████████▏ | 30852/37963 [132:15:40<30:47:49, 15.59s/it]
 81%|████████▏ | 30853/37963 [132:15:54<29:50:29, 15.11s/it]
 81%|████████▏ | 30854/37963 [132:16:15<33:18:12, 16.86s/it]
 81%|████████▏ | 30855/37963 [132:16:29<31:48:17, 16.11s/it]
 81%|████████▏ | 30856/37963 [132:16:44<30:47:09, 15.59s/it]
 81%|████████▏ | 30857/37963 [132:16:58<29:51:26, 15.13s/it]
 81%|████████▏ | 30858/37963 [132:17:19<33:22:40, 16.91s/it]
 81%|████████▏ | 30859/37963 [132:17:33<31:52:47, 16.16s/it]
 81%|████████▏ | 30860/37963 [132:17:48<30:51:46, 15.64s/it]
                                                            
{'loss': '0.083', 'grad_norm': '2.719', 'learning_rate': '1.781e-06', 'epoch': '0.8129'}

 81%|████████▏ | 30860/37963 [132:17:48<30:51:46, 15.64s/it]
 81%|████████▏ | 30861/37963 [132:18:01<29:46:10, 15.09s/it]
 81%|████████▏ | 30862/37963 [132:18:15<29:08:20, 14.77s/it]
 81%|████████▏ | 30863/37963 [132:18:30<28:43:24, 14.56s/it]
 81%|████████▏ | 30864/37963 [132:18:44<28:39:59, 14.54s/it]
 81%|████████▏ | 30865/37963 [132:18:58<28:35:43, 14.50s/it]
 81%|████████▏ | 30866/37963 [132:19:12<28:17:33, 14.35s/it]
 81%|████████▏ | 30867/37963 [132:19:27<28:12:40, 14.31s/it]
 81%|████████▏ | 30868/37963 [132:19:41<28:14:08, 14.33s/it]
 81%|████████▏ | 30869/37963 [132:19:55<28:18:19, 14.36s/it]
 81%|████████▏ | 30870/37963 [132:20:09<27:59:55, 14.21s/it]
                                                            
{'loss': '0.08365', 'grad_norm': '2.34', 'learning_rate': '1.776e-06', 'epoch': '0.8132'}

 81%|████████▏ | 30870/37963 [132:20:09<27:59:55, 14.21s/it]
 81%|████████▏ | 30871/37963 [132:20:24<28:03:12, 14.24s/it]
 81%|████████▏ | 30872/37963 [132:20:37<27:50:13, 14.13s/it]
 81%|████████▏ | 30873/37963 [132:20:52<28:03:13, 14.24s/it]
 81%|████████▏ | 30874/37963 [132:21:06<27:47:14, 14.11s/it]
 81%|████████▏ | 30875/37963 [132:21:20<27:58:13, 14.21s/it]
 81%|████████▏ | 30876/37963 [132:21:34<27:51:51, 14.15s/it]
 81%|████████▏ | 30877/37963 [132:21:48<27:54:49, 14.18s/it]
 81%|████████▏ | 30878/37963 [132:22:03<28:01:54, 14.24s/it]
 81%|████████▏ | 30879/37963 [132:22:17<27:52:48, 14.17s/it]
 81%|████████▏ | 30880/37963 [132:22:31<27:59:35, 14.23s/it]
                                                            
{'loss': '0.07525', 'grad_norm': '2.499', 'learning_rate': '1.771e-06', 'epoch': '0.8134'}

 81%|████████▏ | 30880/37963 [132:22:31<27:59:35, 14.23s/it]
 81%|████████▏ | 30881/37963 [132:22:46<28:04:18, 14.27s/it]
 81%|████████▏ | 30882/37963 [132:23:07<32:09:10, 16.35s/it]
 81%|████████▏ | 30883/37963 [132:23:21<30:49:40, 15.68s/it]
 81%|████████▏ | 30884/37963 [132:23:35<30:01:21, 15.27s/it]
 81%|████████▏ | 30885/37963 [132:23:55<32:55:12, 16.74s/it]
 81%|████████▏ | 30886/37963 [132:24:09<31:14:05, 15.89s/it]
 81%|████████▏ | 30887/37963 [132:24:31<34:31:09, 17.56s/it]
 81%|████████▏ | 30888/37963 [132:24:45<32:44:32, 16.66s/it]
 81%|████████▏ | 30889/37963 [132:25:00<31:24:28, 15.98s/it]
 81%|████████▏ | 30890/37963 [132:25:14<30:24:51, 15.48s/it]
                                                            
{'loss': '0.07815', 'grad_norm': '2.392', 'learning_rate': '1.767e-06', 'epoch': '0.8137'}

 81%|████████▏ | 30890/37963 [132:25:14<30:24:51, 15.48s/it]
 81%|████████▏ | 30891/37963 [132:25:28<29:43:54, 15.13s/it]
 81%|████████▏ | 30892/37963 [132:25:49<33:11:18, 16.90s/it]
 81%|████████▏ | 30893/37963 [132:26:10<35:39:09, 18.15s/it]
 81%|████████▏ | 30894/37963 [132:26:25<33:26:47, 17.03s/it]
 81%|████████▏ | 30895/37963 [132:26:39<31:52:22, 16.23s/it]
 81%|████████▏ | 30896/37963 [132:26:54<30:50:08, 15.71s/it]
 81%|████████▏ | 30897/37963 [132:27:14<33:47:42, 17.22s/it]
 81%|████████▏ | 30898/37963 [132:27:29<32:09:14, 16.38s/it]
 81%|████████▏ | 30899/37963 [132:27:43<31:01:56, 15.81s/it]
 81%|████████▏ | 30900/37963 [132:27:58<30:12:06, 15.39s/it]
                                                            
{'loss': '0.08644', 'grad_norm': '3.401', 'learning_rate': '1.762e-06', 'epoch': '0.814'}

 81%|████████▏ | 30900/37963 [132:27:58<30:12:06, 15.39s/it]
 81%|████████▏ | 30901/37963 [132:28:12<29:38:21, 15.11s/it]
 81%|████████▏ | 30902/37963 [132:28:33<32:45:33, 16.70s/it]
 81%|████████▏ | 30903/37963 [132:28:47<31:26:42, 16.03s/it]
 81%|████████▏ | 30904/37963 [132:29:01<30:15:30, 15.43s/it]
 81%|████████▏ | 30905/37963 [132:29:16<29:39:35, 15.13s/it]
 81%|████████▏ | 30906/37963 [132:29:29<28:54:57, 14.75s/it]
 81%|████████▏ | 30907/37963 [132:29:44<28:41:24, 14.64s/it]
 81%|████████▏ | 30908/37963 [132:29:58<28:34:49, 14.58s/it]
 81%|████████▏ | 30909/37963 [132:30:20<32:36:06, 16.64s/it]
 81%|████████▏ | 30910/37963 [132:30:34<31:14:20, 15.95s/it]
                                                            
{'loss': '0.08737', 'grad_norm': '2.764', 'learning_rate': '1.757e-06', 'epoch': '0.8142'}

 81%|████████▏ | 30910/37963 [132:30:34<31:14:20, 15.95s/it]
 81%|████████▏ | 30911/37963 [132:30:48<30:18:58, 15.48s/it]
 81%|████████▏ | 30912/37963 [132:31:03<29:40:48, 15.15s/it]
 81%|████████▏ | 30913/37963 [132:31:17<29:07:56, 14.88s/it]
 81%|████████▏ | 30914/37963 [132:31:31<28:45:35, 14.69s/it]
 81%|████████▏ | 30915/37963 [132:31:46<28:29:49, 14.56s/it]
 81%|████████▏ | 30916/37963 [132:32:00<28:22:11, 14.49s/it]
 81%|████████▏ | 30917/37963 [132:32:14<27:50:38, 14.23s/it]
 81%|████████▏ | 30918/37963 [132:32:28<27:51:03, 14.23s/it]
 81%|████████▏ | 30919/37963 [132:32:42<27:52:15, 14.24s/it]
 81%|████████▏ | 30920/37963 [132:32:56<27:57:33, 14.29s/it]
                                                            
{'loss': '0.07925', 'grad_norm': '2.251', 'learning_rate': '1.752e-06', 'epoch': '0.8145'}

 81%|████████▏ | 30920/37963 [132:32:56<27:57:33, 14.29s/it]
 81%|████████▏ | 30921/37963 [132:33:11<27:58:51, 14.30s/it]
 81%|████████▏ | 30922/37963 [132:33:25<28:00:12, 14.32s/it]
 81%|████████▏ | 30923/37963 [132:33:39<27:35:09, 14.11s/it]
 81%|████████▏ | 30924/37963 [132:33:53<27:31:55, 14.08s/it]
 81%|████████▏ | 30925/37963 [132:34:07<27:44:07, 14.19s/it]
 81%|████████▏ | 30926/37963 [132:34:22<27:50:55, 14.25s/it]
 81%|████████▏ | 30927/37963 [132:34:36<27:47:01, 14.22s/it]
 81%|████████▏ | 30928/37963 [132:34:50<27:59:32, 14.32s/it]
 81%|████████▏ | 30929/37963 [132:35:04<27:46:34, 14.22s/it]
 81%|████████▏ | 30930/37963 [132:35:19<27:50:46, 14.25s/it]
                                                            
{'loss': '0.0825', 'grad_norm': '4.826', 'learning_rate': '1.747e-06', 'epoch': '0.8147'}

 81%|████████▏ | 30930/37963 [132:35:19<27:50:46, 14.25s/it]
 81%|████████▏ | 30931/37963 [132:35:46<35:30:43, 18.18s/it]
 81%|████████▏ | 30932/37963 [132:36:00<33:19:19, 17.06s/it]
 81%|████████▏ | 30933/37963 [132:36:15<31:35:42, 16.18s/it]
 81%|████████▏ | 30934/37963 [132:36:36<34:24:42, 17.62s/it]
 81%|████████▏ | 30935/37963 [132:36:50<32:34:49, 16.69s/it]
 81%|████████▏ | 30936/37963 [132:37:04<31:15:29, 16.01s/it]
 81%|████████▏ | 30937/37963 [132:37:19<30:22:53, 15.57s/it]
 81%|████████▏ | 30938/37963 [132:37:33<29:17:23, 15.01s/it]
 81%|████████▏ | 30939/37963 [132:37:47<28:51:32, 14.79s/it]
 82%|████████▏ | 30940/37963 [132:38:01<28:40:02, 14.69s/it]
                                                            
{'loss': '0.08701', 'grad_norm': '2.189', 'learning_rate': '1.742e-06', 'epoch': '0.815'}

 82%|████████▏ | 30940/37963 [132:38:01<28:40:02, 14.69s/it]
 82%|████████▏ | 30941/37963 [132:38:23<32:31:00, 16.67s/it]
 82%|████████▏ | 30942/37963 [132:38:37<31:16:31, 16.04s/it]
 82%|████████▏ | 30943/37963 [132:38:58<33:51:14, 17.36s/it]
 82%|████████▏ | 30944/37963 [132:39:12<32:05:59, 16.46s/it]
 82%|████████▏ | 30945/37963 [132:39:26<30:51:12, 15.83s/it]
 82%|████████▏ | 30946/37963 [132:39:41<29:59:45, 15.39s/it]
 82%|████████▏ | 30947/37963 [132:39:55<29:24:08, 15.09s/it]
 82%|████████▏ | 30948/37963 [132:40:16<32:45:41, 16.81s/it]
 82%|████████▏ | 30949/37963 [132:40:30<31:20:14, 16.08s/it]
 82%|████████▏ | 30950/37963 [132:40:51<34:12:29, 17.56s/it]
                                                            
{'loss': '0.08074', 'grad_norm': '3.932', 'learning_rate': '1.738e-06', 'epoch': '0.8153'}

 82%|████████▏ | 30950/37963 [132:40:51<34:12:29, 17.56s/it]
 82%|████████▏ | 30951/37963 [132:41:06<32:18:43, 16.59s/it]
 82%|████████▏ | 30952/37963 [132:41:20<31:02:45, 15.94s/it]
 82%|████████▏ | 30953/37963 [132:41:35<30:07:23, 15.47s/it]
 82%|████████▏ | 30954/37963 [132:41:49<29:24:07, 15.10s/it]
 82%|████████▏ | 30955/37963 [132:42:03<28:57:42, 14.88s/it]
 82%|████████▏ | 30956/37963 [132:42:24<32:36:20, 16.75s/it]
 82%|████████▏ | 30957/37963 [132:42:39<31:12:38, 16.04s/it]
 82%|████████▏ | 30958/37963 [132:42:53<30:13:20, 15.53s/it]
 82%|████████▏ | 30959/37963 [132:43:07<29:12:53, 15.02s/it]
 82%|████████▏ | 30960/37963 [132:43:21<28:42:22, 14.76s/it]
                                                            
{'loss': '0.08503', 'grad_norm': '1.517', 'learning_rate': '1.733e-06', 'epoch': '0.8155'}

 82%|████████▏ | 30960/37963 [132:43:21<28:42:22, 14.76s/it]
 82%|████████▏ | 30961/37963 [132:43:35<28:29:41, 14.65s/it]
 82%|████████▏ | 30962/37963 [132:43:49<28:03:27, 14.43s/it]
 82%|████████▏ | 30963/37963 [132:44:04<28:04:23, 14.44s/it]
 82%|████████▏ | 30964/37963 [132:44:18<27:55:25, 14.36s/it]
 82%|████████▏ | 30965/37963 [132:44:32<27:50:09, 14.32s/it]
 82%|████████▏ | 30966/37963 [132:44:46<27:25:01, 14.11s/it]
 82%|████████▏ | 30967/37963 [132:45:00<27:35:54, 14.20s/it]
 82%|████████▏ | 30968/37963 [132:45:14<27:10:28, 13.99s/it]
 82%|████████▏ | 30969/37963 [132:45:28<27:16:59, 14.04s/it]
 82%|████████▏ | 30970/37963 [132:45:42<27:27:58, 14.14s/it]
                                                            
{'loss': '0.07695', 'grad_norm': '3.02', 'learning_rate': '1.728e-06', 'epoch': '0.8158'}

 82%|████████▏ | 30970/37963 [132:45:42<27:27:58, 14.14s/it]
 82%|████████▏ | 30971/37963 [132:45:57<27:36:26, 14.21s/it]
 82%|████████▏ | 30972/37963 [132:46:11<27:32:55, 14.19s/it]
 82%|████████▏ | 30973/37963 [132:46:24<27:12:05, 14.01s/it]
 82%|████████▏ | 30974/37963 [132:46:39<27:25:22, 14.13s/it]
 82%|████████▏ | 30975/37963 [132:46:53<27:31:39, 14.18s/it]
 82%|████████▏ | 30976/37963 [132:47:07<27:38:06, 14.24s/it]
 82%|████████▏ | 30977/37963 [132:47:22<27:46:34, 14.31s/it]
 82%|████████▏ | 30978/37963 [132:47:43<31:48:01, 16.39s/it]
 82%|████████▏ | 30979/37963 [132:47:57<30:30:04, 15.72s/it]
 82%|████████▏ | 30980/37963 [132:48:12<29:45:06, 15.34s/it]
                                                            
{'loss': '0.07977', 'grad_norm': '2.638', 'learning_rate': '1.723e-06', 'epoch': '0.8161'}

 82%|████████▏ | 30980/37963 [132:48:12<29:45:06, 15.34s/it]
 82%|████████▏ | 30981/37963 [132:48:26<29:08:41, 15.03s/it]
 82%|████████▏ | 30982/37963 [132:48:40<28:48:50, 14.86s/it]
 82%|████████▏ | 30983/37963 [132:49:01<32:19:35, 16.67s/it]
 82%|████████▏ | 30984/37963 [132:49:15<30:45:21, 15.86s/it]
 82%|████████▏ | 30985/37963 [132:49:30<29:56:06, 15.44s/it]
 82%|████████▏ | 30986/37963 [132:49:44<29:19:59, 15.14s/it]
 82%|████████▏ | 30987/37963 [132:49:59<28:50:37, 14.89s/it]
 82%|████████▏ | 30988/37963 [132:50:13<28:35:36, 14.76s/it]
 82%|████████▏ | 30989/37963 [132:50:35<32:33:24, 16.81s/it]
 82%|████████▏ | 30990/37963 [132:50:55<34:28:03, 17.79s/it]
                                                            
{'loss': '0.07383', 'grad_norm': '2.299', 'learning_rate': '1.718e-06', 'epoch': '0.8163'}

 82%|████████▏ | 30990/37963 [132:50:55<34:28:03, 17.79s/it]
 82%|████████▏ | 30991/37963 [132:51:09<32:23:59, 16.73s/it]
 82%|████████▏ | 30992/37963 [132:51:23<30:53:25, 15.95s/it]
 82%|████████▏ | 30993/37963 [132:51:37<29:58:05, 15.48s/it]
 82%|████████▏ | 30994/37963 [132:51:52<29:22:02, 15.17s/it]
 82%|████████▏ | 30995/37963 [132:52:06<28:47:25, 14.87s/it]
 82%|████████▏ | 30996/37963 [132:52:20<28:22:25, 14.66s/it]
 82%|████████▏ | 30997/37963 [132:52:34<27:42:24, 14.32s/it]
 82%|████████▏ | 30998/37963 [132:52:55<31:33:42, 16.31s/it]
 82%|████████▏ | 30999/37963 [132:53:16<34:11:45, 17.68s/it]
 82%|████████▏ | 31000/37963 [132:53:30<32:11:18, 16.64s/it]
                                                            
{'loss': '0.0743', 'grad_norm': '2.919', 'learning_rate': '1.714e-06', 'epoch': '0.8166'}

 82%|████████▏ | 31000/37963 [132:53:30<32:11:18, 16.64s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.41s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.41s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 82%|████████▏ | 31001/37963 [132:55:14<82:48:48, 42.82s/it]
 82%|████████▏ | 31002/37963 [132:55:28<65:57:14, 34.11s/it]
 82%|████████▏ | 31003/37963 [132:55:42<54:32:44, 28.21s/it]
 82%|████████▏ | 31004/37963 [132:55:56<46:20:49, 23.98s/it]
 82%|████████▏ | 31005/37963 [132:56:18<45:08:36, 23.36s/it]
 82%|████████▏ | 31006/37963 [132:56:32<39:57:26, 20.68s/it]
 82%|████████▏ | 31007/37963 [132:56:47<36:18:32, 18.79s/it]
 82%|████████▏ | 31008/37963 [132:57:01<33:35:01, 17.38s/it]
 82%|████████▏ | 31009/37963 [132:57:15<31:43:40, 16.43s/it]
 82%|████████▏ | 31010/37963 [132:57:29<30:15:30, 15.67s/it]
                                                            
{'loss': '0.08924', 'grad_norm': '2.708', 'learning_rate': '1.709e-06', 'epoch': '0.8169'}

 82%|████████▏ | 31010/37963 [132:57:29<30:15:30, 15.67s/it]
 82%|████████▏ | 31011/37963 [132:57:43<29:30:43, 15.28s/it]
 82%|████████▏ | 31012/37963 [132:57:58<28:59:29, 15.01s/it]
 82%|████████▏ | 31013/37963 [132:58:12<28:38:02, 14.83s/it]
 82%|████████▏ | 31014/37963 [132:58:27<28:22:48, 14.70s/it]
 82%|████████▏ | 31015/37963 [132:58:41<28:11:34, 14.61s/it]
 82%|████████▏ | 31016/37963 [132:58:55<28:04:59, 14.55s/it]
 82%|████████▏ | 31017/37963 [132:59:09<27:48:10, 14.41s/it]
 82%|████████▏ | 31018/37963 [132:59:24<27:37:08, 14.32s/it]
 82%|████████▏ | 31019/37963 [132:59:38<27:34:46, 14.30s/it]
 82%|████████▏ | 31020/37963 [132:59:52<27:39:27, 14.34s/it]
                                                            
{'loss': '0.08072', 'grad_norm': '2.026', 'learning_rate': '1.704e-06', 'epoch': '0.8171'}

 82%|████████▏ | 31020/37963 [132:59:52<27:39:27, 14.34s/it]
 82%|████████▏ | 31021/37963 [133:00:07<27:49:51, 14.43s/it]
 82%|████████▏ | 31022/37963 [133:00:21<27:46:50, 14.41s/it]
 82%|████████▏ | 31023/37963 [133:00:36<27:47:10, 14.41s/it]
 82%|████████▏ | 31024/37963 [133:00:57<31:48:30, 16.50s/it]
 82%|████████▏ | 31025/37963 [133:01:17<34:02:02, 17.66s/it]
 82%|████████▏ | 31026/37963 [133:01:32<32:15:46, 16.74s/it]
 82%|████████▏ | 31027/37963 [133:01:46<30:52:28, 16.02s/it]
 82%|████████▏ | 31028/37963 [133:02:00<29:42:58, 15.43s/it]
 82%|████████▏ | 31029/37963 [133:02:15<29:07:47, 15.12s/it]
 82%|████████▏ | 31030/37963 [133:02:29<28:41:08, 14.90s/it]
                                                            
{'loss': '0.07993', 'grad_norm': '2.629', 'learning_rate': '1.699e-06', 'epoch': '0.8174'}

 82%|████████▏ | 31030/37963 [133:02:29<28:41:08, 14.90s/it]
 82%|████████▏ | 31031/37963 [133:02:44<28:25:20, 14.76s/it]
 82%|████████▏ | 31032/37963 [133:02:58<28:11:11, 14.64s/it]
 82%|████████▏ | 31033/37963 [133:03:12<28:05:01, 14.59s/it]
 82%|████████▏ | 31034/37963 [133:03:34<31:53:19, 16.57s/it]
 82%|████████▏ | 31035/37963 [133:03:48<30:39:46, 15.93s/it]
 82%|████████▏ | 31036/37963 [133:04:02<29:27:53, 15.31s/it]
 82%|████████▏ | 31037/37963 [133:04:23<32:54:58, 17.11s/it]
 82%|████████▏ | 31038/37963 [133:04:37<31:08:09, 16.19s/it]
 82%|████████▏ | 31039/37963 [133:04:52<30:05:21, 15.64s/it]
 82%|████████▏ | 31040/37963 [133:05:05<28:51:56, 15.01s/it]
                                                            
{'loss': '0.07219', 'grad_norm': '3.533', 'learning_rate': '1.695e-06', 'epoch': '0.8176'}

 82%|████████▏ | 31040/37963 [133:05:05<28:51:56, 15.01s/it]
 82%|████████▏ | 31041/37963 [133:05:26<32:08:56, 16.72s/it]
 82%|████████▏ | 31042/37963 [133:05:39<30:18:40, 15.77s/it]
 82%|████████▏ | 31043/37963 [133:05:53<29:17:17, 15.24s/it]
 82%|████████▏ | 31044/37963 [133:06:07<28:23:32, 14.77s/it]
 82%|████████▏ | 31045/37963 [133:06:28<31:55:02, 16.61s/it]
 82%|████████▏ | 31046/37963 [133:06:42<30:41:08, 15.97s/it]
 82%|████████▏ | 31047/37963 [133:06:57<29:47:23, 15.51s/it]
 82%|████████▏ | 31048/37963 [133:07:18<33:08:28, 17.25s/it]
 82%|████████▏ | 31049/37963 [133:07:33<31:29:38, 16.40s/it]
 82%|████████▏ | 31050/37963 [133:07:47<30:19:36, 15.79s/it]
                                                            
{'loss': '0.08059', 'grad_norm': '2.602', 'learning_rate': '1.69e-06', 'epoch': '0.8179'}

 82%|████████▏ | 31050/37963 [133:07:47<30:19:36, 15.79s/it]
 82%|████████▏ | 31051/37963 [133:08:01<29:29:57, 15.36s/it]
 82%|████████▏ | 31052/37963 [133:08:15<28:41:32, 14.95s/it]
 82%|████████▏ | 31053/37963 [133:08:30<28:20:12, 14.76s/it]
 82%|████████▏ | 31054/37963 [133:08:44<28:07:44, 14.66s/it]
 82%|████████▏ | 31055/37963 [133:09:05<31:37:44, 16.48s/it]
 82%|████████▏ | 31056/37963 [133:09:19<30:13:05, 15.75s/it]
 82%|████████▏ | 31057/37963 [133:09:33<29:20:11, 15.29s/it]
 82%|████████▏ | 31058/37963 [133:09:48<28:49:32, 15.03s/it]
 82%|████████▏ | 31059/37963 [133:10:02<28:27:35, 14.84s/it]
 82%|████████▏ | 31060/37963 [133:10:16<28:17:49, 14.76s/it]
                                                            
{'loss': '0.08856', 'grad_norm': '3.818', 'learning_rate': '1.685e-06', 'epoch': '0.8182'}

 82%|████████▏ | 31060/37963 [133:10:16<28:17:49, 14.76s/it]
 82%|████████▏ | 31061/37963 [133:10:31<28:01:50, 14.62s/it]
 82%|████████▏ | 31062/37963 [133:10:45<27:50:30, 14.52s/it]
 82%|████████▏ | 31063/37963 [133:10:59<27:40:19, 14.44s/it]
 82%|████████▏ | 31064/37963 [133:11:14<27:36:01, 14.40s/it]
 82%|████████▏ | 31065/37963 [133:11:28<27:37:26, 14.42s/it]
 82%|████████▏ | 31066/37963 [133:11:43<27:44:27, 14.48s/it]
 82%|████████▏ | 31067/37963 [133:11:57<27:38:50, 14.43s/it]
 82%|████████▏ | 31068/37963 [133:12:11<27:23:13, 14.30s/it]
 82%|████████▏ | 31069/37963 [133:12:25<27:26:32, 14.33s/it]
 82%|████████▏ | 31070/37963 [133:12:39<27:12:18, 14.21s/it]
                                                            
{'loss': '0.07799', 'grad_norm': '3.365', 'learning_rate': '1.68e-06', 'epoch': '0.8184'}

 82%|████████▏ | 31070/37963 [133:12:39<27:12:18, 14.21s/it]
 82%|████████▏ | 31071/37963 [133:12:54<27:15:57, 14.24s/it]
 82%|████████▏ | 31072/37963 [133:13:15<31:04:17, 16.23s/it]
 82%|████████▏ | 31073/37963 [133:13:36<33:49:57, 17.68s/it]
 82%|████████▏ | 31074/37963 [133:13:50<31:53:40, 16.67s/it]
 82%|████████▏ | 31075/37963 [133:14:04<30:30:35, 15.95s/it]
 82%|████████▏ | 31076/37963 [133:14:19<29:34:35, 15.46s/it]
 82%|████████▏ | 31077/37963 [133:14:33<28:56:21, 15.13s/it]
 82%|████████▏ | 31078/37963 [133:14:47<28:27:18, 14.88s/it]
 82%|████████▏ | 31079/37963 [133:15:01<28:01:01, 14.65s/it]
 82%|████████▏ | 31080/37963 [133:15:16<27:55:05, 14.60s/it]
                                                            
{'loss': '0.06894', 'grad_norm': '4.276', 'learning_rate': '1.676e-06', 'epoch': '0.8187'}

 82%|████████▏ | 31080/37963 [133:15:16<27:55:05, 14.60s/it]
 82%|████████▏ | 31081/37963 [133:15:29<27:20:51, 14.31s/it]
 82%|████████▏ | 31082/37963 [133:15:50<31:06:42, 16.28s/it]
 82%|████████▏ | 31083/37963 [133:16:05<29:59:47, 15.70s/it]
 82%|████████▏ | 31084/37963 [133:16:18<28:55:40, 15.14s/it]
 82%|████████▏ | 31085/37963 [133:16:39<32:00:18, 16.75s/it]
 82%|████████▏ | 31086/37963 [133:16:53<30:39:08, 16.05s/it]
 82%|████████▏ | 31087/37963 [133:17:08<29:42:39, 15.56s/it]
 82%|████████▏ | 31088/37963 [133:17:22<28:48:17, 15.08s/it]
 82%|████████▏ | 31089/37963 [133:17:43<32:05:03, 16.80s/it]
 82%|████████▏ | 31090/37963 [133:17:57<30:32:02, 15.99s/it]
                                                            
{'loss': '0.08088', 'grad_norm': '3.035', 'learning_rate': '1.671e-06', 'epoch': '0.819'}

 82%|████████▏ | 31090/37963 [133:17:57<30:32:02, 15.99s/it]
 82%|████████▏ | 31091/37963 [133:18:11<29:38:28, 15.53s/it]
 82%|████████▏ | 31092/37963 [133:18:25<28:58:09, 15.18s/it]
 82%|████████▏ | 31093/37963 [133:18:40<28:30:16, 14.94s/it]
 82%|████████▏ | 31094/37963 [133:18:54<28:08:20, 14.75s/it]
 82%|████████▏ | 31095/37963 [133:19:15<31:38:29, 16.59s/it]
 82%|████████▏ | 31096/37963 [133:19:30<30:26:39, 15.96s/it]
 82%|████████▏ | 31097/37963 [133:19:51<33:30:30, 17.57s/it]
 82%|████████▏ | 31098/37963 [133:20:05<31:40:49, 16.61s/it]
 82%|████████▏ | 31099/37963 [133:20:19<30:14:18, 15.86s/it]
 82%|████████▏ | 31100/37963 [133:20:34<29:29:52, 15.47s/it]
                                                            
{'loss': '0.07661', 'grad_norm': '2.159', 'learning_rate': '1.666e-06', 'epoch': '0.8192'}

 82%|████████▏ | 31100/37963 [133:20:34<29:29:52, 15.47s/it]
 82%|████████▏ | 31101/37963 [133:20:48<28:46:41, 15.10s/it]
 82%|████████▏ | 31102/37963 [133:21:02<28:01:07, 14.70s/it]
 82%|████████▏ | 31103/37963 [133:21:16<27:51:52, 14.62s/it]
 82%|████████▏ | 31104/37963 [133:21:38<31:55:49, 16.76s/it]
 82%|████████▏ | 31105/37963 [133:21:52<30:15:56, 15.89s/it]
 82%|████████▏ | 31106/37963 [133:22:06<29:24:57, 15.44s/it]
 82%|████████▏ | 31107/37963 [133:22:21<28:52:07, 15.16s/it]
 82%|████████▏ | 31108/37963 [133:22:35<28:26:06, 14.93s/it]
 82%|████████▏ | 31109/37963 [133:22:49<27:54:47, 14.66s/it]
 82%|████████▏ | 31110/37963 [133:23:04<27:45:39, 14.58s/it]
                                                            
{'loss': '0.08059', 'grad_norm': '3.41', 'learning_rate': '1.661e-06', 'epoch': '0.8195'}

 82%|████████▏ | 31110/37963 [133:23:04<27:45:39, 14.58s/it]
 82%|████████▏ | 31111/37963 [133:23:18<27:38:47, 14.53s/it]
 82%|████████▏ | 31112/37963 [133:23:32<27:33:14, 14.48s/it]
 82%|████████▏ | 31113/37963 [133:23:47<27:27:32, 14.43s/it]
 82%|████████▏ | 31114/37963 [133:24:01<27:27:56, 14.44s/it]
 82%|████████▏ | 31115/37963 [133:24:16<27:24:30, 14.41s/it]
 82%|████████▏ | 31116/37963 [133:24:30<27:26:14, 14.43s/it]
 82%|████████▏ | 31117/37963 [133:24:44<27:13:52, 14.32s/it]
 82%|████████▏ | 31118/37963 [133:24:58<27:09:35, 14.28s/it]
 82%|████████▏ | 31119/37963 [133:25:13<27:13:41, 14.32s/it]
 82%|████████▏ | 31120/37963 [133:25:26<26:54:11, 14.15s/it]
                                                            
{'loss': '0.08043', 'grad_norm': '2.9', 'learning_rate': '1.657e-06', 'epoch': '0.8197'}

 82%|████████▏ | 31120/37963 [133:25:26<26:54:11, 14.15s/it]
 82%|████████▏ | 31121/37963 [133:25:54<34:45:11, 18.29s/it]
 82%|████████▏ | 31122/37963 [133:26:09<32:29:28, 17.10s/it]
 82%|████████▏ | 31123/37963 [133:26:23<31:00:35, 16.32s/it]
 82%|████████▏ | 31124/37963 [133:26:37<29:41:25, 15.63s/it]
 82%|████████▏ | 31125/37963 [133:26:52<29:01:05, 15.28s/it]
 82%|████████▏ | 31126/37963 [133:27:06<28:20:39, 14.92s/it]
 82%|████████▏ | 31127/37963 [133:27:20<27:55:46, 14.71s/it]
 82%|████████▏ | 31128/37963 [133:27:34<27:43:33, 14.60s/it]
 82%|████████▏ | 31129/37963 [133:27:49<27:33:22, 14.52s/it]
 82%|████████▏ | 31130/37963 [133:28:03<27:31:15, 14.50s/it]
                                                            
{'loss': '0.07632', 'grad_norm': '2.216', 'learning_rate': '1.652e-06', 'epoch': '0.82'}

 82%|████████▏ | 31130/37963 [133:28:03<27:31:15, 14.50s/it]
 82%|████████▏ | 31131/37963 [133:28:17<27:12:48, 14.34s/it]
 82%|████████▏ | 31132/37963 [133:28:37<30:33:26, 16.10s/it]
 82%|████████▏ | 31133/37963 [133:28:52<29:34:21, 15.59s/it]
 82%|████████▏ | 31134/37963 [133:29:05<28:21:03, 14.95s/it]
 82%|████████▏ | 31135/37963 [133:29:20<28:01:17, 14.77s/it]
 82%|████████▏ | 31136/37963 [133:29:48<35:42:35, 18.83s/it]
 82%|████████▏ | 31137/37963 [133:30:02<33:12:55, 17.52s/it]
 82%|████████▏ | 31138/37963 [133:30:16<31:12:51, 16.46s/it]
 82%|████████▏ | 31139/37963 [133:30:31<30:06:51, 15.89s/it]
 82%|████████▏ | 31140/37963 [133:30:45<29:14:03, 15.42s/it]
                                                            
{'loss': '0.06909', 'grad_norm': '1.858', 'learning_rate': '1.647e-06', 'epoch': '0.8203'}

 82%|████████▏ | 31140/37963 [133:30:45<29:14:03, 15.42s/it]
 82%|████████▏ | 31141/37963 [133:31:00<28:38:58, 15.12s/it]
 82%|████████▏ | 31142/37963 [133:31:14<28:13:15, 14.89s/it]
 82%|████████▏ | 31143/37963 [133:31:28<27:58:18, 14.77s/it]
 82%|████████▏ | 31144/37963 [133:31:49<31:08:45, 16.44s/it]
 82%|████████▏ | 31145/37963 [133:32:10<34:05:57, 18.00s/it]
 82%|████████▏ | 31146/37963 [133:32:25<32:03:32, 16.93s/it]
 82%|████████▏ | 31147/37963 [133:32:39<30:38:39, 16.19s/it]
 82%|████████▏ | 31148/37963 [133:32:54<29:40:47, 15.68s/it]
 82%|████████▏ | 31149/37963 [133:33:08<28:53:35, 15.26s/it]
 82%|████████▏ | 31150/37963 [133:33:22<28:23:01, 15.00s/it]
                                                            
{'loss': '0.08506', 'grad_norm': '3.879', 'learning_rate': '1.643e-06', 'epoch': '0.8205'}

 82%|████████▏ | 31150/37963 [133:33:22<28:23:01, 15.00s/it]
 82%|████████▏ | 31151/37963 [133:33:43<31:47:15, 16.80s/it]
 82%|████████▏ | 31152/37963 [133:33:58<30:23:09, 16.06s/it]
 82%|████████▏ | 31153/37963 [133:34:12<29:24:46, 15.55s/it]
 82%|████████▏ | 31154/37963 [133:34:26<28:33:07, 15.10s/it]
 82%|████████▏ | 31155/37963 [133:34:41<28:10:12, 14.90s/it]
 82%|████████▏ | 31156/37963 [133:34:55<27:50:40, 14.73s/it]
 82%|████████▏ | 31157/37963 [133:35:09<27:29:40, 14.54s/it]
 82%|████████▏ | 31158/37963 [133:35:23<27:07:28, 14.35s/it]
 82%|████████▏ | 31159/37963 [133:35:37<27:06:50, 14.35s/it]
 82%|████████▏ | 31160/37963 [133:35:52<27:07:02, 14.35s/it]
                                                            
{'loss': '0.07988', 'grad_norm': '2.911', 'learning_rate': '1.638e-06', 'epoch': '0.8208'}

 82%|████████▏ | 31160/37963 [133:35:52<27:07:02, 14.35s/it]
 82%|████████▏ | 31161/37963 [133:36:06<26:58:30, 14.28s/it]
 82%|████████▏ | 31162/37963 [133:36:20<27:03:00, 14.32s/it]
 82%|████████▏ | 31163/37963 [133:36:35<27:05:47, 14.35s/it]
 82%|████████▏ | 31164/37963 [133:36:49<27:10:07, 14.39s/it]
 82%|████████▏ | 31165/37963 [133:37:03<27:10:01, 14.39s/it]
 82%|████████▏ | 31166/37963 [133:37:18<27:03:55, 14.34s/it]
 82%|████████▏ | 31167/37963 [133:37:32<27:03:04, 14.33s/it]
 82%|████████▏ | 31168/37963 [133:37:59<34:29:28, 18.27s/it]
 82%|████████▏ | 31169/37963 [133:38:14<32:15:28, 17.09s/it]
 82%|████████▏ | 31170/37963 [133:38:28<30:45:36, 16.30s/it]
                                                            
{'loss': '0.07441', 'grad_norm': '2.525', 'learning_rate': '1.633e-06', 'epoch': '0.8211'}

 82%|████████▏ | 31170/37963 [133:38:28<30:45:36, 16.30s/it]
 82%|████████▏ | 31171/37963 [133:38:43<29:41:27, 15.74s/it]
 82%|████████▏ | 31172/37963 [133:38:57<28:54:06, 15.32s/it]
 82%|████████▏ | 31173/37963 [133:39:11<28:23:03, 15.05s/it]
 82%|████████▏ | 31174/37963 [133:39:26<27:58:37, 14.84s/it]
 82%|████████▏ | 31175/37963 [133:39:40<27:44:52, 14.72s/it]
 82%|████████▏ | 31176/37963 [133:39:55<27:31:31, 14.60s/it]
 82%|████████▏ | 31177/37963 [133:40:09<27:11:46, 14.43s/it]
 82%|████████▏ | 31178/37963 [133:40:23<27:10:20, 14.42s/it]
 82%|████████▏ | 31179/37963 [133:40:37<26:56:53, 14.30s/it]
 82%|████████▏ | 31180/37963 [133:40:57<30:18:16, 16.08s/it]
                                                            
{'loss': '0.0686', 'grad_norm': '2.631', 'learning_rate': '1.629e-06', 'epoch': '0.8213'}

 82%|████████▏ | 31180/37963 [133:40:57<30:18:16, 16.08s/it]
 82%|████████▏ | 31181/37963 [133:41:11<29:07:15, 15.46s/it]
 82%|████████▏ | 31182/37963 [133:41:26<28:27:56, 15.11s/it]
 82%|████████▏ | 31183/37963 [133:41:40<27:54:52, 14.82s/it]
 82%|████████▏ | 31184/37963 [133:42:00<31:17:07, 16.61s/it]
 82%|████████▏ | 31185/37963 [133:42:22<34:05:49, 18.11s/it]
 82%|████████▏ | 31186/37963 [133:42:37<32:01:23, 17.01s/it]
 82%|████████▏ | 31187/37963 [133:42:51<30:33:50, 16.24s/it]
 82%|████████▏ | 31188/37963 [133:43:05<29:33:39, 15.71s/it]
 82%|████████▏ | 31189/37963 [133:43:20<28:50:26, 15.33s/it]
 82%|████████▏ | 31190/37963 [133:43:34<28:18:53, 15.05s/it]
                                                            
{'loss': '0.08276', 'grad_norm': '4.14', 'learning_rate': '1.624e-06', 'epoch': '0.8216'}

 82%|████████▏ | 31190/37963 [133:43:34<28:18:53, 15.05s/it]
 82%|████████▏ | 31191/37963 [133:43:48<27:50:16, 14.80s/it]
 82%|████████▏ | 31192/37963 [133:44:16<34:53:50, 18.55s/it]
 82%|████████▏ | 31193/37963 [133:44:30<32:36:28, 17.34s/it]
 82%|████████▏ | 31194/37963 [133:44:45<30:56:44, 16.46s/it]
 82%|████████▏ | 31195/37963 [133:44:59<29:43:22, 15.81s/it]
 82%|████████▏ | 31196/37963 [133:45:13<28:49:59, 15.34s/it]
 82%|████████▏ | 31197/37963 [133:45:27<28:13:03, 15.01s/it]
 82%|████████▏ | 31198/37963 [133:45:42<27:52:18, 14.83s/it]
 82%|████████▏ | 31199/37963 [133:45:56<27:15:49, 14.51s/it]
 82%|████████▏ | 31200/37963 [133:46:10<27:15:22, 14.51s/it]
                                                            
{'loss': '0.08216', 'grad_norm': '2.94', 'learning_rate': '1.619e-06', 'epoch': '0.8219'}

 82%|████████▏ | 31200/37963 [133:46:10<27:15:22, 14.51s/it]
 82%|████████▏ | 31201/37963 [133:46:31<30:54:14, 16.45s/it]
 82%|████████▏ | 31202/37963 [133:46:46<29:42:57, 15.82s/it]
 82%|████████▏ | 31203/37963 [133:47:00<28:52:40, 15.38s/it]
 82%|████████▏ | 31204/37963 [133:47:14<28:08:01, 14.98s/it]
 82%|████████▏ | 31205/37963 [133:47:28<27:50:54, 14.84s/it]
 82%|████████▏ | 31206/37963 [133:47:43<27:34:28, 14.69s/it]
 82%|████████▏ | 31207/37963 [133:47:57<27:23:31, 14.60s/it]
 82%|████████▏ | 31208/37963 [133:48:12<27:16:09, 14.53s/it]
 82%|████████▏ | 31209/37963 [133:48:26<27:09:30, 14.48s/it]
 82%|████████▏ | 31210/37963 [133:48:39<26:27:55, 14.11s/it]
                                                            
{'loss': '0.08513', 'grad_norm': '2.547', 'learning_rate': '1.615e-06', 'epoch': '0.8221'}

 82%|████████▏ | 31210/37963 [133:48:39<26:27:55, 14.11s/it]
 82%|████████▏ | 31211/37963 [133:48:54<26:38:39, 14.21s/it]
 82%|████████▏ | 31212/37963 [133:49:08<26:37:41, 14.20s/it]
 82%|████████▏ | 31213/37963 [133:49:22<26:46:12, 14.28s/it]
 82%|████████▏ | 31214/37963 [133:49:36<26:32:10, 14.15s/it]
 82%|████████▏ | 31215/37963 [133:49:58<30:57:30, 16.52s/it]
 82%|████████▏ | 31216/37963 [133:50:13<29:49:20, 15.91s/it]
 82%|████████▏ | 31217/37963 [133:50:27<28:57:33, 15.45s/it]
 82%|████████▏ | 31218/37963 [133:50:48<32:02:45, 17.10s/it]
 82%|████████▏ | 31219/37963 [133:51:02<30:27:42, 16.26s/it]
 82%|████████▏ | 31220/37963 [133:51:17<29:23:48, 15.69s/it]
                                                            
{'loss': '0.07075', 'grad_norm': '2.629', 'learning_rate': '1.61e-06', 'epoch': '0.8224'}

 82%|████████▏ | 31220/37963 [133:51:17<29:23:48, 15.69s/it]
 82%|████████▏ | 31221/37963 [133:51:31<28:37:10, 15.28s/it]
 82%|████████▏ | 31222/37963 [133:51:45<28:05:16, 15.00s/it]
 82%|████████▏ | 31223/37963 [133:52:00<27:43:16, 14.81s/it]
 82%|████████▏ | 31224/37963 [133:52:14<27:24:42, 14.64s/it]
 82%|████████▏ | 31225/37963 [133:52:28<27:14:03, 14.55s/it]
 82%|████████▏ | 31226/37963 [133:52:43<27:12:06, 14.54s/it]
 82%|████████▏ | 31227/37963 [133:52:57<27:00:27, 14.43s/it]
 82%|████████▏ | 31228/37963 [133:53:11<27:00:17, 14.43s/it]
 82%|████████▏ | 31229/37963 [133:53:25<26:48:09, 14.33s/it]
 82%|████████▏ | 31230/37963 [133:53:46<30:30:08, 16.31s/it]
                                                            
{'loss': '0.09283', 'grad_norm': '2.585', 'learning_rate': '1.605e-06', 'epoch': '0.8226'}

 82%|████████▏ | 31230/37963 [133:53:46<30:30:08, 16.31s/it]
 82%|████████▏ | 31231/37963 [133:54:01<29:27:28, 15.75s/it]
 82%|████████▏ | 31232/37963 [133:54:22<32:19:18, 17.29s/it]
 82%|████████▏ | 31233/37963 [133:54:42<34:14:17, 18.31s/it]
 82%|████████▏ | 31234/37963 [133:54:56<31:43:17, 16.97s/it]
 82%|████████▏ | 31235/37963 [133:55:11<30:17:29, 16.21s/it]
 82%|████████▏ | 31236/37963 [133:55:25<29:09:45, 15.61s/it]
 82%|████████▏ | 31237/37963 [133:55:39<28:14:24, 15.12s/it]
 82%|████████▏ | 31238/37963 [133:55:53<27:37:01, 14.78s/it]
 82%|████████▏ | 31239/37963 [133:56:07<27:26:05, 14.69s/it]
 82%|████████▏ | 31240/37963 [133:56:28<30:35:55, 16.38s/it]
                                                            
{'loss': '0.08488', 'grad_norm': '2.476', 'learning_rate': '1.601e-06', 'epoch': '0.8229'}

 82%|████████▏ | 31240/37963 [133:56:28<30:35:55, 16.38s/it]
 82%|████████▏ | 31241/37963 [133:56:42<29:26:15, 15.77s/it]
 82%|████████▏ | 31242/37963 [133:57:04<32:45:20, 17.55s/it]
 82%|████████▏ | 31243/37963 [133:57:18<31:10:49, 16.70s/it]
 82%|████████▏ | 31244/37963 [133:57:33<29:55:45, 16.04s/it]
 82%|████████▏ | 31245/37963 [133:57:47<29:01:09, 15.55s/it]
 82%|████████▏ | 31246/37963 [133:58:02<28:24:22, 15.22s/it]
 82%|████████▏ | 31247/37963 [133:58:16<27:58:04, 14.99s/it]
 82%|████████▏ | 31248/37963 [133:58:30<27:33:29, 14.77s/it]
 82%|████████▏ | 31249/37963 [133:58:52<31:33:06, 16.92s/it]
 82%|████████▏ | 31250/37963 [133:59:07<30:07:48, 16.16s/it]
                                                            
{'loss': '0.07596', 'grad_norm': '2.111', 'learning_rate': '1.596e-06', 'epoch': '0.8232'}

 82%|████████▏ | 31250/37963 [133:59:07<30:07:48, 16.16s/it]
 82%|████████▏ | 31251/37963 [133:59:21<29:08:54, 15.63s/it]
 82%|████████▏ | 31252/37963 [133:59:35<27:58:01, 15.00s/it]
 82%|████████▏ | 31253/37963 [133:59:49<27:38:11, 14.83s/it]
 82%|████████▏ | 31254/37963 [134:00:04<27:27:28, 14.73s/it]
 82%|████████▏ | 31255/37963 [134:00:18<27:17:24, 14.65s/it]
 82%|████████▏ | 31256/37963 [134:00:33<27:09:59, 14.58s/it]
 82%|████████▏ | 31257/37963 [134:00:47<27:03:50, 14.53s/it]
 82%|████████▏ | 31258/37963 [134:01:01<26:59:33, 14.49s/it]
 82%|████████▏ | 31259/37963 [134:01:16<26:55:28, 14.46s/it]
 82%|████████▏ | 31260/37963 [134:01:30<26:48:32, 14.40s/it]
                                                            
{'loss': '0.07862', 'grad_norm': '2.391', 'learning_rate': '1.591e-06', 'epoch': '0.8234'}

 82%|████████▏ | 31260/37963 [134:01:30<26:48:32, 14.40s/it]
 82%|████████▏ | 31261/37963 [134:01:44<26:38:19, 14.31s/it]
 82%|████████▏ | 31262/37963 [134:02:05<30:04:21, 16.16s/it]
 82%|████████▏ | 31263/37963 [134:02:19<29:08:48, 15.66s/it]
 82%|████████▏ | 31264/37963 [134:02:33<28:16:31, 15.19s/it]
 82%|████████▏ | 31265/37963 [134:02:48<27:50:24, 14.96s/it]
 82%|████████▏ | 31266/37963 [134:03:02<27:29:43, 14.78s/it]
 82%|████████▏ | 31267/37963 [134:03:16<27:14:17, 14.64s/it]
 82%|████████▏ | 31268/37963 [134:03:36<30:21:23, 16.32s/it]
 82%|████████▏ | 31269/37963 [134:03:51<29:24:54, 15.82s/it]
 82%|████████▏ | 31270/37963 [134:04:06<28:38:21, 15.40s/it]
                                                            
{'loss': '0.06981', 'grad_norm': '2.438', 'learning_rate': '1.587e-06', 'epoch': '0.8237'}

 82%|████████▏ | 31270/37963 [134:04:06<28:38:21, 15.40s/it]
 82%|████████▏ | 31271/37963 [134:04:19<27:42:12, 14.90s/it]
 82%|████████▏ | 31272/37963 [134:04:34<27:21:08, 14.72s/it]
 82%|████████▏ | 31273/37963 [134:04:48<27:12:45, 14.64s/it]
 82%|████████▏ | 31274/37963 [134:05:02<27:03:24, 14.56s/it]
 82%|████████▏ | 31275/37963 [134:05:17<26:56:32, 14.50s/it]
 82%|████████▏ | 31276/37963 [134:05:31<26:45:26, 14.41s/it]
 82%|████████▏ | 31277/37963 [134:05:52<30:28:05, 16.41s/it]
 82%|████████▏ | 31278/37963 [134:06:07<29:24:00, 15.83s/it]
 82%|████████▏ | 31279/37963 [134:06:21<28:37:53, 15.42s/it]
 82%|████████▏ | 31280/37963 [134:06:35<28:06:03, 15.14s/it]
                                                            
{'loss': '0.09208', 'grad_norm': '3.558', 'learning_rate': '1.582e-06', 'epoch': '0.824'}

 82%|████████▏ | 31280/37963 [134:06:35<28:06:03, 15.14s/it]
 82%|████████▏ | 31281/37963 [134:06:50<27:39:34, 14.90s/it]
 82%|████████▏ | 31282/37963 [134:07:11<31:18:25, 16.87s/it]
 82%|████████▏ | 31283/37963 [134:07:25<29:43:47, 16.02s/it]
 82%|████████▏ | 31284/37963 [134:07:46<32:27:17, 17.49s/it]
 82%|████████▏ | 31285/37963 [134:08:01<30:42:29, 16.55s/it]
 82%|████████▏ | 31286/37963 [134:08:15<29:32:08, 15.92s/it]
 82%|████████▏ | 31287/37963 [134:08:29<28:38:07, 15.44s/it]
 82%|████████▏ | 31288/37963 [134:08:44<28:03:22, 15.13s/it]
 82%|████████▏ | 31289/37963 [134:08:58<27:41:36, 14.94s/it]
 82%|████████▏ | 31290/37963 [134:09:26<34:55:21, 18.84s/it]
                                                            
{'loss': '0.07108', 'grad_norm': '2.136', 'learning_rate': '1.578e-06', 'epoch': '0.8242'}

 82%|████████▏ | 31290/37963 [134:09:26<34:55:21, 18.84s/it]
 82%|████████▏ | 31291/37963 [134:09:41<32:23:37, 17.48s/it]
 82%|████████▏ | 31292/37963 [134:09:55<30:42:11, 16.57s/it]
 82%|████████▏ | 31293/37963 [134:10:09<29:32:51, 15.95s/it]
 82%|████████▏ | 31294/37963 [134:10:24<28:42:05, 15.49s/it]
 82%|████████▏ | 31295/37963 [134:10:38<28:09:36, 15.20s/it]
 82%|████████▏ | 31296/37963 [134:10:53<27:42:48, 14.96s/it]
 82%|████████▏ | 31297/37963 [134:11:07<27:23:23, 14.79s/it]
 82%|████████▏ | 31298/37963 [134:11:28<30:47:30, 16.63s/it]
 82%|████████▏ | 31299/37963 [134:11:43<29:32:20, 15.96s/it]
 82%|████████▏ | 31300/37963 [134:11:57<28:41:58, 15.51s/it]
                                                            
{'loss': '0.07559', 'grad_norm': '2.401', 'learning_rate': '1.573e-06', 'epoch': '0.8245'}

 82%|████████▏ | 31300/37963 [134:11:57<28:41:58, 15.51s/it]
 82%|████████▏ | 31301/37963 [134:12:11<28:04:15, 15.17s/it]
 82%|████████▏ | 31302/37963 [134:12:26<27:36:47, 14.92s/it]
 82%|████████▏ | 31303/37963 [134:12:40<27:13:59, 14.72s/it]
 82%|████████▏ | 31304/37963 [134:12:54<27:01:47, 14.61s/it]
 82%|████████▏ | 31305/37963 [134:13:09<26:53:34, 14.54s/it]
 82%|████████▏ | 31306/37963 [134:13:23<26:37:38, 14.40s/it]
 82%|████████▏ | 31307/37963 [134:13:37<26:38:17, 14.41s/it]
 82%|████████▏ | 31308/37963 [134:13:51<26:27:34, 14.31s/it]
 82%|████████▏ | 31309/37963 [134:14:06<26:28:47, 14.33s/it]
 82%|████████▏ | 31310/37963 [134:14:20<26:34:42, 14.38s/it]
                                                            
{'loss': '0.07676', 'grad_norm': '2.043', 'learning_rate': '1.568e-06', 'epoch': '0.8248'}

 82%|████████▏ | 31310/37963 [134:14:20<26:34:42, 14.38s/it]
 82%|████████▏ | 31311/37963 [134:14:41<30:21:21, 16.43s/it]
 82%|████████▏ | 31312/37963 [134:14:56<29:10:38, 15.79s/it]
 82%|████████▏ | 31313/37963 [134:15:10<28:28:47, 15.42s/it]
 82%|████████▏ | 31314/37963 [134:15:25<27:56:40, 15.13s/it]
 82%|████████▏ | 31315/37963 [134:15:39<27:21:57, 14.82s/it]
 82%|████████▏ | 31316/37963 [134:15:53<27:07:08, 14.69s/it]
 82%|████████▏ | 31317/37963 [134:16:14<30:35:18, 16.57s/it]
 82%|████████▏ | 31318/37963 [134:16:29<29:23:17, 15.92s/it]
 82%|████████▏ | 31319/37963 [134:16:43<28:30:16, 15.45s/it]
 83%|████████▎ | 31320/37963 [134:16:57<27:55:41, 15.13s/it]
                                                            
{'loss': '0.08699', 'grad_norm': '2.868', 'learning_rate': '1.564e-06', 'epoch': '0.825'}

 83%|████████▎ | 31320/37963 [134:16:57<27:55:41, 15.13s/it]
 83%|████████▎ | 31321/37963 [134:17:12<27:29:00, 14.90s/it]
 83%|████████▎ | 31322/37963 [134:17:26<27:12:04, 14.75s/it]
 83%|████████▎ | 31323/37963 [134:17:40<27:00:25, 14.64s/it]
 83%|████████▎ | 31324/37963 [134:17:54<26:40:13, 14.46s/it]
 83%|████████▎ | 31325/37963 [134:18:09<26:30:27, 14.38s/it]
 83%|████████▎ | 31326/37963 [134:18:29<30:04:46, 16.32s/it]
 83%|████████▎ | 31327/37963 [134:18:44<29:01:44, 15.75s/it]
 83%|████████▎ | 31328/37963 [134:18:58<28:14:23, 15.32s/it]
 83%|████████▎ | 31329/37963 [134:19:13<27:40:22, 15.02s/it]
 83%|████████▎ | 31330/37963 [134:19:27<27:19:42, 14.83s/it]
                                                            
{'loss': '0.08216', 'grad_norm': '2.93', 'learning_rate': '1.559e-06', 'epoch': '0.8253'}

 83%|████████▎ | 31330/37963 [134:19:27<27:19:42, 14.83s/it]
 83%|████████▎ | 31331/37963 [134:19:54<33:59:56, 18.46s/it]
 83%|████████▎ | 31332/37963 [134:20:08<31:44:48, 17.24s/it]
 83%|████████▎ | 31333/37963 [134:20:23<30:09:31, 16.38s/it]
 83%|████████▎ | 31334/37963 [134:20:37<28:51:49, 15.67s/it]
 83%|████████▎ | 31335/37963 [134:20:51<28:10:08, 15.30s/it]
 83%|████████▎ | 31336/37963 [134:21:05<27:41:00, 15.04s/it]
 83%|████████▎ | 31337/37963 [134:21:20<27:10:12, 14.76s/it]
 83%|████████▎ | 31338/37963 [134:21:34<26:58:29, 14.66s/it]
 83%|████████▎ | 31339/37963 [134:22:02<34:18:38, 18.65s/it]
 83%|████████▎ | 31340/37963 [134:22:16<31:53:42, 17.34s/it]
                                                            
{'loss': '0.07349', 'grad_norm': '3.317', 'learning_rate': '1.555e-06', 'epoch': '0.8255'}

 83%|████████▎ | 31340/37963 [134:22:16<31:53:42, 17.34s/it]
 83%|████████▎ | 31341/37963 [134:22:31<30:18:03, 16.47s/it]
 83%|████████▎ | 31342/37963 [134:22:45<29:11:37, 15.87s/it]
 83%|████████▎ | 31343/37963 [134:23:00<28:23:31, 15.44s/it]
 83%|████████▎ | 31344/37963 [134:23:14<27:47:01, 15.11s/it]
 83%|████████▎ | 31345/37963 [134:23:28<27:21:21, 14.88s/it]
 83%|████████▎ | 31346/37963 [134:23:49<30:46:59, 16.75s/it]
 83%|████████▎ | 31347/37963 [134:24:04<29:24:58, 16.01s/it]
 83%|████████▎ | 31348/37963 [134:24:18<28:31:07, 15.52s/it]
 83%|████████▎ | 31349/37963 [134:24:33<27:55:32, 15.20s/it]
 83%|████████▎ | 31350/37963 [134:24:47<27:29:33, 14.97s/it]
                                                            
{'loss': '0.07749', 'grad_norm': '2.297', 'learning_rate': '1.55e-06', 'epoch': '0.8258'}

 83%|████████▎ | 31350/37963 [134:24:47<27:29:33, 14.97s/it]
 83%|████████▎ | 31351/37963 [134:25:01<27:09:10, 14.78s/it]
 83%|████████▎ | 31352/37963 [134:25:16<26:52:54, 14.64s/it]
 83%|████████▎ | 31353/37963 [134:25:30<26:40:05, 14.52s/it]
 83%|████████▎ | 31354/37963 [134:25:44<26:28:44, 14.42s/it]
 83%|████████▎ | 31355/37963 [134:25:58<26:25:55, 14.40s/it]
 83%|████████▎ | 31356/37963 [134:26:13<26:24:18, 14.39s/it]
 83%|████████▎ | 31357/37963 [134:26:27<26:25:16, 14.40s/it]
 83%|████████▎ | 31358/37963 [134:26:42<26:24:15, 14.39s/it]
 83%|████████▎ | 31359/37963 [134:27:03<30:02:45, 16.38s/it]
 83%|████████▎ | 31360/37963 [134:27:17<29:03:16, 15.84s/it]
                                                            
{'loss': '0.08033', 'grad_norm': '2.435', 'learning_rate': '1.546e-06', 'epoch': '0.8261'}

 83%|████████▎ | 31360/37963 [134:27:17<29:03:16, 15.84s/it]
 83%|████████▎ | 31361/37963 [134:27:32<28:15:40, 15.41s/it]
 83%|████████▎ | 31362/37963 [134:27:46<27:44:38, 15.13s/it]
 83%|████████▎ | 31363/37963 [134:28:00<27:19:10, 14.90s/it]
 83%|████████▎ | 31364/37963 [134:28:15<26:57:16, 14.70s/it]
 83%|████████▎ | 31365/37963 [134:28:29<26:50:06, 14.64s/it]
 83%|████████▎ | 31366/37963 [134:28:50<30:17:23, 16.53s/it]
 83%|████████▎ | 31367/37963 [134:29:04<28:56:50, 15.80s/it]
 83%|████████▎ | 31368/37963 [134:29:18<28:06:46, 15.35s/it]
 83%|████████▎ | 31369/37963 [134:29:32<27:22:46, 14.95s/it]
 83%|████████▎ | 31370/37963 [134:29:47<27:02:50, 14.77s/it]
                                                            
{'loss': '0.07691', 'grad_norm': '2.336', 'learning_rate': '1.541e-06', 'epoch': '0.8263'}

 83%|████████▎ | 31370/37963 [134:29:47<27:02:50, 14.77s/it]
 83%|████████▎ | 31371/37963 [134:30:01<26:43:39, 14.60s/it]
 83%|████████▎ | 31372/37963 [134:30:15<26:35:09, 14.52s/it]
 83%|████████▎ | 31373/37963 [134:30:30<26:32:57, 14.50s/it]
 83%|████████▎ | 31374/37963 [134:30:50<29:48:06, 16.28s/it]
 83%|████████▎ | 31375/37963 [134:31:05<28:40:48, 15.67s/it]
 83%|████████▎ | 31376/37963 [134:31:19<27:59:53, 15.30s/it]
 83%|████████▎ | 31377/37963 [134:31:33<27:32:25, 15.05s/it]
 83%|████████▎ | 31378/37963 [134:31:48<27:11:08, 14.86s/it]
 83%|████████▎ | 31379/37963 [134:32:08<30:21:15, 16.60s/it]
 83%|████████▎ | 31380/37963 [134:32:23<29:09:24, 15.94s/it]
                                                            
{'loss': '0.07303', 'grad_norm': '3.184', 'learning_rate': '1.537e-06', 'epoch': '0.8266'}

 83%|████████▎ | 31380/37963 [134:32:23<29:09:24, 15.94s/it]
 83%|████████▎ | 31381/37963 [134:32:44<31:42:15, 17.34s/it]
 83%|████████▎ | 31382/37963 [134:32:58<29:54:04, 16.36s/it]
 83%|████████▎ | 31383/37963 [134:33:11<28:32:49, 15.62s/it]
 83%|████████▎ | 31384/37963 [134:33:26<27:53:32, 15.26s/it]
 83%|████████▎ | 31385/37963 [134:33:40<27:28:50, 15.04s/it]
 83%|████████▎ | 31386/37963 [134:33:55<27:07:27, 14.85s/it]
 83%|████████▎ | 31387/37963 [134:34:22<33:57:17, 18.59s/it]
 83%|████████▎ | 31388/37963 [134:34:37<31:43:00, 17.37s/it]
 83%|████████▎ | 31389/37963 [134:34:51<30:03:40, 16.46s/it]
 83%|████████▎ | 31390/37963 [134:35:05<28:30:33, 15.61s/it]
                                                            
{'loss': '0.07114', 'grad_norm': '2.021', 'learning_rate': '1.532e-06', 'epoch': '0.8269'}

 83%|████████▎ | 31390/37963 [134:35:05<28:30:33, 15.61s/it]
 83%|████████▎ | 31391/37963 [134:35:19<27:47:48, 15.23s/it]
 83%|████████▎ | 31392/37963 [134:35:33<27:19:07, 14.97s/it]
 83%|████████▎ | 31393/37963 [134:35:48<26:56:12, 14.76s/it]
 83%|████████▎ | 31394/37963 [134:36:02<26:50:22, 14.71s/it]
 83%|████████▎ | 31395/37963 [134:36:17<26:39:40, 14.61s/it]
 83%|████████▎ | 31396/37963 [134:36:37<30:01:00, 16.46s/it]
 83%|████████▎ | 31397/37963 [134:36:52<28:53:51, 15.84s/it]
 83%|████████▎ | 31398/37963 [134:37:06<28:07:00, 15.42s/it]
 83%|████████▎ | 31399/37963 [134:37:21<27:34:26, 15.12s/it]
 83%|████████▎ | 31400/37963 [134:37:35<27:14:19, 14.94s/it]
                                                            
{'loss': '0.0859', 'grad_norm': '2.562', 'learning_rate': '1.527e-06', 'epoch': '0.8271'}

 83%|████████▎ | 31400/37963 [134:37:35<27:14:19, 14.94s/it]
 83%|████████▎ | 31401/37963 [134:37:50<26:57:08, 14.79s/it]
 83%|████████▎ | 31402/37963 [134:38:04<26:46:49, 14.69s/it]
 83%|████████▎ | 31403/37963 [134:38:19<26:39:58, 14.63s/it]
 83%|████████▎ | 31404/37963 [134:38:33<26:25:58, 14.51s/it]
 83%|████████▎ | 31405/37963 [134:38:47<26:21:02, 14.47s/it]
 83%|████████▎ | 31406/37963 [134:39:01<26:16:50, 14.43s/it]
 83%|████████▎ | 31407/37963 [134:39:16<26:14:37, 14.41s/it]
 83%|████████▎ | 31408/37963 [134:39:30<26:12:06, 14.39s/it]
 83%|████████▎ | 31409/37963 [134:39:52<30:02:00, 16.50s/it]
 83%|████████▎ | 31410/37963 [134:40:06<28:52:40, 15.86s/it]
                                                            
{'loss': '0.07585', 'grad_norm': '2.403', 'learning_rate': '1.523e-06', 'epoch': '0.8274'}

 83%|████████▎ | 31410/37963 [134:40:06<28:52:40, 15.86s/it]
 83%|████████▎ | 31411/37963 [134:40:20<28:03:20, 15.42s/it]
 83%|████████▎ | 31412/37963 [134:40:35<27:31:07, 15.12s/it]
 83%|████████▎ | 31413/37963 [134:40:49<27:00:58, 14.85s/it]
 83%|████████▎ | 31414/37963 [134:41:10<30:29:30, 16.76s/it]
 83%|████████▎ | 31415/37963 [134:41:25<29:15:17, 16.08s/it]
 83%|████████▎ | 31416/37963 [134:41:39<28:19:04, 15.57s/it]
 83%|████████▎ | 31417/37963 [134:41:54<27:42:13, 15.24s/it]
 83%|████████▎ | 31418/37963 [134:42:08<27:06:36, 14.91s/it]
 83%|████████▎ | 31419/37963 [134:42:22<26:48:40, 14.75s/it]
 83%|████████▎ | 31420/37963 [134:42:36<26:34:50, 14.62s/it]
                                                            
{'loss': '0.07333', 'grad_norm': '1.83', 'learning_rate': '1.518e-06', 'epoch': '0.8277'}

 83%|████████▎ | 31420/37963 [134:42:36<26:34:50, 14.62s/it]
 83%|████████▎ | 31421/37963 [134:42:57<29:53:49, 16.45s/it]
 83%|████████▎ | 31422/37963 [134:43:11<28:29:13, 15.68s/it]
 83%|████████▎ | 31423/37963 [134:43:25<27:28:31, 15.12s/it]
 83%|████████▎ | 31424/37963 [134:43:39<26:55:11, 14.82s/it]
 83%|████████▎ | 31425/37963 [134:43:53<26:43:31, 14.72s/it]
 83%|████████▎ | 31426/37963 [134:44:08<26:34:55, 14.64s/it]
 83%|████████▎ | 31427/37963 [134:44:22<26:08:27, 14.40s/it]
 83%|████████▎ | 31428/37963 [134:44:42<29:21:06, 16.17s/it]
 83%|████████▎ | 31429/37963 [134:44:56<28:24:34, 15.65s/it]
 83%|████████▎ | 31430/37963 [134:45:18<31:27:45, 17.34s/it]
                                                            
{'loss': '0.0694', 'grad_norm': '2.386', 'learning_rate': '1.514e-06', 'epoch': '0.8279'}

 83%|████████▎ | 31430/37963 [134:45:18<31:27:45, 17.34s/it]
 83%|████████▎ | 31431/37963 [134:45:32<29:49:50, 16.44s/it]
 83%|████████▎ | 31432/37963 [134:45:46<28:43:01, 15.83s/it]
 83%|████████▎ | 31433/37963 [134:46:01<28:02:33, 15.46s/it]
 83%|████████▎ | 31434/37963 [134:46:15<27:27:47, 15.14s/it]
 83%|████████▎ | 31435/37963 [134:46:37<30:43:47, 16.95s/it]
 83%|████████▎ | 31436/37963 [134:46:51<29:07:40, 16.07s/it]
 83%|████████▎ | 31437/37963 [134:47:11<31:42:38, 17.49s/it]
 83%|████████▎ | 31438/37963 [134:47:26<29:59:00, 16.54s/it]
 83%|████████▎ | 31439/37963 [134:47:40<28:47:05, 15.88s/it]
 83%|████████▎ | 31440/37963 [134:47:54<27:57:04, 15.43s/it]
                                                            
{'loss': '0.07384', 'grad_norm': '2.423', 'learning_rate': '1.509e-06', 'epoch': '0.8282'}

 83%|████████▎ | 31440/37963 [134:47:54<27:57:04, 15.43s/it]
 83%|████████▎ | 31441/37963 [134:48:09<27:24:16, 15.13s/it]
 83%|████████▎ | 31442/37963 [134:48:24<27:07:33, 14.98s/it]
 83%|████████▎ | 31443/37963 [134:48:38<26:43:34, 14.76s/it]
 83%|████████▎ | 31444/37963 [134:48:52<26:30:47, 14.64s/it]
 83%|████████▎ | 31445/37963 [134:49:06<26:09:28, 14.45s/it]
 83%|████████▎ | 31446/37963 [134:49:27<29:38:09, 16.37s/it]
 83%|████████▎ | 31447/37963 [134:49:41<28:27:36, 15.72s/it]
 83%|████████▎ | 31448/37963 [134:49:55<27:30:27, 15.20s/it]
 83%|████████▎ | 31449/37963 [134:50:10<27:02:45, 14.95s/it]
 83%|████████▎ | 31450/37963 [134:50:24<26:45:52, 14.79s/it]
                                                            
{'loss': '0.08623', 'grad_norm': '2.839', 'learning_rate': '1.505e-06', 'epoch': '0.8284'}

 83%|████████▎ | 31450/37963 [134:50:24<26:45:52, 14.79s/it]
 83%|████████▎ | 31451/37963 [134:50:38<26:10:06, 14.47s/it]
 83%|████████▎ | 31452/37963 [134:50:52<26:06:38, 14.44s/it]
 83%|████████▎ | 31453/37963 [134:51:06<26:02:39, 14.40s/it]
 83%|████████▎ | 31454/37963 [134:51:20<25:43:19, 14.23s/it]
 83%|████████▎ | 31455/37963 [134:51:34<25:41:29, 14.21s/it]
 83%|████████▎ | 31456/37963 [134:51:56<29:32:39, 16.35s/it]
 83%|████████▎ | 31457/37963 [134:52:10<28:34:19, 15.81s/it]
 83%|████████▎ | 31458/37963 [134:52:25<27:51:17, 15.42s/it]
 83%|████████▎ | 31459/37963 [134:52:39<27:19:20, 15.12s/it]
 83%|████████▎ | 31460/37963 [134:52:54<26:54:03, 14.89s/it]
                                                            
{'loss': '0.07214', 'grad_norm': '2.614', 'learning_rate': '1.5e-06', 'epoch': '0.8287'}

 83%|████████▎ | 31460/37963 [134:52:54<26:54:03, 14.89s/it]
 83%|████████▎ | 31461/37963 [134:53:14<29:56:49, 16.58s/it]
 83%|████████▎ | 31462/37963 [134:53:28<28:45:16, 15.92s/it]
 83%|████████▎ | 31463/37963 [134:53:42<27:42:15, 15.34s/it]
 83%|████████▎ | 31464/37963 [134:53:57<27:12:58, 15.08s/it]
 83%|████████▎ | 31465/37963 [134:54:11<26:48:26, 14.85s/it]
 83%|████████▎ | 31466/37963 [134:54:26<26:33:49, 14.72s/it]
 83%|████████▎ | 31467/37963 [134:54:40<26:23:55, 14.63s/it]
 83%|████████▎ | 31468/37963 [134:54:54<26:02:35, 14.44s/it]
 83%|████████▎ | 31469/37963 [134:55:15<29:36:45, 16.42s/it]
 83%|████████▎ | 31470/37963 [134:55:29<28:29:10, 15.79s/it]
                                                            
{'loss': '0.07516', 'grad_norm': '2.143', 'learning_rate': '1.496e-06', 'epoch': '0.829'}

 83%|████████▎ | 31470/37963 [134:55:29<28:29:10, 15.79s/it]
 83%|████████▎ | 31471/37963 [134:55:43<27:29:41, 15.25s/it]
 83%|████████▎ | 31472/37963 [134:55:58<27:02:39, 15.00s/it]
 83%|████████▎ | 31473/37963 [134:56:12<26:43:50, 14.83s/it]
 83%|████████▎ | 31474/37963 [134:56:27<26:29:51, 14.70s/it]
 83%|████████▎ | 31475/37963 [134:56:41<26:04:07, 14.46s/it]
 83%|████████▎ | 31476/37963 [134:56:55<25:53:55, 14.37s/it]
 83%|████████▎ | 31477/37963 [134:57:15<29:16:52, 16.25s/it]
 83%|████████▎ | 31478/37963 [134:57:29<27:53:26, 15.48s/it]
 83%|████████▎ | 31479/37963 [134:57:50<30:36:43, 17.00s/it]
 83%|████████▎ | 31480/37963 [134:58:04<29:13:21, 16.23s/it]
                                                            
{'loss': '0.06564', 'grad_norm': '2.346', 'learning_rate': '1.491e-06', 'epoch': '0.8292'}

 83%|████████▎ | 31480/37963 [134:58:04<29:13:21, 16.23s/it]
 83%|████████▎ | 31481/37963 [134:58:18<28:14:03, 15.68s/it]
 83%|████████▎ | 31482/37963 [134:58:33<27:30:59, 15.28s/it]
 83%|████████▎ | 31483/37963 [134:58:54<30:27:13, 16.92s/it]
 83%|████████▎ | 31484/37963 [134:59:08<28:58:07, 16.10s/it]
 83%|████████▎ | 31485/37963 [134:59:21<27:34:04, 15.32s/it]
 83%|████████▎ | 31486/37963 [134:59:35<26:59:20, 15.00s/it]
 83%|████████▎ | 31487/37963 [134:59:56<30:05:36, 16.73s/it]
 83%|████████▎ | 31488/37963 [135:00:11<28:57:07, 16.10s/it]
 83%|████████▎ | 31489/37963 [135:00:25<28:00:03, 15.57s/it]
 83%|████████▎ | 31490/37963 [135:00:39<27:09:10, 15.10s/it]
                                                            
{'loss': '0.07646', 'grad_norm': '2.769', 'learning_rate': '1.487e-06', 'epoch': '0.8295'}

 83%|████████▎ | 31490/37963 [135:00:39<27:09:10, 15.10s/it]
 83%|████████▎ | 31491/37963 [135:00:54<26:45:36, 14.89s/it]
 83%|████████▎ | 31492/37963 [135:01:07<26:07:29, 14.53s/it]
 83%|████████▎ | 31493/37963 [135:01:22<26:04:13, 14.51s/it]
 83%|████████▎ | 31494/37963 [135:01:35<25:40:41, 14.29s/it]
 83%|████████▎ | 31495/37963 [135:01:57<29:24:14, 16.37s/it]
 83%|████████▎ | 31496/37963 [135:02:11<28:25:00, 15.82s/it]
 83%|████████▎ | 31497/37963 [135:02:26<27:37:37, 15.38s/it]
 83%|████████▎ | 31498/37963 [135:02:40<26:51:48, 14.96s/it]
 83%|████████▎ | 31499/37963 [135:02:54<26:33:47, 14.79s/it]
 83%|████████▎ | 31500/37963 [135:03:08<26:19:56, 14.67s/it]
                                                            
{'loss': '0.07197', 'grad_norm': '2.208', 'learning_rate': '1.482e-06', 'epoch': '0.8298'}

 83%|████████▎ | 31500/37963 [135:03:08<26:19:56, 14.67s/it]
 83%|████████▎ | 31501/37963 [135:03:23<26:09:46, 14.58s/it]
 83%|████████▎ | 31502/37963 [135:03:37<25:57:40, 14.47s/it]
 83%|████████▎ | 31503/37963 [135:03:51<25:53:59, 14.43s/it]
 83%|████████▎ | 31504/37963 [135:04:06<25:53:14, 14.43s/it]
 83%|████████▎ | 31505/37963 [135:04:20<25:51:40, 14.42s/it]
 83%|████████▎ | 31506/37963 [135:04:41<29:29:59, 16.45s/it]
 83%|████████▎ | 31507/37963 [135:04:56<28:21:34, 15.81s/it]
 83%|████████▎ | 31508/37963 [135:05:10<27:37:19, 15.40s/it]
 83%|████████▎ | 31509/37963 [135:05:31<30:25:39, 16.97s/it]
 83%|████████▎ | 31510/37963 [135:05:44<28:38:13, 15.98s/it]
                                                            
{'loss': '0.07789', 'grad_norm': '2.404', 'learning_rate': '1.478e-06', 'epoch': '0.83'}

 83%|████████▎ | 31510/37963 [135:05:44<28:38:13, 15.98s/it]
 83%|████████▎ | 31511/37963 [135:05:59<27:47:38, 15.51s/it]
 83%|████████▎ | 31512/37963 [135:06:13<27:15:09, 15.21s/it]
 83%|████████▎ | 31513/37963 [135:06:28<26:46:27, 14.94s/it]
 83%|████████▎ | 31514/37963 [135:06:42<26:27:57, 14.77s/it]
 83%|████████▎ | 31515/37963 [135:06:56<25:56:41, 14.49s/it]
 83%|████████▎ | 31516/37963 [135:07:10<25:40:11, 14.33s/it]
 83%|████████▎ | 31517/37963 [135:07:24<25:41:55, 14.35s/it]
 83%|████████▎ | 31518/37963 [135:07:45<29:19:58, 16.38s/it]
 83%|████████▎ | 31519/37963 [135:08:00<28:15:38, 15.79s/it]
 83%|████████▎ | 31520/37963 [135:08:14<27:17:52, 15.25s/it]
                                                            
{'loss': '0.07363', 'grad_norm': '3.541', 'learning_rate': '1.474e-06', 'epoch': '0.8303'}

 83%|████████▎ | 31520/37963 [135:08:14<27:17:52, 15.25s/it]
 83%|████████▎ | 31521/37963 [135:08:28<26:48:52, 14.98s/it]
 83%|████████▎ | 31522/37963 [135:08:43<26:32:08, 14.83s/it]
 83%|████████▎ | 31523/37963 [135:08:57<26:17:07, 14.69s/it]
 83%|████████▎ | 31524/37963 [135:09:11<26:09:02, 14.62s/it]
 83%|████████▎ | 31525/37963 [135:09:32<29:28:17, 16.48s/it]
 83%|████████▎ | 31526/37963 [135:09:47<28:20:27, 15.85s/it]
 83%|████████▎ | 31527/37963 [135:10:01<27:31:28, 15.40s/it]
 83%|████████▎ | 31528/37963 [135:10:15<26:41:30, 14.93s/it]
 83%|████████▎ | 31529/37963 [135:10:29<26:23:09, 14.76s/it]
 83%|████████▎ | 31530/37963 [135:10:50<29:54:04, 16.73s/it]
                                                            
{'loss': '0.08522', 'grad_norm': '3.042', 'learning_rate': '1.469e-06', 'epoch': '0.8305'}

 83%|████████▎ | 31530/37963 [135:10:50<29:54:04, 16.73s/it]
 83%|████████▎ | 31531/37963 [135:11:05<28:28:33, 15.94s/it]
 83%|████████▎ | 31532/37963 [135:11:25<31:04:19, 17.39s/it]
 83%|████████▎ | 31533/37963 [135:11:39<29:17:40, 16.40s/it]
 83%|████████▎ | 31534/37963 [135:11:54<28:11:59, 15.79s/it]
 83%|████████▎ | 31535/37963 [135:12:08<27:25:21, 15.36s/it]
 83%|████████▎ | 31536/37963 [135:12:22<26:52:02, 15.05s/it]
 83%|████████▎ | 31537/37963 [135:12:43<29:59:48, 16.80s/it]
 83%|████████▎ | 31538/37963 [135:12:58<28:40:05, 16.06s/it]
 83%|████████▎ | 31539/37963 [135:13:11<27:26:58, 15.38s/it]
 83%|████████▎ | 31540/37963 [135:13:26<26:54:05, 15.08s/it]
                                                            
{'loss': '0.08556', 'grad_norm': '3.096', 'learning_rate': '1.465e-06', 'epoch': '0.8308'}

 83%|████████▎ | 31540/37963 [135:13:26<26:54:05, 15.08s/it]
 83%|████████▎ | 31541/37963 [135:13:40<26:32:33, 14.88s/it]
 83%|████████▎ | 31542/37963 [135:13:55<26:14:31, 14.71s/it]
 83%|████████▎ | 31543/37963 [135:14:09<26:02:11, 14.60s/it]
 83%|████████▎ | 31544/37963 [135:14:30<29:18:10, 16.43s/it]
 83%|████████▎ | 31545/37963 [135:14:44<28:15:49, 15.85s/it]
 83%|████████▎ | 31546/37963 [135:14:59<27:28:43, 15.42s/it]
 83%|████████▎ | 31547/37963 [135:15:13<26:42:51, 14.99s/it]
 83%|████████▎ | 31548/37963 [135:15:27<26:25:21, 14.83s/it]
 83%|████████▎ | 31549/37963 [135:15:41<26:11:52, 14.70s/it]
 83%|████████▎ | 31550/37963 [135:15:56<26:00:45, 14.60s/it]
                                                            
{'loss': '0.07995', 'grad_norm': '3.064', 'learning_rate': '1.46e-06', 'epoch': '0.8311'}

 83%|████████▎ | 31550/37963 [135:15:56<26:00:45, 14.60s/it]
 83%|████████▎ | 31551/37963 [135:16:10<25:57:15, 14.57s/it]
 83%|████████▎ | 31552/37963 [135:16:24<25:45:11, 14.46s/it]
 83%|████████▎ | 31553/37963 [135:16:39<25:43:19, 14.45s/it]
 83%|████████▎ | 31554/37963 [135:16:53<25:42:01, 14.44s/it]
 83%|████████▎ | 31555/37963 [135:17:14<29:05:25, 16.34s/it]
 83%|████████▎ | 31556/37963 [135:17:29<28:06:11, 15.79s/it]
 83%|████████▎ | 31557/37963 [135:17:42<27:05:07, 15.22s/it]
 83%|████████▎ | 31558/37963 [135:18:03<29:56:30, 16.83s/it]
 83%|████████▎ | 31559/37963 [135:18:17<28:37:02, 16.09s/it]
 83%|████████▎ | 31560/37963 [135:18:32<27:35:05, 15.51s/it]
                                                            
{'loss': '0.06747', 'grad_norm': '2.605', 'learning_rate': '1.456e-06', 'epoch': '0.8313'}

 83%|████████▎ | 31560/37963 [135:18:32<27:35:05, 15.51s/it]
 83%|████████▎ | 31561/37963 [135:18:46<26:53:38, 15.12s/it]
 83%|████████▎ | 31562/37963 [135:19:00<26:35:02, 14.95s/it]
 83%|████████▎ | 31563/37963 [135:19:15<26:15:35, 14.77s/it]
 83%|████████▎ | 31564/37963 [135:19:29<26:04:36, 14.67s/it]
 83%|████████▎ | 31565/37963 [135:19:44<25:57:18, 14.60s/it]
 83%|████████▎ | 31566/37963 [135:20:04<29:12:45, 16.44s/it]
 83%|████████▎ | 31567/37963 [135:20:18<27:52:21, 15.69s/it]
 83%|████████▎ | 31568/37963 [135:20:33<27:10:47, 15.30s/it]
 83%|████████▎ | 31569/37963 [135:20:47<26:34:56, 14.97s/it]
 83%|████████▎ | 31570/37963 [135:21:01<25:59:26, 14.64s/it]
                                                            
{'loss': '0.07509', 'grad_norm': '3.365', 'learning_rate': '1.451e-06', 'epoch': '0.8316'}

 83%|████████▎ | 31570/37963 [135:21:01<25:59:26, 14.64s/it]
 83%|████████▎ | 31571/37963 [135:21:15<25:57:03, 14.62s/it]
 83%|████████▎ | 31572/37963 [135:21:30<25:48:30, 14.54s/it]
 83%|████████▎ | 31573/37963 [135:21:44<25:43:20, 14.49s/it]
 83%|████████▎ | 31574/37963 [135:22:05<29:01:48, 16.36s/it]
 83%|████████▎ | 31575/37963 [135:22:19<27:59:23, 15.77s/it]
 83%|████████▎ | 31576/37963 [135:22:34<27:16:00, 15.37s/it]
 83%|████████▎ | 31577/37963 [135:22:48<26:49:30, 15.12s/it]
 83%|████████▎ | 31578/37963 [135:23:02<26:25:38, 14.90s/it]
 83%|████████▎ | 31579/37963 [135:23:24<29:48:33, 16.81s/it]
 83%|████████▎ | 31580/37963 [135:23:38<28:33:34, 16.11s/it]
                                                            
{'loss': '0.06893', 'grad_norm': '3.034', 'learning_rate': '1.447e-06', 'epoch': '0.8319'}

 83%|████████▎ | 31580/37963 [135:23:38<28:33:34, 16.11s/it]
 83%|████████▎ | 31581/37963 [135:23:59<31:13:16, 17.61s/it]
 83%|████████▎ | 31582/37963 [135:24:13<29:17:30, 16.53s/it]
 83%|████████▎ | 31583/37963 [135:24:34<31:28:28, 17.76s/it]
 83%|████████▎ | 31584/37963 [135:24:48<29:27:45, 16.63s/it]
 83%|████████▎ | 31585/37963 [135:25:02<28:02:39, 15.83s/it]
 83%|████████▎ | 31586/37963 [135:25:16<27:16:12, 15.39s/it]
 83%|████████▎ | 31587/37963 [135:25:30<26:36:55, 15.03s/it]
 83%|████████▎ | 31588/37963 [135:25:44<25:58:10, 14.67s/it]
 83%|████████▎ | 31589/37963 [135:25:58<25:31:43, 14.42s/it]
 83%|████████▎ | 31590/37963 [135:26:13<25:34:58, 14.45s/it]
                                                            
{'loss': '0.07577', 'grad_norm': '2.51', 'learning_rate': '1.442e-06', 'epoch': '0.8321'}

 83%|████████▎ | 31590/37963 [135:26:13<25:34:58, 14.45s/it]
 83%|████████▎ | 31591/37963 [135:26:27<25:26:39, 14.38s/it]
 83%|████████▎ | 31592/37963 [135:26:41<25:27:49, 14.39s/it]
 83%|████████▎ | 31593/37963 [135:27:02<29:02:03, 16.41s/it]
 83%|████████▎ | 31594/37963 [135:27:17<27:50:19, 15.74s/it]
 83%|████████▎ | 31595/37963 [135:27:31<27:08:03, 15.34s/it]
 83%|████████▎ | 31596/37963 [135:27:45<26:30:39, 14.99s/it]
 83%|████████▎ | 31597/37963 [135:27:59<26:10:13, 14.80s/it]
 83%|████████▎ | 31598/37963 [135:28:14<25:57:11, 14.68s/it]
 83%|████████▎ | 31599/37963 [135:28:28<25:28:48, 14.41s/it]
 83%|████████▎ | 31600/37963 [135:28:42<25:26:41, 14.40s/it]
                                                            
{'loss': '0.1003', 'grad_norm': '2.847', 'learning_rate': '1.438e-06', 'epoch': '0.8324'}

 83%|████████▎ | 31600/37963 [135:28:42<25:26:41, 14.40s/it]
 83%|████████▎ | 31601/37963 [135:28:56<25:25:18, 14.39s/it]
 83%|████████▎ | 31602/37963 [135:29:11<25:19:02, 14.33s/it]
 83%|████████▎ | 31603/37963 [135:29:32<28:56:01, 16.38s/it]
 83%|████████▎ | 31604/37963 [135:29:46<27:36:58, 15.63s/it]
 83%|████████▎ | 31605/37963 [135:30:00<26:57:05, 15.26s/it]
 83%|████████▎ | 31606/37963 [135:30:20<29:34:44, 16.75s/it]
 83%|████████▎ | 31607/37963 [135:30:35<28:19:21, 16.04s/it]
 83%|████████▎ | 31608/37963 [135:30:49<27:21:48, 15.50s/it]
 83%|████████▎ | 31609/37963 [135:31:02<26:18:59, 14.91s/it]
 83%|████████▎ | 31610/37963 [135:31:17<26:00:44, 14.74s/it]
                                                            
{'loss': '0.08708', 'grad_norm': '4.29', 'learning_rate': '1.434e-06', 'epoch': '0.8327'}

 83%|████████▎ | 31610/37963 [135:31:17<26:00:44, 14.74s/it]
 83%|████████▎ | 31611/37963 [135:31:31<25:48:23, 14.63s/it]
 83%|████████▎ | 31612/37963 [135:31:45<25:38:43, 14.54s/it]
 83%|████████▎ | 31613/37963 [135:32:06<29:03:26, 16.47s/it]
 83%|████████▎ | 31614/37963 [135:32:21<27:58:59, 15.87s/it]
 83%|████████▎ | 31615/37963 [135:32:35<26:57:12, 15.29s/it]
 83%|████████▎ | 31616/37963 [135:32:49<26:16:37, 14.90s/it]
 83%|████████▎ | 31617/37963 [135:33:03<26:01:00, 14.76s/it]
 83%|████████▎ | 31618/37963 [135:33:17<25:25:52, 14.43s/it]
 83%|████████▎ | 31619/37963 [135:33:31<25:21:34, 14.39s/it]
 83%|████████▎ | 31620/37963 [135:33:45<25:15:57, 14.34s/it]
                                                            
{'loss': '0.07913', 'grad_norm': '3.237', 'learning_rate': '1.429e-06', 'epoch': '0.8329'}

 83%|████████▎ | 31620/37963 [135:33:45<25:15:57, 14.34s/it]
 83%|████████▎ | 31621/37963 [135:34:00<25:18:22, 14.36s/it]
 83%|████████▎ | 31622/37963 [135:34:20<28:27:52, 16.16s/it]
 83%|████████▎ | 31623/37963 [135:34:34<27:09:45, 15.42s/it]
 83%|████████▎ | 31624/37963 [135:34:48<26:38:09, 15.13s/it]
 83%|████████▎ | 31625/37963 [135:35:03<26:13:21, 14.89s/it]
 83%|████████▎ | 31626/37963 [135:35:17<25:58:17, 14.75s/it]
 83%|████████▎ | 31627/37963 [135:35:31<25:43:26, 14.62s/it]
 83%|████████▎ | 31628/37963 [135:35:53<29:16:02, 16.63s/it]
 83%|████████▎ | 31629/37963 [135:36:07<28:03:41, 15.95s/it]
 83%|████████▎ | 31630/37963 [135:36:28<30:45:59, 17.49s/it]
                                                            
{'loss': '0.07742', 'grad_norm': '3.089', 'learning_rate': '1.425e-06', 'epoch': '0.8332'}

 83%|████████▎ | 31630/37963 [135:36:28<30:45:59, 17.49s/it]
 83%|████████▎ | 31631/37963 [135:36:43<29:06:36, 16.55s/it]
 83%|████████▎ | 31632/37963 [135:36:57<27:54:33, 15.87s/it]
 83%|████████▎ | 31633/37963 [135:37:11<27:12:09, 15.47s/it]
 83%|████████▎ | 31634/37963 [135:37:33<30:17:00, 17.23s/it]
 83%|████████▎ | 31635/37963 [135:37:47<28:47:45, 16.38s/it]
 83%|████████▎ | 31636/37963 [135:38:01<27:22:02, 15.57s/it]
 83%|████████▎ | 31637/37963 [135:38:15<26:45:28, 15.23s/it]
 83%|████████▎ | 31638/37963 [135:38:29<26:04:29, 14.84s/it]
 83%|████████▎ | 31639/37963 [135:38:44<25:49:41, 14.70s/it]
 83%|████████▎ | 31640/37963 [135:38:58<25:45:06, 14.66s/it]
                                                            
{'loss': '0.07212', 'grad_norm': '3.711', 'learning_rate': '1.42e-06', 'epoch': '0.8334'}

 83%|████████▎ | 31640/37963 [135:38:58<25:45:06, 14.66s/it]
 83%|████████▎ | 31641/37963 [135:39:12<25:35:16, 14.57s/it]
 83%|████████▎ | 31642/37963 [135:39:34<29:06:02, 16.57s/it]
 83%|████████▎ | 31643/37963 [135:39:48<27:54:13, 15.89s/it]
 83%|████████▎ | 31644/37963 [135:40:02<27:05:25, 15.43s/it]
 83%|████████▎ | 31645/37963 [135:40:17<26:36:39, 15.16s/it]
 83%|████████▎ | 31646/37963 [135:40:31<26:13:08, 14.94s/it]
 83%|████████▎ | 31647/37963 [135:40:46<25:55:21, 14.78s/it]
 83%|████████▎ | 31648/37963 [135:41:00<25:42:09, 14.65s/it]
 83%|████████▎ | 31649/37963 [135:41:14<25:27:00, 14.51s/it]
 83%|████████▎ | 31650/37963 [135:41:29<25:24:03, 14.48s/it]
                                                            
{'loss': '0.07708', 'grad_norm': '3.627', 'learning_rate': '1.416e-06', 'epoch': '0.8337'}

 83%|████████▎ | 31650/37963 [135:41:29<25:24:03, 14.48s/it]
 83%|████████▎ | 31651/37963 [135:41:43<25:16:52, 14.42s/it]
 83%|████████▎ | 31652/37963 [135:42:04<28:31:59, 16.28s/it]
 83%|████████▎ | 31653/37963 [135:42:18<27:28:59, 15.68s/it]
 83%|████████▎ | 31654/37963 [135:42:32<26:46:45, 15.28s/it]
 83%|████████▎ | 31655/37963 [135:42:47<26:18:12, 15.01s/it]
 83%|████████▎ | 31656/37963 [135:43:08<29:24:00, 16.78s/it]
 83%|████████▎ | 31657/37963 [135:43:22<27:56:37, 15.95s/it]
 83%|████████▎ | 31658/37963 [135:43:36<27:08:27, 15.50s/it]
 83%|████████▎ | 31659/37963 [135:43:56<29:42:17, 16.96s/it]
 83%|████████▎ | 31660/37963 [135:44:11<28:18:59, 16.17s/it]
                                                            
{'loss': '0.08244', 'grad_norm': '3.742', 'learning_rate': '1.412e-06', 'epoch': '0.834'}

 83%|████████▎ | 31660/37963 [135:44:11<28:18:59, 16.17s/it]
 83%|████████▎ | 31661/37963 [135:44:25<27:26:12, 15.67s/it]
 83%|████████▎ | 31662/37963 [135:44:39<26:31:42, 15.16s/it]
 83%|████████▎ | 31663/37963 [135:44:54<26:07:45, 14.93s/it]
 83%|████████▎ | 31664/37963 [135:45:08<25:51:56, 14.78s/it]
 83%|████████▎ | 31665/37963 [135:45:22<25:39:13, 14.66s/it]
 83%|████████▎ | 31666/37963 [135:45:36<25:20:03, 14.48s/it]
 83%|████████▎ | 31667/37963 [135:45:51<25:09:22, 14.38s/it]
 83%|████████▎ | 31668/37963 [135:46:05<25:09:43, 14.39s/it]
 83%|████████▎ | 31669/37963 [135:46:19<25:00:50, 14.31s/it]
 83%|████████▎ | 31670/37963 [135:46:40<28:27:31, 16.28s/it]
                                                            
{'loss': '0.07163', 'grad_norm': '1.856', 'learning_rate': '1.407e-06', 'epoch': '0.8342'}

 83%|████████▎ | 31670/37963 [135:46:40<28:27:31, 16.28s/it]
 83%|████████▎ | 31671/37963 [135:46:54<27:08:41, 15.53s/it]
 83%|████████▎ | 31672/37963 [135:47:08<26:32:37, 15.19s/it]
 83%|████████▎ | 31673/37963 [135:47:23<26:07:49, 14.96s/it]
 83%|████████▎ | 31674/37963 [135:47:37<25:43:55, 14.73s/it]
 83%|████████▎ | 31675/37963 [135:47:58<28:59:45, 16.60s/it]
 83%|████████▎ | 31676/37963 [135:48:12<27:49:46, 15.94s/it]
 83%|████████▎ | 31677/37963 [135:48:27<27:01:07, 15.47s/it]
 83%|████████▎ | 31678/37963 [135:48:41<26:26:16, 15.14s/it]
 83%|████████▎ | 31679/37963 [135:48:55<25:45:18, 14.75s/it]
 83%|████████▎ | 31680/37963 [135:49:16<29:00:37, 16.62s/it]
                                                            
{'loss': '0.08521', 'grad_norm': '3.623', 'learning_rate': '1.403e-06', 'epoch': '0.8345'}

 83%|████████▎ | 31680/37963 [135:49:16<29:00:37, 16.62s/it]
 83%|████████▎ | 31681/37963 [135:49:30<27:49:38, 15.95s/it]
 83%|████████▎ | 31682/37963 [135:49:44<26:56:23, 15.44s/it]
 83%|████████▎ | 31683/37963 [135:49:59<26:22:52, 15.12s/it]
 83%|████████▎ | 31684/37963 [135:50:19<29:19:01, 16.81s/it]
 83%|████████▎ | 31685/37963 [135:50:34<28:04:38, 16.10s/it]
 83%|████████▎ | 31686/37963 [135:50:48<27:12:00, 15.60s/it]
 83%|████████▎ | 31687/37963 [135:51:03<26:28:42, 15.19s/it]
 83%|████████▎ | 31688/37963 [135:51:23<29:18:23, 16.81s/it]
 83%|████████▎ | 31689/37963 [135:51:38<28:02:37, 16.09s/it]
 83%|████████▎ | 31690/37963 [135:51:52<27:11:17, 15.60s/it]
                                                            
{'loss': '0.08366', 'grad_norm': '2.974', 'learning_rate': '1.399e-06', 'epoch': '0.8348'}

 83%|████████▎ | 31690/37963 [135:51:52<27:11:17, 15.60s/it]
 83%|████████▎ | 31691/37963 [135:52:06<26:17:54, 15.09s/it]
 83%|████████▎ | 31692/37963 [135:52:20<25:55:05, 14.88s/it]
 83%|████████▎ | 31693/37963 [135:52:35<25:42:55, 14.76s/it]
 83%|████████▎ | 31694/37963 [135:52:49<25:13:34, 14.49s/it]
 83%|████████▎ | 31695/37963 [135:53:03<25:01:42, 14.37s/it]
 83%|████████▎ | 31696/37963 [135:53:17<25:00:15, 14.36s/it]
 83%|████████▎ | 31697/37963 [135:53:31<24:49:38, 14.26s/it]
 83%|████████▎ | 31698/37963 [135:53:45<24:51:22, 14.28s/it]
 83%|████████▎ | 31699/37963 [135:54:00<24:59:14, 14.36s/it]
 84%|████████▎ | 31700/37963 [135:54:14<25:01:37, 14.39s/it]
                                                            
{'loss': '0.08177', 'grad_norm': '2.408', 'learning_rate': '1.394e-06', 'epoch': '0.835'}

 84%|████████▎ | 31700/37963 [135:54:14<25:01:37, 14.39s/it]
 84%|████████▎ | 31701/37963 [135:54:36<28:37:45, 16.46s/it]
 84%|████████▎ | 31702/37963 [135:54:50<27:36:04, 15.87s/it]
 84%|████████▎ | 31703/37963 [135:55:11<30:05:52, 17.31s/it]
 84%|████████▎ | 31704/37963 [135:55:25<28:35:33, 16.45s/it]
 84%|████████▎ | 31705/37963 [135:55:40<27:34:38, 15.86s/it]
 84%|████████▎ | 31706/37963 [135:55:54<26:36:42, 15.31s/it]
 84%|████████▎ | 31707/37963 [135:56:15<29:30:07, 16.98s/it]
 84%|████████▎ | 31708/37963 [135:56:29<28:11:09, 16.22s/it]
 84%|████████▎ | 31709/37963 [135:56:44<27:13:45, 15.67s/it]
 84%|████████▎ | 31710/37963 [135:56:58<26:31:17, 15.27s/it]
                                                            
{'loss': '0.07886', 'grad_norm': '1.672', 'learning_rate': '1.39e-06', 'epoch': '0.8353'}

 84%|████████▎ | 31710/37963 [135:56:58<26:31:17, 15.27s/it]
 84%|████████▎ | 31711/37963 [135:57:12<25:55:51, 14.93s/it]
 84%|████████▎ | 31712/37963 [135:57:26<25:38:50, 14.77s/it]
 84%|████████▎ | 31713/37963 [135:57:41<25:26:58, 14.66s/it]
 84%|████████▎ | 31714/37963 [135:57:55<25:18:54, 14.58s/it]
 84%|████████▎ | 31715/37963 [135:58:10<25:12:19, 14.52s/it]
 84%|████████▎ | 31716/37963 [135:58:24<25:10:13, 14.51s/it]
 84%|████████▎ | 31717/37963 [135:58:45<28:22:06, 16.35s/it]
 84%|████████▎ | 31718/37963 [135:58:59<27:05:46, 15.62s/it]
 84%|████████▎ | 31719/37963 [135:59:13<26:26:35, 15.25s/it]
 84%|████████▎ | 31720/37963 [135:59:27<25:44:33, 14.84s/it]
                                                            
{'loss': '0.06928', 'grad_norm': '2.424', 'learning_rate': '1.386e-06', 'epoch': '0.8356'}

 84%|████████▎ | 31720/37963 [135:59:27<25:44:33, 14.84s/it]
 84%|████████▎ | 31721/37963 [135:59:41<25:33:24, 14.74s/it]
 84%|████████▎ | 31722/37963 [135:59:56<25:26:59, 14.68s/it]
 84%|████████▎ | 31723/37963 [136:00:10<25:16:52, 14.59s/it]
 84%|████████▎ | 31724/37963 [136:00:25<25:10:22, 14.53s/it]
 84%|████████▎ | 31725/37963 [136:00:46<28:48:20, 16.62s/it]
 84%|████████▎ | 31726/37963 [136:01:01<27:43:07, 16.00s/it]
 84%|████████▎ | 31727/37963 [136:01:15<26:53:15, 15.52s/it]
 84%|████████▎ | 31728/37963 [136:01:30<26:20:43, 15.21s/it]
 84%|████████▎ | 31729/37963 [136:01:51<29:14:56, 16.89s/it]
 84%|████████▎ | 31730/37963 [136:02:05<27:49:55, 16.08s/it]
                                                            
{'loss': '0.08582', 'grad_norm': '2.433', 'learning_rate': '1.381e-06', 'epoch': '0.8358'}

 84%|████████▎ | 31730/37963 [136:02:05<27:49:55, 16.08s/it]
 84%|████████▎ | 31731/37963 [136:02:19<26:59:42, 15.59s/it]
 84%|████████▎ | 31732/37963 [136:02:40<29:54:37, 17.28s/it]
 84%|████████▎ | 31733/37963 [136:02:55<28:23:07, 16.40s/it]
 84%|████████▎ | 31734/37963 [136:03:09<27:22:37, 15.82s/it]
 84%|████████▎ | 31735/37963 [136:03:24<26:37:25, 15.39s/it]
 84%|████████▎ | 31736/37963 [136:03:38<26:03:29, 15.06s/it]
 84%|████████▎ | 31737/37963 [136:03:52<25:23:38, 14.68s/it]
 84%|████████▎ | 31738/37963 [136:04:13<28:41:07, 16.59s/it]
 84%|████████▎ | 31739/37963 [136:04:27<27:14:20, 15.76s/it]
 84%|████████▎ | 31740/37963 [136:04:41<26:22:58, 15.26s/it]
                                                            
{'loss': '0.07592', 'grad_norm': '2.307', 'learning_rate': '1.377e-06', 'epoch': '0.8361'}

 84%|████████▎ | 31740/37963 [136:04:41<26:22:58, 15.26s/it]
 84%|████████▎ | 31741/37963 [136:04:55<25:43:38, 14.89s/it]
 84%|████████▎ | 31742/37963 [136:05:09<25:28:46, 14.74s/it]
 84%|████████▎ | 31743/37963 [136:05:23<24:59:31, 14.46s/it]
 84%|████████▎ | 31744/37963 [136:05:37<24:57:18, 14.45s/it]
 84%|████████▎ | 31745/37963 [136:05:52<24:54:04, 14.42s/it]
 84%|████████▎ | 31746/37963 [136:06:06<24:52:00, 14.40s/it]
 84%|████████▎ | 31747/37963 [136:06:20<24:55:25, 14.43s/it]
 84%|████████▎ | 31748/37963 [136:06:35<24:54:31, 14.43s/it]
 84%|████████▎ | 31749/37963 [136:06:49<24:50:07, 14.39s/it]
 84%|████████▎ | 31750/37963 [136:07:04<24:48:58, 14.38s/it]
                                                            
{'loss': '0.07915', 'grad_norm': '2.152', 'learning_rate': '1.373e-06', 'epoch': '0.8363'}

 84%|████████▎ | 31750/37963 [136:07:04<24:48:58, 14.38s/it]
 84%|████████▎ | 31751/37963 [136:07:25<28:20:29, 16.42s/it]
 84%|████████▎ | 31752/37963 [136:07:39<27:00:04, 15.65s/it]
 84%|████████▎ | 31753/37963 [136:07:53<26:19:45, 15.26s/it]
 84%|████████▎ | 31754/37963 [136:08:14<29:04:01, 16.85s/it]
 84%|████████▎ | 31755/37963 [136:08:28<27:48:14, 16.12s/it]
 84%|████████▎ | 31756/37963 [136:08:42<26:41:35, 15.48s/it]
 84%|████████▎ | 31757/37963 [136:08:56<26:00:33, 15.09s/it]
 84%|████████▎ | 31758/37963 [136:09:16<28:44:14, 16.67s/it]
 84%|████████▎ | 31759/37963 [136:09:31<27:33:13, 15.99s/it]
 84%|████████▎ | 31760/37963 [136:09:45<26:26:32, 15.35s/it]
                                                            
{'loss': '0.08328', 'grad_norm': '2.408', 'learning_rate': '1.368e-06', 'epoch': '0.8366'}

 84%|████████▎ | 31760/37963 [136:09:45<26:26:32, 15.35s/it]
 84%|████████▎ | 31761/37963 [136:09:59<25:56:48, 15.06s/it]
 84%|████████▎ | 31762/37963 [136:10:13<25:33:12, 14.84s/it]
 84%|████████▎ | 31763/37963 [136:10:28<25:22:41, 14.74s/it]
 84%|████████▎ | 31764/37963 [136:10:42<25:10:29, 14.62s/it]
 84%|████████▎ | 31765/37963 [136:11:03<28:22:13, 16.48s/it]
 84%|████████▎ | 31766/37963 [136:11:17<27:06:11, 15.75s/it]
 84%|████████▎ | 31767/37963 [136:11:32<26:25:28, 15.35s/it]
 84%|████████▎ | 31768/37963 [136:11:46<25:59:17, 15.10s/it]
 84%|████████▎ | 31769/37963 [136:12:01<25:38:49, 14.91s/it]
 84%|████████▎ | 31770/37963 [136:12:15<25:20:59, 14.74s/it]
                                                            
{'loss': '0.07624', 'grad_norm': '2.423', 'learning_rate': '1.364e-06', 'epoch': '0.8369'}

 84%|████████▎ | 31770/37963 [136:12:15<25:20:59, 14.74s/it]
 84%|████████▎ | 31771/37963 [136:12:29<25:06:14, 14.60s/it]
 84%|████████▎ | 31772/37963 [136:12:44<25:00:56, 14.55s/it]
 84%|████████▎ | 31773/37963 [136:13:05<28:30:25, 16.58s/it]
 84%|████████▎ | 31774/37963 [136:13:19<27:22:52, 15.93s/it]
 84%|████████▎ | 31775/37963 [136:13:34<26:37:17, 15.49s/it]
 84%|████████▎ | 31776/37963 [136:13:48<25:53:46, 15.07s/it]
 84%|████████▎ | 31777/37963 [136:14:09<28:55:46, 16.84s/it]
 84%|████████▎ | 31778/37963 [136:14:23<27:41:40, 16.12s/it]
 84%|████████▎ | 31779/37963 [136:14:43<29:46:19, 17.33s/it]
 84%|████████▎ | 31780/37963 [136:14:58<28:15:22, 16.45s/it]
                                                            
{'loss': '0.08158', 'grad_norm': '2.655', 'learning_rate': '1.36e-06', 'epoch': '0.8371'}

 84%|████████▎ | 31780/37963 [136:14:58<28:15:22, 16.45s/it]
 84%|████████▎ | 31781/37963 [136:15:12<26:53:52, 15.66s/it]
 84%|████████▎ | 31782/37963 [136:15:26<26:13:43, 15.28s/it]
 84%|████████▎ | 31783/37963 [136:15:40<25:41:52, 14.97s/it]
 84%|████████▎ | 31784/37963 [136:15:55<25:24:56, 14.81s/it]
 84%|████████▎ | 31785/37963 [136:16:09<25:12:12, 14.69s/it]
 84%|████████▎ | 31786/37963 [136:16:24<25:06:17, 14.63s/it]
 84%|████████▎ | 31787/37963 [136:16:38<25:01:14, 14.58s/it]
 84%|████████▎ | 31788/37963 [136:16:52<24:54:00, 14.52s/it]
 84%|████████▎ | 31789/37963 [136:17:14<28:35:32, 16.67s/it]
 84%|████████▎ | 31790/37963 [136:17:28<27:04:25, 15.79s/it]
                                                            
{'loss': '0.07758', 'grad_norm': '2.137', 'learning_rate': '1.355e-06', 'epoch': '0.8374'}

 84%|████████▎ | 31790/37963 [136:17:28<27:04:25, 15.79s/it]
 84%|████████▎ | 31791/37963 [136:17:42<26:19:35, 15.36s/it]
 84%|████████▎ | 31792/37963 [136:17:57<25:48:40, 15.06s/it]
 84%|████████▎ | 31793/37963 [136:18:10<25:13:36, 14.72s/it]
 84%|████████▎ | 31794/37963 [136:18:25<24:56:15, 14.55s/it]
 84%|████████▍ | 31795/37963 [136:18:39<24:51:13, 14.51s/it]
 84%|████████▍ | 31796/37963 [136:18:53<24:48:11, 14.48s/it]
 84%|████████▍ | 31797/37963 [136:19:08<24:44:19, 14.44s/it]
 84%|████████▍ | 31798/37963 [136:19:22<24:39:47, 14.40s/it]
 84%|████████▍ | 31799/37963 [136:19:36<24:37:38, 14.38s/it]
 84%|████████▍ | 31800/37963 [136:19:57<27:48:42, 16.25s/it]
                                                            
{'loss': '0.0906', 'grad_norm': '2.063', 'learning_rate': '1.351e-06', 'epoch': '0.8377'}

 84%|████████▍ | 31800/37963 [136:19:57<27:48:42, 16.25s/it]
 84%|████████▍ | 31801/37963 [136:20:11<26:29:36, 15.48s/it]
 84%|████████▍ | 31802/37963 [136:20:31<29:06:57, 17.01s/it]
 84%|████████▍ | 31803/37963 [136:20:46<27:38:45, 16.16s/it]
 84%|████████▍ | 31804/37963 [136:20:59<26:29:42, 15.49s/it]
 84%|████████▍ | 31805/37963 [136:21:19<28:48:57, 16.85s/it]
 84%|████████▍ | 31806/37963 [136:21:34<27:33:21, 16.11s/it]
 84%|████████▍ | 31807/37963 [136:21:48<26:42:56, 15.62s/it]
 84%|████████▍ | 31808/37963 [136:22:03<26:05:20, 15.26s/it]
 84%|████████▍ | 31809/37963 [136:22:17<25:39:09, 15.01s/it]
 84%|████████▍ | 31810/37963 [136:22:32<25:18:45, 14.81s/it]
                                                            
{'loss': '0.0799', 'grad_norm': '3.658', 'learning_rate': '1.347e-06', 'epoch': '0.8379'}

 84%|████████▍ | 31810/37963 [136:22:32<25:18:45, 14.81s/it]
 84%|████████▍ | 31811/37963 [136:22:46<24:54:46, 14.58s/it]
 84%|████████▍ | 31812/37963 [136:23:06<28:05:16, 16.44s/it]
 84%|████████▍ | 31813/37963 [136:23:21<27:01:09, 15.82s/it]
 84%|████████▍ | 31814/37963 [136:23:35<26:18:07, 15.40s/it]
 84%|████████▍ | 31815/37963 [136:23:49<25:39:55, 15.03s/it]
 84%|████████▍ | 31816/37963 [136:24:04<25:25:08, 14.89s/it]
 84%|████████▍ | 31817/37963 [136:24:18<25:04:50, 14.69s/it]
 84%|████████▍ | 31818/37963 [136:24:33<24:57:09, 14.62s/it]
 84%|████████▍ | 31819/37963 [136:24:47<24:47:12, 14.52s/it]
 84%|████████▍ | 31820/37963 [136:25:01<24:46:47, 14.52s/it]
                                                            
{'loss': '0.07572', 'grad_norm': '3.437', 'learning_rate': '1.343e-06', 'epoch': '0.8382'}

 84%|████████▍ | 31820/37963 [136:25:01<24:46:47, 14.52s/it]
 84%|████████▍ | 31821/37963 [136:25:16<24:43:25, 14.49s/it]
 84%|████████▍ | 31822/37963 [136:25:30<24:40:53, 14.47s/it]
 84%|████████▍ | 31823/37963 [136:25:51<28:10:40, 16.52s/it]
 84%|████████▍ | 31824/37963 [136:26:05<26:52:51, 15.76s/it]
 84%|████████▍ | 31825/37963 [136:26:26<29:20:07, 17.21s/it]
 84%|████████▍ | 31826/37963 [136:26:40<27:48:14, 16.31s/it]
 84%|████████▍ | 31827/37963 [136:26:54<26:40:41, 15.65s/it]
 84%|████████▍ | 31828/37963 [136:27:09<26:01:11, 15.27s/it]
 84%|████████▍ | 31829/37963 [136:27:29<28:43:19, 16.86s/it]
 84%|████████▍ | 31830/37963 [136:27:44<27:31:42, 16.16s/it]
                                                            
{'loss': '0.07069', 'grad_norm': '2.61', 'learning_rate': '1.338e-06', 'epoch': '0.8385'}

 84%|████████▍ | 31830/37963 [136:27:44<27:31:42, 16.16s/it]
 84%|████████▍ | 31831/37963 [136:27:58<26:29:47, 15.56s/it]
 84%|████████▍ | 31832/37963 [136:28:13<25:57:36, 15.24s/it]
 84%|████████▍ | 31833/37963 [136:28:27<25:26:48, 14.94s/it]
 84%|████████▍ | 31834/37963 [136:28:41<25:08:50, 14.77s/it]
 84%|████████▍ | 31835/37963 [136:28:56<24:58:01, 14.67s/it]
 84%|████████▍ | 31836/37963 [136:29:10<24:53:36, 14.63s/it]
 84%|████████▍ | 31837/37963 [136:29:24<24:45:19, 14.55s/it]
 84%|████████▍ | 31838/37963 [136:29:46<28:09:07, 16.55s/it]
 84%|████████▍ | 31839/37963 [136:30:00<27:01:45, 15.89s/it]
 84%|████████▍ | 31840/37963 [136:30:14<26:14:56, 15.43s/it]
                                                            
{'loss': '0.08829', 'grad_norm': '3.481', 'learning_rate': '1.334e-06', 'epoch': '0.8387'}

 84%|████████▍ | 31840/37963 [136:30:14<26:14:56, 15.43s/it]
 84%|████████▍ | 31841/37963 [136:30:29<25:42:21, 15.12s/it]
 84%|████████▍ | 31842/37963 [136:30:43<25:21:03, 14.91s/it]
 84%|████████▍ | 31843/37963 [136:30:57<24:57:39, 14.68s/it]
 84%|████████▍ | 31844/37963 [136:31:12<24:42:50, 14.54s/it]
 84%|████████▍ | 31845/37963 [136:31:26<24:36:15, 14.48s/it]
 84%|████████▍ | 31846/37963 [136:31:40<24:26:39, 14.39s/it]
 84%|████████▍ | 31847/37963 [136:31:54<24:22:45, 14.35s/it]
 84%|████████▍ | 31848/37963 [136:32:09<24:20:37, 14.33s/it]
 84%|████████▍ | 31849/37963 [136:32:23<24:22:01, 14.35s/it]
 84%|████████▍ | 31850/37963 [136:32:44<27:36:43, 16.26s/it]
                                                            
{'loss': '0.08688', 'grad_norm': '2.828', 'learning_rate': '1.33e-06', 'epoch': '0.839'}

 84%|████████▍ | 31850/37963 [136:32:44<27:36:43, 16.26s/it]
 84%|████████▍ | 31851/37963 [136:33:05<30:01:46, 17.69s/it]
 84%|████████▍ | 31852/37963 [136:33:19<28:24:54, 16.74s/it]
 84%|████████▍ | 31853/37963 [136:33:40<30:14:51, 17.82s/it]
 84%|████████▍ | 31854/37963 [136:33:54<28:17:23, 16.67s/it]
 84%|████████▍ | 31855/37963 [136:34:08<27:04:40, 15.96s/it]
 84%|████████▍ | 31856/37963 [136:34:22<26:13:44, 15.46s/it]
 84%|████████▍ | 31857/37963 [136:34:36<25:19:47, 14.93s/it]
 84%|████████▍ | 31858/37963 [136:34:50<24:56:05, 14.70s/it]
 84%|████████▍ | 31859/37963 [136:35:04<24:46:58, 14.62s/it]
 84%|████████▍ | 31860/37963 [136:35:25<27:44:27, 16.36s/it]
                                                            
{'loss': '0.07963', 'grad_norm': '3.73', 'learning_rate': '1.326e-06', 'epoch': '0.8392'}

 84%|████████▍ | 31860/37963 [136:35:25<27:44:27, 16.36s/it]
 84%|████████▍ | 31861/37963 [136:35:39<26:44:26, 15.78s/it]
 84%|████████▍ | 31862/37963 [136:35:53<25:54:59, 15.29s/it]
 84%|████████▍ | 31863/37963 [136:36:08<25:26:53, 15.02s/it]
 84%|████████▍ | 31864/37963 [136:36:22<25:01:06, 14.77s/it]
 84%|████████▍ | 31865/37963 [136:36:36<24:44:28, 14.61s/it]
 84%|████████▍ | 31866/37963 [136:36:51<24:36:35, 14.53s/it]
 84%|████████▍ | 31867/37963 [136:37:05<24:32:19, 14.49s/it]
 84%|████████▍ | 31868/37963 [136:37:19<24:31:04, 14.48s/it]
 84%|████████▍ | 31869/37963 [136:37:34<24:20:31, 14.38s/it]
 84%|████████▍ | 31870/37963 [136:37:48<24:18:57, 14.37s/it]
                                                            
{'loss': '0.07421', 'grad_norm': '3.058', 'learning_rate': '1.321e-06', 'epoch': '0.8395'}

 84%|████████▍ | 31870/37963 [136:37:48<24:18:57, 14.37s/it]
 84%|████████▍ | 31871/37963 [136:38:09<27:26:49, 16.22s/it]
 84%|████████▍ | 31872/37963 [136:38:23<26:34:24, 15.71s/it]
 84%|████████▍ | 31873/37963 [136:38:37<25:42:51, 15.20s/it]
 84%|████████▍ | 31874/37963 [136:38:58<28:46:36, 17.01s/it]
 84%|████████▍ | 31875/37963 [136:39:13<27:27:01, 16.23s/it]
 84%|████████▍ | 31876/37963 [136:39:27<26:30:16, 15.68s/it]
 84%|████████▍ | 31877/37963 [136:39:42<25:52:35, 15.31s/it]
 84%|████████▍ | 31878/37963 [136:40:02<28:43:18, 16.99s/it]
 84%|████████▍ | 31879/37963 [136:40:17<27:28:17, 16.26s/it]
 84%|████████▍ | 31880/37963 [136:40:31<26:30:24, 15.69s/it]
                                                            
{'loss': '0.07458', 'grad_norm': '2.118', 'learning_rate': '1.317e-06', 'epoch': '0.8398'}

 84%|████████▍ | 31880/37963 [136:40:31<26:30:24, 15.69s/it]
 84%|████████▍ | 31881/37963 [136:40:46<25:48:34, 15.28s/it]
 84%|████████▍ | 31882/37963 [136:41:00<25:21:31, 15.01s/it]
 84%|████████▍ | 31883/37963 [136:41:14<24:56:49, 14.77s/it]
 84%|████████▍ | 31884/37963 [136:41:28<24:35:39, 14.56s/it]
 84%|████████▍ | 31885/37963 [136:41:49<27:34:13, 16.33s/it]
 84%|████████▍ | 31886/37963 [136:42:03<26:26:04, 15.66s/it]
 84%|████████▍ | 31887/37963 [136:42:17<25:48:44, 15.29s/it]
 84%|████████▍ | 31888/37963 [136:42:32<25:19:33, 15.01s/it]
 84%|████████▍ | 31889/37963 [136:42:46<24:58:28, 14.80s/it]
 84%|████████▍ | 31890/37963 [136:43:00<24:46:26, 14.69s/it]
                                                            
{'loss': '0.08042', 'grad_norm': '3.02', 'learning_rate': '1.313e-06', 'epoch': '0.84'}

 84%|████████▍ | 31890/37963 [136:43:00<24:46:26, 14.69s/it]
 84%|████████▍ | 31891/37963 [136:43:15<24:39:09, 14.62s/it]
 84%|████████▍ | 31892/37963 [136:43:29<24:21:46, 14.45s/it]
 84%|████████▍ | 31893/37963 [136:43:43<24:15:03, 14.38s/it]
 84%|████████▍ | 31894/37963 [136:43:58<24:14:18, 14.38s/it]
 84%|████████▍ | 31895/37963 [136:44:12<24:04:22, 14.28s/it]
 84%|████████▍ | 31896/37963 [136:44:32<27:19:57, 16.22s/it]
 84%|████████▍ | 31897/37963 [136:44:47<26:21:09, 15.64s/it]
 84%|████████▍ | 31898/37963 [136:45:08<29:10:15, 17.32s/it]
 84%|████████▍ | 31899/37963 [136:45:22<27:37:42, 16.40s/it]
 84%|████████▍ | 31900/37963 [136:45:42<29:35:48, 17.57s/it]
                                                            
{'loss': '0.08159', 'grad_norm': '3.459', 'learning_rate': '1.309e-06', 'epoch': '0.8403'}

 84%|████████▍ | 31900/37963 [136:45:42<29:35:48, 17.57s/it]
 84%|████████▍ | 31901/37963 [136:45:56<27:45:24, 16.48s/it]
 84%|████████▍ | 31902/37963 [136:46:11<26:42:39, 15.87s/it]
 84%|████████▍ | 31903/37963 [136:46:25<25:57:22, 15.42s/it]
 84%|████████▍ | 31904/37963 [136:46:40<25:27:46, 15.13s/it]
 84%|████████▍ | 31905/37963 [136:46:54<25:00:27, 14.86s/it]
 84%|████████▍ | 31906/37963 [136:47:08<24:46:41, 14.73s/it]
 84%|████████▍ | 31907/37963 [136:47:22<24:28:26, 14.55s/it]
 84%|████████▍ | 31908/37963 [136:47:43<27:34:50, 16.40s/it]
 84%|████████▍ | 31909/37963 [136:47:57<26:33:41, 15.79s/it]
 84%|████████▍ | 31910/37963 [136:48:12<25:51:40, 15.38s/it]
                                                            
{'loss': '0.07213', 'grad_norm': '2.724', 'learning_rate': '1.304e-06', 'epoch': '0.8406'}

 84%|████████▍ | 31910/37963 [136:48:12<25:51:40, 15.38s/it]
 84%|████████▍ | 31911/37963 [136:48:26<25:06:31, 14.94s/it]
 84%|████████▍ | 31912/37963 [136:48:40<24:48:03, 14.76s/it]
 84%|████████▍ | 31913/37963 [136:48:54<24:19:55, 14.48s/it]
 84%|████████▍ | 31914/37963 [136:49:08<24:18:38, 14.47s/it]
 84%|████████▍ | 31915/37963 [136:49:23<24:18:41, 14.47s/it]
 84%|████████▍ | 31916/37963 [136:49:37<24:16:50, 14.46s/it]
 84%|████████▍ | 31917/37963 [136:49:52<24:17:39, 14.47s/it]
 84%|████████▍ | 31918/37963 [136:50:06<24:15:59, 14.45s/it]
 84%|████████▍ | 31919/37963 [136:50:20<24:09:10, 14.39s/it]
 84%|████████▍ | 31920/37963 [136:50:41<27:18:20, 16.27s/it]
                                                            
{'loss': '0.08381', 'grad_norm': '1.842', 'learning_rate': '1.3e-06', 'epoch': '0.8408'}

 84%|████████▍ | 31920/37963 [136:50:41<27:18:20, 16.27s/it]
 84%|████████▍ | 31921/37963 [136:50:56<26:25:50, 15.75s/it]
 84%|████████▍ | 31922/37963 [136:51:17<29:02:02, 17.30s/it]
 84%|████████▍ | 31923/37963 [136:51:31<27:33:07, 16.42s/it]
 84%|████████▍ | 31924/37963 [136:51:45<26:30:59, 15.81s/it]
 84%|████████▍ | 31925/37963 [136:52:00<25:48:01, 15.38s/it]
 84%|████████▍ | 31926/37963 [136:52:13<24:54:57, 14.86s/it]
 84%|████████▍ | 31927/37963 [136:52:28<24:40:34, 14.72s/it]
 84%|████████▍ | 31928/37963 [136:52:48<27:38:47, 16.49s/it]
 84%|████████▍ | 31929/37963 [136:53:03<26:34:39, 15.86s/it]
 84%|████████▍ | 31930/37963 [136:53:17<25:49:55, 15.41s/it]
                                                            
{'loss': '0.07872', 'grad_norm': '2.655', 'learning_rate': '1.296e-06', 'epoch': '0.8411'}

 84%|████████▍ | 31930/37963 [136:53:17<25:49:55, 15.41s/it]
 84%|████████▍ | 31931/37963 [136:53:32<25:20:32, 15.12s/it]
 84%|████████▍ | 31932/37963 [136:53:46<24:58:14, 14.91s/it]
 84%|████████▍ | 31933/37963 [136:54:00<24:41:00, 14.74s/it]
 84%|████████▍ | 31934/37963 [136:54:14<24:24:14, 14.57s/it]
 84%|████████▍ | 31935/37963 [136:54:36<27:42:18, 16.55s/it]
 84%|████████▍ | 31936/37963 [136:54:50<26:27:36, 15.81s/it]
 84%|████████▍ | 31937/37963 [136:55:04<25:42:37, 15.36s/it]
 84%|████████▍ | 31938/37963 [136:55:18<25:12:17, 15.06s/it]
 84%|████████▍ | 31939/37963 [136:55:33<24:50:27, 14.85s/it]
 84%|████████▍ | 31940/37963 [136:55:47<24:39:17, 14.74s/it]
                                                            
{'loss': '0.05873', 'grad_norm': '2.767', 'learning_rate': '1.292e-06', 'epoch': '0.8413'}

 84%|████████▍ | 31940/37963 [136:55:47<24:39:17, 14.74s/it]
 84%|████████▍ | 31941/37963 [136:56:02<24:29:35, 14.64s/it]
 84%|████████▍ | 31942/37963 [136:56:16<24:20:16, 14.55s/it]
 84%|████████▍ | 31943/37963 [136:56:30<24:15:55, 14.51s/it]
 84%|████████▍ | 31944/37963 [136:56:44<24:03:18, 14.39s/it]
 84%|████████▍ | 31945/37963 [136:56:59<24:03:33, 14.39s/it]
 84%|████████▍ | 31946/37963 [136:57:13<24:05:13, 14.41s/it]
 84%|████████▍ | 31947/37963 [136:57:41<30:45:53, 18.41s/it]
 84%|████████▍ | 31948/37963 [136:57:55<28:42:57, 17.19s/it]
 84%|████████▍ | 31949/37963 [136:58:10<27:24:38, 16.41s/it]
 84%|████████▍ | 31950/37963 [136:58:24<26:22:11, 15.79s/it]
                                                            
{'loss': '0.07991', 'grad_norm': '2.03', 'learning_rate': '1.288e-06', 'epoch': '0.8416'}

 84%|████████▍ | 31950/37963 [136:58:24<26:22:11, 15.79s/it]
 84%|████████▍ | 31951/37963 [136:58:45<28:40:52, 17.17s/it]
 84%|████████▍ | 31952/37963 [136:58:59<27:15:42, 16.33s/it]
 84%|████████▍ | 31953/37963 [136:59:14<26:17:49, 15.75s/it]
 84%|████████▍ | 31954/37963 [136:59:28<25:36:30, 15.34s/it]
 84%|████████▍ | 31955/37963 [136:59:42<25:09:07, 15.07s/it]
 84%|████████▍ | 31956/37963 [137:00:02<27:40:31, 16.59s/it]
 84%|████████▍ | 31957/37963 [137:00:17<26:36:51, 15.95s/it]
 84%|████████▍ | 31958/37963 [137:00:31<25:49:08, 15.48s/it]
 84%|████████▍ | 31959/37963 [137:00:46<25:14:50, 15.14s/it]
 84%|████████▍ | 31960/37963 [137:01:00<24:49:48, 14.89s/it]
                                                            
{'loss': '0.07882', 'grad_norm': '3.22', 'learning_rate': '1.283e-06', 'epoch': '0.8419'}

 84%|████████▍ | 31960/37963 [137:01:00<24:49:48, 14.89s/it]
 84%|████████▍ | 31961/37963 [137:01:14<24:29:51, 14.69s/it]
 84%|████████▍ | 31962/37963 [137:01:28<24:09:49, 14.50s/it]
 84%|████████▍ | 31963/37963 [137:01:43<24:05:28, 14.45s/it]
 84%|████████▍ | 31964/37963 [137:01:57<24:04:08, 14.44s/it]
 84%|████████▍ | 31965/37963 [137:02:11<23:51:04, 14.32s/it]
 84%|████████▍ | 31966/37963 [137:02:25<23:37:04, 14.18s/it]
 84%|████████▍ | 31967/37963 [137:02:39<23:42:42, 14.24s/it]
 84%|████████▍ | 31968/37963 [137:02:54<23:52:40, 14.34s/it]
 84%|████████▍ | 31969/37963 [137:03:15<27:22:16, 16.44s/it]
 84%|████████▍ | 31970/37963 [137:03:30<26:24:20, 15.86s/it]
                                                            
{'loss': '0.08005', 'grad_norm': '3.573', 'learning_rate': '1.279e-06', 'epoch': '0.8421'}

 84%|████████▍ | 31970/37963 [137:03:30<26:24:20, 15.86s/it]
 84%|████████▍ | 31971/37963 [137:03:51<29:10:52, 17.53s/it]
 84%|████████▍ | 31972/37963 [137:04:05<27:33:35, 16.56s/it]
 84%|████████▍ | 31973/37963 [137:04:20<26:27:27, 15.90s/it]
 84%|████████▍ | 31974/37963 [137:04:34<25:28:32, 15.31s/it]
 84%|████████▍ | 31975/37963 [137:04:48<25:02:50, 15.06s/it]
 84%|████████▍ | 31976/37963 [137:05:02<24:39:33, 14.83s/it]
 84%|████████▍ | 31977/37963 [137:05:17<24:22:04, 14.65s/it]
 84%|████████▍ | 31978/37963 [137:05:31<24:07:36, 14.51s/it]
 84%|████████▍ | 31979/37963 [137:05:52<27:26:09, 16.51s/it]
 84%|████████▍ | 31980/37963 [137:06:06<26:22:26, 15.87s/it]
                                                            
{'loss': '0.08001', 'grad_norm': '3.192', 'learning_rate': '1.275e-06', 'epoch': '0.8424'}

 84%|████████▍ | 31980/37963 [137:06:06<26:22:26, 15.87s/it]
 84%|████████▍ | 31981/37963 [137:06:21<25:40:14, 15.45s/it]
 84%|████████▍ | 31982/37963 [137:06:35<24:58:31, 15.03s/it]
 84%|████████▍ | 31983/37963 [137:06:56<27:56:26, 16.82s/it]
 84%|████████▍ | 31984/37963 [137:07:10<26:43:33, 16.09s/it]
 84%|████████▍ | 31985/37963 [137:07:25<25:46:58, 15.53s/it]
 84%|████████▍ | 31986/37963 [137:07:39<25:09:33, 15.15s/it]
 84%|████████▍ | 31987/37963 [137:07:53<24:45:28, 14.91s/it]
 84%|████████▍ | 31988/37963 [137:08:08<24:26:31, 14.73s/it]
 84%|████████▍ | 31989/37963 [137:08:22<24:18:56, 14.65s/it]
 84%|████████▍ | 31990/37963 [137:08:36<24:12:21, 14.59s/it]
                                                            
{'loss': '0.07199', 'grad_norm': '2.924', 'learning_rate': '1.271e-06', 'epoch': '0.8427'}

 84%|████████▍ | 31990/37963 [137:08:36<24:12:21, 14.59s/it]
 84%|████████▍ | 31991/37963 [137:08:51<24:07:18, 14.54s/it]
 84%|████████▍ | 31992/37963 [137:09:05<23:57:14, 14.44s/it]
 84%|████████▍ | 31993/37963 [137:09:26<27:06:14, 16.34s/it]
 84%|████████▍ | 31994/37963 [137:09:40<25:52:17, 15.60s/it]
 84%|████████▍ | 31995/37963 [137:09:54<24:59:28, 15.08s/it]
 84%|████████▍ | 31996/37963 [137:10:15<28:04:17, 16.94s/it]
 84%|████████▍ | 31997/37963 [137:10:29<26:48:54, 16.18s/it]
 84%|████████▍ | 31998/37963 [137:10:44<25:54:00, 15.63s/it]
 84%|████████▍ | 31999/37963 [137:10:58<25:17:32, 15.27s/it]
 84%|████████▍ | 32000/37963 [137:11:13<24:53:51, 15.03s/it]
                                                            
{'loss': '0.07486', 'grad_norm': '2.294', 'learning_rate': '1.267e-06', 'epoch': '0.8429'}

 84%|████████▍ | 32000/37963 [137:11:13<24:53:51, 15.03s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.57s/it]
Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.57s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 84%|████████▍ | 32001/37963 [137:13:02<71:59:36, 43.47s/it]
 84%|████████▍ | 32002/37963 [137:13:17<57:31:57, 34.75s/it]
 84%|████████▍ | 32003/37963 [137:13:31<47:23:15, 28.62s/it]
 84%|████████▍ | 32004/37963 [137:13:51<43:12:23, 26.10s/it]
 84%|████████▍ | 32005/37963 [137:14:06<37:21:40, 22.57s/it]
 84%|████████▍ | 32006/37963 [137:14:20<33:07:48, 20.02s/it]
 84%|████████▍ | 32007/37963 [137:14:34<30:19:40, 18.33s/it]
 84%|████████▍ | 32008/37963 [137:14:48<28:22:52, 17.16s/it]
 84%|████████▍ | 32009/37963 [137:15:03<26:58:36, 16.31s/it]
 84%|████████▍ | 32010/37963 [137:15:17<26:01:14, 15.74s/it]
                                                            
{'loss': '0.07967', 'grad_norm': '2.947', 'learning_rate': '1.263e-06', 'epoch': '0.8432'}

 84%|████████▍ | 32010/37963 [137:15:17<26:01:14, 15.74s/it]
 84%|████████▍ | 32011/37963 [137:15:31<25:16:17, 15.29s/it]
 84%|████████▍ | 32012/37963 [137:15:46<24:50:00, 15.02s/it]
 84%|████████▍ | 32013/37963 [137:16:00<24:31:55, 14.84s/it]
 84%|████████▍ | 32014/37963 [137:16:15<24:20:46, 14.73s/it]
 84%|████████▍ | 32015/37963 [137:16:29<24:07:11, 14.60s/it]
 84%|████████▍ | 32016/37963 [137:16:43<23:58:22, 14.51s/it]
 84%|████████▍ | 32017/37963 [137:17:04<26:51:02, 16.26s/it]
 84%|████████▍ | 32018/37963 [137:17:18<25:59:26, 15.74s/it]
 84%|████████▍ | 32019/37963 [137:17:40<28:51:44, 17.48s/it]
 84%|████████▍ | 32020/37963 [137:17:54<27:18:03, 16.54s/it]
                                                            
{'loss': '0.06715', 'grad_norm': '3.923', 'learning_rate': '1.258e-06', 'epoch': '0.8435'}

 84%|████████▍ | 32020/37963 [137:17:54<27:18:03, 16.54s/it]
 84%|████████▍ | 32021/37963 [137:18:09<26:18:29, 15.94s/it]
 84%|████████▍ | 32022/37963 [137:18:23<25:25:50, 15.41s/it]
 84%|████████▍ | 32023/37963 [137:18:37<24:52:58, 15.08s/it]
 84%|████████▍ | 32024/37963 [137:18:51<24:30:16, 14.85s/it]
 84%|████████▍ | 32025/37963 [137:19:06<24:12:02, 14.67s/it]
 84%|████████▍ | 32026/37963 [137:19:20<23:56:58, 14.52s/it]
 84%|████████▍ | 32027/37963 [137:19:41<27:01:29, 16.39s/it]
 84%|████████▍ | 32028/37963 [137:19:55<26:02:00, 15.79s/it]
 84%|████████▍ | 32029/37963 [137:20:09<25:19:29, 15.36s/it]
 84%|████████▍ | 32030/37963 [137:20:24<24:53:12, 15.10s/it]
                                                            
{'loss': '0.08553', 'grad_norm': '3.149', 'learning_rate': '1.254e-06', 'epoch': '0.8437'}

 84%|████████▍ | 32030/37963 [137:20:24<24:53:12, 15.10s/it]
 84%|████████▍ | 32031/37963 [137:20:38<24:28:54, 14.86s/it]
 84%|████████▍ | 32032/37963 [137:20:52<24:01:35, 14.58s/it]
 84%|████████▍ | 32033/37963 [137:21:06<23:46:37, 14.43s/it]
 84%|████████▍ | 32034/37963 [137:21:27<27:05:48, 16.45s/it]
 84%|████████▍ | 32035/37963 [137:21:42<26:07:33, 15.87s/it]
 84%|████████▍ | 32036/37963 [137:21:56<25:28:45, 15.48s/it]
 84%|████████▍ | 32037/37963 [137:22:11<25:02:15, 15.21s/it]
 84%|████████▍ | 32038/37963 [137:22:25<24:36:44, 14.95s/it]
 84%|████████▍ | 32039/37963 [137:22:40<24:18:10, 14.77s/it]
 84%|████████▍ | 32040/37963 [137:22:54<24:06:37, 14.65s/it]
                                                            
{'loss': '0.07455', 'grad_norm': '3.31', 'learning_rate': '1.25e-06', 'epoch': '0.844'}

 84%|████████▍ | 32040/37963 [137:22:54<24:06:37, 14.65s/it]
 84%|████████▍ | 32041/37963 [137:23:08<23:47:29, 14.46s/it]
 84%|████████▍ | 32042/37963 [137:23:22<23:39:14, 14.38s/it]
 84%|████████▍ | 32043/37963 [137:23:43<26:46:42, 16.28s/it]
 84%|████████▍ | 32044/37963 [137:24:04<29:00:11, 17.64s/it]
 84%|████████▍ | 32045/37963 [137:24:18<27:23:59, 16.67s/it]
 84%|████████▍ | 32046/37963 [137:24:33<26:13:04, 15.95s/it]
 84%|████████▍ | 32047/37963 [137:24:47<25:25:43, 15.47s/it]
 84%|████████▍ | 32048/37963 [137:25:01<24:52:27, 15.14s/it]
 84%|████████▍ | 32049/37963 [137:25:21<27:20:57, 16.65s/it]
 84%|████████▍ | 32050/37963 [137:25:35<26:03:05, 15.86s/it]
                                                            
{'loss': '0.08481', 'grad_norm': '2.841', 'learning_rate': '1.246e-06', 'epoch': '0.8442'}

 84%|████████▍ | 32050/37963 [137:25:35<26:03:05, 15.86s/it]
 84%|████████▍ | 32051/37963 [137:25:50<25:18:42, 15.41s/it]
 84%|████████▍ | 32052/37963 [137:26:04<24:41:56, 15.04s/it]
 84%|████████▍ | 32053/37963 [137:26:18<24:20:49, 14.83s/it]
 84%|████████▍ | 32054/37963 [137:26:33<24:07:06, 14.69s/it]
 84%|████████▍ | 32055/37963 [137:26:53<26:59:27, 16.45s/it]
 84%|████████▍ | 32056/37963 [137:27:08<25:57:06, 15.82s/it]
 84%|████████▍ | 32057/37963 [137:27:22<25:14:18, 15.38s/it]
 84%|████████▍ | 32058/37963 [137:27:36<24:44:40, 15.09s/it]
 84%|████████▍ | 32059/37963 [137:27:51<24:27:25, 14.91s/it]
 84%|████████▍ | 32060/37963 [137:28:05<24:11:12, 14.75s/it]
                                                            
{'loss': '0.07152', 'grad_norm': '2.361', 'learning_rate': '1.242e-06', 'epoch': '0.8445'}

 84%|████████▍ | 32060/37963 [137:28:05<24:11:12, 14.75s/it]
 84%|████████▍ | 32061/37963 [137:28:20<24:01:51, 14.66s/it]
 84%|████████▍ | 32062/37963 [137:28:34<23:41:29, 14.45s/it]
 84%|████████▍ | 32063/37963 [137:28:48<23:39:36, 14.44s/it]
 84%|████████▍ | 32064/37963 [137:29:09<26:57:48, 16.46s/it]
 84%|████████▍ | 32065/37963 [137:29:23<25:50:22, 15.77s/it]
 84%|████████▍ | 32066/37963 [137:29:38<25:11:49, 15.38s/it]
 84%|████████▍ | 32067/37963 [137:29:52<24:40:04, 15.06s/it]
 84%|████████▍ | 32068/37963 [137:30:13<27:40:15, 16.90s/it]
 84%|████████▍ | 32069/37963 [137:30:27<26:06:37, 15.95s/it]
 84%|████████▍ | 32070/37963 [137:30:41<25:08:04, 15.35s/it]
                                                            
{'loss': '0.07436', 'grad_norm': '2.298', 'learning_rate': '1.238e-06', 'epoch': '0.8448'}

 84%|████████▍ | 32070/37963 [137:30:41<25:08:04, 15.35s/it]
 84%|████████▍ | 32071/37963 [137:30:55<24:39:56, 15.07s/it]
 84%|████████▍ | 32072/37963 [137:31:09<24:08:42, 14.76s/it]
 84%|████████▍ | 32073/37963 [137:31:24<23:57:43, 14.65s/it]
 84%|████████▍ | 32074/37963 [137:31:38<23:49:00, 14.56s/it]
 84%|████████▍ | 32075/37963 [137:31:53<23:42:54, 14.50s/it]
 84%|████████▍ | 32076/37963 [137:32:07<23:38:22, 14.46s/it]
 84%|████████▍ | 32077/37963 [137:32:27<26:28:32, 16.19s/it]
 84%|████████▍ | 32078/37963 [137:32:42<25:36:41, 15.67s/it]
 85%|████████▍ | 32079/37963 [137:32:56<24:59:58, 15.30s/it]
 85%|████████▍ | 32080/37963 [137:33:10<24:33:19, 15.03s/it]
                                                            
{'loss': '0.07473', 'grad_norm': '3.556', 'learning_rate': '1.234e-06', 'epoch': '0.845'}

 85%|████████▍ | 32080/37963 [137:33:10<24:33:19, 15.03s/it]
 85%|████████▍ | 32081/37963 [137:33:25<24:08:32, 14.78s/it]
 85%|████████▍ | 32082/37963 [137:33:45<27:04:51, 16.58s/it]
 85%|████████▍ | 32083/37963 [137:34:00<26:05:52, 15.98s/it]
 85%|████████▍ | 32084/37963 [137:34:14<25:04:34, 15.36s/it]
 85%|████████▍ | 32085/37963 [137:34:28<24:41:26, 15.12s/it]
 85%|████████▍ | 32086/37963 [137:34:43<24:24:08, 14.95s/it]
 85%|████████▍ | 32087/37963 [137:34:57<24:07:05, 14.78s/it]
 85%|████████▍ | 32088/37963 [137:35:12<23:59:25, 14.70s/it]
 85%|████████▍ | 32089/37963 [137:35:26<23:36:05, 14.46s/it]
 85%|████████▍ | 32090/37963 [137:35:40<23:32:16, 14.43s/it]
                                                            
{'loss': '0.06779', 'grad_norm': '2.72', 'learning_rate': '1.23e-06', 'epoch': '0.8453'}

 85%|████████▍ | 32090/37963 [137:35:40<23:32:16, 14.43s/it]
 85%|████████▍ | 32091/37963 [137:36:01<26:30:33, 16.25s/it]
 85%|████████▍ | 32092/37963 [137:36:22<28:52:17, 17.70s/it]
 85%|████████▍ | 32093/37963 [137:36:36<27:16:13, 16.72s/it]
 85%|████████▍ | 32094/37963 [137:36:51<26:09:49, 16.05s/it]
 85%|████████▍ | 32095/37963 [137:37:05<25:21:26, 15.56s/it]
 85%|████████▍ | 32096/37963 [137:37:19<24:45:43, 15.19s/it]
 85%|████████▍ | 32097/37963 [137:37:41<27:37:48, 16.96s/it]
 85%|████████▍ | 32098/37963 [137:37:54<26:06:59, 16.03s/it]
 85%|████████▍ | 32099/37963 [137:38:09<25:21:31, 15.57s/it]
 85%|████████▍ | 32100/37963 [137:38:23<24:41:25, 15.16s/it]
                                                            
{'loss': '0.07179', 'grad_norm': '2.664', 'learning_rate': '1.226e-06', 'epoch': '0.8456'}

 85%|████████▍ | 32100/37963 [137:38:23<24:41:25, 15.16s/it]
 85%|████████▍ | 32101/37963 [137:38:38<24:21:23, 14.96s/it]
 85%|████████▍ | 32102/37963 [137:38:52<23:54:16, 14.68s/it]
 85%|████████▍ | 32103/37963 [137:39:06<23:49:38, 14.64s/it]
 85%|████████▍ | 32104/37963 [137:39:21<23:44:01, 14.58s/it]
 85%|████████▍ | 32105/37963 [137:39:35<23:39:14, 14.54s/it]
 85%|████████▍ | 32106/37963 [137:39:56<26:44:20, 16.44s/it]
 85%|████████▍ | 32107/37963 [137:40:10<25:43:32, 15.81s/it]
 85%|████████▍ | 32108/37963 [137:40:24<24:51:02, 15.28s/it]
 85%|████████▍ | 32109/37963 [137:40:39<24:24:03, 15.01s/it]
 85%|████████▍ | 32110/37963 [137:40:53<24:04:00, 14.80s/it]
                                                            
{'loss': '0.07629', 'grad_norm': '2.313', 'learning_rate': '1.221e-06', 'epoch': '0.8458'}

 85%|████████▍ | 32110/37963 [137:40:53<24:04:00, 14.80s/it]
 85%|████████▍ | 32111/37963 [137:41:07<23:52:48, 14.69s/it]
 85%|████████▍ | 32112/37963 [137:41:29<27:02:54, 16.64s/it]
 85%|████████▍ | 32113/37963 [137:41:43<25:56:25, 15.96s/it]
 85%|████████▍ | 32114/37963 [137:41:57<25:10:19, 15.49s/it]
 85%|████████▍ | 32115/37963 [137:42:11<24:19:30, 14.97s/it]
 85%|████████▍ | 32116/37963 [137:42:26<24:03:34, 14.81s/it]
 85%|████████▍ | 32117/37963 [137:42:46<26:58:47, 16.61s/it]
 85%|████████▍ | 32118/37963 [137:43:00<25:40:23, 15.81s/it]
 85%|████████▍ | 32119/37963 [137:43:14<24:51:42, 15.32s/it]
 85%|████████▍ | 32120/37963 [137:43:29<24:22:58, 15.02s/it]
                                                            
{'loss': '0.0747', 'grad_norm': '3.304', 'learning_rate': '1.217e-06', 'epoch': '0.8461'}

 85%|████████▍ | 32120/37963 [137:43:29<24:22:58, 15.02s/it]
 85%|████████▍ | 32121/37963 [137:43:43<24:03:02, 14.82s/it]
 85%|████████▍ | 32122/37963 [137:43:57<23:43:47, 14.63s/it]
 85%|████████▍ | 32123/37963 [137:44:12<23:30:50, 14.49s/it]
 85%|████████▍ | 32124/37963 [137:44:25<23:00:09, 14.18s/it]
 85%|████████▍ | 32125/37963 [137:44:39<22:55:43, 14.14s/it]
 85%|████████▍ | 32126/37963 [137:45:00<26:05:46, 16.10s/it]
 85%|████████▍ | 32127/37963 [137:45:14<25:16:13, 15.59s/it]
 85%|████████▍ | 32128/37963 [137:45:28<24:27:58, 15.09s/it]
 85%|████████▍ | 32129/37963 [137:45:42<23:58:50, 14.80s/it]
 85%|████████▍ | 32130/37963 [137:45:56<23:44:08, 14.65s/it]
                                                            
{'loss': '0.06734', 'grad_norm': '2.816', 'learning_rate': '1.213e-06', 'epoch': '0.8464'}

 85%|████████▍ | 32130/37963 [137:45:56<23:44:08, 14.65s/it]
 85%|████████▍ | 32131/37963 [137:46:18<26:51:50, 16.58s/it]
 85%|████████▍ | 32132/37963 [137:46:32<25:47:39, 15.93s/it]
 85%|████████▍ | 32133/37963 [137:46:46<25:03:17, 15.47s/it]
 85%|████████▍ | 32134/37963 [137:47:01<24:30:23, 15.14s/it]
 85%|████████▍ | 32135/37963 [137:47:15<24:08:18, 14.91s/it]
 85%|████████▍ | 32136/37963 [137:47:30<23:53:47, 14.76s/it]
 85%|████████▍ | 32137/37963 [137:47:44<23:41:56, 14.64s/it]
 85%|████████▍ | 32138/37963 [137:47:58<23:24:13, 14.46s/it]
 85%|████████▍ | 32139/37963 [137:48:12<23:23:19, 14.46s/it]
 85%|████████▍ | 32140/37963 [137:48:33<26:31:44, 16.40s/it]
                                                            
{'loss': '0.07886', 'grad_norm': '3.618', 'learning_rate': '1.209e-06', 'epoch': '0.8466'}

 85%|████████▍ | 32140/37963 [137:48:33<26:31:44, 16.40s/it]
 85%|████████▍ | 32141/37963 [137:48:48<25:32:25, 15.79s/it]
 85%|████████▍ | 32142/37963 [137:49:09<28:14:24, 17.47s/it]
 85%|████████▍ | 32143/37963 [137:49:23<26:42:11, 16.52s/it]
 85%|████████▍ | 32144/37963 [137:49:38<25:42:10, 15.90s/it]
 85%|████████▍ | 32145/37963 [137:49:59<28:04:13, 17.37s/it]
 85%|████████▍ | 32146/37963 [137:50:13<26:36:58, 16.47s/it]
 85%|████████▍ | 32147/37963 [137:50:27<25:36:28, 15.85s/it]
 85%|████████▍ | 32148/37963 [137:50:42<24:55:03, 15.43s/it]
 85%|████████▍ | 32149/37963 [137:50:56<24:26:14, 15.13s/it]
 85%|████████▍ | 32150/37963 [137:51:11<24:03:40, 14.90s/it]
                                                            
{'loss': '0.07413', 'grad_norm': '2.683', 'learning_rate': '1.205e-06', 'epoch': '0.8469'}

 85%|████████▍ | 32150/37963 [137:51:11<24:03:40, 14.90s/it]
 85%|████████▍ | 32151/37963 [137:51:25<23:42:24, 14.68s/it]
 85%|████████▍ | 32152/37963 [137:51:39<23:33:06, 14.59s/it]
 85%|████████▍ | 32153/37963 [137:51:54<23:27:51, 14.54s/it]
 85%|████████▍ | 32154/37963 [137:52:08<23:24:53, 14.51s/it]
 85%|████████▍ | 32155/37963 [137:52:28<26:12:00, 16.24s/it]
 85%|████████▍ | 32156/37963 [137:52:43<25:17:31, 15.68s/it]
 85%|████████▍ | 32157/37963 [137:52:57<24:29:43, 15.19s/it]
 85%|████████▍ | 32158/37963 [137:53:11<24:03:45, 14.92s/it]
 85%|████████▍ | 32159/37963 [137:53:25<23:50:00, 14.78s/it]
 85%|████████▍ | 32160/37963 [137:53:40<23:39:15, 14.67s/it]
                                                            
{'loss': '0.07233', 'grad_norm': '3.636', 'learning_rate': '1.201e-06', 'epoch': '0.8471'}

 85%|████████▍ | 32160/37963 [137:53:40<23:39:15, 14.67s/it]
 85%|████████▍ | 32161/37963 [137:54:01<26:59:06, 16.74s/it]
 85%|████████▍ | 32162/37963 [137:54:16<25:49:25, 16.03s/it]
 85%|████████▍ | 32163/37963 [137:54:30<25:01:06, 15.53s/it]
 85%|████████▍ | 32164/37963 [137:54:44<24:21:13, 15.12s/it]
 85%|████████▍ | 32165/37963 [137:54:59<23:59:01, 14.89s/it]
 85%|████████▍ | 32166/37963 [137:55:19<26:41:43, 16.58s/it]
 85%|████████▍ | 32167/37963 [137:55:34<25:40:35, 15.95s/it]
 85%|████████▍ | 32168/37963 [137:55:48<24:55:43, 15.49s/it]
 85%|████████▍ | 32169/37963 [137:56:02<24:22:05, 15.14s/it]
 85%|████████▍ | 32170/37963 [137:56:17<23:55:25, 14.87s/it]
                                                            
{'loss': '0.07991', 'grad_norm': '2.817', 'learning_rate': '1.197e-06', 'epoch': '0.8474'}

 85%|████████▍ | 32170/37963 [137:56:17<23:55:25, 14.87s/it]
 85%|████████▍ | 32171/37963 [137:56:31<23:43:47, 14.75s/it]
 85%|████████▍ | 32172/37963 [137:56:46<23:33:22, 14.64s/it]
 85%|████████▍ | 32173/37963 [137:57:00<23:25:58, 14.57s/it]
 85%|████████▍ | 32174/37963 [137:57:14<23:19:54, 14.51s/it]
 85%|████████▍ | 32175/37963 [137:57:35<26:24:10, 16.42s/it]
 85%|████████▍ | 32176/37963 [137:57:50<25:22:54, 15.79s/it]
 85%|████████▍ | 32177/37963 [137:58:04<24:33:28, 15.28s/it]
 85%|████████▍ | 32178/37963 [137:58:18<24:10:08, 15.04s/it]
 85%|████████▍ | 32179/37963 [137:58:32<23:51:22, 14.85s/it]
 85%|████████▍ | 32180/37963 [137:58:53<26:40:05, 16.60s/it]
                                                            
{'loss': '0.07596', 'grad_norm': '2.858', 'learning_rate': '1.193e-06', 'epoch': '0.8477'}

 85%|████████▍ | 32180/37963 [137:58:53<26:40:05, 16.60s/it]
 85%|████████▍ | 32181/37963 [137:59:08<25:34:49, 15.93s/it]
 85%|████████▍ | 32182/37963 [137:59:22<24:44:22, 15.41s/it]
 85%|████████▍ | 32183/37963 [137:59:36<24:02:48, 14.98s/it]
 85%|████████▍ | 32184/37963 [137:59:50<23:44:57, 14.79s/it]
 85%|████████▍ | 32185/37963 [138:00:04<23:31:27, 14.66s/it]
 85%|████████▍ | 32186/37963 [138:00:19<23:23:51, 14.58s/it]
 85%|████████▍ | 32187/37963 [138:00:33<23:20:14, 14.55s/it]
 85%|████████▍ | 32188/37963 [138:00:54<26:22:13, 16.44s/it]
 85%|████████▍ | 32189/37963 [138:01:09<25:25:33, 15.85s/it]
 85%|████████▍ | 32190/37963 [138:01:30<28:01:59, 17.48s/it]
                                                            
{'loss': '0.07811', 'grad_norm': '2.154', 'learning_rate': '1.189e-06', 'epoch': '0.8479'}

 85%|████████▍ | 32190/37963 [138:01:30<28:01:59, 17.48s/it]
 85%|████████▍ | 32191/37963 [138:01:44<26:33:30, 16.56s/it]
 85%|████████▍ | 32192/37963 [138:01:59<25:26:53, 15.87s/it]
 85%|████████▍ | 32193/37963 [138:02:20<27:53:27, 17.40s/it]
 85%|████████▍ | 32194/37963 [138:02:34<26:25:53, 16.49s/it]
 85%|████████▍ | 32195/37963 [138:02:48<25:24:35, 15.86s/it]
 85%|████████▍ | 32196/37963 [138:03:03<24:37:37, 15.37s/it]
 85%|████████▍ | 32197/37963 [138:03:17<24:01:43, 15.00s/it]
 85%|████████▍ | 32198/37963 [138:03:31<23:43:59, 14.82s/it]
 85%|████████▍ | 32199/37963 [138:03:45<23:09:43, 14.47s/it]
 85%|████████▍ | 32200/37963 [138:03:59<23:05:44, 14.43s/it]
                                                            
{'loss': '0.07334', 'grad_norm': '1.431', 'learning_rate': '1.185e-06', 'epoch': '0.8482'}

 85%|████████▍ | 32200/37963 [138:03:59<23:05:44, 14.43s/it]
 85%|████████▍ | 32201/37963 [138:04:13<23:02:39, 14.40s/it]
 85%|████████▍ | 32202/37963 [138:04:27<22:48:13, 14.25s/it]
 85%|████████▍ | 32203/37963 [138:04:42<22:53:42, 14.31s/it]
 85%|████████▍ | 32204/37963 [138:05:02<25:42:37, 16.07s/it]
 85%|████████▍ | 32205/37963 [138:05:16<24:43:23, 15.46s/it]
 85%|████████▍ | 32206/37963 [138:05:30<23:58:25, 14.99s/it]
 85%|████████▍ | 32207/37963 [138:05:44<23:31:06, 14.71s/it]
 85%|████████▍ | 32208/37963 [138:05:58<23:24:11, 14.64s/it]
 85%|████████▍ | 32209/37963 [138:06:20<26:44:18, 16.73s/it]
 85%|████████▍ | 32210/37963 [138:06:34<25:37:31, 16.04s/it]
                                                            
{'loss': '0.07067', 'grad_norm': '2.687', 'learning_rate': '1.181e-06', 'epoch': '0.8485'}

 85%|████████▍ | 32210/37963 [138:06:34<25:37:31, 16.04s/it]
 85%|████████▍ | 32211/37963 [138:06:49<24:43:15, 15.47s/it]
 85%|████████▍ | 32212/37963 [138:07:03<24:10:20, 15.13s/it]
 85%|████████▍ | 32213/37963 [138:07:17<23:33:07, 14.75s/it]
 85%|████████▍ | 32214/37963 [138:07:31<23:19:47, 14.61s/it]
 85%|████████▍ | 32215/37963 [138:07:45<23:14:11, 14.55s/it]
 85%|████████▍ | 32216/37963 [138:08:07<26:23:43, 16.53s/it]
 85%|████████▍ | 32217/37963 [138:08:21<25:15:53, 15.83s/it]
 85%|████████▍ | 32218/37963 [138:08:35<24:31:00, 15.36s/it]
 85%|████████▍ | 32219/37963 [138:08:49<24:00:37, 15.05s/it]
 85%|████████▍ | 32220/37963 [138:09:04<23:42:07, 14.86s/it]
                                                            
{'loss': '0.08197', 'grad_norm': '3.96', 'learning_rate': '1.177e-06', 'epoch': '0.8487'}

 85%|████████▍ | 32220/37963 [138:09:04<23:42:07, 14.86s/it]
 85%|████████▍ | 32221/37963 [138:09:18<23:29:44, 14.73s/it]
 85%|████████▍ | 32222/37963 [138:09:33<23:17:54, 14.61s/it]
 85%|████████▍ | 32223/37963 [138:09:47<23:12:01, 14.55s/it]
 85%|████████▍ | 32224/37963 [138:10:01<23:02:25, 14.45s/it]
 85%|████████▍ | 32225/37963 [138:10:22<26:11:57, 16.44s/it]
 85%|████████▍ | 32226/37963 [138:10:36<24:49:25, 15.58s/it]
 85%|████████▍ | 32227/37963 [138:10:50<24:07:22, 15.14s/it]
 85%|████████▍ | 32228/37963 [138:11:04<23:49:26, 14.95s/it]
 85%|████████▍ | 32229/37963 [138:11:25<26:29:23, 16.63s/it]
 85%|████████▍ | 32230/37963 [138:11:40<25:32:50, 16.04s/it]
                                                            
{'loss': '0.08296', 'grad_norm': '2.294', 'learning_rate': '1.173e-06', 'epoch': '0.849'}

 85%|████████▍ | 32230/37963 [138:11:40<25:32:50, 16.04s/it]
 85%|████████▍ | 32231/37963 [138:11:54<24:46:39, 15.56s/it]
 85%|████████▍ | 32232/37963 [138:12:09<24:17:09, 15.26s/it]
 85%|████████▍ | 32233/37963 [138:12:23<23:54:20, 15.02s/it]
 85%|████████▍ | 32234/37963 [138:12:44<26:46:36, 16.83s/it]
 85%|████████▍ | 32235/37963 [138:12:58<25:33:08, 16.06s/it]
 85%|████████▍ | 32236/37963 [138:13:13<24:38:48, 15.49s/it]
 85%|████████▍ | 32237/37963 [138:13:27<24:06:47, 15.16s/it]
 85%|████████▍ | 32238/37963 [138:13:41<23:43:59, 14.92s/it]
 85%|████████▍ | 32239/37963 [138:14:02<26:39:21, 16.76s/it]
 85%|████████▍ | 32240/37963 [138:14:17<25:34:25, 16.09s/it]
                                                            
{'loss': '0.08414', 'grad_norm': '3.24', 'learning_rate': '1.169e-06', 'epoch': '0.8493'}

 85%|████████▍ | 32240/37963 [138:14:17<25:34:25, 16.09s/it]
 85%|████████▍ | 32241/37963 [138:14:31<24:43:54, 15.56s/it]
 85%|████████▍ | 32242/37963 [138:14:52<27:13:21, 17.13s/it]
 85%|████████▍ | 32243/37963 [138:15:07<25:58:28, 16.35s/it]
 85%|████████▍ | 32244/37963 [138:15:21<25:01:27, 15.75s/it]
 85%|████████▍ | 32245/37963 [138:15:35<24:23:41, 15.36s/it]
 85%|████████▍ | 32246/37963 [138:15:49<23:39:58, 14.90s/it]
 85%|████████▍ | 32247/37963 [138:16:04<23:26:30, 14.76s/it]
 85%|████████▍ | 32248/37963 [138:16:18<23:02:10, 14.51s/it]
 85%|████████▍ | 32249/37963 [138:16:31<22:42:29, 14.31s/it]
 85%|████████▍ | 32250/37963 [138:16:45<22:33:01, 14.21s/it]
                                                            
{'loss': '0.07467', 'grad_norm': '2.547', 'learning_rate': '1.165e-06', 'epoch': '0.8495'}

 85%|████████▍ | 32250/37963 [138:16:45<22:33:01, 14.21s/it]
 85%|████████▍ | 32251/37963 [138:17:00<22:31:42, 14.20s/it]
 85%|████████▍ | 32252/37963 [138:17:14<22:24:14, 14.12s/it]
 85%|████████▍ | 32253/37963 [138:17:34<25:20:21, 15.98s/it]
 85%|████████▍ | 32254/37963 [138:17:48<24:36:17, 15.52s/it]
 85%|████████▍ | 32255/37963 [138:18:03<24:04:45, 15.19s/it]
 85%|████████▍ | 32256/37963 [138:18:17<23:26:37, 14.79s/it]
 85%|████████▍ | 32257/37963 [138:18:38<26:24:47, 16.66s/it]
 85%|████████▍ | 32258/37963 [138:18:52<25:17:50, 15.96s/it]
 85%|████████▍ | 32259/37963 [138:19:06<24:35:27, 15.52s/it]
 85%|████████▍ | 32260/37963 [138:19:21<24:04:48, 15.20s/it]
                                                            
{'loss': '0.07302', 'grad_norm': '4.279', 'learning_rate': '1.161e-06', 'epoch': '0.8498'}

 85%|████████▍ | 32260/37963 [138:19:21<24:04:48, 15.20s/it]
 85%|████████▍ | 32261/37963 [138:19:35<23:43:01, 14.97s/it]
 85%|████████▍ | 32262/37963 [138:19:50<23:27:39, 14.81s/it]
 85%|████████▍ | 32263/37963 [138:20:04<23:13:01, 14.66s/it]
 85%|████████▍ | 32264/37963 [138:20:18<23:04:57, 14.58s/it]
 85%|████████▍ | 32265/37963 [138:20:32<22:48:47, 14.41s/it]
 85%|████████▍ | 32266/37963 [138:20:53<25:49:07, 16.32s/it]
 85%|████████▍ | 32267/37963 [138:21:08<24:59:13, 15.79s/it]
 85%|████████▍ | 32268/37963 [138:21:22<24:10:39, 15.28s/it]
 85%|████████▌ | 32269/37963 [138:21:36<23:37:16, 14.93s/it]
 85%|████████▌ | 32270/37963 [138:21:50<23:21:34, 14.77s/it]
                                                            
{'loss': '0.07686', 'grad_norm': '3.4', 'learning_rate': '1.157e-06', 'epoch': '0.85'}

 85%|████████▌ | 32270/37963 [138:21:50<23:21:34, 14.77s/it]
 85%|████████▌ | 32271/37963 [138:22:05<23:05:01, 14.60s/it]
 85%|████████▌ | 32272/37963 [138:22:19<22:59:31, 14.54s/it]
 85%|████████▌ | 32273/37963 [138:22:33<22:35:28, 14.29s/it]
 85%|████████▌ | 32274/37963 [138:22:54<25:53:50, 16.39s/it]
 85%|████████▌ | 32275/37963 [138:23:09<25:00:34, 15.83s/it]
 85%|████████▌ | 32276/37963 [138:23:23<24:08:16, 15.28s/it]
 85%|████████▌ | 32277/37963 [138:23:37<23:42:07, 15.01s/it]
 85%|████████▌ | 32278/37963 [138:23:57<26:20:44, 16.68s/it]
 85%|████████▌ | 32279/37963 [138:24:12<25:16:57, 16.01s/it]
 85%|████████▌ | 32280/37963 [138:24:26<24:30:59, 15.53s/it]
                                                            
{'loss': '0.06868', 'grad_norm': '2.892', 'learning_rate': '1.153e-06', 'epoch': '0.8503'}

 85%|████████▌ | 32280/37963 [138:24:26<24:30:59, 15.53s/it]
 85%|████████▌ | 32281/37963 [138:24:40<23:40:44, 15.00s/it]
 85%|████████▌ | 32282/37963 [138:24:54<23:21:31, 14.80s/it]
 85%|████████▌ | 32283/37963 [138:25:09<23:02:40, 14.61s/it]
 85%|████████▌ | 32284/37963 [138:25:30<26:13:56, 16.63s/it]
 85%|████████▌ | 32285/37963 [138:25:44<25:08:44, 15.94s/it]
 85%|████████▌ | 32286/37963 [138:25:59<24:26:30, 15.50s/it]
 85%|████████▌ | 32287/37963 [138:26:13<23:56:08, 15.18s/it]
 85%|████████▌ | 32288/37963 [138:26:34<26:31:02, 16.82s/it]
 85%|████████▌ | 32289/37963 [138:26:48<25:11:34, 15.98s/it]
 85%|████████▌ | 32290/37963 [138:27:08<27:13:36, 17.28s/it]
                                                            
{'loss': '0.07982', 'grad_norm': '2.12', 'learning_rate': '1.149e-06', 'epoch': '0.8506'}

 85%|████████▌ | 32290/37963 [138:27:08<27:13:36, 17.28s/it]
 85%|████████▌ | 32291/37963 [138:27:22<25:42:27, 16.32s/it]
 85%|████████▌ | 32292/37963 [138:27:37<24:45:46, 15.72s/it]
 85%|████████▌ | 32293/37963 [138:27:51<23:58:32, 15.22s/it]
 85%|████████▌ | 32294/37963 [138:28:05<23:32:48, 14.95s/it]
 85%|████████▌ | 32295/37963 [138:28:19<23:16:05, 14.78s/it]
 85%|████████▌ | 32296/37963 [138:28:34<23:02:53, 14.64s/it]
 85%|████████▌ | 32297/37963 [138:28:48<22:52:37, 14.54s/it]
 85%|████████▌ | 32298/37963 [138:29:02<22:48:08, 14.49s/it]
 85%|████████▌ | 32299/37963 [138:29:17<22:45:26, 14.46s/it]
 85%|████████▌ | 32300/37963 [138:29:31<22:43:38, 14.45s/it]
                                                            
{'loss': '0.07157', 'grad_norm': '3.095', 'learning_rate': '1.145e-06', 'epoch': '0.8508'}

 85%|████████▌ | 32300/37963 [138:29:31<22:43:38, 14.45s/it]
 85%|████████▌ | 32301/37963 [138:29:45<22:16:27, 14.16s/it]
 85%|████████▌ | 32302/37963 [138:29:59<22:21:39, 14.22s/it]
 85%|████████▌ | 32303/37963 [138:30:19<25:17:26, 16.09s/it]
 85%|████████▌ | 32304/37963 [138:30:34<24:22:08, 15.50s/it]
 85%|████████▌ | 32305/37963 [138:30:55<27:08:46, 17.27s/it]
 85%|████████▌ | 32306/37963 [138:31:10<25:52:56, 16.47s/it]
 85%|████████▌ | 32307/37963 [138:31:24<24:53:07, 15.84s/it]
 85%|████████▌ | 32308/37963 [138:31:38<24:14:13, 15.43s/it]
 85%|████████▌ | 32309/37963 [138:31:53<23:41:28, 15.08s/it]
 85%|████████▌ | 32310/37963 [138:32:07<23:23:52, 14.90s/it]
                                                            
{'loss': '0.07336', 'grad_norm': '3.086', 'learning_rate': '1.141e-06', 'epoch': '0.8511'}

 85%|████████▌ | 32310/37963 [138:32:07<23:23:52, 14.90s/it]
 85%|████████▌ | 32311/37963 [138:32:22<23:08:37, 14.74s/it]
 85%|████████▌ | 32312/37963 [138:32:36<22:58:18, 14.63s/it]
 85%|████████▌ | 32313/37963 [138:32:50<22:51:02, 14.56s/it]
 85%|████████▌ | 32314/37963 [138:33:05<22:44:51, 14.50s/it]
 85%|████████▌ | 32315/37963 [138:33:26<25:55:21, 16.52s/it]
 85%|████████▌ | 32316/37963 [138:33:40<24:47:44, 15.81s/it]
 85%|████████▌ | 32317/37963 [138:33:54<24:08:59, 15.40s/it]
 85%|████████▌ | 32318/37963 [138:34:09<23:43:32, 15.13s/it]
 85%|████████▌ | 32319/37963 [138:34:23<23:21:51, 14.90s/it]
 85%|████████▌ | 32320/37963 [138:34:38<23:05:31, 14.73s/it]
                                                            
{'loss': '0.0689', 'grad_norm': '2.753', 'learning_rate': '1.137e-06', 'epoch': '0.8514'}

 85%|████████▌ | 32320/37963 [138:34:38<23:05:31, 14.73s/it]
 85%|████████▌ | 32321/37963 [138:34:52<22:54:55, 14.62s/it]
 85%|████████▌ | 32322/37963 [138:35:06<22:47:20, 14.54s/it]
 85%|████████▌ | 32323/37963 [138:35:21<22:46:42, 14.54s/it]
 85%|████████▌ | 32324/37963 [138:35:42<26:00:00, 16.60s/it]
 85%|████████▌ | 32325/37963 [138:35:57<25:01:52, 15.98s/it]
 85%|████████▌ | 32326/37963 [138:36:11<24:22:07, 15.56s/it]
 85%|████████▌ | 32327/37963 [138:36:26<23:45:40, 15.18s/it]
 85%|████████▌ | 32328/37963 [138:36:40<23:18:00, 14.89s/it]
 85%|████████▌ | 32329/37963 [138:37:01<26:10:15, 16.72s/it]
 85%|████████▌ | 32330/37963 [138:37:15<25:05:58, 16.04s/it]
                                                            
{'loss': '0.06588', 'grad_norm': '2.983', 'learning_rate': '1.133e-06', 'epoch': '0.8516'}

 85%|████████▌ | 32330/37963 [138:37:15<25:05:58, 16.04s/it]
 85%|████████▌ | 32331/37963 [138:37:30<24:22:01, 15.58s/it]
 85%|████████▌ | 32332/37963 [138:37:44<23:47:05, 15.21s/it]
 85%|████████▌ | 32333/37963 [138:37:59<23:24:18, 14.97s/it]
 85%|████████▌ | 32334/37963 [138:38:19<26:02:39, 16.66s/it]
 85%|████████▌ | 32335/37963 [138:38:33<24:45:51, 15.84s/it]
 85%|████████▌ | 32336/37963 [138:38:48<24:03:39, 15.39s/it]
 85%|████████▌ | 32337/37963 [138:39:09<26:45:48, 17.13s/it]
 85%|████████▌ | 32338/37963 [138:39:30<28:30:41, 18.25s/it]
 85%|████████▌ | 32339/37963 [138:39:44<26:35:41, 17.02s/it]
 85%|████████▌ | 32340/37963 [138:39:58<25:23:26, 16.26s/it]
                                                            
{'loss': '0.0794', 'grad_norm': '5.06', 'learning_rate': '1.129e-06', 'epoch': '0.8519'}

 85%|████████▌ | 32340/37963 [138:39:58<25:23:26, 16.26s/it]
 85%|████████▌ | 32341/37963 [138:40:12<24:20:50, 15.59s/it]
 85%|████████▌ | 32342/37963 [138:40:26<23:43:06, 15.19s/it]
 85%|████████▌ | 32343/37963 [138:40:41<23:21:45, 14.97s/it]
 85%|████████▌ | 32344/37963 [138:40:55<22:46:59, 14.60s/it]
 85%|████████▌ | 32345/37963 [138:41:09<22:32:00, 14.44s/it]
 85%|████████▌ | 32346/37963 [138:41:23<22:27:42, 14.40s/it]
 85%|████████▌ | 32347/37963 [138:41:37<22:25:46, 14.38s/it]
 85%|████████▌ | 32348/37963 [138:41:52<22:20:53, 14.33s/it]
 85%|████████▌ | 32349/37963 [138:42:06<22:22:18, 14.35s/it]
 85%|████████▌ | 32350/37963 [138:42:20<22:11:58, 14.24s/it]
                                                            
{'loss': '0.07312', 'grad_norm': '2.877', 'learning_rate': '1.125e-06', 'epoch': '0.8521'}

 85%|████████▌ | 32350/37963 [138:42:20<22:11:58, 14.24s/it]
 85%|████████▌ | 32351/37963 [138:42:34<22:17:00, 14.29s/it]
 85%|████████▌ | 32352/37963 [138:42:55<25:13:49, 16.19s/it]
 85%|████████▌ | 32353/37963 [138:43:09<24:22:07, 15.64s/it]
 85%|████████▌ | 32354/37963 [138:43:31<27:00:47, 17.34s/it]
 85%|████████▌ | 32355/37963 [138:43:45<25:38:53, 16.46s/it]
 85%|████████▌ | 32356/37963 [138:44:00<24:43:04, 15.87s/it]
 85%|████████▌ | 32357/37963 [138:44:14<24:00:44, 15.42s/it]
 85%|████████▌ | 32358/37963 [138:44:28<23:26:42, 15.06s/it]
 85%|████████▌ | 32359/37963 [138:44:43<23:09:10, 14.87s/it]
 85%|████████▌ | 32360/37963 [138:44:57<22:46:18, 14.63s/it]
                                                            
{'loss': '0.07507', 'grad_norm': '3.478', 'learning_rate': '1.121e-06', 'epoch': '0.8524'}

 85%|████████▌ | 32360/37963 [138:44:57<22:46:18, 14.63s/it]
 85%|████████▌ | 32361/37963 [138:45:11<22:34:04, 14.50s/it]
 85%|████████▌ | 32362/37963 [138:45:25<22:27:07, 14.43s/it]
 85%|████████▌ | 32363/37963 [138:45:39<22:10:02, 14.25s/it]
 85%|████████▌ | 32364/37963 [138:46:00<25:26:31, 16.36s/it]
 85%|████████▌ | 32365/37963 [138:46:15<24:34:50, 15.81s/it]
 85%|████████▌ | 32366/37963 [138:46:29<23:54:04, 15.37s/it]
 85%|████████▌ | 32367/37963 [138:46:44<23:28:48, 15.11s/it]
 85%|████████▌ | 32368/37963 [138:46:58<23:08:43, 14.89s/it]
 85%|████████▌ | 32369/37963 [138:47:12<22:53:15, 14.73s/it]
 85%|████████▌ | 32370/37963 [138:47:27<22:43:31, 14.63s/it]
                                                            
{'loss': '0.07205', 'grad_norm': '4.228', 'learning_rate': '1.117e-06', 'epoch': '0.8527'}

 85%|████████▌ | 32370/37963 [138:47:27<22:43:31, 14.63s/it]
 85%|████████▌ | 32371/37963 [138:47:40<22:17:06, 14.35s/it]
 85%|████████▌ | 32372/37963 [138:48:01<25:06:28, 16.17s/it]
 85%|████████▌ | 32373/37963 [138:48:15<24:11:21, 15.58s/it]
 85%|████████▌ | 32374/37963 [138:48:29<23:37:37, 15.22s/it]
 85%|████████▌ | 32375/37963 [138:48:44<23:14:13, 14.97s/it]
 85%|████████▌ | 32376/37963 [138:48:58<22:59:51, 14.82s/it]
 85%|████████▌ | 32377/37963 [138:49:13<22:45:23, 14.67s/it]
 85%|████████▌ | 32378/37963 [138:49:26<22:23:07, 14.43s/it]
 85%|████████▌ | 32379/37963 [138:49:48<25:27:51, 16.42s/it]
 85%|████████▌ | 32380/37963 [138:50:02<24:32:51, 15.83s/it]
                                                            
{'loss': '0.07307', 'grad_norm': '3.029', 'learning_rate': '1.113e-06', 'epoch': '0.8529'}

 85%|████████▌ | 32380/37963 [138:50:02<24:32:51, 15.83s/it]
 85%|████████▌ | 32381/37963 [138:50:16<23:49:15, 15.36s/it]
 85%|████████▌ | 32382/37963 [138:50:37<26:18:45, 16.97s/it]
 85%|████████▌ | 32383/37963 [138:50:51<25:06:11, 16.20s/it]
 85%|████████▌ | 32384/37963 [138:51:06<24:19:31, 15.70s/it]
 85%|████████▌ | 32385/37963 [138:51:20<23:40:35, 15.28s/it]
 85%|████████▌ | 32386/37963 [138:51:41<26:25:36, 17.06s/it]
 85%|████████▌ | 32387/37963 [138:52:03<28:23:49, 18.33s/it]
 85%|████████▌ | 32388/37963 [138:52:17<26:29:17, 17.10s/it]
 85%|████████▌ | 32389/37963 [138:52:31<25:15:58, 16.32s/it]
 85%|████████▌ | 32390/37963 [138:52:46<24:22:05, 15.74s/it]
                                                            
{'loss': '0.07144', 'grad_norm': '3.324', 'learning_rate': '1.11e-06', 'epoch': '0.8532'}

 85%|████████▌ | 32390/37963 [138:52:46<24:22:05, 15.74s/it]
 85%|████████▌ | 32391/37963 [138:53:00<23:42:55, 15.32s/it]
 85%|████████▌ | 32392/37963 [138:53:15<23:15:15, 15.03s/it]
 85%|████████▌ | 32393/37963 [138:53:29<23:01:37, 14.88s/it]
 85%|████████▌ | 32394/37963 [138:53:43<22:45:05, 14.71s/it]
 85%|████████▌ | 32395/37963 [138:53:57<22:27:02, 14.52s/it]
 85%|████████▌ | 32396/37963 [138:54:12<22:23:59, 14.49s/it]
 85%|████████▌ | 32397/37963 [138:54:26<22:02:24, 14.26s/it]
 85%|████████▌ | 32398/37963 [138:54:39<21:48:42, 14.11s/it]
 85%|████████▌ | 32399/37963 [138:54:53<21:41:03, 14.03s/it]
 85%|████████▌ | 32400/37963 [138:55:14<24:49:30, 16.07s/it]
                                                            
{'loss': '0.06989', 'grad_norm': '2.05', 'learning_rate': '1.106e-06', 'epoch': '0.8535'}

 85%|████████▌ | 32400/37963 [138:55:14<24:49:30, 16.07s/it]
 85%|████████▌ | 32401/37963 [138:55:28<24:02:43, 15.56s/it]
 85%|████████▌ | 32402/37963 [138:55:50<26:42:13, 17.29s/it]
 85%|████████▌ | 32403/37963 [138:56:04<25:23:07, 16.44s/it]
 85%|████████▌ | 32404/37963 [138:56:18<24:23:17, 15.79s/it]
 85%|████████▌ | 32405/37963 [138:56:33<23:42:25, 15.36s/it]
 85%|████████▌ | 32406/37963 [138:56:47<23:15:43, 15.07s/it]
 85%|████████▌ | 32407/37963 [138:57:02<22:58:36, 14.89s/it]
 85%|████████▌ | 32408/37963 [138:57:15<22:28:02, 14.56s/it]
 85%|████████▌ | 32409/37963 [138:57:30<22:24:51, 14.53s/it]
 85%|████████▌ | 32410/37963 [138:57:44<22:19:47, 14.48s/it]
                                                            
{'loss': '0.06605', 'grad_norm': '2.938', 'learning_rate': '1.102e-06', 'epoch': '0.8537'}

 85%|████████▌ | 32410/37963 [138:57:44<22:19:47, 14.48s/it]
 85%|████████▌ | 32411/37963 [138:57:59<22:16:25, 14.44s/it]
 85%|████████▌ | 32412/37963 [138:58:13<22:17:22, 14.46s/it]
 85%|████████▌ | 32413/37963 [138:58:34<25:23:19, 16.47s/it]
 85%|████████▌ | 32414/37963 [138:58:48<24:20:02, 15.79s/it]
 85%|████████▌ | 32415/37963 [138:59:02<23:30:55, 15.26s/it]
 85%|████████▌ | 32416/37963 [138:59:17<23:02:08, 14.95s/it]
 85%|████████▌ | 32417/37963 [138:59:31<22:46:32, 14.78s/it]
 85%|████████▌ | 32418/37963 [138:59:45<22:34:39, 14.66s/it]
 85%|████████▌ | 32419/37963 [139:00:00<22:22:14, 14.53s/it]
 85%|████████▌ | 32420/37963 [139:00:21<25:23:27, 16.49s/it]
                                                            
{'loss': '0.07858', 'grad_norm': '3.468', 'learning_rate': '1.098e-06', 'epoch': '0.854'}

 85%|████████▌ | 32420/37963 [139:00:21<25:23:27, 16.49s/it]
 85%|████████▌ | 32421/37963 [139:00:35<24:21:29, 15.82s/it]
 85%|████████▌ | 32422/37963 [139:00:49<23:41:31, 15.39s/it]
 85%|████████▌ | 32423/37963 [139:01:04<23:08:29, 15.04s/it]
 85%|████████▌ | 32424/37963 [139:01:18<22:53:05, 14.87s/it]
 85%|████████▌ | 32425/37963 [139:01:33<22:41:17, 14.75s/it]
 85%|████████▌ | 32426/37963 [139:01:47<22:33:16, 14.66s/it]
 85%|████████▌ | 32427/37963 [139:02:02<22:29:38, 14.63s/it]
 85%|████████▌ | 32428/37963 [139:02:23<25:31:23, 16.60s/it]
 85%|████████▌ | 32429/37963 [139:02:44<27:29:16, 17.88s/it]
 85%|████████▌ | 32430/37963 [139:02:58<25:49:33, 16.80s/it]
                                                            
{'loss': '0.06398', 'grad_norm': '2.377', 'learning_rate': '1.094e-06', 'epoch': '0.8543'}

 85%|████████▌ | 32430/37963 [139:02:58<25:49:33, 16.80s/it]
 85%|████████▌ | 32431/37963 [139:03:12<24:43:07, 16.09s/it]
 85%|████████▌ | 32432/37963 [139:03:27<23:57:33, 15.59s/it]
 85%|████████▌ | 32433/37963 [139:03:41<23:17:04, 15.16s/it]
 85%|████████▌ | 32434/37963 [139:04:02<25:58:16, 16.91s/it]
 85%|████████▌ | 32435/37963 [139:04:16<24:42:48, 16.09s/it]
 85%|████████▌ | 32436/37963 [139:04:30<23:45:09, 15.47s/it]
 85%|████████▌ | 32437/37963 [139:04:51<26:24:49, 17.21s/it]
 85%|████████▌ | 32438/37963 [139:05:06<25:06:52, 16.36s/it]
 85%|████████▌ | 32439/37963 [139:05:20<24:12:56, 15.78s/it]
 85%|████████▌ | 32440/37963 [139:05:34<23:21:00, 15.22s/it]
                                                            
{'loss': '0.07915', 'grad_norm': '2.456', 'learning_rate': '1.09e-06', 'epoch': '0.8545'}

 85%|████████▌ | 32440/37963 [139:05:34<23:21:00, 15.22s/it]
 85%|████████▌ | 32441/37963 [139:05:48<22:49:37, 14.88s/it]
 85%|████████▌ | 32442/37963 [139:06:03<22:35:29, 14.73s/it]
 85%|████████▌ | 32443/37963 [139:06:17<22:17:32, 14.54s/it]
 85%|████████▌ | 32444/37963 [139:06:31<22:10:31, 14.46s/it]
 85%|████████▌ | 32445/37963 [139:06:45<22:07:22, 14.43s/it]
 85%|████████▌ | 32446/37963 [139:07:00<22:06:33, 14.43s/it]
 85%|████████▌ | 32447/37963 [139:07:14<22:09:05, 14.46s/it]
 85%|████████▌ | 32448/37963 [139:07:35<25:10:03, 16.43s/it]
 85%|████████▌ | 32449/37963 [139:07:50<24:15:13, 15.83s/it]
 85%|████████▌ | 32450/37963 [139:08:04<23:38:31, 15.44s/it]
                                                            
{'loss': '0.08042', 'grad_norm': '3.033', 'learning_rate': '1.086e-06', 'epoch': '0.8548'}

 85%|████████▌ | 32450/37963 [139:08:04<23:38:31, 15.44s/it]
 85%|████████▌ | 32451/37963 [139:08:25<26:16:35, 17.16s/it]
 85%|████████▌ | 32452/37963 [139:08:40<25:02:44, 16.36s/it]
 85%|████████▌ | 32453/37963 [139:08:54<24:05:14, 15.74s/it]
 85%|████████▌ | 32454/37963 [139:09:08<23:22:49, 15.28s/it]
 85%|████████▌ | 32455/37963 [139:09:22<22:41:09, 14.83s/it]
 85%|████████▌ | 32456/37963 [139:09:36<22:09:00, 14.48s/it]
 85%|████████▌ | 32457/37963 [139:09:50<22:00:14, 14.39s/it]
 85%|████████▌ | 32458/37963 [139:10:04<21:55:06, 14.33s/it]
 86%|████████▌ | 32459/37963 [139:10:19<21:57:53, 14.37s/it]
 86%|████████▌ | 32460/37963 [139:10:33<21:58:15, 14.37s/it]
                                                            
{'loss': '0.06874', 'grad_norm': '2.662', 'learning_rate': '1.082e-06', 'epoch': '0.855'}

 86%|████████▌ | 32460/37963 [139:10:33<21:58:15, 14.37s/it]
 86%|████████▌ | 32461/37963 [139:10:47<21:45:21, 14.24s/it]
 86%|████████▌ | 32462/37963 [139:11:08<24:53:40, 16.29s/it]
 86%|████████▌ | 32463/37963 [139:11:22<24:00:50, 15.72s/it]
 86%|████████▌ | 32464/37963 [139:11:37<23:25:49, 15.34s/it]
 86%|████████▌ | 32465/37963 [139:11:51<23:01:05, 15.07s/it]
 86%|████████▌ | 32466/37963 [139:12:06<22:41:56, 14.87s/it]
 86%|████████▌ | 32467/37963 [139:12:20<22:30:23, 14.74s/it]
 86%|████████▌ | 32468/37963 [139:12:35<22:20:06, 14.63s/it]
 86%|████████▌ | 32469/37963 [139:12:55<24:58:17, 16.36s/it]
 86%|████████▌ | 32470/37963 [139:13:09<24:04:05, 15.77s/it]
                                                            
{'loss': '0.07736', 'grad_norm': '3.353', 'learning_rate': '1.078e-06', 'epoch': '0.8553'}

 86%|████████▌ | 32470/37963 [139:13:09<24:04:05, 15.77s/it]
 86%|████████▌ | 32471/37963 [139:13:24<23:20:03, 15.30s/it]
 86%|████████▌ | 32472/37963 [139:13:38<22:54:09, 15.02s/it]
 86%|████████▌ | 32473/37963 [139:13:52<22:36:14, 14.82s/it]
 86%|████████▌ | 32474/37963 [139:14:07<22:24:16, 14.69s/it]
 86%|████████▌ | 32475/37963 [139:14:21<22:15:15, 14.60s/it]
 86%|████████▌ | 32476/37963 [139:14:42<25:05:43, 16.47s/it]
 86%|████████▌ | 32477/37963 [139:14:56<24:09:50, 15.86s/it]
 86%|████████▌ | 32478/37963 [139:15:17<26:32:21, 17.42s/it]
 86%|████████▌ | 32479/37963 [139:15:32<25:07:15, 16.49s/it]
 86%|████████▌ | 32480/37963 [139:15:46<24:09:45, 15.86s/it]
                                                            
{'loss': '0.07428', 'grad_norm': '3.689', 'learning_rate': '1.075e-06', 'epoch': '0.8556'}

 86%|████████▌ | 32480/37963 [139:15:46<24:09:45, 15.86s/it]
 86%|████████▌ | 32481/37963 [139:16:01<23:29:56, 15.43s/it]
 86%|████████▌ | 32482/37963 [139:16:15<22:55:52, 15.06s/it]
 86%|████████▌ | 32483/37963 [139:16:36<25:43:27, 16.90s/it]
 86%|████████▌ | 32484/37963 [139:16:50<24:32:39, 16.13s/it]
 86%|████████▌ | 32485/37963 [139:17:05<23:44:05, 15.60s/it]
 86%|████████▌ | 32486/37963 [139:17:25<26:07:33, 17.17s/it]
 86%|████████▌ | 32487/37963 [139:17:40<24:53:57, 16.37s/it]
 86%|████████▌ | 32488/37963 [139:17:54<23:59:20, 15.77s/it]
 86%|████████▌ | 32489/37963 [139:18:09<23:27:25, 15.43s/it]
 86%|████████▌ | 32490/37963 [139:18:23<22:58:59, 15.12s/it]
                                                            
{'loss': '0.07699', 'grad_norm': '3.328', 'learning_rate': '1.071e-06', 'epoch': '0.8558'}

 86%|████████▌ | 32490/37963 [139:18:23<22:58:59, 15.12s/it]
 86%|████████▌ | 32491/37963 [139:18:38<22:39:25, 14.91s/it]
 86%|████████▌ | 32492/37963 [139:18:52<22:25:44, 14.76s/it]
 86%|████████▌ | 32493/37963 [139:19:07<22:17:52, 14.68s/it]
 86%|████████▌ | 32494/37963 [139:19:21<22:09:04, 14.58s/it]
 86%|████████▌ | 32495/37963 [139:19:35<22:03:03, 14.52s/it]
 86%|████████▌ | 32496/37963 [139:19:50<21:59:36, 14.48s/it]
 86%|████████▌ | 32497/37963 [139:20:10<24:48:52, 16.34s/it]
 86%|████████▌ | 32498/37963 [139:20:25<23:55:14, 15.76s/it]
 86%|████████▌ | 32499/37963 [139:20:46<26:29:21, 17.45s/it]
 86%|████████▌ | 32500/37963 [139:21:01<25:05:04, 16.53s/it]
                                                            
{'loss': '0.06426', 'grad_norm': '2.495', 'learning_rate': '1.067e-06', 'epoch': '0.8561'}

 86%|████████▌ | 32500/37963 [139:21:01<25:05:04, 16.53s/it]
 86%|████████▌ | 32501/37963 [139:21:15<23:53:14, 15.74s/it]
 86%|████████▌ | 32502/37963 [139:21:29<23:18:19, 15.36s/it]
 86%|████████▌ | 32503/37963 [139:21:43<22:52:02, 15.08s/it]
 86%|████████▌ | 32504/37963 [139:21:58<22:31:47, 14.86s/it]
 86%|████████▌ | 32505/37963 [139:22:12<22:13:28, 14.66s/it]
 86%|████████▌ | 32506/37963 [139:22:26<21:50:58, 14.41s/it]
 86%|████████▌ | 32507/37963 [139:22:40<21:49:26, 14.40s/it]
 86%|████████▌ | 32508/37963 [139:22:55<21:47:18, 14.38s/it]
 86%|████████▌ | 32509/37963 [139:23:09<21:46:39, 14.37s/it]
 86%|████████▌ | 32510/37963 [139:23:30<24:48:49, 16.38s/it]
                                                            
{'loss': '0.06791', 'grad_norm': '3.214', 'learning_rate': '1.063e-06', 'epoch': '0.8564'}

 86%|████████▌ | 32510/37963 [139:23:30<24:48:49, 16.38s/it]
 86%|████████▌ | 32511/37963 [139:23:44<23:54:12, 15.78s/it]
 86%|████████▌ | 32512/37963 [139:23:59<23:15:06, 15.36s/it]
 86%|████████▌ | 32513/37963 [139:24:13<22:53:00, 15.12s/it]
 86%|████████▌ | 32514/37963 [139:24:27<22:28:03, 14.84s/it]
 86%|████████▌ | 32515/37963 [139:24:42<22:15:02, 14.70s/it]
 86%|████████▌ | 32516/37963 [139:24:56<22:04:18, 14.59s/it]
 86%|████████▌ | 32517/37963 [139:25:17<24:41:27, 16.32s/it]
 86%|████████▌ | 32518/37963 [139:25:31<23:47:05, 15.73s/it]
 86%|████████▌ | 32519/37963 [139:25:45<23:08:30, 15.30s/it]
 86%|████████▌ | 32520/37963 [139:26:00<22:41:05, 15.00s/it]
                                                            
{'loss': '0.07685', 'grad_norm': '4.758', 'learning_rate': '1.059e-06', 'epoch': '0.8566'}

 86%|████████▌ | 32520/37963 [139:26:00<22:41:05, 15.00s/it]
 86%|████████▌ | 32521/37963 [139:26:14<22:23:21, 14.81s/it]
 86%|████████▌ | 32522/37963 [139:26:28<22:12:10, 14.69s/it]
 86%|████████▌ | 32523/37963 [139:26:43<22:02:20, 14.58s/it]
 86%|████████▌ | 32524/37963 [139:26:57<21:55:24, 14.51s/it]
 86%|████████▌ | 32525/37963 [139:27:18<24:40:20, 16.33s/it]
 86%|████████▌ | 32526/37963 [139:27:32<23:46:23, 15.74s/it]
 86%|████████▌ | 32527/37963 [139:27:53<26:07:17, 17.30s/it]
 86%|████████▌ | 32528/37963 [139:28:07<24:34:21, 16.28s/it]
 86%|████████▌ | 32529/37963 [139:28:21<23:35:54, 15.63s/it]
 86%|████████▌ | 32530/37963 [139:28:35<23:01:18, 15.25s/it]
                                                            
{'loss': '0.08827', 'grad_norm': '3.857', 'learning_rate': '1.055e-06', 'epoch': '0.8569'}

 86%|████████▌ | 32530/37963 [139:28:35<23:01:18, 15.25s/it]
 86%|████████▌ | 32531/37963 [139:28:49<22:34:22, 14.96s/it]
 86%|████████▌ | 32532/37963 [139:29:11<25:31:48, 16.92s/it]
 86%|████████▌ | 32533/37963 [139:29:25<24:07:52, 16.00s/it]
 86%|████████▌ | 32534/37963 [139:29:45<26:01:33, 17.26s/it]
 86%|████████▌ | 32535/37963 [139:29:59<24:36:51, 16.32s/it]
 86%|████████▌ | 32536/37963 [139:30:13<23:35:29, 15.65s/it]
 86%|████████▌ | 32537/37963 [139:30:27<22:55:03, 15.21s/it]
 86%|████████▌ | 32538/37963 [139:30:42<22:34:56, 14.99s/it]
 86%|████████▌ | 32539/37963 [139:30:56<22:18:54, 14.81s/it]
 86%|████████▌ | 32540/37963 [139:31:10<21:45:17, 14.44s/it]
                                                            
{'loss': '0.0673', 'grad_norm': '2.498', 'learning_rate': '1.052e-06', 'epoch': '0.8572'}

 86%|████████▌ | 32540/37963 [139:31:10<21:45:17, 14.44s/it]
 86%|████████▌ | 32541/37963 [139:31:24<21:42:28, 14.41s/it]
 86%|████████▌ | 32542/37963 [139:31:38<21:35:30, 14.34s/it]
 86%|████████▌ | 32543/37963 [139:31:53<21:37:14, 14.36s/it]
 86%|████████▌ | 32544/37963 [139:32:07<21:37:27, 14.37s/it]
 86%|████████▌ | 32545/37963 [139:32:22<21:38:01, 14.37s/it]
 86%|████████▌ | 32546/37963 [139:32:36<21:37:18, 14.37s/it]
 86%|████████▌ | 32547/37963 [139:32:57<24:30:45, 16.29s/it]
 86%|████████▌ | 32548/37963 [139:33:16<26:00:07, 17.29s/it]
 86%|████████▌ | 32549/37963 [139:33:31<24:44:33, 16.45s/it]
 86%|████████▌ | 32550/37963 [139:33:45<23:50:13, 15.85s/it]
                                                            
{'loss': '0.07581', 'grad_norm': '1.975', 'learning_rate': '1.048e-06', 'epoch': '0.8574'}

 86%|████████▌ | 32550/37963 [139:33:45<23:50:13, 15.85s/it]
 86%|████████▌ | 32551/37963 [139:34:00<23:11:07, 15.42s/it]
 86%|████████▌ | 32552/37963 [139:34:14<22:42:45, 15.11s/it]
 86%|████████▌ | 32553/37963 [139:34:28<22:23:16, 14.90s/it]
 86%|████████▌ | 32554/37963 [139:34:43<22:10:04, 14.75s/it]
 86%|████████▌ | 32555/37963 [139:34:57<21:54:30, 14.58s/it]
 86%|████████▌ | 32556/37963 [139:35:11<21:48:09, 14.52s/it]
 86%|████████▌ | 32557/37963 [139:35:25<21:31:40, 14.34s/it]
 86%|████████▌ | 32558/37963 [139:35:46<24:31:32, 16.34s/it]
 86%|████████▌ | 32559/37963 [139:36:01<23:40:02, 15.77s/it]
 86%|████████▌ | 32560/37963 [139:36:15<23:04:16, 15.37s/it]
                                                            
{'loss': '0.06983', 'grad_norm': '2.751', 'learning_rate': '1.044e-06', 'epoch': '0.8577'}

 86%|████████▌ | 32560/37963 [139:36:15<23:04:16, 15.37s/it]
 86%|████████▌ | 32561/37963 [139:36:30<22:38:16, 15.09s/it]
 86%|████████▌ | 32562/37963 [139:36:44<22:23:07, 14.92s/it]
 86%|████████▌ | 32563/37963 [139:36:58<22:00:56, 14.68s/it]
 86%|████████▌ | 32564/37963 [139:37:13<21:52:47, 14.59s/it]
 86%|████████▌ | 32565/37963 [139:37:27<21:47:45, 14.54s/it]
 86%|████████▌ | 32566/37963 [139:37:48<24:42:06, 16.48s/it]
 86%|████████▌ | 32567/37963 [139:38:03<23:47:16, 15.87s/it]
 86%|████████▌ | 32568/37963 [139:38:16<22:50:03, 15.24s/it]
 86%|████████▌ | 32569/37963 [139:38:30<22:09:17, 14.79s/it]
 86%|████████▌ | 32570/37963 [139:38:44<21:55:08, 14.63s/it]
                                                            
{'loss': '0.08305', 'grad_norm': '2.438', 'learning_rate': '1.04e-06', 'epoch': '0.8579'}

 86%|████████▌ | 32570/37963 [139:38:44<21:55:08, 14.63s/it]
 86%|████████▌ | 32571/37963 [139:38:59<21:47:21, 14.55s/it]
 86%|████████▌ | 32572/37963 [139:39:13<21:44:00, 14.51s/it]
 86%|████████▌ | 32573/37963 [139:39:34<24:26:29, 16.32s/it]
 86%|████████▌ | 32574/37963 [139:39:48<23:32:01, 15.72s/it]
 86%|████████▌ | 32575/37963 [139:40:02<22:50:36, 15.26s/it]
 86%|████████▌ | 32576/37963 [139:40:24<25:43:49, 17.19s/it]
 86%|████████▌ | 32577/37963 [139:40:38<24:27:47, 16.35s/it]
 86%|████████▌ | 32578/37963 [139:40:53<23:40:02, 15.82s/it]
 86%|████████▌ | 32579/37963 [139:41:07<22:45:35, 15.22s/it]
 86%|████████▌ | 32580/37963 [139:41:21<22:22:34, 14.96s/it]
                                                            
{'loss': '0.07726', 'grad_norm': '4.416', 'learning_rate': '1.036e-06', 'epoch': '0.8582'}

 86%|████████▌ | 32580/37963 [139:41:21<22:22:34, 14.96s/it]
 86%|████████▌ | 32581/37963 [139:41:35<22:06:10, 14.78s/it]
 86%|████████▌ | 32582/37963 [139:41:56<24:52:02, 16.64s/it]
 86%|████████▌ | 32583/37963 [139:42:17<26:49:54, 17.95s/it]
 86%|████████▌ | 32584/37963 [139:42:32<25:17:52, 16.93s/it]
 86%|████████▌ | 32585/37963 [139:42:46<24:09:34, 16.17s/it]
 86%|████████▌ | 32586/37963 [139:43:01<23:22:39, 15.65s/it]
 86%|████████▌ | 32587/37963 [139:43:15<22:52:34, 15.32s/it]
 86%|████████▌ | 32588/37963 [139:43:30<22:28:44, 15.06s/it]
 86%|████████▌ | 32589/37963 [139:43:44<22:09:04, 14.84s/it]
 86%|████████▌ | 32590/37963 [139:43:58<21:56:02, 14.70s/it]
                                                            
{'loss': '0.08008', 'grad_norm': '3.578', 'learning_rate': '1.033e-06', 'epoch': '0.8585'}

 86%|████████▌ | 32590/37963 [139:43:58<21:56:02, 14.70s/it]
 86%|████████▌ | 32591/37963 [139:44:13<21:45:41, 14.58s/it]
 86%|████████▌ | 32592/37963 [139:44:27<21:34:09, 14.46s/it]
 86%|████████▌ | 32593/37963 [139:44:41<21:17:32, 14.27s/it]
 86%|████████▌ | 32594/37963 [139:44:55<21:20:00, 14.30s/it]
 86%|████████▌ | 32595/37963 [139:45:16<24:14:16, 16.25s/it]
 86%|████████▌ | 32596/37963 [139:45:30<23:08:43, 15.53s/it]
 86%|████████▌ | 32597/37963 [139:45:44<22:33:03, 15.13s/it]
 86%|████████▌ | 32598/37963 [139:46:05<25:10:19, 16.89s/it]
 86%|████████▌ | 32599/37963 [139:46:19<23:52:25, 16.02s/it]
 86%|████████▌ | 32600/37963 [139:46:33<23:10:33, 15.56s/it]
                                                            
{'loss': '0.0798', 'grad_norm': '3.208', 'learning_rate': '1.029e-06', 'epoch': '0.8587'}

 86%|████████▌ | 32600/37963 [139:46:33<23:10:33, 15.56s/it]
 86%|████████▌ | 32601/37963 [139:46:48<22:40:22, 15.22s/it]
 86%|████████▌ | 32602/37963 [139:47:02<22:22:22, 15.02s/it]
 86%|████████▌ | 32603/37963 [139:47:17<22:14:30, 14.94s/it]
 86%|████████▌ | 32604/37963 [139:47:32<22:04:07, 14.83s/it]
 86%|████████▌ | 32605/37963 [139:47:45<21:34:16, 14.49s/it]
 86%|████████▌ | 32606/37963 [139:48:06<24:22:16, 16.38s/it]
 86%|████████▌ | 32607/37963 [139:48:21<23:31:07, 15.81s/it]
 86%|████████▌ | 32608/37963 [139:48:35<22:51:09, 15.36s/it]
 86%|████████▌ | 32609/37963 [139:48:49<22:25:10, 15.07s/it]
 86%|████████▌ | 32610/37963 [139:49:04<22:05:22, 14.86s/it]
                                                            
{'loss': '0.07235', 'grad_norm': '3.621', 'learning_rate': '1.025e-06', 'epoch': '0.859'}

 86%|████████▌ | 32610/37963 [139:49:04<22:05:22, 14.86s/it]
 86%|████████▌ | 32611/37963 [139:49:18<21:53:30, 14.73s/it]
 86%|████████▌ | 32612/37963 [139:49:32<21:31:34, 14.48s/it]
 86%|████████▌ | 32613/37963 [139:49:46<21:22:48, 14.39s/it]
 86%|████████▌ | 32614/37963 [139:50:07<24:15:21, 16.32s/it]
 86%|████████▌ | 32615/37963 [139:50:22<23:24:17, 15.75s/it]
 86%|████████▌ | 32616/37963 [139:50:36<22:43:05, 15.30s/it]
 86%|████████▌ | 32617/37963 [139:50:50<22:21:36, 15.06s/it]
 86%|████████▌ | 32618/37963 [139:51:05<22:02:07, 14.84s/it]
 86%|████████▌ | 32619/37963 [139:51:19<21:43:08, 14.63s/it]
 86%|████████▌ | 32620/37963 [139:51:32<21:17:25, 14.34s/it]
                                                            
{'loss': '0.06308', 'grad_norm': '2.364', 'learning_rate': '1.021e-06', 'epoch': '0.8593'}

 86%|████████▌ | 32620/37963 [139:51:32<21:17:25, 14.34s/it]
 86%|████████▌ | 32621/37963 [139:51:47<21:14:55, 14.32s/it]
 86%|████████▌ | 32622/37963 [139:52:01<21:05:47, 14.22s/it]
 86%|████████▌ | 32623/37963 [139:52:22<24:06:57, 16.26s/it]
 86%|████████▌ | 32624/37963 [139:52:36<23:13:14, 15.66s/it]
 86%|████████▌ | 32625/37963 [139:52:57<25:40:16, 17.31s/it]
 86%|████████▌ | 32626/37963 [139:53:11<24:19:40, 16.41s/it]
 86%|████████▌ | 32627/37963 [139:53:26<23:26:32, 15.82s/it]
 86%|████████▌ | 32628/37963 [139:53:40<22:41:55, 15.32s/it]
 86%|████████▌ | 32629/37963 [139:53:54<22:14:24, 15.01s/it]
 86%|████████▌ | 32630/37963 [139:54:15<24:56:30, 16.84s/it]
                                                            
{'loss': '0.08033', 'grad_norm': '2.933', 'learning_rate': '1.018e-06', 'epoch': '0.8595'}

 86%|████████▌ | 32630/37963 [139:54:15<24:56:30, 16.84s/it]
 86%|████████▌ | 32631/37963 [139:54:36<26:39:50, 18.00s/it]
 86%|████████▌ | 32632/37963 [139:54:51<25:03:17, 16.92s/it]
 86%|████████▌ | 32633/37963 [139:55:05<23:56:35, 16.17s/it]
 86%|████████▌ | 32634/37963 [139:55:19<23:09:01, 15.64s/it]
 86%|████████▌ | 32635/37963 [139:55:34<22:35:43, 15.27s/it]
 86%|████████▌ | 32636/37963 [139:55:48<22:07:16, 14.95s/it]
 86%|████████▌ | 32637/37963 [139:56:02<21:50:20, 14.76s/it]
 86%|████████▌ | 32638/37963 [139:56:17<21:40:32, 14.65s/it]
 86%|████████▌ | 32639/37963 [139:56:31<21:20:30, 14.43s/it]
 86%|████████▌ | 32640/37963 [139:56:45<21:20:40, 14.44s/it]
                                                            
{'loss': '0.0832', 'grad_norm': '2.989', 'learning_rate': '1.014e-06', 'epoch': '0.8598'}

 86%|████████▌ | 32640/37963 [139:56:45<21:20:40, 14.44s/it]
 86%|████████▌ | 32641/37963 [139:56:59<21:20:17, 14.43s/it]
 86%|████████▌ | 32642/37963 [139:57:14<21:18:15, 14.41s/it]
 86%|████████▌ | 32643/37963 [139:57:34<24:01:43, 16.26s/it]
 86%|████████▌ | 32644/37963 [139:57:49<23:12:25, 15.71s/it]
 86%|████████▌ | 32645/37963 [139:58:03<22:37:35, 15.32s/it]
 86%|████████▌ | 32646/37963 [139:58:18<22:15:01, 15.07s/it]
 86%|████████▌ | 32647/37963 [139:58:38<24:44:35, 16.76s/it]
 86%|████████▌ | 32648/37963 [139:58:53<23:39:41, 16.03s/it]
 86%|████████▌ | 32649/37963 [139:59:07<22:56:04, 15.54s/it]
 86%|████████▌ | 32650/37963 [139:59:22<22:26:21, 15.20s/it]
                                                            
{'loss': '0.07587', 'grad_norm': '3.119', 'learning_rate': '1.01e-06', 'epoch': '0.8601'}

 86%|████████▌ | 32650/37963 [139:59:22<22:26:21, 15.20s/it]
 86%|████████▌ | 32651/37963 [139:59:36<21:54:14, 14.84s/it]
 86%|████████▌ | 32652/37963 [139:59:50<21:42:26, 14.71s/it]
 86%|████████▌ | 32653/37963 [140:00:05<21:40:41, 14.70s/it]
 86%|████████▌ | 32654/37963 [140:00:26<24:36:02, 16.68s/it]
 86%|████████▌ | 32655/37963 [140:00:40<23:25:57, 15.89s/it]
 86%|████████▌ | 32656/37963 [140:00:54<22:41:48, 15.40s/it]
 86%|████████▌ | 32657/37963 [140:01:08<22:07:00, 15.01s/it]
 86%|████████▌ | 32658/37963 [140:01:22<21:41:17, 14.72s/it]
 86%|████████▌ | 32659/37963 [140:01:37<21:37:56, 14.68s/it]
 86%|████████▌ | 32660/37963 [140:01:51<21:17:32, 14.45s/it]
                                                            
{'loss': '0.07189', 'grad_norm': '3.42', 'learning_rate': '1.006e-06', 'epoch': '0.8603'}

 86%|████████▌ | 32660/37963 [140:01:51<21:17:32, 14.45s/it]
 86%|████████▌ | 32661/37963 [140:02:05<21:11:04, 14.38s/it]
 86%|████████▌ | 32662/37963 [140:02:19<21:04:04, 14.31s/it]
 86%|████████▌ | 32663/37963 [140:02:41<24:07:43, 16.39s/it]
 86%|████████▌ | 32664/37963 [140:02:55<23:15:06, 15.80s/it]
 86%|████████▌ | 32665/37963 [140:03:09<22:37:44, 15.38s/it]
 86%|████████▌ | 32666/37963 [140:03:24<22:13:46, 15.11s/it]
 86%|████████▌ | 32667/37963 [140:03:37<21:29:12, 14.61s/it]
 86%|████████▌ | 32668/37963 [140:03:52<21:23:32, 14.54s/it]
 86%|████████▌ | 32669/37963 [140:04:06<21:14:29, 14.44s/it]
 86%|████████▌ | 32670/37963 [140:04:20<21:11:53, 14.42s/it]
                                                            
{'loss': '0.0747', 'grad_norm': '2.318', 'learning_rate': '1.003e-06', 'epoch': '0.8606'}

 86%|████████▌ | 32670/37963 [140:04:20<21:11:53, 14.42s/it]
 86%|████████▌ | 32671/37963 [140:04:34<21:04:56, 14.34s/it]
 86%|████████▌ | 32672/37963 [140:04:49<21:07:11, 14.37s/it]
 86%|████████▌ | 32673/37963 [140:05:10<23:59:33, 16.33s/it]
 86%|████████▌ | 32674/37963 [140:05:24<23:02:55, 15.69s/it]
 86%|████████▌ | 32675/37963 [140:05:45<25:15:29, 17.20s/it]
 86%|████████▌ | 32676/37963 [140:05:59<24:00:23, 16.35s/it]
 86%|████████▌ | 32677/37963 [140:06:19<25:48:05, 17.57s/it]
 86%|████████▌ | 32678/37963 [140:06:34<24:24:06, 16.62s/it]
 86%|████████▌ | 32679/37963 [140:06:48<23:16:40, 15.86s/it]
 86%|████████▌ | 32680/37963 [140:07:10<25:49:12, 17.59s/it]
                                                            
{'loss': '0.06997', 'grad_norm': '3.403', 'learning_rate': '9.99e-07', 'epoch': '0.8608'}

 86%|████████▌ | 32680/37963 [140:07:10<25:49:12, 17.59s/it]
 86%|████████▌ | 32681/37963 [140:07:24<24:19:30, 16.58s/it]
 86%|████████▌ | 32682/37963 [140:07:38<23:08:06, 15.77s/it]
 86%|████████▌ | 32683/37963 [140:07:52<22:31:07, 15.35s/it]
 86%|████████▌ | 32684/37963 [140:08:06<22:06:11, 15.07s/it]
 86%|████████▌ | 32685/37963 [140:08:21<21:46:01, 14.85s/it]
 86%|████████▌ | 32686/37963 [140:08:35<21:33:42, 14.71s/it]
 86%|████████▌ | 32687/37963 [140:08:49<21:23:13, 14.59s/it]
 86%|████████▌ | 32688/37963 [140:09:04<21:15:09, 14.50s/it]
 86%|████████▌ | 32689/37963 [140:09:18<21:03:08, 14.37s/it]
 86%|████████▌ | 32690/37963 [140:09:32<21:03:25, 14.38s/it]
                                                            
{'loss': '0.06667', 'grad_norm': '2.843', 'learning_rate': '9.953e-07', 'epoch': '0.8611'}

 86%|████████▌ | 32690/37963 [140:09:32<21:03:25, 14.38s/it]
 86%|████████▌ | 32691/37963 [140:09:53<23:44:46, 16.22s/it]
 86%|████████▌ | 32692/37963 [140:10:07<22:56:07, 15.66s/it]
 86%|████████▌ | 32693/37963 [140:10:21<22:14:37, 15.20s/it]
 86%|████████▌ | 32694/37963 [140:10:36<21:52:10, 14.94s/it]
 86%|████████▌ | 32695/37963 [140:10:50<21:34:26, 14.74s/it]
 86%|████████▌ | 32696/37963 [140:11:10<24:06:04, 16.47s/it]
 86%|████████▌ | 32697/37963 [140:11:25<23:10:04, 15.84s/it]
 86%|████████▌ | 32698/37963 [140:11:39<22:32:33, 15.41s/it]
 86%|████████▌ | 32699/37963 [140:11:54<22:06:26, 15.12s/it]
 86%|████████▌ | 32700/37963 [140:12:08<21:47:11, 14.90s/it]
                                                            
{'loss': '0.06946', 'grad_norm': '3.607', 'learning_rate': '9.916e-07', 'epoch': '0.8614'}

 86%|████████▌ | 32700/37963 [140:12:08<21:47:11, 14.90s/it]
 86%|████████▌ | 32701/37963 [140:12:22<21:31:57, 14.73s/it]
 86%|████████▌ | 32702/37963 [140:12:43<24:22:42, 16.68s/it]
 86%|████████▌ | 32703/37963 [140:12:58<23:23:27, 16.01s/it]
 86%|████████▌ | 32704/37963 [140:13:12<22:31:58, 15.42s/it]
 86%|████████▌ | 32705/37963 [140:13:26<22:03:35, 15.10s/it]
 86%|████████▌ | 32706/37963 [140:13:41<21:45:29, 14.90s/it]
 86%|████████▌ | 32707/37963 [140:13:55<21:32:33, 14.76s/it]
 86%|████████▌ | 32708/37963 [140:14:10<21:21:13, 14.63s/it]
 86%|████████▌ | 32709/37963 [140:14:24<21:13:43, 14.55s/it]
 86%|████████▌ | 32710/37963 [140:14:38<21:09:48, 14.50s/it]
                                                            
{'loss': '0.07184', 'grad_norm': '3.46', 'learning_rate': '9.879e-07', 'epoch': '0.8616'}

 86%|████████▌ | 32710/37963 [140:14:38<21:09:48, 14.50s/it]
 86%|████████▌ | 32711/37963 [140:14:59<23:54:56, 16.39s/it]
 86%|████████▌ | 32712/37963 [140:15:14<23:04:58, 15.83s/it]
 86%|████████▌ | 32713/37963 [140:15:28<22:26:37, 15.39s/it]
 86%|████████▌ | 32714/37963 [140:15:42<21:56:35, 15.05s/it]
 86%|████████▌ | 32715/37963 [140:15:56<21:31:24, 14.76s/it]
 86%|████████▌ | 32716/37963 [140:16:10<21:07:10, 14.49s/it]
 86%|████████▌ | 32717/37963 [140:16:25<21:03:03, 14.45s/it]
 86%|████████▌ | 32718/37963 [140:16:39<21:00:44, 14.42s/it]
 86%|████████▌ | 32719/37963 [140:16:53<20:44:12, 14.24s/it]
 86%|████████▌ | 32720/37963 [140:17:07<20:42:01, 14.21s/it]
                                                            
{'loss': '0.07802', 'grad_norm': '3.43', 'learning_rate': '9.842e-07', 'epoch': '0.8619'}

 86%|████████▌ | 32720/37963 [140:17:07<20:42:01, 14.21s/it]
 86%|████████▌ | 32721/37963 [140:17:21<20:41:09, 14.21s/it]
 86%|████████▌ | 32722/37963 [140:17:36<20:49:35, 14.31s/it]
 86%|████████▌ | 32723/37963 [140:17:56<23:41:35, 16.28s/it]
 86%|████████▌ | 32724/37963 [140:18:17<25:37:55, 17.61s/it]
 86%|████████▌ | 32725/37963 [140:18:32<24:19:52, 16.72s/it]
 86%|████████▌ | 32726/37963 [140:18:52<25:57:35, 17.85s/it]
 86%|████████▌ | 32727/37963 [140:19:13<27:20:11, 18.80s/it]
 86%|████████▌ | 32728/37963 [140:19:27<25:17:42, 17.39s/it]
 86%|████████▌ | 32729/37963 [140:19:42<23:59:16, 16.50s/it]
 86%|████████▌ | 32730/37963 [140:19:56<22:49:22, 15.70s/it]
                                                            
{'loss': '0.06424', 'grad_norm': '2', 'learning_rate': '9.805e-07', 'epoch': '0.8622'}

 86%|████████▌ | 32730/37963 [140:19:56<22:49:22, 15.70s/it]
 86%|████████▌ | 32731/37963 [140:20:10<22:17:04, 15.33s/it]
 86%|████████▌ | 32732/37963 [140:20:25<21:53:14, 15.06s/it]
 86%|████████▌ | 32733/37963 [140:20:39<21:35:46, 14.87s/it]
 86%|████████▌ | 32734/37963 [140:20:53<21:24:08, 14.73s/it]
 86%|████████▌ | 32735/37963 [140:21:08<21:13:08, 14.61s/it]
 86%|████████▌ | 32736/37963 [140:21:22<21:04:25, 14.51s/it]
 86%|████████▌ | 32737/37963 [140:21:36<20:51:40, 14.37s/it]
 86%|████████▌ | 32738/37963 [140:21:51<20:53:39, 14.40s/it]
 86%|████████▌ | 32739/37963 [140:22:05<20:56:57, 14.44s/it]
 86%|████████▌ | 32740/37963 [140:22:26<23:52:38, 16.46s/it]
                                                            
{'loss': '0.06987', 'grad_norm': '2.325', 'learning_rate': '9.768e-07', 'epoch': '0.8624'}

 86%|████████▌ | 32740/37963 [140:22:26<23:52:38, 16.46s/it]
 86%|████████▌ | 32741/37963 [140:22:40<22:54:26, 15.79s/it]
 86%|████████▌ | 32742/37963 [140:22:55<22:19:29, 15.39s/it]
 86%|████████▌ | 32743/37963 [140:23:09<21:55:59, 15.13s/it]
 86%|████████▋ | 32744/37963 [140:23:24<21:35:59, 14.90s/it]
 86%|████████▋ | 32745/37963 [140:23:44<23:58:34, 16.54s/it]
 86%|████████▋ | 32746/37963 [140:23:59<23:06:14, 15.94s/it]
 86%|████████▋ | 32747/37963 [140:24:13<22:27:19, 15.50s/it]
 86%|████████▋ | 32748/37963 [140:24:28<21:57:50, 15.16s/it]
 86%|████████▋ | 32749/37963 [140:24:42<21:37:50, 14.93s/it]
 86%|████████▋ | 32750/37963 [140:25:03<24:10:23, 16.69s/it]
                                                            
{'loss': '0.07808', 'grad_norm': '3.591', 'learning_rate': '9.731e-07', 'epoch': '0.8627'}

 86%|████████▋ | 32750/37963 [140:25:03<24:10:23, 16.69s/it]
 86%|████████▋ | 32751/37963 [140:25:17<23:09:21, 15.99s/it]
 86%|████████▋ | 32752/37963 [140:25:31<22:26:37, 15.51s/it]
 86%|████████▋ | 32753/37963 [140:25:46<21:56:30, 15.16s/it]
 86%|████████▋ | 32754/37963 [140:26:00<21:35:32, 14.92s/it]
 86%|████████▋ | 32755/37963 [140:26:14<21:06:50, 14.59s/it]
 86%|████████▋ | 32756/37963 [140:26:28<21:00:14, 14.52s/it]
 86%|████████▋ | 32757/37963 [140:26:43<20:58:30, 14.50s/it]
 86%|████████▋ | 32758/37963 [140:26:57<20:55:28, 14.47s/it]
 86%|████████▋ | 32759/37963 [140:27:12<20:54:03, 14.46s/it]
 86%|████████▋ | 32760/37963 [140:27:26<20:55:09, 14.47s/it]
                                                            
{'loss': '0.079', 'grad_norm': '2.796', 'learning_rate': '9.695e-07', 'epoch': '0.8629'}

 86%|████████▋ | 32760/37963 [140:27:26<20:55:09, 14.47s/it]
 86%|████████▋ | 32761/37963 [140:27:41<20:52:06, 14.44s/it]
 86%|████████▋ | 32762/37963 [140:27:55<20:51:50, 14.44s/it]
 86%|████████▋ | 32763/37963 [140:28:16<23:36:56, 16.35s/it]
 86%|████████▋ | 32764/37963 [140:28:30<22:48:13, 15.79s/it]
 86%|████████▋ | 32765/37963 [140:28:45<22:09:48, 15.35s/it]
 86%|████████▋ | 32766/37963 [140:28:59<21:38:54, 15.00s/it]
 86%|████████▋ | 32767/37963 [140:29:12<20:59:33, 14.54s/it]
 86%|████████▋ | 32768/37963 [140:29:27<20:52:48, 14.47s/it]
 86%|████████▋ | 32769/37963 [140:29:41<20:53:54, 14.48s/it]
 86%|████████▋ | 32770/37963 [140:30:01<23:17:32, 16.15s/it]
                                                            
{'loss': '0.07505', 'grad_norm': '2.529', 'learning_rate': '9.658e-07', 'epoch': '0.8632'}

 86%|████████▋ | 32770/37963 [140:30:01<23:17:32, 16.15s/it]
 86%|████████▋ | 32771/37963 [140:30:15<22:31:28, 15.62s/it]
 86%|████████▋ | 32772/37963 [140:30:30<22:01:07, 15.27s/it]
 86%|████████▋ | 32773/37963 [140:30:51<24:34:31, 17.05s/it]
 86%|████████▋ | 32774/37963 [140:31:05<23:24:08, 16.24s/it]
 86%|████████▋ | 32775/37963 [140:31:27<25:30:42, 17.70s/it]
 86%|████████▋ | 32776/37963 [140:31:41<24:05:35, 16.72s/it]
 86%|████████▋ | 32777/37963 [140:32:03<26:22:16, 18.31s/it]
 86%|████████▋ | 32778/37963 [140:32:17<24:23:42, 16.94s/it]
 86%|████████▋ | 32779/37963 [140:32:31<23:16:57, 16.17s/it]
 86%|████████▋ | 32780/37963 [140:32:46<22:30:09, 15.63s/it]
                                                            
{'loss': '0.08048', 'grad_norm': '3.946', 'learning_rate': '9.622e-07', 'epoch': '0.8635'}

 86%|████████▋ | 32780/37963 [140:32:46<22:30:09, 15.63s/it]
 86%|████████▋ | 32781/37963 [140:33:00<21:59:14, 15.27s/it]
 86%|████████▋ | 32782/37963 [140:33:14<21:20:20, 14.83s/it]
 86%|████████▋ | 32783/37963 [140:33:28<21:06:46, 14.67s/it]
 86%|████████▋ | 32784/37963 [140:33:42<20:58:17, 14.58s/it]
 86%|████████▋ | 32785/37963 [140:33:56<20:39:16, 14.36s/it]
 86%|████████▋ | 32786/37963 [140:34:11<20:39:20, 14.36s/it]
 86%|████████▋ | 32787/37963 [140:34:25<20:42:49, 14.41s/it]
 86%|████████▋ | 32788/37963 [140:34:39<20:40:36, 14.38s/it]
 86%|████████▋ | 32789/37963 [140:35:01<23:42:06, 16.49s/it]
 86%|████████▋ | 32790/37963 [140:35:15<22:49:09, 15.88s/it]
                                                            
{'loss': '0.07549', 'grad_norm': '3.319', 'learning_rate': '9.585e-07', 'epoch': '0.8637'}

 86%|████████▋ | 32790/37963 [140:35:15<22:49:09, 15.88s/it]
 86%|████████▋ | 32791/37963 [140:35:30<22:12:46, 15.46s/it]
 86%|████████▋ | 32792/37963 [140:35:44<21:47:14, 15.17s/it]
 86%|████████▋ | 32793/37963 [140:35:59<21:30:54, 14.98s/it]
 86%|████████▋ | 32794/37963 [140:36:13<21:16:40, 14.82s/it]
 86%|████████▋ | 32795/37963 [140:36:34<23:53:09, 16.64s/it]
 86%|████████▋ | 32796/37963 [140:36:49<22:55:47, 15.98s/it]
 86%|████████▋ | 32797/37963 [140:37:03<22:15:50, 15.52s/it]
 86%|████████▋ | 32798/37963 [140:37:17<21:37:24, 15.07s/it]
 86%|████████▋ | 32799/37963 [140:37:38<24:01:07, 16.74s/it]
 86%|████████▋ | 32800/37963 [140:37:52<23:03:16, 16.08s/it]
                                                            
{'loss': '0.07575', 'grad_norm': '2.868', 'learning_rate': '9.549e-07', 'epoch': '0.864'}

 86%|████████▋ | 32800/37963 [140:37:52<23:03:16, 16.08s/it]
 86%|████████▋ | 32801/37963 [140:38:07<22:16:52, 15.54s/it]
 86%|████████▋ | 32802/37963 [140:38:21<21:47:33, 15.20s/it]
 86%|████████▋ | 32803/37963 [140:38:35<21:25:22, 14.95s/it]
 86%|████████▋ | 32804/37963 [140:38:50<21:10:54, 14.78s/it]
 86%|████████▋ | 32805/37963 [140:39:04<21:00:20, 14.66s/it]
 86%|████████▋ | 32806/37963 [140:39:18<20:53:29, 14.58s/it]
 86%|████████▋ | 32807/37963 [140:39:33<20:48:51, 14.53s/it]
 86%|████████▋ | 32808/37963 [140:39:47<20:45:41, 14.50s/it]
 86%|████████▋ | 32809/37963 [140:40:02<20:44:07, 14.48s/it]
 86%|████████▋ | 32810/37963 [140:40:22<23:24:22, 16.35s/it]
                                                            
{'loss': '0.07066', 'grad_norm': '3.917', 'learning_rate': '9.512e-07', 'epoch': '0.8643'}

 86%|████████▋ | 32810/37963 [140:40:22<23:24:22, 16.35s/it]
 86%|████████▋ | 32811/37963 [140:40:37<22:34:27, 15.77s/it]
 86%|████████▋ | 32812/37963 [140:40:51<21:45:42, 15.21s/it]
 86%|████████▋ | 32813/37963 [140:41:05<21:24:28, 14.96s/it]
 86%|████████▋ | 32814/37963 [140:41:20<21:13:32, 14.84s/it]
 86%|████████▋ | 32815/37963 [140:41:34<20:59:39, 14.68s/it]
 86%|████████▋ | 32816/37963 [140:41:48<20:49:39, 14.57s/it]
 86%|████████▋ | 32817/37963 [140:42:03<20:47:54, 14.55s/it]
 86%|████████▋ | 32818/37963 [140:42:17<20:43:57, 14.51s/it]
 86%|████████▋ | 32819/37963 [140:42:38<23:24:21, 16.38s/it]
 86%|████████▋ | 32820/37963 [140:42:53<22:36:39, 15.83s/it]
                                                            
{'loss': '0.07809', 'grad_norm': '2.28', 'learning_rate': '9.476e-07', 'epoch': '0.8645'}

 86%|████████▋ | 32820/37963 [140:42:53<22:36:39, 15.83s/it]
 86%|████████▋ | 32821/37963 [140:43:07<21:57:37, 15.37s/it]
 86%|████████▋ | 32822/37963 [140:43:28<24:27:50, 17.13s/it]
 86%|████████▋ | 32823/37963 [140:43:49<26:02:39, 18.24s/it]
 86%|████████▋ | 32824/37963 [140:44:03<24:25:20, 17.11s/it]
 86%|████████▋ | 32825/37963 [140:44:25<26:09:42, 18.33s/it]
 86%|████████▋ | 32826/37963 [140:44:39<24:25:54, 17.12s/it]
 86%|████████▋ | 32827/37963 [140:44:53<23:03:02, 16.16s/it]
 86%|████████▋ | 32828/37963 [140:45:07<22:16:16, 15.61s/it]
 86%|████████▋ | 32829/37963 [140:45:22<21:45:20, 15.26s/it]
 86%|████████▋ | 32830/37963 [140:45:36<21:25:15, 15.02s/it]
                                                            
{'loss': '0.07249', 'grad_norm': '3.515', 'learning_rate': '9.44e-07', 'epoch': '0.8648'}

 86%|████████▋ | 32830/37963 [140:45:36<21:25:15, 15.02s/it]
 86%|████████▋ | 32831/37963 [140:45:50<21:09:48, 14.85s/it]
 86%|████████▋ | 32832/37963 [140:46:04<20:46:13, 14.57s/it]
 86%|████████▋ | 32833/37963 [140:46:19<20:44:59, 14.56s/it]
 86%|████████▋ | 32834/37963 [140:46:33<20:38:54, 14.49s/it]
 86%|████████▋ | 32835/37963 [140:46:48<20:36:43, 14.47s/it]
 86%|████████▋ | 32836/37963 [140:47:02<20:35:32, 14.46s/it]
 86%|████████▋ | 32837/37963 [140:47:17<20:37:55, 14.49s/it]
 87%|████████▋ | 32838/37963 [140:47:38<23:30:07, 16.51s/it]
 87%|████████▋ | 32839/37963 [140:47:52<22:34:47, 15.86s/it]
 87%|████████▋ | 32840/37963 [140:48:07<21:56:51, 15.42s/it]
                                                            
{'loss': '0.07404', 'grad_norm': '3.361', 'learning_rate': '9.404e-07', 'epoch': '0.8651'}

 87%|████████▋ | 32840/37963 [140:48:07<21:56:51, 15.42s/it]
 87%|████████▋ | 32841/37963 [140:48:21<21:32:44, 15.14s/it]
 87%|████████▋ | 32842/37963 [140:48:36<21:13:23, 14.92s/it]
 87%|████████▋ | 32843/37963 [140:48:50<20:52:01, 14.67s/it]
 87%|████████▋ | 32844/37963 [140:49:04<20:44:55, 14.59s/it]
 87%|████████▋ | 32845/37963 [140:49:18<20:39:27, 14.53s/it]
 87%|████████▋ | 32846/37963 [140:49:40<23:32:27, 16.56s/it]
 87%|████████▋ | 32847/37963 [140:49:54<22:38:45, 15.94s/it]
 87%|████████▋ | 32848/37963 [140:50:09<21:59:46, 15.48s/it]
 87%|████████▋ | 32849/37963 [140:50:30<24:33:34, 17.29s/it]
 87%|████████▋ | 32850/37963 [140:50:45<23:20:19, 16.43s/it]
                                                            
{'loss': '0.08085', 'grad_norm': '3.347', 'learning_rate': '9.368e-07', 'epoch': '0.8653'}

 87%|████████▋ | 32850/37963 [140:50:45<23:20:19, 16.43s/it]
 87%|████████▋ | 32851/37963 [140:50:59<22:24:54, 15.79s/it]
 87%|████████▋ | 32852/37963 [140:51:13<21:48:02, 15.36s/it]
 87%|████████▋ | 32853/37963 [140:51:28<21:22:23, 15.06s/it]
 87%|████████▋ | 32854/37963 [140:51:42<20:54:25, 14.73s/it]
 87%|████████▋ | 32855/37963 [140:51:56<20:46:01, 14.64s/it]
 87%|████████▋ | 32856/37963 [140:52:10<20:38:25, 14.55s/it]
 87%|████████▋ | 32857/37963 [140:52:25<20:35:20, 14.52s/it]
 87%|████████▋ | 32858/37963 [140:52:39<20:31:52, 14.48s/it]
 87%|████████▋ | 32859/37963 [140:53:00<23:24:14, 16.51s/it]
 87%|████████▋ | 32860/37963 [140:53:15<22:30:18, 15.88s/it]
                                                            
{'loss': '0.08615', 'grad_norm': '3.438', 'learning_rate': '9.332e-07', 'epoch': '0.8656'}

 87%|████████▋ | 32860/37963 [140:53:15<22:30:18, 15.88s/it]
 87%|████████▋ | 32861/37963 [140:53:29<21:51:29, 15.42s/it]
 87%|████████▋ | 32862/37963 [140:53:44<21:27:41, 15.15s/it]
 87%|████████▋ | 32863/37963 [140:53:58<21:07:56, 14.92s/it]
 87%|████████▋ | 32864/37963 [140:54:12<20:38:47, 14.58s/it]
 87%|████████▋ | 32865/37963 [140:54:26<20:34:30, 14.53s/it]
 87%|████████▋ | 32866/37963 [140:54:41<20:36:22, 14.55s/it]
 87%|████████▋ | 32867/37963 [140:55:02<23:15:08, 16.43s/it]
 87%|████████▋ | 32868/37963 [140:55:16<22:23:41, 15.82s/it]
 87%|████████▋ | 32869/37963 [140:55:30<21:48:10, 15.41s/it]
 87%|████████▋ | 32870/37963 [140:55:52<24:14:56, 17.14s/it]
                                                            
{'loss': '0.06695', 'grad_norm': '2.623', 'learning_rate': '9.296e-07', 'epoch': '0.8658'}

 87%|████████▋ | 32870/37963 [140:55:52<24:14:56, 17.14s/it]
 87%|████████▋ | 32871/37963 [140:56:06<23:04:38, 16.32s/it]
 87%|████████▋ | 32872/37963 [140:56:27<25:07:32, 17.77s/it]
 87%|████████▋ | 32873/37963 [140:56:42<23:40:54, 16.75s/it]
 87%|████████▋ | 32874/37963 [140:56:56<22:39:17, 16.03s/it]
 87%|████████▋ | 32875/37963 [140:57:17<24:41:23, 17.47s/it]
 87%|████████▋ | 32876/37963 [140:57:31<23:18:16, 16.49s/it]
 87%|████████▋ | 32877/37963 [140:57:45<22:24:10, 15.86s/it]
 87%|████████▋ | 32878/37963 [140:58:00<21:46:41, 15.42s/it]
 87%|████████▋ | 32879/37963 [140:58:14<21:21:15, 15.12s/it]
 87%|████████▋ | 32880/37963 [140:58:29<21:03:20, 14.91s/it]
                                                            
{'loss': '0.07005', 'grad_norm': '3.578', 'learning_rate': '9.26e-07', 'epoch': '0.8661'}

 87%|████████▋ | 32880/37963 [140:58:29<21:03:20, 14.91s/it]
 87%|████████▋ | 32881/37963 [140:58:43<20:52:23, 14.79s/it]
 87%|████████▋ | 32882/37963 [140:58:58<20:45:01, 14.70s/it]
 87%|████████▋ | 32883/37963 [140:59:12<20:41:27, 14.66s/it]
 87%|████████▋ | 32884/37963 [140:59:26<20:21:47, 14.43s/it]
 87%|████████▋ | 32885/37963 [140:59:41<20:22:56, 14.45s/it]
 87%|████████▋ | 32886/37963 [140:59:55<20:20:53, 14.43s/it]
 87%|████████▋ | 32887/37963 [141:00:16<23:17:04, 16.51s/it]
 87%|████████▋ | 32888/37963 [141:00:31<22:18:39, 15.83s/it]
 87%|████████▋ | 32889/37963 [141:00:45<21:39:51, 15.37s/it]
 87%|████████▋ | 32890/37963 [141:00:59<21:17:10, 15.11s/it]
                                                            
{'loss': '0.07488', 'grad_norm': '3.804', 'learning_rate': '9.224e-07', 'epoch': '0.8664'}

 87%|████████▋ | 32890/37963 [141:00:59<21:17:10, 15.11s/it]
 87%|████████▋ | 32891/37963 [141:01:14<21:03:13, 14.94s/it]
 87%|████████▋ | 32892/37963 [141:01:28<20:38:13, 14.65s/it]
 87%|████████▋ | 32893/37963 [141:01:49<23:15:43, 16.52s/it]
 87%|████████▋ | 32894/37963 [141:02:03<22:25:57, 15.93s/it]
 87%|████████▋ | 32895/37963 [141:02:18<21:44:29, 15.44s/it]
 87%|████████▋ | 32896/37963 [141:02:32<21:13:06, 15.08s/it]
 87%|████████▋ | 32897/37963 [141:02:53<23:47:28, 16.91s/it]
 87%|████████▋ | 32898/37963 [141:03:07<22:38:01, 16.09s/it]
 87%|████████▋ | 32899/37963 [141:03:22<21:54:34, 15.58s/it]
 87%|████████▋ | 32900/37963 [141:03:36<21:22:36, 15.20s/it]
                                                            
{'loss': '0.06922', 'grad_norm': '3.648', 'learning_rate': '9.188e-07', 'epoch': '0.8666'}

 87%|████████▋ | 32900/37963 [141:03:36<21:22:36, 15.20s/it]
 87%|████████▋ | 32901/37963 [141:03:50<21:03:15, 14.97s/it]
 87%|████████▋ | 32902/37963 [141:04:05<20:48:21, 14.80s/it]
 87%|████████▋ | 32903/37963 [141:04:19<20:32:56, 14.62s/it]
 87%|████████▋ | 32904/37963 [141:04:33<20:26:04, 14.54s/it]
 87%|████████▋ | 32905/37963 [141:04:48<20:21:56, 14.50s/it]
 87%|████████▋ | 32906/37963 [141:05:08<22:57:11, 16.34s/it]
 87%|████████▋ | 32907/37963 [141:05:23<22:07:41, 15.76s/it]
 87%|████████▋ | 32908/37963 [141:05:37<21:23:21, 15.23s/it]
 87%|████████▋ | 32909/37963 [141:05:51<21:01:07, 14.97s/it]
 87%|████████▋ | 32910/37963 [141:06:05<20:45:54, 14.79s/it]
                                                            
{'loss': '0.06684', 'grad_norm': '2.419', 'learning_rate': '9.152e-07', 'epoch': '0.8669'}

 87%|████████▋ | 32910/37963 [141:06:05<20:45:54, 14.79s/it]
 87%|████████▋ | 32911/37963 [141:06:20<20:31:41, 14.63s/it]
 87%|████████▋ | 32912/37963 [141:06:34<20:20:31, 14.50s/it]
 87%|████████▋ | 32913/37963 [141:06:48<20:03:40, 14.30s/it]
 87%|████████▋ | 32914/37963 [141:07:02<20:05:18, 14.32s/it]
 87%|████████▋ | 32915/37963 [141:07:15<19:32:21, 13.93s/it]
 87%|████████▋ | 32916/37963 [141:07:35<22:08:55, 15.80s/it]
 87%|████████▋ | 32917/37963 [141:07:57<24:29:56, 17.48s/it]
 87%|████████▋ | 32918/37963 [141:08:11<23:17:16, 16.62s/it]
 87%|████████▋ | 32919/37963 [141:08:26<22:19:41, 15.94s/it]
 87%|████████▋ | 32920/37963 [141:08:40<21:40:14, 15.47s/it]
                                                            
{'loss': '0.07406', 'grad_norm': '3.679', 'learning_rate': '9.117e-07', 'epoch': '0.8672'}

 87%|████████▋ | 32920/37963 [141:08:40<21:40:14, 15.47s/it]
 87%|████████▋ | 32921/37963 [141:08:54<21:05:47, 15.06s/it]
 87%|████████▋ | 32922/37963 [141:09:15<23:42:35, 16.93s/it]
 87%|████████▋ | 32923/37963 [141:09:30<22:38:45, 16.18s/it]
 87%|████████▋ | 32924/37963 [141:09:51<24:38:20, 17.60s/it]
 87%|████████▋ | 32925/37963 [141:10:05<23:16:36, 16.63s/it]
 87%|████████▋ | 32926/37963 [141:10:20<22:19:29, 15.96s/it]
 87%|████████▋ | 32927/37963 [141:10:34<21:39:49, 15.49s/it]
 87%|████████▋ | 32928/37963 [141:10:48<21:07:40, 15.11s/it]
 87%|████████▋ | 32929/37963 [141:11:02<20:48:43, 14.88s/it]
 87%|████████▋ | 32930/37963 [141:11:17<20:41:40, 14.80s/it]
                                                            
{'loss': '0.06991', 'grad_norm': '2.312', 'learning_rate': '9.081e-07', 'epoch': '0.8674'}

 87%|████████▋ | 32930/37963 [141:11:17<20:41:40, 14.80s/it]
 87%|████████▋ | 32931/37963 [141:11:32<20:31:00, 14.68s/it]
 87%|████████▋ | 32932/37963 [141:11:46<20:24:14, 14.60s/it]
 87%|████████▋ | 32933/37963 [141:12:00<20:18:07, 14.53s/it]
 87%|████████▋ | 32934/37963 [141:12:15<20:16:49, 14.52s/it]
 87%|████████▋ | 32935/37963 [141:12:29<20:01:01, 14.33s/it]
 87%|████████▋ | 32936/37963 [141:12:43<20:01:38, 14.34s/it]
 87%|████████▋ | 32937/37963 [141:13:04<22:56:36, 16.43s/it]
 87%|████████▋ | 32938/37963 [141:13:19<22:03:17, 15.80s/it]
 87%|████████▋ | 32939/37963 [141:13:33<21:16:08, 15.24s/it]
 87%|████████▋ | 32940/37963 [141:13:47<20:44:49, 14.87s/it]
                                                            
{'loss': '0.07337', 'grad_norm': '2.364', 'learning_rate': '9.046e-07', 'epoch': '0.8677'}

 87%|████████▋ | 32940/37963 [141:13:47<20:44:49, 14.87s/it]
 87%|████████▋ | 32941/37963 [141:14:00<20:17:52, 14.55s/it]
 87%|████████▋ | 32942/37963 [141:14:15<20:09:42, 14.46s/it]
 87%|████████▋ | 32943/37963 [141:14:36<22:59:55, 16.49s/it]
 87%|████████▋ | 32944/37963 [141:14:50<22:05:29, 15.85s/it]
 87%|████████▋ | 32945/37963 [141:15:04<21:23:40, 15.35s/it]
 87%|████████▋ | 32946/37963 [141:15:25<23:29:25, 16.86s/it]
 87%|████████▋ | 32947/37963 [141:15:39<22:28:54, 16.14s/it]
 87%|████████▋ | 32948/37963 [141:15:54<21:44:47, 15.61s/it]
 87%|████████▋ | 32949/37963 [141:16:08<21:14:07, 15.25s/it]
 87%|████████▋ | 32950/37963 [141:16:22<20:52:36, 14.99s/it]
                                                            
{'loss': '0.06669', 'grad_norm': '2.314', 'learning_rate': '9.01e-07', 'epoch': '0.868'}

 87%|████████▋ | 32950/37963 [141:16:22<20:52:36, 14.99s/it]
 87%|████████▋ | 32951/37963 [141:16:36<20:27:42, 14.70s/it]
 87%|████████▋ | 32952/37963 [141:16:51<20:19:55, 14.61s/it]
 87%|████████▋ | 32953/37963 [141:17:05<20:06:30, 14.45s/it]
 87%|████████▋ | 32954/37963 [141:17:19<20:04:49, 14.43s/it]
 87%|████████▋ | 32955/37963 [141:17:40<22:42:26, 16.32s/it]
 87%|████████▋ | 32956/37963 [141:17:55<21:56:19, 15.77s/it]
 87%|████████▋ | 32957/37963 [141:18:09<21:20:59, 15.35s/it]
 87%|████████▋ | 32958/37963 [141:18:23<20:56:26, 15.06s/it]
 87%|████████▋ | 32959/37963 [141:18:37<20:33:39, 14.79s/it]
 87%|████████▋ | 32960/37963 [141:18:52<20:19:26, 14.62s/it]
                                                            
{'loss': '0.08561', 'grad_norm': '2.931', 'learning_rate': '8.975e-07', 'epoch': '0.8682'}

 87%|████████▋ | 32960/37963 [141:18:52<20:19:26, 14.62s/it]
 87%|████████▋ | 32961/37963 [141:19:06<20:11:58, 14.54s/it]
 87%|████████▋ | 32962/37963 [141:19:20<20:03:55, 14.44s/it]
 87%|████████▋ | 32963/37963 [141:19:41<22:42:59, 16.36s/it]
 87%|████████▋ | 32964/37963 [141:19:55<21:54:11, 15.77s/it]
 87%|████████▋ | 32965/37963 [141:20:10<21:12:02, 15.27s/it]
 87%|████████▋ | 32966/37963 [141:20:31<23:54:42, 17.23s/it]
 87%|████████▋ | 32967/37963 [141:20:46<22:44:40, 16.39s/it]
 87%|████████▋ | 32968/37963 [141:21:00<21:52:46, 15.77s/it]
 87%|████████▋ | 32969/37963 [141:21:21<23:48:28, 17.16s/it]
 87%|████████▋ | 32970/37963 [141:21:35<22:40:12, 16.35s/it]
                                                            
{'loss': '0.08219', 'grad_norm': '3.412', 'learning_rate': '8.94e-07', 'epoch': '0.8685'}

 87%|████████▋ | 32970/37963 [141:21:35<22:40:12, 16.35s/it]
 87%|████████▋ | 32971/37963 [141:21:56<24:38:30, 17.77s/it]
 87%|████████▋ | 32972/37963 [141:22:11<23:15:29, 16.78s/it]
 87%|████████▋ | 32973/37963 [141:22:25<22:17:55, 16.09s/it]
 87%|████████▋ | 32974/37963 [141:22:40<21:40:58, 15.65s/it]
 87%|████████▋ | 32975/37963 [141:22:54<21:08:52, 15.26s/it]
 87%|████████▋ | 32976/37963 [141:23:08<20:47:37, 15.01s/it]
 87%|████████▋ | 32977/37963 [141:23:23<20:26:44, 14.76s/it]
 87%|████████▋ | 32978/37963 [141:23:37<20:11:49, 14.59s/it]
 87%|████████▋ | 32979/37963 [141:23:51<20:05:36, 14.51s/it]
 87%|████████▋ | 32980/37963 [141:24:05<20:00:49, 14.46s/it]
                                                            
{'loss': '0.06214', 'grad_norm': '3.152', 'learning_rate': '8.905e-07', 'epoch': '0.8687'}

 87%|████████▋ | 32980/37963 [141:24:05<20:00:49, 14.46s/it]
 87%|████████▋ | 32981/37963 [141:24:20<19:53:33, 14.37s/it]
 87%|████████▋ | 32982/37963 [141:24:34<19:48:55, 14.32s/it]
 87%|████████▋ | 32983/37963 [141:24:48<19:48:55, 14.32s/it]
 87%|████████▋ | 32984/37963 [141:25:03<19:49:38, 14.34s/it]
 87%|████████▋ | 32985/37963 [141:25:23<22:31:38, 16.29s/it]
 87%|████████▋ | 32986/37963 [141:25:38<21:45:09, 15.73s/it]
 87%|████████▋ | 32987/37963 [141:25:52<21:16:14, 15.39s/it]
 87%|████████▋ | 32988/37963 [141:26:07<20:54:45, 15.13s/it]
 87%|████████▋ | 32989/37963 [141:26:21<20:39:21, 14.95s/it]
 87%|████████▋ | 32990/37963 [141:26:36<20:25:47, 14.79s/it]
                                                            
{'loss': '0.06817', 'grad_norm': '2.621', 'learning_rate': '8.869e-07', 'epoch': '0.869'}

 87%|████████▋ | 32990/37963 [141:26:36<20:25:47, 14.79s/it]
 87%|████████▋ | 32991/37963 [141:26:56<22:50:16, 16.54s/it]
 87%|████████▋ | 32992/37963 [141:27:11<21:54:57, 15.87s/it]
 87%|████████▋ | 32993/37963 [141:27:25<21:18:21, 15.43s/it]
 87%|████████▋ | 32994/37963 [141:27:39<20:44:07, 15.02s/it]
 87%|████████▋ | 32995/37963 [141:27:54<20:26:53, 14.82s/it]
 87%|████████▋ | 32996/37963 [141:28:08<20:04:07, 14.55s/it]
 87%|████████▋ | 32997/37963 [141:28:29<23:03:09, 16.71s/it]
 87%|████████▋ | 32998/37963 [141:28:44<22:06:46, 16.03s/it]
 87%|████████▋ | 32999/37963 [141:28:58<21:24:38, 15.53s/it]
 87%|████████▋ | 33000/37963 [141:29:12<20:56:07, 15.19s/it]
                                                            
{'loss': '0.07793', 'grad_norm': '3.3', 'learning_rate': '8.834e-07', 'epoch': '0.8693'}

 87%|████████▋ | 33000/37963 [141:29:12<20:56:07, 15.19s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.79s/it]
Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.79s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 87%|████████▋ | 33001/37963 [141:31:01<59:21:15, 43.06s/it]
 87%|████████▋ | 33002/37963 [141:31:15<47:24:28, 34.40s/it]
 87%|████████▋ | 33003/37963 [141:31:35<41:42:13, 30.27s/it]
 87%|████████▋ | 33004/37963 [141:31:50<35:11:05, 25.54s/it]
 87%|████████▋ | 33005/37963 [141:32:04<30:32:55, 22.18s/it]
 87%|████████▋ | 33006/37963 [141:32:18<27:09:40, 19.73s/it]
 87%|████████▋ | 33007/37963 [141:32:33<24:55:38, 18.11s/it]
 87%|████████▋ | 33008/37963 [141:32:47<23:28:27, 17.06s/it]
 87%|████████▋ | 33009/37963 [141:33:01<22:14:00, 16.16s/it]
 87%|████████▋ | 33010/37963 [141:33:15<21:26:23, 15.58s/it]
                                                            
{'loss': '0.07186', 'grad_norm': '2.508', 'learning_rate': '8.799e-07', 'epoch': '0.8695'}

 87%|████████▋ | 33010/37963 [141:33:15<21:26:23, 15.58s/it]
 87%|████████▋ | 33011/37963 [141:33:30<20:56:35, 15.23s/it]
 87%|████████▋ | 33012/37963 [141:33:44<20:34:49, 14.96s/it]
 87%|████████▋ | 33013/37963 [141:34:05<22:55:24, 16.67s/it]
 87%|████████▋ | 33014/37963 [141:34:19<21:57:19, 15.97s/it]
 87%|████████▋ | 33015/37963 [141:34:40<24:07:14, 17.55s/it]
 87%|████████▋ | 33016/37963 [141:34:55<22:46:20, 16.57s/it]
 87%|████████▋ | 33017/37963 [141:35:16<24:32:04, 17.86s/it]
 87%|████████▋ | 33018/37963 [141:35:37<25:59:52, 18.93s/it]
 87%|████████▋ | 33019/37963 [141:35:51<23:52:02, 17.38s/it]
 87%|████████▋ | 33020/37963 [141:36:04<22:20:51, 16.28s/it]
                                                            
{'loss': '0.07841', 'grad_norm': '2.775', 'learning_rate': '8.764e-07', 'epoch': '0.8698'}

 87%|████████▋ | 33020/37963 [141:36:05<22:20:51, 16.28s/it]
 87%|████████▋ | 33021/37963 [141:36:19<21:34:41, 15.72s/it]
 87%|████████▋ | 33022/37963 [141:36:33<20:59:45, 15.30s/it]
 87%|████████▋ | 33023/37963 [141:36:48<20:36:27, 15.02s/it]
 87%|████████▋ | 33024/37963 [141:37:02<20:22:54, 14.86s/it]
 87%|████████▋ | 33025/37963 [141:37:16<20:11:29, 14.72s/it]
 87%|████████▋ | 33026/37963 [141:37:31<20:04:31, 14.64s/it]
 87%|████████▋ | 33027/37963 [141:37:45<20:00:29, 14.59s/it]
 87%|████████▋ | 33028/37963 [141:37:59<19:44:30, 14.40s/it]
 87%|████████▋ | 33029/37963 [141:38:14<19:42:54, 14.38s/it]
 87%|████████▋ | 33030/37963 [141:38:28<19:41:30, 14.37s/it]
                                                            
{'loss': '0.08307', 'grad_norm': '2.518', 'learning_rate': '8.729e-07', 'epoch': '0.8701'}

 87%|████████▋ | 33030/37963 [141:38:28<19:41:30, 14.37s/it]
 87%|████████▋ | 33031/37963 [141:38:42<19:41:21, 14.37s/it]
 87%|████████▋ | 33032/37963 [141:38:57<19:41:47, 14.38s/it]
 87%|████████▋ | 33033/37963 [141:39:19<22:43:57, 16.60s/it]
 87%|████████▋ | 33034/37963 [141:39:33<21:39:13, 15.82s/it]
 87%|████████▋ | 33035/37963 [141:39:47<21:02:41, 15.37s/it]
 87%|████████▋ | 33036/37963 [141:40:01<20:37:27, 15.07s/it]
 87%|████████▋ | 33037/37963 [141:40:16<20:20:25, 14.87s/it]
 87%|████████▋ | 33038/37963 [141:40:30<20:04:26, 14.67s/it]
 87%|████████▋ | 33039/37963 [141:40:51<22:39:09, 16.56s/it]
 87%|████████▋ | 33040/37963 [141:41:05<21:46:22, 15.92s/it]
                                                            
{'loss': '0.0754', 'grad_norm': '2.425', 'learning_rate': '8.695e-07', 'epoch': '0.8703'}

 87%|████████▋ | 33040/37963 [141:41:05<21:46:22, 15.92s/it]
 87%|████████▋ | 33041/37963 [141:41:20<21:07:07, 15.45s/it]
 87%|████████▋ | 33042/37963 [141:41:33<20:24:48, 14.93s/it]
 87%|████████▋ | 33043/37963 [141:41:48<20:06:06, 14.71s/it]
 87%|████████▋ | 33044/37963 [141:42:08<22:35:22, 16.53s/it]
 87%|████████▋ | 33045/37963 [141:42:23<21:40:42, 15.87s/it]
 87%|████████▋ | 33046/37963 [141:42:37<20:56:15, 15.33s/it]
 87%|████████▋ | 33047/37963 [141:42:50<20:11:02, 14.78s/it]
 87%|████████▋ | 33048/37963 [141:43:05<20:00:05, 14.65s/it]
 87%|████████▋ | 33049/37963 [141:43:19<19:45:01, 14.47s/it]
 87%|████████▋ | 33050/37963 [141:43:33<19:43:26, 14.45s/it]
                                                            
{'loss': '0.07177', 'grad_norm': '2.903', 'learning_rate': '8.66e-07', 'epoch': '0.8706'}

 87%|████████▋ | 33050/37963 [141:43:33<19:43:26, 14.45s/it]
 87%|████████▋ | 33051/37963 [141:43:47<19:31:38, 14.31s/it]
 87%|████████▋ | 33052/37963 [141:44:08<22:11:43, 16.27s/it]
 87%|████████▋ | 33053/37963 [141:44:22<21:24:06, 15.69s/it]
 87%|████████▋ | 33054/37963 [141:44:37<20:51:46, 15.30s/it]
 87%|████████▋ | 33055/37963 [141:44:51<20:21:00, 14.93s/it]
 87%|████████▋ | 33056/37963 [141:45:05<20:07:31, 14.76s/it]
 87%|████████▋ | 33057/37963 [141:45:20<19:59:59, 14.68s/it]
 87%|████████▋ | 33058/37963 [141:45:34<19:53:24, 14.60s/it]
 87%|████████▋ | 33059/37963 [141:45:48<19:48:28, 14.54s/it]
 87%|████████▋ | 33060/37963 [141:46:03<19:44:36, 14.50s/it]
                                                            
{'loss': '0.0694', 'grad_norm': '2.601', 'learning_rate': '8.625e-07', 'epoch': '0.8709'}

 87%|████████▋ | 33060/37963 [141:46:03<19:44:36, 14.50s/it]
 87%|████████▋ | 33061/37963 [141:46:17<19:43:18, 14.48s/it]
 87%|████████▋ | 33062/37963 [141:46:38<22:09:57, 16.28s/it]
 87%|████████▋ | 33063/37963 [141:46:59<24:02:23, 17.66s/it]
 87%|████████▋ | 33064/37963 [141:47:12<22:29:26, 16.53s/it]
 87%|████████▋ | 33065/37963 [141:47:34<24:21:38, 17.90s/it]
 87%|████████▋ | 33066/37963 [141:47:48<22:56:32, 16.87s/it]
 87%|████████▋ | 33067/37963 [141:48:09<24:44:31, 18.19s/it]
 87%|████████▋ | 33068/37963 [141:48:24<23:12:59, 17.07s/it]
 87%|████████▋ | 33069/37963 [141:48:38<22:07:05, 16.27s/it]
 87%|████████▋ | 33070/37963 [141:48:53<21:21:06, 15.71s/it]
                                                            
{'loss': '0.06856', 'grad_norm': '3.176', 'learning_rate': '8.59e-07', 'epoch': '0.8711'}

 87%|████████▋ | 33070/37963 [141:48:53<21:21:06, 15.71s/it]
 87%|████████▋ | 33071/37963 [141:49:07<20:48:58, 15.32s/it]
 87%|████████▋ | 33072/37963 [141:49:21<20:20:02, 14.97s/it]
 87%|████████▋ | 33073/37963 [141:49:35<20:05:44, 14.79s/it]
 87%|████████▋ | 33074/37963 [141:49:50<19:55:54, 14.68s/it]
 87%|████████▋ | 33075/37963 [141:50:04<19:41:06, 14.50s/it]
 87%|████████▋ | 33076/37963 [141:50:18<19:40:00, 14.49s/it]
 87%|████████▋ | 33077/37963 [141:50:33<19:39:18, 14.48s/it]
 87%|████████▋ | 33078/37963 [141:50:47<19:39:17, 14.48s/it]
 87%|████████▋ | 33079/37963 [141:51:02<19:42:52, 14.53s/it]
 87%|████████▋ | 33080/37963 [141:51:16<19:40:18, 14.50s/it]
                                                            
{'loss': '0.07503', 'grad_norm': '3.402', 'learning_rate': '8.556e-07', 'epoch': '0.8714'}

 87%|████████▋ | 33080/37963 [141:51:16<19:40:18, 14.50s/it]
 87%|████████▋ | 33081/37963 [141:51:37<22:17:26, 16.44s/it]
 87%|████████▋ | 33082/37963 [141:51:52<21:27:18, 15.82s/it]
 87%|████████▋ | 33083/37963 [141:52:06<20:50:39, 15.38s/it]
 87%|████████▋ | 33084/37963 [141:52:20<20:12:24, 14.91s/it]
 87%|████████▋ | 33085/37963 [141:52:34<19:58:49, 14.75s/it]
 87%|████████▋ | 33086/37963 [141:52:49<19:49:25, 14.63s/it]
 87%|████████▋ | 33087/37963 [141:53:03<19:42:10, 14.55s/it]
 87%|████████▋ | 33088/37963 [141:53:17<19:25:28, 14.34s/it]
 87%|████████▋ | 33089/37963 [141:53:37<21:57:17, 16.22s/it]
 87%|████████▋ | 33090/37963 [141:53:52<21:08:49, 15.62s/it]
                                                            
{'loss': '0.08144', 'grad_norm': '2.866', 'learning_rate': '8.521e-07', 'epoch': '0.8716'}

 87%|████████▋ | 33090/37963 [141:53:52<21:08:49, 15.62s/it]
 87%|████████▋ | 33091/37963 [141:54:06<20:40:47, 15.28s/it]
 87%|████████▋ | 33092/37963 [141:54:27<22:58:30, 16.98s/it]
 87%|████████▋ | 33093/37963 [141:54:41<21:44:00, 16.07s/it]
 87%|████████▋ | 33094/37963 [141:54:55<20:59:28, 15.52s/it]
 87%|████████▋ | 33095/37963 [141:55:10<20:31:00, 15.17s/it]
 87%|████████▋ | 33096/37963 [141:55:23<19:49:38, 14.67s/it]
 87%|████████▋ | 33097/37963 [141:55:38<19:41:59, 14.57s/it]
 87%|████████▋ | 33098/37963 [141:55:52<19:36:34, 14.51s/it]
 87%|████████▋ | 33099/37963 [141:56:06<19:28:42, 14.42s/it]
 87%|████████▋ | 33100/37963 [141:56:27<22:00:26, 16.29s/it]
                                                            
{'loss': '0.06531', 'grad_norm': '3.333', 'learning_rate': '8.487e-07', 'epoch': '0.8719'}

 87%|████████▋ | 33100/37963 [141:56:27<22:00:26, 16.29s/it]
 87%|████████▋ | 33101/37963 [141:56:41<21:14:21, 15.73s/it]
 87%|████████▋ | 33102/37963 [141:56:56<20:41:47, 15.33s/it]
 87%|████████▋ | 33103/37963 [141:57:10<20:19:47, 15.06s/it]
 87%|████████▋ | 33104/37963 [141:57:24<20:02:11, 14.84s/it]
 87%|████████▋ | 33105/37963 [141:57:39<19:45:52, 14.65s/it]
 87%|████████▋ | 33106/37963 [141:57:53<19:41:45, 14.60s/it]
 87%|████████▋ | 33107/37963 [141:58:07<19:26:20, 14.41s/it]
 87%|████████▋ | 33108/37963 [141:58:21<19:20:56, 14.35s/it]
 87%|████████▋ | 33109/37963 [141:58:36<19:22:01, 14.36s/it]
 87%|████████▋ | 33110/37963 [141:58:56<21:59:38, 16.32s/it]
                                                            
{'loss': '0.0709', 'grad_norm': '3.729', 'learning_rate': '8.453e-07', 'epoch': '0.8722'}

 87%|████████▋ | 33110/37963 [141:58:56<21:59:38, 16.32s/it]
 87%|████████▋ | 33111/37963 [141:59:18<23:55:19, 17.75s/it]
 87%|████████▋ | 33112/37963 [141:59:32<22:34:24, 16.75s/it]
 87%|████████▋ | 33113/37963 [141:59:46<21:32:09, 15.99s/it]
 87%|████████▋ | 33114/37963 [142:00:07<23:30:17, 17.45s/it]
 87%|████████▋ | 33115/37963 [142:00:21<22:15:05, 16.52s/it]
 87%|████████▋ | 33116/37963 [142:00:43<24:09:49, 17.95s/it]
 87%|████████▋ | 33117/37963 [142:00:57<22:39:33, 16.83s/it]
 87%|████████▋ | 33118/37963 [142:01:11<21:33:52, 16.02s/it]
 87%|████████▋ | 33119/37963 [142:01:25<20:53:46, 15.53s/it]
 87%|████████▋ | 33120/37963 [142:01:40<20:25:27, 15.18s/it]
                                                            
{'loss': '0.07651', 'grad_norm': '3.263', 'learning_rate': '8.418e-07', 'epoch': '0.8724'}

 87%|████████▋ | 33120/37963 [142:01:40<20:25:27, 15.18s/it]
 87%|████████▋ | 33121/37963 [142:01:54<19:57:31, 14.84s/it]
 87%|████████▋ | 33122/37963 [142:02:08<19:46:25, 14.70s/it]
 87%|████████▋ | 33123/37963 [142:02:23<19:38:23, 14.61s/it]
 87%|████████▋ | 33124/37963 [142:02:37<19:34:27, 14.56s/it]
 87%|████████▋ | 33125/37963 [142:02:52<19:32:54, 14.55s/it]
 87%|████████▋ | 33126/37963 [142:03:06<19:25:54, 14.46s/it]
 87%|████████▋ | 33127/37963 [142:03:20<19:24:41, 14.45s/it]
 87%|████████▋ | 33128/37963 [142:03:34<19:03:11, 14.19s/it]
 87%|████████▋ | 33129/37963 [142:03:48<19:07:29, 14.24s/it]
 87%|████████▋ | 33130/37963 [142:04:02<19:06:53, 14.24s/it]
                                                            
{'loss': '0.07774', 'grad_norm': '2.898', 'learning_rate': '8.384e-07', 'epoch': '0.8727'}

 87%|████████▋ | 33130/37963 [142:04:02<19:06:53, 14.24s/it]
 87%|████████▋ | 33131/37963 [142:04:23<21:44:36, 16.20s/it]
 87%|████████▋ | 33132/37963 [142:04:38<21:01:49, 15.67s/it]
 87%|████████▋ | 33133/37963 [142:04:52<20:18:46, 15.14s/it]
 87%|████████▋ | 33134/37963 [142:05:06<20:01:35, 14.93s/it]
 87%|████████▋ | 33135/37963 [142:05:20<19:45:31, 14.73s/it]
 87%|████████▋ | 33136/37963 [142:05:35<19:37:30, 14.64s/it]
 87%|████████▋ | 33137/37963 [142:05:49<19:25:50, 14.49s/it]
 87%|████████▋ | 33138/37963 [142:06:10<21:54:27, 16.35s/it]
 87%|████████▋ | 33139/37963 [142:06:24<21:03:22, 15.71s/it]
 87%|████████▋ | 33140/37963 [142:06:38<20:17:06, 15.14s/it]
                                                            
{'loss': '0.06906', 'grad_norm': '2.386', 'learning_rate': '8.35e-07', 'epoch': '0.873'}

 87%|████████▋ | 33140/37963 [142:06:38<20:17:06, 15.14s/it]
 87%|████████▋ | 33141/37963 [142:06:59<22:41:03, 16.94s/it]
 87%|████████▋ | 33142/37963 [142:07:13<21:35:33, 16.12s/it]
 87%|████████▋ | 33143/37963 [142:07:27<20:40:57, 15.45s/it]
 87%|████████▋ | 33144/37963 [142:07:41<20:15:09, 15.13s/it]
 87%|████████▋ | 33145/37963 [142:07:55<19:50:39, 14.83s/it]
 87%|████████▋ | 33146/37963 [142:08:09<19:30:53, 14.58s/it]
 87%|████████▋ | 33147/37963 [142:08:24<19:26:54, 14.54s/it]
 87%|████████▋ | 33148/37963 [142:08:38<19:23:39, 14.50s/it]
 87%|████████▋ | 33149/37963 [142:08:53<19:20:04, 14.46s/it]
 87%|████████▋ | 33150/37963 [142:09:06<19:03:23, 14.25s/it]
                                                            
{'loss': '0.08118', 'grad_norm': '2.899', 'learning_rate': '8.316e-07', 'epoch': '0.8732'}

 87%|████████▋ | 33150/37963 [142:09:06<19:03:23, 14.25s/it]
 87%|████████▋ | 33151/37963 [142:09:27<21:35:06, 16.15s/it]
 87%|████████▋ | 33152/37963 [142:09:41<20:52:53, 15.63s/it]
 87%|████████▋ | 33153/37963 [142:09:56<20:21:25, 15.24s/it]
 87%|████████▋ | 33154/37963 [142:10:10<20:00:45, 14.98s/it]
 87%|████████▋ | 33155/37963 [142:10:24<19:36:09, 14.68s/it]
 87%|████████▋ | 33156/37963 [142:10:38<19:30:08, 14.61s/it]
 87%|████████▋ | 33157/37963 [142:10:52<19:13:40, 14.40s/it]
 87%|████████▋ | 33158/37963 [142:11:07<19:14:04, 14.41s/it]
 87%|████████▋ | 33159/37963 [142:11:21<19:12:23, 14.39s/it]
 87%|████████▋ | 33160/37963 [142:11:42<21:53:29, 16.41s/it]
                                                            
{'loss': '0.07457', 'grad_norm': '2.73', 'learning_rate': '8.282e-07', 'epoch': '0.8735'}

 87%|████████▋ | 33160/37963 [142:11:42<21:53:29, 16.41s/it]
 87%|████████▋ | 33161/37963 [142:12:03<23:46:37, 17.83s/it]
 87%|████████▋ | 33162/37963 [142:12:25<25:13:01, 18.91s/it]
 87%|████████▋ | 33163/37963 [142:12:39<23:20:15, 17.50s/it]
 87%|████████▋ | 33164/37963 [142:12:53<22:06:18, 16.58s/it]
 87%|████████▋ | 33165/37963 [142:13:15<24:01:06, 18.02s/it]
 87%|████████▋ | 33166/37963 [142:13:29<22:35:43, 16.96s/it]
 87%|████████▋ | 33167/37963 [142:13:44<21:34:12, 16.19s/it]
 87%|████████▋ | 33168/37963 [142:13:58<20:52:52, 15.68s/it]
 87%|████████▋ | 33169/37963 [142:14:13<20:21:44, 15.29s/it]
 87%|████████▋ | 33170/37963 [142:14:26<19:45:43, 14.84s/it]
                                                            
{'loss': '0.06375', 'grad_norm': '2.045', 'learning_rate': '8.248e-07', 'epoch': '0.8737'}

 87%|████████▋ | 33170/37963 [142:14:26<19:45:43, 14.84s/it]
 87%|████████▋ | 33171/37963 [142:14:40<19:26:33, 14.61s/it]
 87%|████████▋ | 33172/37963 [142:14:55<19:23:08, 14.57s/it]
 87%|████████▋ | 33173/37963 [142:15:09<19:15:36, 14.48s/it]
 87%|████████▋ | 33174/37963 [142:15:23<19:06:27, 14.36s/it]
 87%|████████▋ | 33175/37963 [142:15:38<19:05:51, 14.36s/it]
 87%|████████▋ | 33176/37963 [142:15:52<19:07:37, 14.38s/it]
 87%|████████▋ | 33177/37963 [142:16:06<19:07:06, 14.38s/it]
 87%|████████▋ | 33178/37963 [142:16:20<18:45:20, 14.11s/it]
 87%|████████▋ | 33179/37963 [142:16:34<18:48:32, 14.15s/it]
 87%|████████▋ | 33180/37963 [142:16:56<21:50:37, 16.44s/it]
                                                            
{'loss': '0.06895', 'grad_norm': '2.992', 'learning_rate': '8.214e-07', 'epoch': '0.874'}

 87%|████████▋ | 33180/37963 [142:16:56<21:50:37, 16.44s/it]
 87%|████████▋ | 33181/37963 [142:17:10<20:57:59, 15.78s/it]
 87%|████████▋ | 33182/37963 [142:17:25<20:23:27, 15.35s/it]
 87%|████████▋ | 33183/37963 [142:17:39<19:59:09, 15.05s/it]
 87%|████████▋ | 33184/37963 [142:17:53<19:42:35, 14.85s/it]
 87%|████████▋ | 33185/37963 [142:18:07<19:27:37, 14.66s/it]
 87%|████████▋ | 33186/37963 [142:18:28<21:52:10, 16.48s/it]
 87%|████████▋ | 33187/37963 [142:18:43<21:00:25, 15.83s/it]
 87%|████████▋ | 33188/37963 [142:18:57<20:24:40, 15.39s/it]
 87%|████████▋ | 33189/37963 [142:19:11<19:56:07, 15.03s/it]
 87%|████████▋ | 33190/37963 [142:19:32<22:24:47, 16.90s/it]
                                                            
{'loss': '0.07539', 'grad_norm': '3.371', 'learning_rate': '8.18e-07', 'epoch': '0.8743'}

 87%|████████▋ | 33190/37963 [142:19:32<22:24:47, 16.90s/it]
 87%|████████▋ | 33191/37963 [142:19:47<21:24:18, 16.15s/it]
 87%|████████▋ | 33192/37963 [142:20:01<20:34:08, 15.52s/it]
 87%|████████▋ | 33193/37963 [142:20:15<20:10:15, 15.22s/it]
 87%|████████▋ | 33194/37963 [142:20:29<19:44:16, 14.90s/it]
 87%|████████▋ | 33195/37963 [142:20:44<19:26:51, 14.68s/it]
 87%|████████▋ | 33196/37963 [142:20:58<19:18:47, 14.59s/it]
 87%|████████▋ | 33197/37963 [142:21:12<19:15:01, 14.54s/it]
 87%|████████▋ | 33198/37963 [142:21:27<19:11:00, 14.49s/it]
 87%|████████▋ | 33199/37963 [142:21:41<19:08:53, 14.47s/it]
 87%|████████▋ | 33200/37963 [142:22:02<21:36:17, 16.33s/it]
                                                            
{'loss': '0.0683', 'grad_norm': '3.206', 'learning_rate': '8.146e-07', 'epoch': '0.8745'}

 87%|████████▋ | 33200/37963 [142:22:02<21:36:17, 16.33s/it]
 87%|████████▋ | 33201/37963 [142:22:16<20:52:00, 15.77s/it]
 87%|████████▋ | 33202/37963 [142:22:31<20:14:00, 15.30s/it]
 87%|████████▋ | 33203/37963 [142:22:45<19:59:32, 15.12s/it]
 87%|████████▋ | 33204/37963 [142:22:59<19:34:39, 14.81s/it]
 87%|████████▋ | 33205/37963 [142:23:13<19:15:15, 14.57s/it]
 87%|████████▋ | 33206/37963 [142:23:28<19:11:59, 14.53s/it]
 87%|████████▋ | 33207/37963 [142:23:42<19:08:32, 14.49s/it]
 87%|████████▋ | 33208/37963 [142:24:09<24:00:54, 18.18s/it]
 87%|████████▋ | 33209/37963 [142:24:30<25:03:40, 18.98s/it]
 87%|████████▋ | 33210/37963 [142:24:44<23:12:56, 17.58s/it]
                                                            
{'loss': '0.07629', 'grad_norm': '4.516', 'learning_rate': '8.113e-07', 'epoch': '0.8748'}

 87%|████████▋ | 33210/37963 [142:24:44<23:12:56, 17.58s/it]
 87%|████████▋ | 33211/37963 [142:24:58<21:36:03, 16.36s/it]
 87%|████████▋ | 33212/37963 [142:25:12<20:38:46, 15.64s/it]
 87%|████████▋ | 33213/37963 [142:25:33<22:50:46, 17.31s/it]
 87%|████████▋ | 33214/37963 [142:25:47<21:39:16, 16.42s/it]
 87%|████████▋ | 33215/37963 [142:26:02<20:50:11, 15.80s/it]
 87%|████████▋ | 33216/37963 [142:26:16<20:16:01, 15.37s/it]
 87%|████████▋ | 33217/37963 [142:26:30<19:52:52, 15.08s/it]
 88%|████████▊ | 33218/37963 [142:26:45<19:37:00, 14.88s/it]
 88%|████████▊ | 33219/37963 [142:26:59<19:25:12, 14.74s/it]
 88%|████████▊ | 33220/37963 [142:27:14<19:23:21, 14.72s/it]
                                                            
{'loss': '0.0798', 'grad_norm': '2.832', 'learning_rate': '8.079e-07', 'epoch': '0.8751'}

 88%|████████▊ | 33220/37963 [142:27:14<19:23:21, 14.72s/it]
 88%|████████▊ | 33221/37963 [142:27:28<19:14:28, 14.61s/it]
 88%|████████▊ | 33222/37963 [142:27:42<19:03:56, 14.48s/it]
 88%|████████▊ | 33223/37963 [142:27:57<19:02:19, 14.46s/it]
 88%|████████▊ | 33224/37963 [142:28:11<19:03:05, 14.47s/it]
 88%|████████▊ | 33225/37963 [142:28:26<19:02:56, 14.47s/it]
 88%|████████▊ | 33226/37963 [142:28:40<19:06:28, 14.52s/it]
 88%|████████▊ | 33227/37963 [142:28:55<19:00:42, 14.45s/it]
 88%|████████▊ | 33228/37963 [142:29:16<21:45:58, 16.55s/it]
 88%|████████▊ | 33229/37963 [142:29:31<20:56:15, 15.92s/it]
 88%|████████▊ | 33230/37963 [142:29:45<20:16:50, 15.43s/it]
                                                            
{'loss': '0.07174', 'grad_norm': '2.561', 'learning_rate': '8.045e-07', 'epoch': '0.8753'}

 88%|████████▊ | 33230/37963 [142:29:45<20:16:50, 15.43s/it]
 88%|████████▊ | 33231/37963 [142:29:59<19:55:42, 15.16s/it]
 88%|████████▊ | 33232/37963 [142:30:14<19:32:41, 14.87s/it]
 88%|████████▊ | 33233/37963 [142:30:34<21:38:23, 16.47s/it]
 88%|████████▊ | 33234/37963 [142:30:48<20:50:38, 15.87s/it]
 88%|████████▊ | 33235/37963 [142:31:03<20:15:31, 15.43s/it]
 88%|████████▊ | 33236/37963 [142:31:17<19:51:16, 15.12s/it]
 88%|████████▊ | 33237/37963 [142:31:31<19:32:41, 14.89s/it]
 88%|████████▊ | 33238/37963 [142:31:52<21:42:54, 16.54s/it]
 88%|████████▊ | 33239/37963 [142:32:06<20:40:00, 15.75s/it]
 88%|████████▊ | 33240/37963 [142:32:20<20:04:08, 15.30s/it]
                                                            
{'loss': '0.075', 'grad_norm': '4.661', 'learning_rate': '8.012e-07', 'epoch': '0.8756'}

 88%|████████▊ | 33240/37963 [142:32:20<20:04:08, 15.30s/it]
 88%|████████▊ | 33241/37963 [142:32:34<19:35:54, 14.94s/it]
 88%|████████▊ | 33242/37963 [142:32:48<19:22:53, 14.78s/it]
 88%|████████▊ | 33243/37963 [142:33:02<18:56:04, 14.44s/it]
 88%|████████▊ | 33244/37963 [142:33:16<18:55:27, 14.44s/it]
 88%|████████▊ | 33245/37963 [142:33:31<18:54:22, 14.43s/it]
 88%|████████▊ | 33246/37963 [142:33:45<18:52:45, 14.41s/it]
 88%|████████▊ | 33247/37963 [142:33:59<18:48:27, 14.36s/it]
 88%|████████▊ | 33248/37963 [142:34:14<18:48:49, 14.36s/it]
 88%|████████▊ | 33249/37963 [142:34:35<21:17:26, 16.26s/it]
 88%|████████▊ | 33250/37963 [142:34:48<20:18:54, 15.52s/it]
                                                            
{'loss': '0.07294', 'grad_norm': '2.784', 'learning_rate': '7.979e-07', 'epoch': '0.8759'}

 88%|████████▊ | 33250/37963 [142:34:48<20:18:54, 15.52s/it]
 88%|████████▊ | 33251/37963 [142:35:03<19:52:15, 15.18s/it]
 88%|████████▊ | 33252/37963 [142:35:17<19:35:18, 14.97s/it]
 88%|████████▊ | 33253/37963 [142:35:32<19:21:42, 14.80s/it]
 88%|████████▊ | 33254/37963 [142:35:46<19:11:18, 14.67s/it]
 88%|████████▊ | 33255/37963 [142:36:00<18:44:34, 14.33s/it]
 88%|████████▊ | 33256/37963 [142:36:20<21:16:55, 16.28s/it]
 88%|████████▊ | 33257/37963 [142:36:34<20:17:46, 15.53s/it]
 88%|████████▊ | 33258/37963 [142:36:49<19:51:59, 15.20s/it]
 88%|████████▊ | 33259/37963 [142:37:10<22:14:17, 17.02s/it]
 88%|████████▊ | 33260/37963 [142:37:30<23:33:09, 18.03s/it]
                                                            
{'loss': '0.06594', 'grad_norm': '3.065', 'learning_rate': '7.945e-07', 'epoch': '0.8761'}

 88%|████████▊ | 33260/37963 [142:37:30<23:33:09, 18.03s/it]
 88%|████████▊ | 33261/37963 [142:37:44<21:58:17, 16.82s/it]
 88%|████████▊ | 33262/37963 [142:38:05<23:39:17, 18.11s/it]
 88%|████████▊ | 33263/37963 [142:38:20<22:11:01, 16.99s/it]
 88%|████████▊ | 33264/37963 [142:38:34<21:08:29, 16.20s/it]
 88%|████████▊ | 33265/37963 [142:38:48<20:21:38, 15.60s/it]
 88%|████████▊ | 33266/37963 [142:39:03<19:50:21, 15.21s/it]
 88%|████████▊ | 33267/37963 [142:39:17<19:29:52, 14.95s/it]
 88%|████████▊ | 33268/37963 [142:39:31<19:18:55, 14.81s/it]
 88%|████████▊ | 33269/37963 [142:39:46<19:10:04, 14.70s/it]
 88%|████████▊ | 33270/37963 [142:40:00<19:00:58, 14.59s/it]
                                                            
{'loss': '0.06587', 'grad_norm': '2.775', 'learning_rate': '7.912e-07', 'epoch': '0.8764'}

 88%|████████▊ | 33270/37963 [142:40:00<19:00:58, 14.59s/it]
 88%|████████▊ | 33271/37963 [142:40:15<18:58:33, 14.56s/it]
 88%|████████▊ | 33272/37963 [142:40:29<18:55:05, 14.52s/it]
 88%|████████▊ | 33273/37963 [142:40:44<18:53:21, 14.50s/it]
 88%|████████▊ | 33274/37963 [142:40:58<18:45:22, 14.40s/it]
 88%|████████▊ | 33275/37963 [142:41:12<18:47:04, 14.42s/it]
 88%|████████▊ | 33276/37963 [142:41:27<18:45:55, 14.41s/it]
 88%|████████▊ | 33277/37963 [142:41:48<21:29:34, 16.51s/it]
 88%|████████▊ | 33278/37963 [142:42:02<20:34:09, 15.81s/it]
 88%|████████▊ | 33279/37963 [142:42:16<19:51:01, 15.26s/it]
 88%|████████▊ | 33280/37963 [142:42:30<19:29:03, 14.98s/it]
                                                            
{'loss': '0.06681', 'grad_norm': '2.899', 'learning_rate': '7.879e-07', 'epoch': '0.8766'}

 88%|████████▊ | 33280/37963 [142:42:30<19:29:03, 14.98s/it]
 88%|████████▊ | 33281/37963 [142:42:45<19:15:11, 14.80s/it]
 88%|████████▊ | 33282/37963 [142:43:05<21:29:58, 16.53s/it]
 88%|████████▊ | 33283/37963 [142:43:20<20:38:09, 15.87s/it]
 88%|████████▊ | 33284/37963 [142:43:34<20:04:47, 15.45s/it]
 88%|████████▊ | 33285/37963 [142:43:49<19:38:31, 15.12s/it]
 88%|████████▊ | 33286/37963 [142:44:02<19:00:01, 14.63s/it]
 88%|████████▊ | 33287/37963 [142:44:23<21:17:49, 16.40s/it]
 88%|████████▊ | 33288/37963 [142:44:37<20:27:50, 15.76s/it]
 88%|████████▊ | 33289/37963 [142:44:51<19:54:58, 15.34s/it]
 88%|████████▊ | 33290/37963 [142:45:06<19:31:31, 15.04s/it]
                                                            
{'loss': '0.0638', 'grad_norm': '4', 'learning_rate': '7.846e-07', 'epoch': '0.8769'}

 88%|████████▊ | 33290/37963 [142:45:06<19:31:31, 15.04s/it]
 88%|████████▊ | 33291/37963 [142:45:19<18:53:05, 14.55s/it]
 88%|████████▊ | 33292/37963 [142:45:33<18:51:42, 14.54s/it]
 88%|████████▊ | 33293/37963 [142:45:48<18:48:54, 14.50s/it]
 88%|████████▊ | 33294/37963 [142:46:01<18:27:34, 14.23s/it]
 88%|████████▊ | 33295/37963 [142:46:16<18:30:35, 14.28s/it]
 88%|████████▊ | 33296/37963 [142:46:30<18:34:10, 14.32s/it]
 88%|████████▊ | 33297/37963 [142:46:51<21:05:30, 16.27s/it]
 88%|████████▊ | 33298/37963 [142:47:06<20:23:29, 15.74s/it]
 88%|████████▊ | 33299/37963 [142:47:20<19:44:10, 15.23s/it]
 88%|████████▊ | 33300/37963 [142:47:33<19:03:57, 14.72s/it]
                                                            
{'loss': '0.06231', 'grad_norm': '3.155', 'learning_rate': '7.812e-07', 'epoch': '0.8772'}

 88%|████████▊ | 33300/37963 [142:47:33<19:03:57, 14.72s/it]
 88%|████████▊ | 33301/37963 [142:47:48<18:55:49, 14.62s/it]
 88%|████████▊ | 33302/37963 [142:48:01<18:37:39, 14.39s/it]
 88%|████████▊ | 33303/37963 [142:48:16<18:38:41, 14.40s/it]
 88%|████████▊ | 33304/37963 [142:48:30<18:38:49, 14.41s/it]
 88%|████████▊ | 33305/37963 [142:48:51<20:56:00, 16.18s/it]
 88%|████████▊ | 33306/37963 [142:49:05<20:04:57, 15.52s/it]
 88%|████████▊ | 33307/37963 [142:49:26<22:13:58, 17.19s/it]
 88%|████████▊ | 33308/37963 [142:49:40<21:09:11, 16.36s/it]
 88%|████████▊ | 33309/37963 [142:50:01<22:56:17, 17.74s/it]
 88%|████████▊ | 33310/37963 [142:50:15<21:38:13, 16.74s/it]
                                                            
{'loss': '0.06869', 'grad_norm': '2.989', 'learning_rate': '7.779e-07', 'epoch': '0.8774'}

 88%|████████▊ | 33310/37963 [142:50:15<21:38:13, 16.74s/it]
 88%|████████▊ | 33311/37963 [142:50:30<20:43:08, 16.03s/it]
 88%|████████▊ | 33312/37963 [142:50:51<22:38:37, 17.53s/it]
 88%|████████▊ | 33313/37963 [142:51:05<21:26:33, 16.60s/it]
 88%|████████▊ | 33314/37963 [142:51:19<20:26:07, 15.82s/it]
 88%|████████▊ | 33315/37963 [142:51:34<19:52:53, 15.40s/it]
 88%|████████▊ | 33316/37963 [142:51:48<19:27:30, 15.07s/it]
 88%|████████▊ | 33317/37963 [142:52:02<19:08:34, 14.83s/it]
 88%|████████▊ | 33318/37963 [142:52:17<18:57:31, 14.69s/it]
 88%|████████▊ | 33319/37963 [142:52:30<18:36:33, 14.43s/it]
 88%|████████▊ | 33320/37963 [142:52:45<18:32:14, 14.37s/it]
                                                            
{'loss': '0.06733', 'grad_norm': '2.955', 'learning_rate': '7.746e-07', 'epoch': '0.8777'}

 88%|████████▊ | 33320/37963 [142:52:45<18:32:14, 14.37s/it]
 88%|████████▊ | 33321/37963 [142:52:59<18:32:07, 14.37s/it]
 88%|████████▊ | 33322/37963 [142:53:14<18:36:21, 14.43s/it]
 88%|████████▊ | 33323/37963 [142:53:28<18:35:05, 14.42s/it]
 88%|████████▊ | 33324/37963 [142:53:42<18:28:47, 14.34s/it]
 88%|████████▊ | 33325/37963 [142:54:03<21:07:50, 16.40s/it]
 88%|████████▊ | 33326/37963 [142:54:17<20:12:42, 15.69s/it]
 88%|████████▊ | 33327/37963 [142:54:32<19:36:29, 15.23s/it]
 88%|████████▊ | 33328/37963 [142:54:46<19:20:43, 15.03s/it]
 88%|████████▊ | 33329/37963 [142:55:00<19:04:31, 14.82s/it]
 88%|████████▊ | 33330/37963 [142:55:15<18:55:10, 14.70s/it]
                                                            
{'loss': '0.08172', 'grad_norm': '2.799', 'learning_rate': '7.714e-07', 'epoch': '0.878'}

 88%|████████▊ | 33330/37963 [142:55:15<18:55:10, 14.70s/it]
 88%|████████▊ | 33331/37963 [142:55:29<18:48:51, 14.62s/it]
 88%|████████▊ | 33332/37963 [142:55:50<20:58:19, 16.30s/it]
 88%|████████▊ | 33333/37963 [142:56:04<20:15:55, 15.76s/it]
 88%|████████▊ | 33334/37963 [142:56:18<19:43:38, 15.34s/it]
 88%|████████▊ | 33335/37963 [142:56:39<21:55:43, 17.06s/it]
 88%|████████▊ | 33336/37963 [142:56:54<20:54:08, 16.26s/it]
 88%|████████▊ | 33337/37963 [142:57:08<20:05:21, 15.63s/it]
 88%|████████▊ | 33338/37963 [142:57:22<19:37:50, 15.28s/it]
 88%|████████▊ | 33339/37963 [142:57:37<19:17:00, 15.01s/it]
 88%|████████▊ | 33340/37963 [142:57:51<19:06:20, 14.88s/it]
                                                            
{'loss': '0.07237', 'grad_norm': '2.469', 'learning_rate': '7.681e-07', 'epoch': '0.8782'}

 88%|████████▊ | 33340/37963 [142:57:51<19:06:20, 14.88s/it]
 88%|████████▊ | 33341/37963 [142:58:06<18:56:23, 14.75s/it]
 88%|████████▊ | 33342/37963 [142:58:20<18:35:32, 14.48s/it]
 88%|████████▊ | 33343/37963 [142:58:34<18:31:39, 14.44s/it]
 88%|████████▊ | 33344/37963 [142:58:48<18:29:55, 14.42s/it]
 88%|████████▊ | 33345/37963 [142:59:03<18:24:51, 14.36s/it]
 88%|████████▊ | 33346/37963 [142:59:17<18:25:58, 14.37s/it]
 88%|████████▊ | 33347/37963 [142:59:38<20:56:04, 16.33s/it]
 88%|████████▊ | 33348/37963 [142:59:52<20:12:58, 15.77s/it]
 88%|████████▊ | 33349/37963 [143:00:07<19:41:35, 15.37s/it]
 88%|████████▊ | 33350/37963 [143:00:21<19:20:58, 15.10s/it]
                                                            
{'loss': '0.07959', 'grad_norm': '3.024', 'learning_rate': '7.648e-07', 'epoch': '0.8785'}

 88%|████████▊ | 33350/37963 [143:00:21<19:20:58, 15.10s/it]
 88%|████████▊ | 33351/37963 [143:00:36<19:03:44, 14.88s/it]
 88%|████████▊ | 33352/37963 [143:00:50<18:52:31, 14.74s/it]
 88%|████████▊ | 33353/37963 [143:01:04<18:42:58, 14.62s/it]
 88%|████████▊ | 33354/37963 [143:01:19<18:33:07, 14.49s/it]
 88%|████████▊ | 33355/37963 [143:01:40<21:07:03, 16.50s/it]
 88%|████████▊ | 33356/37963 [143:02:01<22:45:22, 17.78s/it]
 88%|████████▊ | 33357/37963 [143:02:15<21:27:42, 16.77s/it]
 88%|████████▊ | 33358/37963 [143:02:36<22:59:55, 17.98s/it]
 88%|████████▊ | 33359/37963 [143:02:50<21:36:21, 16.89s/it]
 88%|████████▊ | 33360/37963 [143:03:05<20:36:44, 16.12s/it]
                                                            
{'loss': '0.0639', 'grad_norm': '2.567', 'learning_rate': '7.615e-07', 'epoch': '0.8788'}

 88%|████████▊ | 33360/37963 [143:03:05<20:36:44, 16.12s/it]
 88%|████████▊ | 33361/37963 [143:03:26<22:29:20, 17.59s/it]
 88%|████████▊ | 33362/37963 [143:03:40<21:10:35, 16.57s/it]
 88%|████████▊ | 33363/37963 [143:03:54<20:19:56, 15.91s/it]
 88%|████████▊ | 33364/37963 [143:04:08<19:44:23, 15.45s/it]
 88%|████████▊ | 33365/37963 [143:04:22<19:08:40, 14.99s/it]
 88%|████████▊ | 33366/37963 [143:04:37<18:51:40, 14.77s/it]
 88%|████████▊ | 33367/37963 [143:04:51<18:43:12, 14.66s/it]
 88%|████████▊ | 33368/37963 [143:05:05<18:34:30, 14.55s/it]
 88%|████████▊ | 33369/37963 [143:05:20<18:31:51, 14.52s/it]
 88%|████████▊ | 33370/37963 [143:05:34<18:27:49, 14.47s/it]
                                                            
{'loss': '0.06656', 'grad_norm': '4.944', 'learning_rate': '7.583e-07', 'epoch': '0.879'}

 88%|████████▊ | 33370/37963 [143:05:34<18:27:49, 14.47s/it]
 88%|████████▊ | 33371/37963 [143:05:48<18:15:38, 14.32s/it]
 88%|████████▊ | 33372/37963 [143:06:02<18:16:48, 14.33s/it]
 88%|████████▊ | 33373/37963 [143:06:17<18:19:04, 14.37s/it]
 88%|████████▊ | 33374/37963 [143:06:37<20:39:30, 16.21s/it]
 88%|████████▊ | 33375/37963 [143:06:52<19:53:15, 15.60s/it]
 88%|████████▊ | 33376/37963 [143:07:06<19:24:28, 15.23s/it]
 88%|████████▊ | 33377/37963 [143:07:20<19:07:26, 15.01s/it]
 88%|████████▊ | 33378/37963 [143:07:35<18:51:47, 14.81s/it]
 88%|████████▊ | 33379/37963 [143:07:49<18:40:58, 14.67s/it]
 88%|████████▊ | 33380/37963 [143:08:03<18:25:00, 14.47s/it]
                                                            
{'loss': '0.06959', 'grad_norm': '2.966', 'learning_rate': '7.55e-07', 'epoch': '0.8793'}

 88%|████████▊ | 33380/37963 [143:08:03<18:25:00, 14.47s/it]
 88%|████████▊ | 33381/37963 [143:08:24<20:57:06, 16.46s/it]
 88%|████████▊ | 33382/37963 [143:08:39<20:08:53, 15.83s/it]
 88%|████████▊ | 33383/37963 [143:08:53<19:35:43, 15.40s/it]
 88%|████████▊ | 33384/37963 [143:09:14<21:47:15, 17.13s/it]
 88%|████████▊ | 33385/37963 [143:09:28<20:36:24, 16.20s/it]
 88%|████████▊ | 33386/37963 [143:09:43<19:53:07, 15.64s/it]
 88%|████████▊ | 33387/37963 [143:09:57<19:23:41, 15.26s/it]
 88%|████████▊ | 33388/37963 [143:10:11<19:03:56, 15.00s/it]
 88%|████████▊ | 33389/37963 [143:10:26<18:52:24, 14.85s/it]
 88%|████████▊ | 33390/37963 [143:10:40<18:41:30, 14.71s/it]
                                                            
{'loss': '0.06811', 'grad_norm': '2.668', 'learning_rate': '7.518e-07', 'epoch': '0.8795'}

 88%|████████▊ | 33390/37963 [143:10:40<18:41:30, 14.71s/it]
 88%|████████▊ | 33391/37963 [143:10:55<18:34:58, 14.63s/it]
 88%|████████▊ | 33392/37963 [143:11:09<18:30:08, 14.57s/it]
 88%|████████▊ | 33393/37963 [143:11:23<18:19:25, 14.43s/it]
 88%|████████▊ | 33394/37963 [143:11:38<18:18:06, 14.42s/it]
 88%|████████▊ | 33395/37963 [143:11:58<20:39:47, 16.28s/it]
 88%|████████▊ | 33396/37963 [143:12:12<19:50:29, 15.64s/it]
 88%|████████▊ | 33397/37963 [143:12:26<19:07:07, 15.07s/it]
 88%|████████▊ | 33398/37963 [143:12:40<18:45:01, 14.79s/it]
 88%|████████▊ | 33399/37963 [143:12:55<18:34:24, 14.65s/it]
 88%|████████▊ | 33400/37963 [143:13:09<18:19:42, 14.46s/it]
                                                            
{'loss': '0.06017', 'grad_norm': '2.409', 'learning_rate': '7.485e-07', 'epoch': '0.8798'}

 88%|████████▊ | 33400/37963 [143:13:09<18:19:42, 14.46s/it]
 88%|████████▊ | 33401/37963 [143:13:23<18:16:26, 14.42s/it]
 88%|████████▊ | 33402/37963 [143:13:37<18:14:01, 14.39s/it]
 88%|████████▊ | 33403/37963 [143:13:58<20:46:08, 16.40s/it]
 88%|████████▊ | 33404/37963 [143:14:18<22:09:12, 17.49s/it]
 88%|████████▊ | 33405/37963 [143:14:33<20:58:43, 16.57s/it]
 88%|████████▊ | 33406/37963 [143:14:53<22:20:08, 17.65s/it]
 88%|████████▊ | 33407/37963 [143:15:07<21:06:11, 16.68s/it]
 88%|████████▊ | 33408/37963 [143:15:22<20:13:16, 15.98s/it]
 88%|████████▊ | 33409/37963 [143:15:36<19:38:54, 15.53s/it]
 88%|████████▊ | 33410/37963 [143:15:51<19:13:35, 15.20s/it]
                                                            
{'loss': '0.07624', 'grad_norm': '3.676', 'learning_rate': '7.453e-07', 'epoch': '0.8801'}

 88%|████████▊ | 33410/37963 [143:15:51<19:13:35, 15.20s/it]
 88%|████████▊ | 33411/37963 [143:16:12<21:23:13, 16.91s/it]
 88%|████████▊ | 33412/37963 [143:16:26<20:24:11, 16.14s/it]
 88%|████████▊ | 33413/37963 [143:16:40<19:46:53, 15.65s/it]
 88%|████████▊ | 33414/37963 [143:16:55<19:20:00, 15.30s/it]
 88%|████████▊ | 33415/37963 [143:17:09<19:00:34, 15.05s/it]
 88%|████████▊ | 33416/37963 [143:17:24<18:42:03, 14.81s/it]
 88%|████████▊ | 33417/37963 [143:17:38<18:30:45, 14.66s/it]
 88%|████████▊ | 33418/37963 [143:17:52<18:23:15, 14.56s/it]
 88%|████████▊ | 33419/37963 [143:18:07<18:19:33, 14.52s/it]
 88%|████████▊ | 33420/37963 [143:18:21<18:11:46, 14.42s/it]
                                                            
{'loss': '0.06725', 'grad_norm': '3.073', 'learning_rate': '7.421e-07', 'epoch': '0.8803'}

 88%|████████▊ | 33420/37963 [143:18:21<18:11:46, 14.42s/it]
 88%|████████▊ | 33421/37963 [143:18:35<18:10:35, 14.41s/it]
 88%|████████▊ | 33422/37963 [143:18:50<18:10:32, 14.41s/it]
 88%|████████▊ | 33423/37963 [143:19:04<18:09:46, 14.40s/it]
 88%|████████▊ | 33424/37963 [143:19:25<20:43:46, 16.44s/it]
 88%|████████▊ | 33425/37963 [143:19:40<19:58:17, 15.84s/it]
 88%|████████▊ | 33426/37963 [143:19:54<19:17:02, 15.30s/it]
 88%|████████▊ | 33427/37963 [143:20:08<18:59:00, 15.07s/it]
 88%|████████▊ | 33428/37963 [143:20:28<20:50:15, 16.54s/it]
 88%|████████▊ | 33429/37963 [143:20:43<20:02:36, 15.91s/it]
 88%|████████▊ | 33430/37963 [143:20:57<19:27:32, 15.45s/it]
                                                            
{'loss': '0.07761', 'grad_norm': '2.74', 'learning_rate': '7.388e-07', 'epoch': '0.8806'}

 88%|████████▊ | 33430/37963 [143:20:57<19:27:32, 15.45s/it]
 88%|████████▊ | 33431/37963 [143:21:11<19:03:18, 15.14s/it]
 88%|████████▊ | 33432/37963 [143:21:26<18:45:19, 14.90s/it]
 88%|████████▊ | 33433/37963 [143:21:47<21:08:07, 16.80s/it]
 88%|████████▊ | 33434/37963 [143:22:01<20:14:43, 16.09s/it]
 88%|████████▊ | 33435/37963 [143:22:16<19:35:27, 15.58s/it]
 88%|████████▊ | 33436/37963 [143:22:30<19:07:37, 15.21s/it]
 88%|████████▊ | 33437/37963 [143:22:44<18:39:29, 14.84s/it]
 88%|████████▊ | 33438/37963 [143:22:58<18:20:59, 14.60s/it]
 88%|████████▊ | 33439/37963 [143:23:12<18:11:42, 14.48s/it]
 88%|████████▊ | 33440/37963 [143:23:27<18:09:00, 14.45s/it]
                                                            
{'loss': '0.07361', 'grad_norm': '2.569', 'learning_rate': '7.356e-07', 'epoch': '0.8809'}

 88%|████████▊ | 33440/37963 [143:23:27<18:09:00, 14.45s/it]
 88%|████████▊ | 33441/37963 [143:23:41<17:57:21, 14.29s/it]
 88%|████████▊ | 33442/37963 [143:23:55<17:58:00, 14.31s/it]
 88%|████████▊ | 33443/37963 [143:24:16<20:24:48, 16.26s/it]
 88%|████████▊ | 33444/37963 [143:24:30<19:29:48, 15.53s/it]
 88%|████████▊ | 33445/37963 [143:24:44<19:04:22, 15.20s/it]
 88%|████████▊ | 33446/37963 [143:24:59<18:47:30, 14.98s/it]
 88%|████████▊ | 33447/37963 [143:25:13<18:29:45, 14.74s/it]
 88%|████████▊ | 33448/37963 [143:25:26<18:06:11, 14.43s/it]
 88%|████████▊ | 33449/37963 [143:25:41<18:05:16, 14.43s/it]
 88%|████████▊ | 33450/37963 [143:25:55<18:02:16, 14.39s/it]
                                                            
{'loss': '0.0651', 'grad_norm': '2.474', 'learning_rate': '7.324e-07', 'epoch': '0.8811'}

 88%|████████▊ | 33450/37963 [143:25:55<18:02:16, 14.39s/it]
 88%|████████▊ | 33451/37963 [143:26:09<17:58:01, 14.34s/it]
 88%|████████▊ | 33452/37963 [143:26:30<20:24:43, 16.29s/it]
 88%|████████▊ | 33453/37963 [143:26:52<22:20:56, 17.84s/it]
 88%|████████▊ | 33454/37963 [143:27:06<20:50:04, 16.63s/it]
 88%|████████▊ | 33455/37963 [143:27:20<19:59:50, 15.97s/it]
 88%|████████▊ | 33456/37963 [143:27:41<21:50:47, 17.45s/it]
 88%|████████▊ | 33457/37963 [143:27:55<20:41:34, 16.53s/it]
 88%|████████▊ | 33458/37963 [143:28:10<19:51:36, 15.87s/it]
 88%|████████▊ | 33459/37963 [143:28:24<19:16:20, 15.40s/it]
 88%|████████▊ | 33460/37963 [143:28:38<18:54:59, 15.12s/it]
                                                            
{'loss': '0.06431', 'grad_norm': '2.757', 'learning_rate': '7.292e-07', 'epoch': '0.8814'}

 88%|████████▊ | 33460/37963 [143:28:38<18:54:59, 15.12s/it]
 88%|████████▊ | 33461/37963 [143:28:59<21:09:58, 16.93s/it]
 88%|████████▊ | 33462/37963 [143:29:14<20:07:51, 16.10s/it]
 88%|████████▊ | 33463/37963 [143:29:28<19:27:14, 15.56s/it]
 88%|████████▊ | 33464/37963 [143:29:42<18:58:49, 15.19s/it]
 88%|████████▊ | 33465/37963 [143:29:57<18:40:02, 14.94s/it]
 88%|████████▊ | 33466/37963 [143:30:11<18:26:50, 14.77s/it]
 88%|████████▊ | 33467/37963 [143:30:26<18:22:02, 14.71s/it]
 88%|████████▊ | 33468/37963 [143:30:40<18:13:51, 14.60s/it]
 88%|████████▊ | 33469/37963 [143:30:54<18:10:26, 14.56s/it]
 88%|████████▊ | 33470/37963 [143:31:09<18:06:17, 14.51s/it]
                                                            
{'loss': '0.06923', 'grad_norm': '2.894', 'learning_rate': '7.26e-07', 'epoch': '0.8817'}

 88%|████████▊ | 33470/37963 [143:31:09<18:06:17, 14.51s/it]
 88%|████████▊ | 33471/37963 [143:31:23<18:03:05, 14.47s/it]
 88%|████████▊ | 33472/37963 [143:31:44<20:16:50, 16.26s/it]
 88%|████████▊ | 33473/37963 [143:31:58<19:36:20, 15.72s/it]
 88%|████████▊ | 33474/37963 [143:32:12<19:06:30, 15.32s/it]
 88%|████████▊ | 33475/37963 [143:32:26<18:37:21, 14.94s/it]
 88%|████████▊ | 33476/37963 [143:32:41<18:23:35, 14.76s/it]
 88%|████████▊ | 33477/37963 [143:32:55<18:14:10, 14.63s/it]
 88%|████████▊ | 33478/37963 [143:33:16<20:32:10, 16.48s/it]
 88%|████████▊ | 33479/37963 [143:33:30<19:37:47, 15.76s/it]
 88%|████████▊ | 33480/37963 [143:33:44<18:59:38, 15.25s/it]
                                                            
{'loss': '0.08088', 'grad_norm': '2.77', 'learning_rate': '7.228e-07', 'epoch': '0.8819'}

 88%|████████▊ | 33480/37963 [143:33:44<18:59:38, 15.25s/it]
 88%|████████▊ | 33481/37963 [143:34:05<20:59:17, 16.86s/it]
 88%|████████▊ | 33482/37963 [143:34:18<19:45:38, 15.88s/it]
 88%|████████▊ | 33483/37963 [143:34:33<19:08:50, 15.39s/it]
 88%|████████▊ | 33484/37963 [143:34:47<18:43:01, 15.04s/it]
 88%|████████▊ | 33485/37963 [143:35:01<18:27:26, 14.84s/it]
 88%|████████▊ | 33486/37963 [143:35:16<18:18:08, 14.72s/it]
 88%|████████▊ | 33487/37963 [143:35:30<18:11:26, 14.63s/it]
 88%|████████▊ | 33488/37963 [143:35:44<18:07:33, 14.58s/it]
 88%|████████▊ | 33489/37963 [143:35:59<17:55:05, 14.42s/it]
 88%|████████▊ | 33490/37963 [143:36:13<17:45:32, 14.29s/it]
                                                            
{'loss': '0.07995', 'grad_norm': '3.457', 'learning_rate': '7.196e-07', 'epoch': '0.8822'}

 88%|████████▊ | 33490/37963 [143:36:13<17:45:32, 14.29s/it]
 88%|████████▊ | 33491/37963 [143:36:27<17:46:39, 14.31s/it]
 88%|████████▊ | 33492/37963 [143:36:48<20:11:40, 16.26s/it]
 88%|████████▊ | 33493/37963 [143:37:02<19:30:24, 15.71s/it]
 88%|████████▊ | 33494/37963 [143:37:17<19:01:31, 15.33s/it]
 88%|████████▊ | 33495/37963 [143:37:31<18:42:28, 15.07s/it]
 88%|████████▊ | 33496/37963 [143:37:45<18:23:13, 14.82s/it]
 88%|████████▊ | 33497/37963 [143:38:00<18:11:45, 14.67s/it]
 88%|████████▊ | 33498/37963 [143:38:14<18:05:03, 14.58s/it]
 88%|████████▊ | 33499/37963 [143:38:28<17:59:14, 14.51s/it]
 88%|████████▊ | 33500/37963 [143:38:43<17:55:43, 14.46s/it]
                                                            
{'loss': '0.05442', 'grad_norm': '3.807', 'learning_rate': '7.165e-07', 'epoch': '0.8824'}

 88%|████████▊ | 33500/37963 [143:38:43<17:55:43, 14.46s/it]
 88%|████████▊ | 33501/37963 [143:39:10<22:41:22, 18.31s/it]
 88%|████████▊ | 33502/37963 [143:39:24<21:16:14, 17.17s/it]
 88%|████████▊ | 33503/37963 [143:39:39<20:16:30, 16.37s/it]
 88%|████████▊ | 33504/37963 [143:39:53<19:32:45, 15.78s/it]
 88%|████████▊ | 33505/37963 [143:40:14<21:18:29, 17.21s/it]
 88%|████████▊ | 33506/37963 [143:40:28<20:14:46, 16.35s/it]
 88%|████████▊ | 33507/37963 [143:40:42<19:26:04, 15.70s/it]
 88%|████████▊ | 33508/37963 [143:40:57<18:58:02, 15.33s/it]
 88%|████████▊ | 33509/37963 [143:41:11<18:35:31, 15.03s/it]
 88%|████████▊ | 33510/37963 [143:41:32<20:53:56, 16.90s/it]
                                                            
{'loss': '0.07751', 'grad_norm': '2.91', 'learning_rate': '7.133e-07', 'epoch': '0.8827'}

 88%|████████▊ | 33510/37963 [143:41:32<20:53:56, 16.90s/it]
 88%|████████▊ | 33511/37963 [143:41:47<19:57:45, 16.14s/it]
 88%|████████▊ | 33512/37963 [143:42:01<19:05:31, 15.44s/it]
 88%|████████▊ | 33513/37963 [143:42:15<18:41:45, 15.12s/it]
 88%|████████▊ | 33514/37963 [143:42:29<18:15:52, 14.78s/it]
 88%|████████▊ | 33515/37963 [143:42:43<18:08:05, 14.68s/it]
 88%|████████▊ | 33516/37963 [143:42:58<17:57:31, 14.54s/it]
 88%|████████▊ | 33517/37963 [143:43:12<17:54:05, 14.50s/it]
 88%|████████▊ | 33518/37963 [143:43:26<17:51:23, 14.46s/it]
 88%|████████▊ | 33519/37963 [143:43:41<17:48:40, 14.43s/it]
 88%|████████▊ | 33520/37963 [143:43:55<17:42:47, 14.35s/it]
                                                            
{'loss': '0.07054', 'grad_norm': '3.4', 'learning_rate': '7.101e-07', 'epoch': '0.883'}

 88%|████████▊ | 33520/37963 [143:43:55<17:42:47, 14.35s/it]
 88%|████████▊ | 33521/37963 [143:44:09<17:42:54, 14.36s/it]
 88%|████████▊ | 33522/37963 [143:44:31<20:29:21, 16.61s/it]
 88%|████████▊ | 33523/37963 [143:44:46<19:39:17, 15.94s/it]
 88%|████████▊ | 33524/37963 [143:45:00<19:06:37, 15.50s/it]
 88%|████████▊ | 33525/37963 [143:45:14<18:42:41, 15.18s/it]
 88%|████████▊ | 33526/37963 [143:45:29<18:26:34, 14.96s/it]
 88%|████████▊ | 33527/37963 [143:45:50<20:38:36, 16.75s/it]
 88%|████████▊ | 33528/37963 [143:46:04<19:44:56, 16.03s/it]
 88%|████████▊ | 33529/37963 [143:46:19<19:08:05, 15.54s/it]
 88%|████████▊ | 33530/37963 [143:46:40<21:13:20, 17.23s/it]
                                                            
{'loss': '0.07597', 'grad_norm': '2.976', 'learning_rate': '7.07e-07', 'epoch': '0.8832'}

 88%|████████▊ | 33530/37963 [143:46:40<21:13:20, 17.23s/it]
 88%|████████▊ | 33531/37963 [143:46:54<20:12:23, 16.41s/it]
 88%|████████▊ | 33532/37963 [143:47:09<19:28:38, 15.82s/it]
 88%|████████▊ | 33533/37963 [143:47:23<18:56:18, 15.39s/it]
 88%|████████▊ | 33534/37963 [143:47:37<18:25:26, 14.98s/it]
 88%|████████▊ | 33535/37963 [143:47:52<18:15:01, 14.84s/it]
 88%|████████▊ | 33536/37963 [143:48:05<17:48:15, 14.48s/it]
 88%|████████▊ | 33537/37963 [143:48:19<17:37:04, 14.33s/it]
 88%|████████▊ | 33538/37963 [143:48:34<17:36:48, 14.33s/it]
 88%|████████▊ | 33539/37963 [143:48:48<17:37:25, 14.34s/it]
 88%|████████▊ | 33540/37963 [143:49:02<17:30:42, 14.25s/it]
                                                            
{'loss': '0.06693', 'grad_norm': '3.063', 'learning_rate': '7.038e-07', 'epoch': '0.8835'}

 88%|████████▊ | 33540/37963 [143:49:02<17:30:42, 14.25s/it]
 88%|████████▊ | 33541/37963 [143:49:23<19:54:44, 16.21s/it]
 88%|████████▊ | 33542/37963 [143:49:37<19:14:51, 15.67s/it]
 88%|████████▊ | 33543/37963 [143:49:51<18:38:24, 15.18s/it]
 88%|████████▊ | 33544/37963 [143:50:05<18:11:27, 14.82s/it]
 88%|████████▊ | 33545/37963 [143:50:20<18:01:12, 14.68s/it]
 88%|████████▊ | 33546/37963 [143:50:34<17:46:34, 14.49s/it]
 88%|████████▊ | 33547/37963 [143:50:48<17:46:16, 14.49s/it]
 88%|████████▊ | 33548/37963 [143:51:02<17:38:16, 14.38s/it]
 88%|████████▊ | 33549/37963 [143:51:16<17:34:57, 14.34s/it]
 88%|████████▊ | 33550/37963 [143:51:37<19:57:54, 16.29s/it]
                                                            
{'loss': '0.0741', 'grad_norm': '2.767', 'learning_rate': '7.007e-07', 'epoch': '0.8838'}

 88%|████████▊ | 33550/37963 [143:51:38<19:57:54, 16.29s/it]
 88%|████████▊ | 33551/37963 [143:51:58<21:46:11, 17.76s/it]
 88%|████████▊ | 33552/37963 [143:52:13<20:31:00, 16.74s/it]
 88%|████████▊ | 33553/37963 [143:52:34<22:01:41, 17.98s/it]
 88%|████████▊ | 33554/37963 [143:52:48<20:34:54, 16.81s/it]
 88%|████████▊ | 33555/37963 [143:53:02<19:29:38, 15.92s/it]
 88%|████████▊ | 33556/37963 [143:53:15<18:43:27, 15.30s/it]
 88%|████████▊ | 33557/37963 [143:53:30<18:21:44, 15.00s/it]
 88%|████████▊ | 33558/37963 [143:53:44<18:06:44, 14.80s/it]
 88%|████████▊ | 33559/37963 [143:54:05<20:27:57, 16.73s/it]
 88%|████████▊ | 33560/37963 [143:54:20<19:43:24, 16.13s/it]
                                                            
{'loss': '0.06802', 'grad_norm': '2.713', 'learning_rate': '6.976e-07', 'epoch': '0.884'}

 88%|████████▊ | 33560/37963 [143:54:20<19:43:24, 16.13s/it]
 88%|████████▊ | 33561/37963 [143:54:34<19:03:47, 15.59s/it]
 88%|████████▊ | 33562/37963 [143:54:49<18:38:43, 15.25s/it]
 88%|████████▊ | 33563/37963 [143:55:03<18:16:09, 14.95s/it]
 88%|████████▊ | 33564/37963 [143:55:17<17:52:16, 14.63s/it]
 88%|████████▊ | 33565/37963 [143:55:31<17:45:27, 14.54s/it]
 88%|████████▊ | 33566/37963 [143:55:46<17:40:14, 14.47s/it]
 88%|████████▊ | 33567/37963 [143:56:00<17:40:33, 14.48s/it]
 88%|████████▊ | 33568/37963 [143:56:14<17:37:46, 14.44s/it]
 88%|████████▊ | 33569/37963 [143:56:29<17:36:20, 14.42s/it]
 88%|████████▊ | 33570/37963 [143:56:50<20:08:30, 16.51s/it]
                                                            
{'loss': '0.05726', 'grad_norm': '4.315', 'learning_rate': '6.944e-07', 'epoch': '0.8843'}

 88%|████████▊ | 33570/37963 [143:56:50<20:08:30, 16.51s/it]
 88%|████████▊ | 33571/37963 [143:57:05<19:20:18, 15.85s/it]
 88%|████████▊ | 33572/37963 [143:57:19<18:47:30, 15.41s/it]
 88%|████████▊ | 33573/37963 [143:57:33<18:24:54, 15.10s/it]
 88%|████████▊ | 33574/37963 [143:57:48<18:09:16, 14.89s/it]
 88%|████████▊ | 33575/37963 [143:58:09<20:22:10, 16.71s/it]
 88%|████████▊ | 33576/37963 [143:58:23<19:31:18, 16.02s/it]
 88%|████████▊ | 33577/37963 [143:58:37<18:41:19, 15.34s/it]
 88%|████████▊ | 33578/37963 [143:58:58<20:43:50, 17.02s/it]
 88%|████████▊ | 33579/37963 [143:59:12<19:45:52, 16.23s/it]
 88%|████████▊ | 33580/37963 [143:59:27<19:08:53, 15.73s/it]
                                                            
{'loss': '0.06908', 'grad_norm': '2.364', 'learning_rate': '6.913e-07', 'epoch': '0.8845'}

 88%|████████▊ | 33580/37963 [143:59:27<19:08:53, 15.73s/it]
 88%|████████▊ | 33581/37963 [143:59:41<18:39:19, 15.33s/it]
 88%|████████▊ | 33582/37963 [143:59:55<18:14:01, 14.98s/it]
 88%|████████▊ | 33583/37963 [144:00:10<18:00:01, 14.79s/it]
 88%|████████▊ | 33584/37963 [144:00:24<17:51:32, 14.68s/it]
 88%|████████▊ | 33585/37963 [144:00:38<17:44:44, 14.59s/it]
 88%|████████▊ | 33586/37963 [144:00:53<17:39:14, 14.52s/it]
 88%|████████▊ | 33587/37963 [144:01:07<17:36:10, 14.48s/it]
 88%|████████▊ | 33588/37963 [144:01:22<17:33:32, 14.45s/it]
 88%|████████▊ | 33589/37963 [144:01:42<19:53:54, 16.38s/it]
 88%|████████▊ | 33590/37963 [144:01:57<19:11:17, 15.80s/it]
                                                            
{'loss': '0.06714', 'grad_norm': '3.928', 'learning_rate': '6.882e-07', 'epoch': '0.8848'}

 88%|████████▊ | 33590/37963 [144:01:57<19:11:17, 15.80s/it]
 88%|████████▊ | 33591/37963 [144:02:11<18:32:57, 15.27s/it]
 88%|████████▊ | 33592/37963 [144:02:25<18:16:11, 15.05s/it]
 88%|████████▊ | 33593/37963 [144:02:39<17:53:07, 14.73s/it]
 88%|████████▊ | 33594/37963 [144:02:54<17:46:05, 14.64s/it]
 88%|████████▊ | 33595/37963 [144:03:08<17:42:32, 14.60s/it]
 88%|████████▊ | 33596/37963 [144:03:23<17:37:20, 14.53s/it]
 88%|████████▊ | 33597/37963 [144:03:37<17:37:39, 14.53s/it]
 89%|████████▊ | 33598/37963 [144:03:52<17:35:14, 14.51s/it]
 89%|████████▊ | 33599/37963 [144:04:06<17:31:28, 14.46s/it]
 89%|████████▊ | 33600/37963 [144:04:34<22:22:07, 18.46s/it]
                                                            
{'loss': '0.07081', 'grad_norm': '2.98', 'learning_rate': '6.851e-07', 'epoch': '0.8851'}

 89%|████████▊ | 33600/37963 [144:04:34<22:22:07, 18.46s/it]
 89%|████████▊ | 33601/37963 [144:04:55<23:19:21, 19.25s/it]
 89%|████████▊ | 33602/37963 [144:05:09<21:32:45, 17.79s/it]
 89%|████████▊ | 33603/37963 [144:05:23<20:03:44, 16.57s/it]
 89%|████████▊ | 33604/37963 [144:05:37<19:12:42, 15.87s/it]
 89%|████████▊ | 33605/37963 [144:05:51<18:29:24, 15.27s/it]
 89%|████████▊ | 33606/37963 [144:06:06<18:09:16, 15.00s/it]
 89%|████████▊ | 33607/37963 [144:06:27<20:31:41, 16.97s/it]
 89%|████████▊ | 33608/37963 [144:06:41<19:29:59, 16.12s/it]
 89%|████████▊ | 33609/37963 [144:06:56<18:55:23, 15.65s/it]
 89%|████████▊ | 33610/37963 [144:07:10<18:27:59, 15.27s/it]
                                                            
{'loss': '0.06227', 'grad_norm': '1.993', 'learning_rate': '6.82e-07', 'epoch': '0.8853'}

 89%|████████▊ | 33610/37963 [144:07:10<18:27:59, 15.27s/it]
 89%|████████▊ | 33611/37963 [144:07:24<17:55:28, 14.83s/it]
 89%|████████▊ | 33612/37963 [144:07:38<17:47:23, 14.72s/it]
 89%|████████▊ | 33613/37963 [144:07:53<17:42:28, 14.65s/it]
 89%|████████▊ | 33614/37963 [144:08:07<17:35:31, 14.56s/it]
 89%|████████▊ | 33615/37963 [144:08:22<17:32:08, 14.52s/it]
 89%|████████▊ | 33616/37963 [144:08:36<17:27:35, 14.46s/it]
 89%|████████▊ | 33617/37963 [144:08:50<17:27:40, 14.46s/it]
 89%|████████▊ | 33618/37963 [144:09:05<17:24:56, 14.43s/it]
 89%|████████▊ | 33619/37963 [144:09:19<17:22:59, 14.41s/it]
 89%|████████▊ | 33620/37963 [144:09:40<19:38:26, 16.28s/it]
                                                            
{'loss': '0.07229', 'grad_norm': '3.218', 'learning_rate': '6.789e-07', 'epoch': '0.8856'}

 89%|████████▊ | 33620/37963 [144:09:40<19:38:26, 16.28s/it]
 89%|████████▊ | 33621/37963 [144:10:00<21:10:41, 17.56s/it]
 89%|████████▊ | 33622/37963 [144:10:14<19:51:54, 16.47s/it]
 89%|████████▊ | 33623/37963 [144:10:28<18:58:30, 15.74s/it]
 89%|████████▊ | 33624/37963 [144:10:43<18:29:51, 15.35s/it]
 89%|████████▊ | 33625/37963 [144:10:57<18:06:35, 15.03s/it]
 89%|████████▊ | 33626/37963 [144:11:18<20:14:03, 16.80s/it]
 89%|████████▊ | 33627/37963 [144:11:32<19:22:58, 16.09s/it]
 89%|████████▊ | 33628/37963 [144:11:47<18:43:26, 15.55s/it]
 89%|████████▊ | 33629/37963 [144:12:01<18:13:37, 15.14s/it]
 89%|████████▊ | 33630/37963 [144:12:15<17:49:25, 14.81s/it]
                                                            
{'loss': '0.08031', 'grad_norm': '3.311', 'learning_rate': '6.758e-07', 'epoch': '0.8859'}

 89%|████████▊ | 33630/37963 [144:12:15<17:49:25, 14.81s/it]
 89%|████████▊ | 33631/37963 [144:12:29<17:39:46, 14.68s/it]
 89%|████████▊ | 33632/37963 [144:12:43<17:19:51, 14.41s/it]
 89%|████████▊ | 33633/37963 [144:12:58<17:20:50, 14.42s/it]
 89%|████████▊ | 33634/37963 [144:13:12<17:20:54, 14.43s/it]
 89%|████████▊ | 33635/37963 [144:13:26<17:20:25, 14.42s/it]
 89%|████████▊ | 33636/37963 [144:13:41<17:20:40, 14.43s/it]
 89%|████████▊ | 33637/37963 [144:13:55<17:19:13, 14.41s/it]
 89%|████████▊ | 33638/37963 [144:14:16<19:46:00, 16.45s/it]
 89%|████████▊ | 33639/37963 [144:14:30<18:48:32, 15.66s/it]
 89%|████████▊ | 33640/37963 [144:14:45<18:19:55, 15.27s/it]
                                                            
{'loss': '0.07496', 'grad_norm': '3.509', 'learning_rate': '6.727e-07', 'epoch': '0.8861'}

 89%|████████▊ | 33640/37963 [144:14:45<18:19:55, 15.27s/it]
 89%|████████▊ | 33641/37963 [144:14:59<18:04:12, 15.05s/it]
 89%|████████▊ | 33642/37963 [144:15:14<17:50:01, 14.86s/it]
 89%|████████▊ | 33643/37963 [144:15:28<17:39:03, 14.71s/it]
 89%|████████▊ | 33644/37963 [144:15:42<17:28:20, 14.56s/it]
 89%|████████▊ | 33645/37963 [144:15:57<17:24:48, 14.52s/it]
 89%|████████▊ | 33646/37963 [144:16:11<17:21:45, 14.48s/it]
 89%|████████▊ | 33647/37963 [144:16:25<17:08:35, 14.30s/it]
 89%|████████▊ | 33648/37963 [144:16:52<21:45:06, 18.15s/it]
 89%|████████▊ | 33649/37963 [144:17:12<22:31:38, 18.80s/it]
 89%|████████▊ | 33650/37963 [144:17:26<20:45:56, 17.33s/it]
                                                            
{'loss': '0.07336', 'grad_norm': '2.636', 'learning_rate': '6.697e-07', 'epoch': '0.8864'}

 89%|████████▊ | 33650/37963 [144:17:26<20:45:56, 17.33s/it]
 89%|████████▊ | 33651/37963 [144:17:41<19:50:56, 16.57s/it]
 89%|████████▊ | 33652/37963 [144:17:55<19:06:53, 15.96s/it]
 89%|████████▊ | 33653/37963 [144:18:10<18:34:30, 15.52s/it]
 89%|████████▊ | 33654/37963 [144:18:24<18:09:49, 15.18s/it]
 89%|████████▊ | 33655/37963 [144:18:39<17:53:14, 14.95s/it]
 89%|████████▊ | 33656/37963 [144:19:00<20:16:37, 16.95s/it]
 89%|████████▊ | 33657/37963 [144:19:15<19:19:19, 16.15s/it]
 89%|████████▊ | 33658/37963 [144:19:29<18:36:19, 15.56s/it]
 89%|████████▊ | 33659/37963 [144:19:43<18:07:39, 15.16s/it]
 89%|████████▊ | 33660/37963 [144:19:58<17:52:02, 14.95s/it]
                                                            
{'loss': '0.06913', 'grad_norm': '3.67', 'learning_rate': '6.666e-07', 'epoch': '0.8867'}

 89%|████████▊ | 33660/37963 [144:19:58<17:52:02, 14.95s/it]
 89%|████████▊ | 33661/37963 [144:20:11<17:23:13, 14.55s/it]
 89%|████████▊ | 33662/37963 [144:20:26<17:19:13, 14.50s/it]
 89%|████████▊ | 33663/37963 [144:20:40<17:17:48, 14.48s/it]
 89%|████████▊ | 33664/37963 [144:20:54<17:14:42, 14.44s/it]
 89%|████████▊ | 33665/37963 [144:21:09<17:11:26, 14.40s/it]
 89%|████████▊ | 33666/37963 [144:21:23<17:11:20, 14.40s/it]
 89%|████████▊ | 33667/37963 [144:21:37<17:04:05, 14.30s/it]
 89%|████████▊ | 33668/37963 [144:21:58<19:34:57, 16.41s/it]
 89%|████████▊ | 33669/37963 [144:22:13<18:52:18, 15.82s/it]
 89%|████████▊ | 33670/37963 [144:22:27<18:20:00, 15.37s/it]
                                                            
{'loss': '0.06278', 'grad_norm': '1.761', 'learning_rate': '6.635e-07', 'epoch': '0.8869'}

 89%|████████▊ | 33670/37963 [144:22:27<18:20:00, 15.37s/it]
 89%|████████▊ | 33671/37963 [144:22:42<17:59:42, 15.09s/it]
 89%|████████▊ | 33672/37963 [144:23:03<20:06:27, 16.87s/it]
 89%|████████▊ | 33673/37963 [144:23:17<19:14:08, 16.14s/it]
 89%|████████▊ | 33674/37963 [144:23:31<18:35:30, 15.61s/it]
 89%|████████▊ | 33675/37963 [144:23:53<20:32:28, 17.25s/it]
 89%|████████▊ | 33676/37963 [144:24:06<19:19:24, 16.23s/it]
 89%|████████▊ | 33677/37963 [144:24:21<18:39:36, 15.67s/it]
 89%|████████▊ | 33678/37963 [144:24:35<18:12:49, 15.30s/it]
 89%|████████▊ | 33679/37963 [144:24:50<17:53:31, 15.04s/it]
 89%|████████▊ | 33680/37963 [144:25:04<17:39:26, 14.84s/it]
                                                            
{'loss': '0.06737', 'grad_norm': '4.317', 'learning_rate': '6.605e-07', 'epoch': '0.8872'}

 89%|████████▊ | 33680/37963 [144:25:04<17:39:26, 14.84s/it]
 89%|████████▊ | 33681/37963 [144:25:18<17:30:55, 14.73s/it]
 89%|████████▊ | 33682/37963 [144:25:33<17:22:09, 14.61s/it]
 89%|████████▊ | 33683/37963 [144:25:47<17:18:54, 14.56s/it]
 89%|████████▊ | 33684/37963 [144:26:01<17:11:10, 14.46s/it]
 89%|████████▊ | 33685/37963 [144:26:16<17:15:57, 14.53s/it]
 89%|████████▊ | 33686/37963 [144:26:31<17:13:20, 14.50s/it]
 89%|████████▊ | 33687/37963 [144:26:51<19:22:36, 16.31s/it]
 89%|████████▊ | 33688/37963 [144:27:06<18:42:48, 15.76s/it]
 89%|████████▊ | 33689/37963 [144:27:20<18:13:07, 15.35s/it]
 89%|████████▊ | 33690/37963 [144:27:34<17:47:59, 15.00s/it]
                                                            
{'loss': '0.07181', 'grad_norm': '2.798', 'learning_rate': '6.574e-07', 'epoch': '0.8874'}

 89%|████████▊ | 33690/37963 [144:27:34<17:47:59, 15.00s/it]
 89%|████████▊ | 33691/37963 [144:27:48<17:16:36, 14.56s/it]
 89%|████████▊ | 33692/37963 [144:28:01<16:58:00, 14.30s/it]
 89%|████████▉ | 33693/37963 [144:28:16<16:57:50, 14.30s/it]
 89%|████████▉ | 33694/37963 [144:28:30<16:58:59, 14.32s/it]
 89%|████████▉ | 33695/37963 [144:28:44<16:55:46, 14.28s/it]
 89%|████████▉ | 33696/37963 [144:29:05<19:20:22, 16.32s/it]
 89%|████████▉ | 33697/37963 [144:29:26<21:01:21, 17.74s/it]
 89%|████████▉ | 33698/37963 [144:29:41<19:51:05, 16.76s/it]
 89%|████████▉ | 33699/37963 [144:29:55<19:00:27, 16.05s/it]
 89%|████████▉ | 33700/37963 [144:30:16<20:41:04, 17.47s/it]
                                                            
{'loss': '0.0653', 'grad_norm': '4.004', 'learning_rate': '6.544e-07', 'epoch': '0.8877'}

 89%|████████▉ | 33700/37963 [144:30:16<20:41:04, 17.47s/it]
 89%|████████▉ | 33701/37963 [144:30:30<19:31:03, 16.49s/it]
 89%|████████▉ | 33702/37963 [144:30:45<18:49:31, 15.91s/it]
 89%|████████▉ | 33703/37963 [144:30:59<18:16:40, 15.45s/it]
 89%|████████▉ | 33704/37963 [144:31:20<20:12:10, 17.08s/it]
 89%|████████▉ | 33705/37963 [144:31:34<19:13:11, 16.25s/it]
 89%|████████▉ | 33706/37963 [144:31:49<18:33:40, 15.70s/it]
 89%|████████▉ | 33707/37963 [144:32:03<17:57:18, 15.19s/it]
 89%|████████▉ | 33708/37963 [144:32:17<17:40:10, 14.95s/it]
 89%|████████▉ | 33709/37963 [144:32:31<17:23:24, 14.72s/it]
 89%|████████▉ | 33710/37963 [144:32:46<17:15:49, 14.61s/it]
                                                            
{'loss': '0.05621', 'grad_norm': '2.7', 'learning_rate': '6.514e-07', 'epoch': '0.888'}

 89%|████████▉ | 33710/37963 [144:32:46<17:15:49, 14.61s/it]
 89%|████████▉ | 33711/37963 [144:33:01<17:20:36, 14.68s/it]
 89%|████████▉ | 33712/37963 [144:33:15<17:13:41, 14.59s/it]
 89%|████████▉ | 33713/37963 [144:33:29<16:54:51, 14.33s/it]
 89%|████████▉ | 33714/37963 [144:33:43<16:58:00, 14.38s/it]
 89%|████████▉ | 33715/37963 [144:33:57<16:57:12, 14.37s/it]
 89%|████████▉ | 33716/37963 [144:34:12<16:59:38, 14.41s/it]
 89%|████████▉ | 33717/37963 [144:34:33<19:25:45, 16.47s/it]
 89%|████████▉ | 33718/37963 [144:34:48<18:41:03, 15.85s/it]
 89%|████████▉ | 33719/37963 [144:35:02<18:09:02, 15.40s/it]
 89%|████████▉ | 33720/37963 [144:35:16<17:46:54, 15.09s/it]
                                                            
{'loss': '0.07243', 'grad_norm': '3.021', 'learning_rate': '6.483e-07', 'epoch': '0.8882'}

 89%|████████▉ | 33720/37963 [144:35:16<17:46:54, 15.09s/it]
 89%|████████▉ | 33721/37963 [144:35:31<17:32:06, 14.88s/it]
 89%|████████▉ | 33722/37963 [144:35:52<19:36:47, 16.65s/it]
 89%|████████▉ | 33723/37963 [144:36:12<21:01:08, 17.85s/it]
 89%|████████▉ | 33724/37963 [144:36:26<19:45:36, 16.78s/it]
 89%|████████▉ | 33725/37963 [144:36:40<18:42:22, 15.89s/it]
 89%|████████▉ | 33726/37963 [144:36:55<18:13:35, 15.49s/it]
 89%|████████▉ | 33727/37963 [144:37:09<17:51:02, 15.17s/it]
 89%|████████▉ | 33728/37963 [144:37:24<17:35:58, 14.96s/it]
 89%|████████▉ | 33729/37963 [144:37:38<17:24:50, 14.81s/it]
 89%|████████▉ | 33730/37963 [144:37:53<17:16:12, 14.69s/it]
                                                            
{'loss': '0.05902', 'grad_norm': '2.423', 'learning_rate': '6.453e-07', 'epoch': '0.8885'}

 89%|████████▉ | 33730/37963 [144:37:53<17:16:12, 14.69s/it]
 89%|████████▉ | 33731/37963 [144:38:07<17:10:53, 14.62s/it]
 89%|████████▉ | 33732/37963 [144:38:21<17:05:13, 14.54s/it]
 89%|████████▉ | 33733/37963 [144:38:36<16:57:45, 14.44s/it]
 89%|████████▉ | 33734/37963 [144:38:50<16:56:01, 14.42s/it]
 89%|████████▉ | 33735/37963 [144:39:11<19:12:46, 16.36s/it]
 89%|████████▉ | 33736/37963 [144:39:25<18:31:30, 15.78s/it]
 89%|████████▉ | 33737/37963 [144:39:40<18:00:59, 15.35s/it]
 89%|████████▉ | 33738/37963 [144:39:54<17:39:58, 15.05s/it]
 89%|████████▉ | 33739/37963 [144:40:08<17:22:27, 14.81s/it]
 89%|████████▉ | 33740/37963 [144:40:23<17:12:58, 14.68s/it]
                                                            
{'loss': '0.07109', 'grad_norm': '2.982', 'learning_rate': '6.423e-07', 'epoch': '0.8888'}

 89%|████████▉ | 33740/37963 [144:40:23<17:12:58, 14.68s/it]
 89%|████████▉ | 33741/37963 [144:40:37<17:02:09, 14.53s/it]
 89%|████████▉ | 33742/37963 [144:40:51<16:58:06, 14.47s/it]
 89%|████████▉ | 33743/37963 [144:41:05<16:55:13, 14.43s/it]
 89%|████████▉ | 33744/37963 [144:41:20<16:53:36, 14.41s/it]
 89%|████████▉ | 33745/37963 [144:41:48<21:52:28, 18.67s/it]
 89%|████████▉ | 33746/37963 [144:42:03<20:19:37, 17.35s/it]
 89%|████████▉ | 33747/37963 [144:42:17<19:12:00, 16.39s/it]
 89%|████████▉ | 33748/37963 [144:42:31<18:19:49, 15.66s/it]
 89%|████████▉ | 33749/37963 [144:42:45<17:53:07, 15.28s/it]
 89%|████████▉ | 33750/37963 [144:43:06<19:42:53, 16.85s/it]
                                                            
{'loss': '0.07008', 'grad_norm': '3.658', 'learning_rate': '6.393e-07', 'epoch': '0.889'}

 89%|████████▉ | 33750/37963 [144:43:06<19:42:53, 16.85s/it]
 89%|████████▉ | 33751/37963 [144:43:20<18:51:22, 16.12s/it]
 89%|████████▉ | 33752/37963 [144:43:34<17:59:11, 15.38s/it]
 89%|████████▉ | 33753/37963 [144:43:55<20:03:26, 17.15s/it]
 89%|████████▉ | 33754/37963 [144:44:08<18:42:17, 16.00s/it]
 89%|████████▉ | 33755/37963 [144:44:23<18:11:53, 15.57s/it]
 89%|████████▉ | 33756/37963 [144:44:37<17:41:52, 15.14s/it]
 89%|████████▉ | 33757/37963 [144:44:51<17:25:27, 14.91s/it]
 89%|████████▉ | 33758/37963 [144:45:06<17:14:20, 14.76s/it]
 89%|████████▉ | 33759/37963 [144:45:20<17:05:17, 14.63s/it]
 89%|████████▉ | 33760/37963 [144:45:35<16:59:26, 14.55s/it]
                                                            
{'loss': '0.06811', 'grad_norm': '2.642', 'learning_rate': '6.363e-07', 'epoch': '0.8893'}

 89%|████████▉ | 33760/37963 [144:45:35<16:59:26, 14.55s/it]
 89%|████████▉ | 33761/37963 [144:45:49<16:59:36, 14.56s/it]
 89%|████████▉ | 33762/37963 [144:46:04<16:57:00, 14.53s/it]
 89%|████████▉ | 33763/37963 [144:46:18<16:54:16, 14.49s/it]
 89%|████████▉ | 33764/37963 [144:46:32<16:49:12, 14.42s/it]
 89%|████████▉ | 33765/37963 [144:46:54<19:17:38, 16.55s/it]
 89%|████████▉ | 33766/37963 [144:47:08<18:35:09, 15.94s/it]
 89%|████████▉ | 33767/37963 [144:47:23<18:00:08, 15.45s/it]
 89%|████████▉ | 33768/37963 [144:47:37<17:34:59, 15.09s/it]
 89%|████████▉ | 33769/37963 [144:47:58<19:40:57, 16.89s/it]
 89%|████████▉ | 33770/37963 [144:48:12<18:44:36, 16.09s/it]
                                                            
{'loss': '0.06708', 'grad_norm': '5.703', 'learning_rate': '6.333e-07', 'epoch': '0.8896'}

 89%|████████▉ | 33770/37963 [144:48:12<18:44:36, 16.09s/it]
 89%|████████▉ | 33771/37963 [144:48:26<17:51:56, 15.34s/it]
 89%|████████▉ | 33772/37963 [144:48:47<19:45:58, 16.98s/it]
 89%|████████▉ | 33773/37963 [144:49:01<18:43:12, 16.08s/it]
 89%|████████▉ | 33774/37963 [144:49:15<18:03:51, 15.52s/it]
 89%|████████▉ | 33775/37963 [144:49:29<17:41:20, 15.21s/it]
 89%|████████▉ | 33776/37963 [144:49:44<17:24:25, 14.97s/it]
 89%|████████▉ | 33777/37963 [144:49:58<17:11:15, 14.78s/it]
 89%|████████▉ | 33778/37963 [144:50:12<17:02:31, 14.66s/it]
 89%|████████▉ | 33779/37963 [144:50:26<16:49:02, 14.47s/it]
 89%|████████▉ | 33780/37963 [144:50:41<16:46:02, 14.43s/it]
                                                            
{'loss': '0.06499', 'grad_norm': '2.945', 'learning_rate': '6.303e-07', 'epoch': '0.8898'}

 89%|████████▉ | 33780/37963 [144:50:41<16:46:02, 14.43s/it]
 89%|████████▉ | 33781/37963 [144:50:55<16:48:09, 14.46s/it]
 89%|████████▉ | 33782/37963 [144:51:10<16:45:26, 14.43s/it]
 89%|████████▉ | 33783/37963 [144:51:24<16:45:11, 14.43s/it]
 89%|████████▉ | 33784/37963 [144:51:38<16:37:32, 14.32s/it]
 89%|████████▉ | 33785/37963 [144:51:59<18:55:01, 16.30s/it]
 89%|████████▉ | 33786/37963 [144:52:13<18:15:09, 15.73s/it]
 89%|████████▉ | 33787/37963 [144:52:28<17:46:42, 15.33s/it]
 89%|████████▉ | 33788/37963 [144:52:42<17:26:11, 15.04s/it]
 89%|████████▉ | 33789/37963 [144:52:56<17:09:18, 14.80s/it]
 89%|████████▉ | 33790/37963 [144:53:11<16:54:59, 14.59s/it]
                                                            
{'loss': '0.06581', 'grad_norm': '3.28', 'learning_rate': '6.274e-07', 'epoch': '0.8901'}

 89%|████████▉ | 33790/37963 [144:53:11<16:54:59, 14.59s/it]
 89%|████████▉ | 33791/37963 [144:53:25<16:50:26, 14.53s/it]
 89%|████████▉ | 33792/37963 [144:53:39<16:45:24, 14.46s/it]
 89%|████████▉ | 33793/37963 [144:54:00<18:53:56, 16.32s/it]
 89%|████████▉ | 33794/37963 [144:54:20<20:18:22, 17.53s/it]
 89%|████████▉ | 33795/37963 [144:54:35<19:12:02, 16.58s/it]
 89%|████████▉ | 33796/37963 [144:54:49<18:26:26, 15.93s/it]
 89%|████████▉ | 33797/37963 [144:55:03<17:50:59, 15.42s/it]
 89%|████████▉ | 33798/37963 [144:55:23<19:28:57, 16.84s/it]
 89%|████████▉ | 33799/37963 [144:55:38<18:37:36, 16.10s/it]
 89%|████████▉ | 33800/37963 [144:55:52<18:02:50, 15.61s/it]
                                                            
{'loss': '0.06389', 'grad_norm': '2.398', 'learning_rate': '6.244e-07', 'epoch': '0.8903'}

 89%|████████▉ | 33800/37963 [144:55:52<18:02:50, 15.61s/it]
 89%|████████▉ | 33801/37963 [144:56:14<20:10:26, 17.45s/it]
 89%|████████▉ | 33802/37963 [144:56:28<19:06:20, 16.53s/it]
 89%|████████▉ | 33803/37963 [144:56:42<18:07:23, 15.68s/it]
 89%|████████▉ | 33804/37963 [144:56:56<17:31:50, 15.17s/it]
 89%|████████▉ | 33805/37963 [144:57:10<17:10:31, 14.87s/it]
 89%|████████▉ | 33806/37963 [144:57:25<16:59:29, 14.71s/it]
 89%|████████▉ | 33807/37963 [144:57:39<16:52:18, 14.61s/it]
 89%|████████▉ | 33808/37963 [144:57:53<16:39:30, 14.43s/it]
 89%|████████▉ | 33809/37963 [144:58:07<16:37:33, 14.41s/it]
 89%|████████▉ | 33810/37963 [144:58:21<16:30:26, 14.31s/it]
                                                            
{'loss': '0.06669', 'grad_norm': '3.622', 'learning_rate': '6.214e-07', 'epoch': '0.8906'}

 89%|████████▉ | 33810/37963 [144:58:21<16:30:26, 14.31s/it]
 89%|████████▉ | 33811/37963 [144:58:35<16:13:25, 14.07s/it]
 89%|████████▉ | 33812/37963 [144:58:49<16:23:03, 14.21s/it]
 89%|████████▉ | 33813/37963 [144:59:04<16:28:53, 14.30s/it]
 89%|████████▉ | 33814/37963 [144:59:25<18:55:55, 16.43s/it]
 89%|████████▉ | 33815/37963 [144:59:40<18:13:01, 15.81s/it]
 89%|████████▉ | 33816/37963 [144:59:54<17:42:14, 15.37s/it]
 89%|████████▉ | 33817/37963 [145:00:08<17:22:29, 15.09s/it]
 89%|████████▉ | 33818/37963 [145:00:29<19:18:01, 16.76s/it]
 89%|████████▉ | 33819/37963 [145:00:43<18:20:49, 15.94s/it]
 89%|████████▉ | 33820/37963 [145:00:57<17:47:25, 15.46s/it]
                                                            
{'loss': '0.06868', 'grad_norm': '2.61', 'learning_rate': '6.185e-07', 'epoch': '0.8909'}

 89%|████████▉ | 33820/37963 [145:00:57<17:47:25, 15.46s/it]
 89%|████████▉ | 33821/37963 [145:01:18<19:26:46, 16.90s/it]
 89%|████████▉ | 33822/37963 [145:01:32<18:34:21, 16.15s/it]
 89%|████████▉ | 33823/37963 [145:01:46<17:48:36, 15.49s/it]
 89%|████████▉ | 33824/37963 [145:02:01<17:26:29, 15.17s/it]
 89%|████████▉ | 33825/37963 [145:02:15<17:08:36, 14.91s/it]
 89%|████████▉ | 33826/37963 [145:02:29<16:48:13, 14.62s/it]
 89%|████████▉ | 33827/37963 [145:02:43<16:41:34, 14.53s/it]
 89%|████████▉ | 33828/37963 [145:02:57<16:30:48, 14.38s/it]
 89%|████████▉ | 33829/37963 [145:03:11<16:20:22, 14.23s/it]
 89%|████████▉ | 33830/37963 [145:03:25<16:24:55, 14.30s/it]
                                                            
{'loss': '0.06557', 'grad_norm': '2.814', 'learning_rate': '6.155e-07', 'epoch': '0.8911'}

 89%|████████▉ | 33830/37963 [145:03:25<16:24:55, 14.30s/it]
 89%|████████▉ | 33831/37963 [145:03:40<16:27:34, 14.34s/it]
 89%|████████▉ | 33832/37963 [145:03:54<16:29:53, 14.38s/it]
 89%|████████▉ | 33833/37963 [145:04:09<16:29:31, 14.38s/it]
 89%|████████▉ | 33834/37963 [145:04:29<18:28:35, 16.11s/it]
 89%|████████▉ | 33835/37963 [145:04:43<17:53:38, 15.61s/it]
 89%|████████▉ | 33836/37963 [145:04:58<17:29:07, 15.25s/it]
 89%|████████▉ | 33837/37963 [145:05:12<17:13:27, 15.03s/it]
 89%|████████▉ | 33838/37963 [145:05:27<16:58:38, 14.82s/it]
 89%|████████▉ | 33839/37963 [145:05:41<16:50:37, 14.70s/it]
 89%|████████▉ | 33840/37963 [145:05:55<16:42:59, 14.60s/it]
                                                            
{'loss': '0.07151', 'grad_norm': '3.495', 'learning_rate': '6.126e-07', 'epoch': '0.8914'}

 89%|████████▉ | 33840/37963 [145:05:55<16:42:59, 14.60s/it]
 89%|████████▉ | 33841/37963 [145:06:10<16:39:41, 14.55s/it]
 89%|████████▉ | 33842/37963 [145:06:31<18:56:29, 16.55s/it]
 89%|████████▉ | 33843/37963 [145:06:45<18:13:31, 15.93s/it]
 89%|████████▉ | 33844/37963 [145:07:00<17:41:41, 15.47s/it]
 89%|████████▉ | 33845/37963 [145:07:14<17:15:57, 15.09s/it]
 89%|████████▉ | 33846/37963 [145:07:35<19:17:35, 16.87s/it]
 89%|████████▉ | 33847/37963 [145:07:56<20:30:17, 17.93s/it]
 89%|████████▉ | 33848/37963 [145:08:10<19:16:00, 16.86s/it]
 89%|████████▉ | 33849/37963 [145:08:31<20:50:35, 18.24s/it]
 89%|████████▉ | 33850/37963 [145:08:46<19:31:39, 17.09s/it]
                                                            
{'loss': '0.08024', 'grad_norm': '3.334', 'learning_rate': '6.096e-07', 'epoch': '0.8917'}

 89%|████████▉ | 33850/37963 [145:08:46<19:31:39, 17.09s/it]
 89%|████████▉ | 33851/37963 [145:09:00<18:33:48, 16.25s/it]
 89%|████████▉ | 33852/37963 [145:09:14<17:53:52, 15.67s/it]
 89%|████████▉ | 33853/37963 [145:09:28<17:16:30, 15.13s/it]
 89%|████████▉ | 33854/37963 [145:09:42<16:52:39, 14.79s/it]
 89%|████████▉ | 33855/37963 [145:09:57<16:43:49, 14.66s/it]
 89%|████████▉ | 33856/37963 [145:10:11<16:30:35, 14.47s/it]
 89%|████████▉ | 33857/37963 [145:10:25<16:27:47, 14.43s/it]
 89%|████████▉ | 33858/37963 [145:10:39<16:23:58, 14.38s/it]
 89%|████████▉ | 33859/37963 [145:10:53<16:17:10, 14.29s/it]
 89%|████████▉ | 33860/37963 [145:11:07<16:11:23, 14.21s/it]
                                                            
{'loss': '0.06771', 'grad_norm': '2.511', 'learning_rate': '6.067e-07', 'epoch': '0.8919'}

 89%|████████▉ | 33860/37963 [145:11:07<16:11:23, 14.21s/it]
 89%|████████▉ | 33861/37963 [145:11:22<16:15:24, 14.27s/it]
 89%|████████▉ | 33862/37963 [145:11:36<16:19:46, 14.33s/it]
 89%|████████▉ | 33863/37963 [145:11:57<18:33:38, 16.30s/it]
 89%|████████▉ | 33864/37963 [145:12:11<17:54:07, 15.72s/it]
 89%|████████▉ | 33865/37963 [145:12:26<17:25:02, 15.30s/it]
 89%|████████▉ | 33866/37963 [145:12:40<16:58:05, 14.91s/it]
 89%|████████▉ | 33867/37963 [145:12:54<16:47:01, 14.75s/it]
 89%|████████▉ | 33868/37963 [145:13:15<18:47:35, 16.52s/it]
 89%|████████▉ | 33869/37963 [145:13:36<20:16:23, 17.83s/it]
 89%|████████▉ | 33870/37963 [145:13:50<19:07:18, 16.82s/it]
                                                            
{'loss': '0.07397', 'grad_norm': '3.126', 'learning_rate': '6.038e-07', 'epoch': '0.8922'}

 89%|████████▉ | 33870/37963 [145:13:50<19:07:18, 16.82s/it]
 89%|████████▉ | 33871/37963 [145:14:05<18:18:54, 16.11s/it]
 89%|████████▉ | 33872/37963 [145:14:19<17:37:02, 15.50s/it]
 89%|████████▉ | 33873/37963 [145:14:33<17:14:14, 15.17s/it]
 89%|████████▉ | 33874/37963 [145:14:47<16:45:09, 14.75s/it]
 89%|████████▉ | 33875/37963 [145:15:01<16:34:42, 14.60s/it]
 89%|████████▉ | 33876/37963 [145:15:15<16:28:41, 14.51s/it]
 89%|████████▉ | 33877/37963 [145:15:29<16:18:57, 14.38s/it]
 89%|████████▉ | 33878/37963 [145:15:44<16:13:48, 14.30s/it]
 89%|████████▉ | 33879/37963 [145:15:58<16:15:47, 14.34s/it]
 89%|████████▉ | 33880/37963 [145:16:12<16:16:57, 14.36s/it]
                                                            
{'loss': '0.06258', 'grad_norm': '2.96', 'learning_rate': '6.009e-07', 'epoch': '0.8925'}

 89%|████████▉ | 33880/37963 [145:16:12<16:16:57, 14.36s/it]
 89%|████████▉ | 33881/37963 [145:16:27<16:21:55, 14.43s/it]
 89%|████████▉ | 33882/37963 [145:16:48<18:33:46, 16.38s/it]
 89%|████████▉ | 33883/37963 [145:17:02<17:53:30, 15.79s/it]
 89%|████████▉ | 33884/37963 [145:17:16<17:16:28, 15.25s/it]
 89%|████████▉ | 33885/37963 [145:17:31<17:00:02, 15.01s/it]
 89%|████████▉ | 33886/37963 [145:17:45<16:47:34, 14.83s/it]
 89%|████████▉ | 33887/37963 [145:17:59<16:32:44, 14.61s/it]
 89%|████████▉ | 33888/37963 [145:18:13<16:21:40, 14.45s/it]
 89%|████████▉ | 33889/37963 [145:18:28<16:23:04, 14.48s/it]
 89%|████████▉ | 33890/37963 [145:18:42<16:18:38, 14.42s/it]
                                                            
{'loss': '0.06708', 'grad_norm': '2.917', 'learning_rate': '5.98e-07', 'epoch': '0.8927'}

 89%|████████▉ | 33890/37963 [145:18:42<16:18:38, 14.42s/it]
 89%|████████▉ | 33891/37963 [145:19:03<18:35:21, 16.43s/it]
 89%|████████▉ | 33892/37963 [145:19:17<17:47:19, 15.73s/it]
 89%|████████▉ | 33893/37963 [145:19:31<17:09:50, 15.18s/it]
 89%|████████▉ | 33894/37963 [145:19:59<21:15:26, 18.81s/it]
 89%|████████▉ | 33895/37963 [145:20:13<19:42:48, 17.45s/it]
 89%|████████▉ | 33896/37963 [145:20:27<18:39:44, 16.52s/it]
 89%|████████▉ | 33897/37963 [145:20:42<17:56:51, 15.89s/it]
 89%|████████▉ | 33898/37963 [145:21:03<19:44:14, 17.48s/it]
 89%|████████▉ | 33899/37963 [145:21:17<18:33:42, 16.44s/it]
 89%|████████▉ | 33900/37963 [145:21:31<17:40:21, 15.66s/it]
                                                            
{'loss': '0.06274', 'grad_norm': '2.048', 'learning_rate': '5.951e-07', 'epoch': '0.893'}

 89%|████████▉ | 33900/37963 [145:21:31<17:40:21, 15.66s/it]
 89%|████████▉ | 33901/37963 [145:21:45<17:13:41, 15.27s/it]
 89%|████████▉ | 33902/37963 [145:21:59<16:41:40, 14.80s/it]
 89%|████████▉ | 33903/37963 [145:22:13<16:33:04, 14.68s/it]
 89%|████████▉ | 33904/37963 [145:22:27<16:25:45, 14.57s/it]
 89%|████████▉ | 33905/37963 [145:22:42<16:21:45, 14.52s/it]
 89%|████████▉ | 33906/37963 [145:22:56<16:15:02, 14.42s/it]
 89%|████████▉ | 33907/37963 [145:23:10<16:09:09, 14.34s/it]
 89%|████████▉ | 33908/37963 [145:23:25<16:10:40, 14.36s/it]
 89%|████████▉ | 33909/37963 [145:23:39<16:07:30, 14.32s/it]
 89%|████████▉ | 33910/37963 [145:23:53<16:09:50, 14.36s/it]
                                                            
{'loss': '0.06192', 'grad_norm': '2.134', 'learning_rate': '5.922e-07', 'epoch': '0.8932'}

 89%|████████▉ | 33910/37963 [145:23:53<16:09:50, 14.36s/it]
 89%|████████▉ | 33911/37963 [145:24:08<16:09:27, 14.36s/it]
 89%|████████▉ | 33912/37963 [145:24:29<18:28:55, 16.42s/it]
 89%|████████▉ | 33913/37963 [145:24:43<17:47:01, 15.81s/it]
 89%|████████▉ | 33914/37963 [145:24:58<17:18:46, 15.39s/it]
 89%|████████▉ | 33915/37963 [145:25:19<19:11:32, 17.07s/it]
 89%|████████▉ | 33916/37963 [145:25:40<20:28:38, 18.22s/it]
 89%|████████▉ | 33917/37963 [145:25:54<19:11:00, 17.07s/it]
 89%|████████▉ | 33918/37963 [145:26:08<18:16:01, 16.26s/it]
 89%|████████▉ | 33919/37963 [145:26:22<17:21:05, 15.45s/it]
 89%|████████▉ | 33920/37963 [145:26:36<16:57:25, 15.10s/it]
                                                            
{'loss': '0.06401', 'grad_norm': '3.133', 'learning_rate': '5.893e-07', 'epoch': '0.8935'}

 89%|████████▉ | 33920/37963 [145:26:36<16:57:25, 15.10s/it]
 89%|████████▉ | 33921/37963 [145:26:51<16:44:01, 14.90s/it]
 89%|████████▉ | 33922/37963 [145:27:05<16:29:32, 14.69s/it]
 89%|████████▉ | 33923/37963 [145:27:19<16:15:50, 14.49s/it]
 89%|████████▉ | 33924/37963 [145:27:33<16:13:36, 14.46s/it]
 89%|████████▉ | 33925/37963 [145:27:48<16:12:20, 14.45s/it]
 89%|████████▉ | 33926/37963 [145:28:02<16:10:15, 14.42s/it]
 89%|████████▉ | 33927/37963 [145:28:16<16:06:46, 14.37s/it]
 89%|████████▉ | 33928/37963 [145:28:31<16:09:58, 14.42s/it]
 89%|████████▉ | 33929/37963 [145:28:45<16:05:19, 14.36s/it]
 89%|████████▉ | 33930/37963 [145:29:06<18:13:13, 16.26s/it]
                                                            
{'loss': '0.05752', 'grad_norm': '2.457', 'learning_rate': '5.864e-07', 'epoch': '0.8938'}

 89%|████████▉ | 33930/37963 [145:29:06<18:13:13, 16.26s/it]
 89%|████████▉ | 33931/37963 [145:29:20<17:35:13, 15.70s/it]
 89%|████████▉ | 33932/37963 [145:29:34<16:59:59, 15.18s/it]
 89%|████████▉ | 33933/37963 [145:29:48<16:42:49, 14.93s/it]
 89%|████████▉ | 33934/37963 [145:30:02<16:18:08, 14.57s/it]
 89%|████████▉ | 33935/37963 [145:30:16<16:13:34, 14.50s/it]
 89%|████████▉ | 33936/37963 [145:30:31<16:10:51, 14.47s/it]
 89%|████████▉ | 33937/37963 [145:30:45<16:11:50, 14.48s/it]
 89%|████████▉ | 33938/37963 [145:30:59<16:02:24, 14.35s/it]
 89%|████████▉ | 33939/37963 [145:31:14<16:04:16, 14.38s/it]
 89%|████████▉ | 33940/37963 [145:31:28<16:04:05, 14.38s/it]
                                                            
{'loss': '0.06214', 'grad_norm': '2.663', 'learning_rate': '5.835e-07', 'epoch': '0.894'}

 89%|████████▉ | 33940/37963 [145:31:28<16:04:05, 14.38s/it]
 89%|████████▉ | 33941/37963 [145:31:56<20:36:26, 18.45s/it]
 89%|████████▉ | 33942/37963 [145:32:11<19:16:16, 17.25s/it]
 89%|████████▉ | 33943/37963 [145:32:32<20:29:07, 18.35s/it]
 89%|████████▉ | 33944/37963 [145:32:46<19:03:07, 17.07s/it]
 89%|████████▉ | 33945/37963 [145:33:00<18:08:38, 16.26s/it]
 89%|████████▉ | 33946/37963 [145:33:14<17:31:25, 15.70s/it]
 89%|████████▉ | 33947/37963 [145:33:35<19:17:24, 17.29s/it]
 89%|████████▉ | 33948/37963 [145:33:50<18:18:40, 16.42s/it]
 89%|████████▉ | 33949/37963 [145:34:04<17:32:41, 15.74s/it]
 89%|████████▉ | 33950/37963 [145:34:18<17:05:39, 15.34s/it]
                                                            
{'loss': '0.06736', 'grad_norm': '2.851', 'learning_rate': '5.806e-07', 'epoch': '0.8943'}

 89%|████████▉ | 33950/37963 [145:34:18<17:05:39, 15.34s/it]
 89%|████████▉ | 33951/37963 [145:34:32<16:41:01, 14.97s/it]
 89%|████████▉ | 33952/37963 [145:34:47<16:27:44, 14.78s/it]
 89%|████████▉ | 33953/37963 [145:35:01<16:22:10, 14.70s/it]
 89%|████████▉ | 33954/37963 [145:35:16<16:18:15, 14.64s/it]
 89%|████████▉ | 33955/37963 [145:35:30<16:12:15, 14.55s/it]
 89%|████████▉ | 33956/37963 [145:35:45<16:08:31, 14.50s/it]
 89%|████████▉ | 33957/37963 [145:35:59<15:58:22, 14.35s/it]
 89%|████████▉ | 33958/37963 [145:36:13<15:55:40, 14.32s/it]
 89%|████████▉ | 33959/37963 [145:36:27<15:56:11, 14.33s/it]
 89%|████████▉ | 33960/37963 [145:36:41<15:54:49, 14.31s/it]
                                                            
{'loss': '0.06484', 'grad_norm': '1.578', 'learning_rate': '5.778e-07', 'epoch': '0.8946'}

 89%|████████▉ | 33960/37963 [145:36:41<15:54:49, 14.31s/it]
 89%|████████▉ | 33961/37963 [145:37:02<17:51:46, 16.07s/it]
 89%|████████▉ | 33962/37963 [145:37:23<19:38:15, 17.67s/it]
 89%|████████▉ | 33963/37963 [145:37:38<18:35:44, 16.74s/it]
 89%|████████▉ | 33964/37963 [145:37:51<17:39:30, 15.90s/it]
 89%|████████▉ | 33965/37963 [145:38:13<19:25:00, 17.48s/it]
 89%|████████▉ | 33966/37963 [145:38:27<18:16:30, 16.46s/it]
 89%|████████▉ | 33967/37963 [145:38:41<17:39:02, 15.90s/it]
 89%|████████▉ | 33968/37963 [145:38:56<17:08:49, 15.45s/it]
 89%|████████▉ | 33969/37963 [145:39:10<16:47:00, 15.13s/it]
 89%|████████▉ | 33970/37963 [145:39:24<16:26:19, 14.82s/it]
                                                            
{'loss': '0.05992', 'grad_norm': '2.771', 'learning_rate': '5.749e-07', 'epoch': '0.8948'}

 89%|████████▉ | 33970/37963 [145:39:24<16:26:19, 14.82s/it]
 89%|████████▉ | 33971/37963 [145:39:39<16:16:56, 14.68s/it]
 89%|████████▉ | 33972/37963 [145:39:53<16:11:13, 14.60s/it]
 89%|████████▉ | 33973/37963 [145:40:07<16:06:05, 14.53s/it]
 89%|████████▉ | 33974/37963 [145:40:22<16:06:42, 14.54s/it]
 89%|████████▉ | 33975/37963 [145:40:36<16:03:43, 14.50s/it]
 89%|████████▉ | 33976/37963 [145:40:51<16:02:13, 14.48s/it]
 90%|████████▉ | 33977/37963 [145:41:11<18:01:16, 16.28s/it]
 90%|████████▉ | 33978/37963 [145:41:25<17:17:36, 15.62s/it]
 90%|████████▉ | 33979/37963 [145:41:40<16:52:03, 15.24s/it]
 90%|████████▉ | 33980/37963 [145:41:54<16:35:21, 14.99s/it]
                                                            
{'loss': '0.06959', 'grad_norm': '4.581', 'learning_rate': '5.721e-07', 'epoch': '0.8951'}

 90%|████████▉ | 33980/37963 [145:41:54<16:35:21, 14.99s/it]
 90%|████████▉ | 33981/37963 [145:42:08<16:13:30, 14.67s/it]
 90%|████████▉ | 33982/37963 [145:42:23<16:11:20, 14.64s/it]
 90%|████████▉ | 33983/37963 [145:42:37<15:59:01, 14.46s/it]
 90%|████████▉ | 33984/37963 [145:42:51<15:58:43, 14.46s/it]
 90%|████████▉ | 33985/37963 [145:43:05<15:57:22, 14.44s/it]
 90%|████████▉ | 33986/37963 [145:43:20<15:58:24, 14.46s/it]
 90%|████████▉ | 33987/37963 [145:43:34<15:55:45, 14.42s/it]
 90%|████████▉ | 33988/37963 [145:43:49<15:54:37, 14.41s/it]
 90%|████████▉ | 33989/37963 [145:44:10<18:13:22, 16.51s/it]
 90%|████████▉ | 33990/37963 [145:44:24<17:14:33, 15.62s/it]
                                                            
{'loss': '0.06657', 'grad_norm': '2.684', 'learning_rate': '5.692e-07', 'epoch': '0.8953'}

 90%|████████▉ | 33990/37963 [145:44:24<17:14:33, 15.62s/it]
 90%|████████▉ | 33991/37963 [145:44:44<18:55:37, 17.15s/it]
 90%|████████▉ | 33992/37963 [145:45:05<20:08:59, 18.27s/it]
 90%|████████▉ | 33993/37963 [145:45:20<18:51:00, 17.09s/it]
 90%|████████▉ | 33994/37963 [145:45:34<17:49:49, 16.17s/it]
 90%|████████▉ | 33995/37963 [145:45:55<19:27:27, 17.65s/it]
 90%|████████▉ | 33996/37963 [145:46:09<18:21:19, 16.66s/it]
 90%|████████▉ | 33997/37963 [145:46:23<17:36:15, 15.98s/it]
 90%|████████▉ | 33998/37963 [145:46:38<17:03:24, 15.49s/it]
 90%|████████▉ | 33999/37963 [145:46:52<16:41:52, 15.16s/it]
 90%|████████▉ | 34000/37963 [145:47:06<16:14:03, 14.75s/it]
                                                            
{'loss': '0.06018', 'grad_norm': '2.281', 'learning_rate': '5.664e-07', 'epoch': '0.8956'}

 90%|████████▉ | 34000/37963 [145:47:06<16:14:03, 14.75s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.33s/it]
Writing model shards: 100%|██████████| 1/1 [00:15<00:00, 15.33s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 90%|████████▉ | 34001/37963 [145:48:53<46:51:46, 42.58s/it]
 90%|████████▉ | 34002/37963 [145:49:08<37:30:29, 34.09s/it]
 90%|████████▉ | 34003/37963 [145:49:22<31:00:13, 28.19s/it]
 90%|████████▉ | 34004/37963 [145:49:37<26:28:04, 24.07s/it]
 90%|████████▉ | 34005/37963 [145:49:51<23:15:52, 21.16s/it]
 90%|████████▉ | 34006/37963 [145:50:05<21:00:41, 19.12s/it]
 90%|████████▉ | 34007/37963 [145:50:20<19:30:21, 17.75s/it]
 90%|████████▉ | 34008/37963 [145:50:34<18:25:22, 16.77s/it]
 90%|████████▉ | 34009/37963 [145:50:55<19:47:17, 18.02s/it]
 90%|████████▉ | 34010/37963 [145:51:10<18:33:57, 16.91s/it]
                                                            
{'loss': '0.06756', 'grad_norm': '2.903', 'learning_rate': '5.636e-07', 'epoch': '0.8959'}

 90%|████████▉ | 34010/37963 [145:51:10<18:33:57, 16.91s/it]
 90%|████████▉ | 34011/37963 [145:51:31<20:02:26, 18.26s/it]
 90%|████████▉ | 34012/37963 [145:51:52<20:56:31, 19.08s/it]
 90%|████████▉ | 34013/37963 [145:52:06<19:12:05, 17.50s/it]
 90%|████████▉ | 34014/37963 [145:52:20<18:09:06, 16.55s/it]
 90%|████████▉ | 34015/37963 [145:52:35<17:25:23, 15.89s/it]
 90%|████████▉ | 34016/37963 [145:52:48<16:44:54, 15.28s/it]
 90%|████████▉ | 34017/37963 [145:53:03<16:26:51, 15.01s/it]
 90%|████████▉ | 34018/37963 [145:53:17<16:13:43, 14.81s/it]
 90%|████████▉ | 34019/37963 [145:53:31<16:02:03, 14.64s/it]
 90%|████████▉ | 34020/37963 [145:53:46<15:56:17, 14.55s/it]
                                                            
{'loss': '0.05554', 'grad_norm': '3.399', 'learning_rate': '5.608e-07', 'epoch': '0.8961'}

 90%|████████▉ | 34020/37963 [145:53:46<15:56:17, 14.55s/it]
 90%|████████▉ | 34021/37963 [145:54:00<15:46:22, 14.40s/it]
 90%|████████▉ | 34022/37963 [145:54:14<15:44:06, 14.37s/it]
 90%|████████▉ | 34023/37963 [145:54:28<15:44:22, 14.38s/it]
 90%|████████▉ | 34024/37963 [145:54:43<15:44:34, 14.39s/it]
 90%|████████▉ | 34025/37963 [145:55:04<17:50:46, 16.31s/it]
 90%|████████▉ | 34026/37963 [145:55:18<17:11:47, 15.72s/it]
 90%|████████▉ | 34027/37963 [145:55:32<16:40:25, 15.25s/it]
 90%|████████▉ | 34028/37963 [145:55:47<16:22:45, 14.99s/it]
 90%|████████▉ | 34029/37963 [145:56:01<16:09:52, 14.79s/it]
 90%|████████▉ | 34030/37963 [145:56:15<16:03:50, 14.70s/it]
                                                            
{'loss': '0.06159', 'grad_norm': '3.224', 'learning_rate': '5.58e-07', 'epoch': '0.8964'}

 90%|████████▉ | 34030/37963 [145:56:15<16:03:50, 14.70s/it]
 90%|████████▉ | 34031/37963 [145:56:30<15:59:04, 14.64s/it]
 90%|████████▉ | 34032/37963 [145:56:44<15:56:04, 14.59s/it]
 90%|████████▉ | 34033/37963 [145:56:58<15:40:51, 14.36s/it]
 90%|████████▉ | 34034/37963 [145:57:13<15:40:50, 14.37s/it]
 90%|████████▉ | 34035/37963 [145:57:27<15:40:48, 14.37s/it]
 90%|████████▉ | 34036/37963 [145:57:41<15:40:20, 14.37s/it]
 90%|████████▉ | 34037/37963 [145:57:56<15:40:27, 14.37s/it]
 90%|████████▉ | 34038/37963 [145:58:17<17:48:44, 16.34s/it]
 90%|████████▉ | 34039/37963 [145:58:31<17:10:19, 15.75s/it]
 90%|████████▉ | 34040/37963 [145:58:57<20:35:46, 18.90s/it]
                                                            
{'loss': '0.06466', 'grad_norm': '3.673', 'learning_rate': '5.551e-07', 'epoch': '0.8967'}

 90%|████████▉ | 34040/37963 [145:58:57<20:35:46, 18.90s/it]
 90%|████████▉ | 34041/37963 [145:59:12<19:07:08, 17.55s/it]
 90%|████████▉ | 34042/37963 [145:59:33<20:23:11, 18.72s/it]
 90%|████████▉ | 34043/37963 [145:59:47<18:58:25, 17.42s/it]
 90%|████████▉ | 34044/37963 [146:00:02<17:58:02, 16.50s/it]
 90%|████████▉ | 34045/37963 [146:00:16<17:15:49, 15.86s/it]
 90%|████████▉ | 34046/37963 [146:00:31<16:46:48, 15.42s/it]
 90%|████████▉ | 34047/37963 [146:00:45<16:26:40, 15.12s/it]
 90%|████████▉ | 34048/37963 [146:00:59<16:12:06, 14.90s/it]
 90%|████████▉ | 34049/37963 [146:01:14<15:58:08, 14.69s/it]
 90%|████████▉ | 34050/37963 [146:01:28<15:51:52, 14.60s/it]
                                                            
{'loss': '0.08308', 'grad_norm': '4.238', 'learning_rate': '5.523e-07', 'epoch': '0.8969'}

 90%|████████▉ | 34050/37963 [146:01:28<15:51:52, 14.60s/it]
 90%|████████▉ | 34051/37963 [146:01:42<15:47:01, 14.52s/it]
 90%|████████▉ | 34052/37963 [146:01:57<15:43:26, 14.47s/it]
 90%|████████▉ | 34053/37963 [146:02:11<15:41:09, 14.44s/it]
 90%|████████▉ | 34054/37963 [146:02:25<15:40:01, 14.43s/it]
 90%|████████▉ | 34055/37963 [146:02:40<15:34:34, 14.35s/it]
 90%|████████▉ | 34056/37963 [146:03:00<17:37:47, 16.24s/it]
 90%|████████▉ | 34057/37963 [146:03:15<16:59:31, 15.66s/it]
 90%|████████▉ | 34058/37963 [146:03:28<16:24:35, 15.13s/it]
 90%|████████▉ | 34059/37963 [146:03:43<16:09:04, 14.89s/it]
 90%|████████▉ | 34060/37963 [146:04:04<18:04:53, 16.68s/it]
                                                            
{'loss': '0.06726', 'grad_norm': '2.588', 'learning_rate': '5.496e-07', 'epoch': '0.8972'}

 90%|████████▉ | 34060/37963 [146:04:04<18:04:53, 16.68s/it]
 90%|████████▉ | 34061/37963 [146:04:25<19:27:55, 17.96s/it]
 90%|████████▉ | 34062/37963 [146:04:39<18:19:00, 16.90s/it]
 90%|████████▉ | 34063/37963 [146:04:53<17:18:21, 15.97s/it]
 90%|████████▉ | 34064/37963 [146:05:07<16:47:26, 15.50s/it]
 90%|████████▉ | 34065/37963 [146:05:22<16:28:24, 15.21s/it]
 90%|████████▉ | 34066/37963 [146:05:36<16:10:42, 14.95s/it]
 90%|████████▉ | 34067/37963 [146:05:51<16:02:09, 14.82s/it]
 90%|████████▉ | 34068/37963 [146:06:05<15:54:11, 14.70s/it]
 90%|████████▉ | 34069/37963 [146:06:19<15:47:09, 14.59s/it]
 90%|████████▉ | 34070/37963 [146:06:34<15:43:02, 14.53s/it]
                                                            
{'loss': '0.07017', 'grad_norm': '3.138', 'learning_rate': '5.468e-07', 'epoch': '0.8975'}

 90%|████████▉ | 34070/37963 [146:06:34<15:43:02, 14.53s/it]
 90%|████████▉ | 34071/37963 [146:06:48<15:33:07, 14.39s/it]
 90%|████████▉ | 34072/37963 [146:07:02<15:29:51, 14.34s/it]
 90%|████████▉ | 34073/37963 [146:07:16<15:30:41, 14.36s/it]
 90%|████████▉ | 34074/37963 [146:07:37<17:39:26, 16.35s/it]
 90%|████████▉ | 34075/37963 [146:07:52<17:00:42, 15.75s/it]
 90%|████████▉ | 34076/37963 [146:08:06<16:32:45, 15.32s/it]
 90%|████████▉ | 34077/37963 [146:08:20<16:01:43, 14.85s/it]
 90%|████████▉ | 34078/37963 [146:08:34<15:53:24, 14.72s/it]
 90%|████████▉ | 34079/37963 [146:08:49<15:46:43, 14.62s/it]
 90%|████████▉ | 34080/37963 [146:09:03<15:41:01, 14.54s/it]
                                                            
{'loss': '0.07299', 'grad_norm': '2.753', 'learning_rate': '5.44e-07', 'epoch': '0.8977'}

 90%|████████▉ | 34080/37963 [146:09:03<15:41:01, 14.54s/it]
 90%|████████▉ | 34081/37963 [146:09:17<15:38:28, 14.50s/it]
 90%|████████▉ | 34082/37963 [146:09:32<15:37:12, 14.49s/it]
 90%|████████▉ | 34083/37963 [146:09:46<15:35:38, 14.47s/it]
 90%|████████▉ | 34084/37963 [146:10:01<15:31:59, 14.42s/it]
 90%|████████▉ | 34085/37963 [146:10:15<15:27:19, 14.35s/it]
 90%|████████▉ | 34086/37963 [146:10:29<15:19:49, 14.24s/it]
 90%|████████▉ | 34087/37963 [146:10:49<17:21:54, 16.13s/it]
 90%|████████▉ | 34088/37963 [146:11:17<21:03:29, 19.56s/it]
 90%|████████▉ | 34089/37963 [146:11:31<19:15:37, 17.90s/it]
 90%|████████▉ | 34090/37963 [146:11:45<18:08:19, 16.86s/it]
                                                            
{'loss': '0.05262', 'grad_norm': '3.404', 'learning_rate': '5.412e-07', 'epoch': '0.898'}

 90%|████████▉ | 34090/37963 [146:11:45<18:08:19, 16.86s/it]
 90%|████████▉ | 34091/37963 [146:12:07<19:35:05, 18.21s/it]
 90%|████████▉ | 34092/37963 [146:12:21<18:19:16, 17.04s/it]
 90%|████████▉ | 34093/37963 [146:12:35<17:27:07, 16.23s/it]
 90%|████████▉ | 34094/37963 [146:12:50<16:52:11, 15.70s/it]
 90%|████████▉ | 34095/37963 [146:13:04<16:30:18, 15.36s/it]
 90%|████████▉ | 34096/37963 [146:13:19<16:11:12, 15.07s/it]
 90%|████████▉ | 34097/37963 [146:13:33<15:52:40, 14.79s/it]
 90%|████████▉ | 34098/37963 [146:13:47<15:43:46, 14.65s/it]
 90%|████████▉ | 34099/37963 [146:14:01<15:34:44, 14.51s/it]
 90%|████████▉ | 34100/37963 [146:14:16<15:29:06, 14.43s/it]
                                                            
{'loss': '0.08006', 'grad_norm': '2.585', 'learning_rate': '5.385e-07', 'epoch': '0.8982'}

 90%|████████▉ | 34100/37963 [146:14:16<15:29:06, 14.43s/it]
 90%|████████▉ | 34101/37963 [146:14:30<15:28:38, 14.43s/it]
 90%|████████▉ | 34102/37963 [146:14:44<15:25:06, 14.38s/it]
 90%|████████▉ | 34103/37963 [146:14:58<15:19:40, 14.30s/it]
 90%|████████▉ | 34104/37963 [146:15:19<17:25:04, 16.25s/it]
 90%|████████▉ | 34105/37963 [146:15:34<16:47:26, 15.67s/it]
 90%|████████▉ | 34106/37963 [146:15:48<16:23:28, 15.30s/it]
 90%|████████▉ | 34107/37963 [146:16:03<16:09:00, 15.08s/it]
 90%|████████▉ | 34108/37963 [146:16:17<15:59:37, 14.94s/it]
 90%|████████▉ | 34109/37963 [146:16:39<18:04:10, 16.88s/it]
 90%|████████▉ | 34110/37963 [146:17:00<19:24:34, 18.14s/it]
                                                            
{'loss': '0.07845', 'grad_norm': '2.789', 'learning_rate': '5.357e-07', 'epoch': '0.8985'}

 90%|████████▉ | 34110/37963 [146:17:00<19:24:34, 18.14s/it]
 90%|████████▉ | 34111/37963 [146:17:14<18:12:17, 17.01s/it]
 90%|████████▉ | 34112/37963 [146:17:28<17:03:47, 15.95s/it]
 90%|████████▉ | 34113/37963 [146:17:42<16:33:08, 15.48s/it]
 90%|████████▉ | 34114/37963 [146:17:56<16:13:27, 15.17s/it]
 90%|████████▉ | 34115/37963 [146:18:11<15:57:42, 14.93s/it]
 90%|████████▉ | 34116/37963 [146:18:25<15:46:34, 14.76s/it]
 90%|████████▉ | 34117/37963 [146:18:39<15:38:19, 14.64s/it]
 90%|████████▉ | 34118/37963 [146:18:54<15:32:32, 14.55s/it]
 90%|████████▉ | 34119/37963 [146:19:08<15:29:00, 14.50s/it]
 90%|████████▉ | 34120/37963 [146:19:23<15:28:41, 14.50s/it]
                                                            
{'loss': '0.07148', 'grad_norm': '3.942', 'learning_rate': '5.329e-07', 'epoch': '0.8988'}

 90%|████████▉ | 34120/37963 [146:19:23<15:28:41, 14.50s/it]
 90%|████████▉ | 34121/37963 [146:19:37<15:26:04, 14.46s/it]
 90%|████████▉ | 34122/37963 [146:19:58<17:27:04, 16.36s/it]
 90%|████████▉ | 34123/37963 [146:20:12<16:49:36, 15.78s/it]
 90%|████████▉ | 34124/37963 [146:20:27<16:19:56, 15.32s/it]
 90%|████████▉ | 34125/37963 [146:20:41<16:01:54, 15.04s/it]
 90%|████████▉ | 34126/37963 [146:20:55<15:51:15, 14.88s/it]
 90%|████████▉ | 34127/37963 [146:21:10<15:43:05, 14.75s/it]
 90%|████████▉ | 34128/37963 [146:21:24<15:34:34, 14.62s/it]
 90%|████████▉ | 34129/37963 [146:21:39<15:31:04, 14.57s/it]
 90%|████████▉ | 34130/37963 [146:21:53<15:26:58, 14.51s/it]
                                                            
{'loss': '0.06488', 'grad_norm': '3.489', 'learning_rate': '5.302e-07', 'epoch': '0.899'}

 90%|████████▉ | 34130/37963 [146:21:53<15:26:58, 14.51s/it]
 90%|████████▉ | 34131/37963 [146:22:07<15:17:50, 14.37s/it]
 90%|████████▉ | 34132/37963 [146:22:21<15:18:24, 14.38s/it]
 90%|████████▉ | 34133/37963 [146:22:36<15:18:29, 14.39s/it]
 90%|████████▉ | 34134/37963 [146:22:50<15:21:15, 14.44s/it]
 90%|████████▉ | 34135/37963 [146:23:11<17:24:40, 16.37s/it]
 90%|████████▉ | 34136/37963 [146:23:38<20:48:29, 19.57s/it]
 90%|████████▉ | 34137/37963 [146:23:53<19:07:52, 18.00s/it]
 90%|████████▉ | 34138/37963 [146:24:06<17:45:37, 16.72s/it]
 90%|████████▉ | 34139/37963 [146:24:21<17:00:26, 16.01s/it]
 90%|████████▉ | 34140/37963 [146:24:42<18:41:18, 17.60s/it]
                                                            
{'loss': '0.06651', 'grad_norm': '2.766', 'learning_rate': '5.275e-07', 'epoch': '0.8993'}

 90%|████████▉ | 34140/37963 [146:24:42<18:41:18, 17.60s/it]
 90%|████████▉ | 34141/37963 [146:24:57<17:41:39, 16.67s/it]
 90%|████████▉ | 34142/37963 [146:25:11<16:57:04, 15.97s/it]
 90%|████████▉ | 34143/37963 [146:25:25<16:28:28, 15.53s/it]
 90%|████████▉ | 34144/37963 [146:25:40<16:06:43, 15.19s/it]
 90%|████████▉ | 34145/37963 [146:25:54<15:51:08, 14.95s/it]
 90%|████████▉ | 34146/37963 [146:26:09<15:43:19, 14.83s/it]
 90%|████████▉ | 34147/37963 [146:26:23<15:33:40, 14.68s/it]
 90%|████████▉ | 34148/37963 [146:26:37<15:28:06, 14.60s/it]
 90%|████████▉ | 34149/37963 [146:26:52<15:23:00, 14.52s/it]
 90%|████████▉ | 34150/37963 [146:27:06<15:22:15, 14.51s/it]
                                                            
{'loss': '0.05924', 'grad_norm': '2.779', 'learning_rate': '5.247e-07', 'epoch': '0.8996'}

 90%|████████▉ | 34150/37963 [146:27:06<15:22:15, 14.51s/it]
 90%|████████▉ | 34151/37963 [146:27:21<15:18:56, 14.46s/it]
 90%|████████▉ | 34152/37963 [146:27:35<15:16:41, 14.43s/it]
 90%|████████▉ | 34153/37963 [146:27:49<15:16:59, 14.44s/it]
 90%|████████▉ | 34154/37963 [146:28:10<17:19:17, 16.37s/it]
 90%|████████▉ | 34155/37963 [146:28:25<16:41:18, 15.78s/it]
 90%|████████▉ | 34156/37963 [146:28:39<16:05:44, 15.22s/it]
 90%|████████▉ | 34157/37963 [146:28:53<15:49:35, 14.97s/it]
 90%|████████▉ | 34158/37963 [146:29:21<19:50:24, 18.77s/it]
 90%|████████▉ | 34159/37963 [146:29:35<18:28:37, 17.49s/it]
 90%|████████▉ | 34160/37963 [146:29:50<17:32:39, 16.61s/it]
                                                            
{'loss': '0.07352', 'grad_norm': '4.502', 'learning_rate': '5.22e-07', 'epoch': '0.8998'}

 90%|████████▉ | 34160/37963 [146:29:50<17:32:39, 16.61s/it]
 90%|████████▉ | 34161/37963 [146:30:04<16:47:58, 15.91s/it]
 90%|████████▉ | 34162/37963 [146:30:18<16:20:34, 15.48s/it]
 90%|████████▉ | 34163/37963 [146:30:32<15:48:17, 14.97s/it]
 90%|████████▉ | 34164/37963 [146:30:46<15:32:56, 14.73s/it]
 90%|████████▉ | 34165/37963 [146:31:01<15:25:37, 14.62s/it]
 90%|████████▉ | 34166/37963 [146:31:15<15:20:48, 14.55s/it]
 90%|█████████ | 34167/37963 [146:31:30<15:17:24, 14.50s/it]
 90%|█████████ | 34168/37963 [146:31:44<15:15:21, 14.47s/it]
 90%|█████████ | 34169/37963 [146:31:58<15:02:41, 14.28s/it]
 90%|█████████ | 34170/37963 [146:32:19<17:05:29, 16.22s/it]
                                                            
{'loss': '0.07171', 'grad_norm': '3.992', 'learning_rate': '5.193e-07', 'epoch': '0.9001'}

 90%|█████████ | 34170/37963 [146:32:19<17:05:29, 16.22s/it]
 90%|█████████ | 34171/37963 [146:32:33<16:28:47, 15.65s/it]
 90%|█████████ | 34172/37963 [146:32:47<16:04:14, 15.26s/it]
 90%|█████████ | 34173/37963 [146:33:02<15:47:37, 15.00s/it]
 90%|█████████ | 34174/37963 [146:33:16<15:39:43, 14.88s/it]
 90%|█████████ | 34175/37963 [146:33:31<15:29:10, 14.72s/it]
 90%|█████████ | 34176/37963 [146:33:45<15:19:58, 14.58s/it]
 90%|█████████ | 34177/37963 [146:33:59<15:17:17, 14.54s/it]
 90%|█████████ | 34178/37963 [146:34:14<15:14:39, 14.50s/it]
 90%|█████████ | 34179/37963 [146:34:28<15:10:54, 14.44s/it]
 90%|█████████ | 34180/37963 [146:34:42<15:08:24, 14.41s/it]
                                                            
{'loss': '0.06712', 'grad_norm': '2.744', 'learning_rate': '5.166e-07', 'epoch': '0.9004'}

 90%|█████████ | 34180/37963 [146:34:42<15:08:24, 14.41s/it]
 90%|█████████ | 34181/37963 [146:34:57<15:07:32, 14.40s/it]
 90%|█████████ | 34182/37963 [146:35:18<17:10:48, 16.36s/it]
 90%|█████████ | 34183/37963 [146:35:32<16:24:31, 15.63s/it]
 90%|█████████ | 34184/37963 [146:35:52<18:04:20, 17.22s/it]
 90%|█████████ | 34185/37963 [146:36:07<17:10:05, 16.36s/it]
 90%|█████████ | 34186/37963 [146:36:28<18:37:34, 17.75s/it]
 90%|█████████ | 34187/37963 [146:36:42<17:36:06, 16.78s/it]
 90%|█████████ | 34188/37963 [146:37:03<18:57:51, 18.09s/it]
 90%|█████████ | 34189/37963 [146:37:17<17:27:37, 16.66s/it]
 90%|█████████ | 34190/37963 [146:37:31<16:44:21, 15.97s/it]
                                                            
{'loss': '0.07246', 'grad_norm': '3.416', 'learning_rate': '5.139e-07', 'epoch': '0.9006'}

 90%|█████████ | 34190/37963 [146:37:31<16:44:21, 15.97s/it]
 90%|█████████ | 34191/37963 [146:37:45<16:09:19, 15.42s/it]
 90%|█████████ | 34192/37963 [146:37:59<15:38:42, 14.94s/it]
 90%|█████████ | 34193/37963 [146:38:13<15:27:36, 14.76s/it]
 90%|█████████ | 34194/37963 [146:38:28<15:23:21, 14.70s/it]
 90%|█████████ | 34195/37963 [146:38:42<15:17:06, 14.60s/it]
 90%|█████████ | 34196/37963 [146:38:57<15:10:34, 14.50s/it]
 90%|█████████ | 34197/37963 [146:39:11<15:04:39, 14.41s/it]
 90%|█████████ | 34198/37963 [146:39:25<15:04:34, 14.42s/it]
 90%|█████████ | 34199/37963 [146:39:40<15:02:37, 14.39s/it]
 90%|█████████ | 34200/37963 [146:39:54<15:01:39, 14.38s/it]
                                                            
{'loss': '0.07711', 'grad_norm': '3.098', 'learning_rate': '5.112e-07', 'epoch': '0.9009'}

 90%|█████████ | 34200/37963 [146:39:54<15:01:39, 14.38s/it]
 90%|█████████ | 34201/37963 [146:40:08<14:57:24, 14.31s/it]
 90%|█████████ | 34202/37963 [146:40:23<15:00:23, 14.36s/it]
 90%|█████████ | 34203/37963 [146:40:37<14:56:06, 14.30s/it]
 90%|█████████ | 34204/37963 [146:40:58<17:07:29, 16.40s/it]
 90%|█████████ | 34205/37963 [146:41:12<16:28:27, 15.78s/it]
 90%|█████████ | 34206/37963 [146:41:33<17:58:44, 17.23s/it]
 90%|█████████ | 34207/37963 [146:41:55<19:24:13, 18.60s/it]
 90%|█████████ | 34208/37963 [146:42:09<18:05:50, 17.35s/it]
 90%|█████████ | 34209/37963 [146:42:24<17:09:25, 16.45s/it]
 90%|█████████ | 34210/37963 [146:42:37<16:18:35, 15.64s/it]
                                                            
{'loss': '0.05247', 'grad_norm': '2.901', 'learning_rate': '5.085e-07', 'epoch': '0.9011'}

 90%|█████████ | 34210/37963 [146:42:37<16:18:35, 15.64s/it]
 90%|█████████ | 34211/37963 [146:42:52<15:54:53, 15.27s/it]
 90%|█████████ | 34212/37963 [146:43:06<15:35:52, 14.97s/it]
 90%|█████████ | 34213/37963 [146:43:20<15:20:22, 14.73s/it]
 90%|█████████ | 34214/37963 [146:43:34<15:07:10, 14.52s/it]
 90%|█████████ | 34215/37963 [146:43:48<14:47:08, 14.20s/it]
 90%|█████████ | 34216/37963 [146:44:02<14:51:58, 14.28s/it]
 90%|█████████ | 34217/37963 [146:44:17<14:54:04, 14.32s/it]
 90%|█████████ | 34218/37963 [146:44:31<14:54:45, 14.34s/it]
 90%|█████████ | 34219/37963 [146:44:52<16:58:40, 16.32s/it]
 90%|█████████ | 34220/37963 [146:45:06<16:23:51, 15.77s/it]
                                                            
{'loss': '0.07067', 'grad_norm': '3.418', 'learning_rate': '5.058e-07', 'epoch': '0.9014'}

 90%|█████████ | 34220/37963 [146:45:06<16:23:51, 15.77s/it]
 90%|█████████ | 34221/37963 [146:45:21<15:56:58, 15.34s/it]
 90%|█████████ | 34222/37963 [146:45:35<15:38:42, 15.06s/it]
 90%|█████████ | 34223/37963 [146:45:50<15:27:25, 14.88s/it]
 90%|█████████ | 34224/37963 [146:46:04<15:20:05, 14.76s/it]
 90%|█████████ | 34225/37963 [146:46:18<15:13:00, 14.66s/it]
 90%|█████████ | 34226/37963 [146:46:33<15:06:55, 14.56s/it]
 90%|█████████ | 34227/37963 [146:46:47<15:05:04, 14.54s/it]
 90%|█████████ | 34228/37963 [146:47:02<15:05:01, 14.54s/it]
 90%|█████████ | 34229/37963 [146:47:16<14:58:58, 14.45s/it]
 90%|█████████ | 34230/37963 [146:47:30<14:55:23, 14.39s/it]
                                                            
{'loss': '0.07301', 'grad_norm': '2.356', 'learning_rate': '5.031e-07', 'epoch': '0.9017'}

 90%|█████████ | 34230/37963 [146:47:30<14:55:23, 14.39s/it]
 90%|█████████ | 34231/37963 [146:47:45<14:58:03, 14.44s/it]
 90%|█████████ | 34232/37963 [146:48:06<16:55:16, 16.33s/it]
 90%|█████████ | 34233/37963 [146:48:19<16:08:25, 15.58s/it]
 90%|█████████ | 34234/37963 [146:48:40<17:41:56, 17.09s/it]
 90%|█████████ | 34235/37963 [146:49:01<18:57:28, 18.31s/it]
 90%|█████████ | 34236/37963 [146:49:16<17:43:48, 17.13s/it]
 90%|█████████ | 34237/37963 [146:49:37<18:59:36, 18.35s/it]
 90%|█████████ | 34238/37963 [146:49:51<17:34:56, 16.99s/it]
 90%|█████████ | 34239/37963 [146:50:04<16:31:35, 15.98s/it]
 90%|█████████ | 34240/37963 [146:50:18<15:58:22, 15.45s/it]
                                                            
{'loss': '0.07047', 'grad_norm': '4.4', 'learning_rate': '5.005e-07', 'epoch': '0.9019'}

 90%|█████████ | 34240/37963 [146:50:18<15:58:22, 15.45s/it]
 90%|█████████ | 34241/37963 [146:50:33<15:35:25, 15.08s/it]
 90%|█████████ | 34242/37963 [146:50:47<15:22:37, 14.88s/it]
 90%|█████████ | 34243/37963 [146:51:02<15:15:00, 14.76s/it]
 90%|█████████ | 34244/37963 [146:51:16<15:08:36, 14.66s/it]
 90%|█████████ | 34245/37963 [146:51:30<15:02:43, 14.57s/it]
 90%|█████████ | 34246/37963 [146:51:45<14:59:28, 14.52s/it]
 90%|█████████ | 34247/37963 [146:51:59<14:58:15, 14.50s/it]
 90%|█████████ | 34248/37963 [146:52:14<14:56:37, 14.48s/it]
 90%|█████████ | 34249/37963 [146:52:28<14:53:51, 14.44s/it]
 90%|█████████ | 34250/37963 [146:52:48<16:37:30, 16.12s/it]
                                                            
{'loss': '0.06914', 'grad_norm': '3.554', 'learning_rate': '4.978e-07', 'epoch': '0.9022'}

 90%|█████████ | 34250/37963 [146:52:48<16:37:30, 16.12s/it]
 90%|█████████ | 34251/37963 [146:53:02<16:01:43, 15.55s/it]
 90%|█████████ | 34252/37963 [146:53:17<15:40:26, 15.21s/it]
 90%|█████████ | 34253/37963 [146:53:31<15:20:54, 14.89s/it]
 90%|█████████ | 34254/37963 [146:53:45<15:13:21, 14.78s/it]
 90%|█████████ | 34255/37963 [146:54:13<19:15:21, 18.70s/it]
 90%|█████████ | 34256/37963 [146:54:27<17:51:03, 17.34s/it]
 90%|█████████ | 34257/37963 [146:54:42<16:57:09, 16.47s/it]
 90%|█████████ | 34258/37963 [146:54:56<16:18:24, 15.84s/it]
 90%|█████████ | 34259/37963 [146:55:10<15:51:12, 15.41s/it]
 90%|█████████ | 34260/37963 [146:55:25<15:32:24, 15.11s/it]
                                                            
{'loss': '0.07342', 'grad_norm': '2.589', 'learning_rate': '4.951e-07', 'epoch': '0.9025'}

 90%|█████████ | 34260/37963 [146:55:25<15:32:24, 15.11s/it]
 90%|█████████ | 34261/37963 [146:55:39<15:14:30, 14.82s/it]
 90%|█████████ | 34262/37963 [146:55:53<15:04:50, 14.67s/it]
 90%|█████████ | 34263/37963 [146:56:08<14:59:28, 14.59s/it]
 90%|█████████ | 34264/37963 [146:56:22<14:44:01, 14.34s/it]
 90%|█████████ | 34265/37963 [146:56:36<14:43:38, 14.34s/it]
 90%|█████████ | 34266/37963 [146:56:50<14:43:51, 14.34s/it]
 90%|█████████ | 34267/37963 [146:57:04<14:41:17, 14.31s/it]
 90%|█████████ | 34268/37963 [146:57:25<16:43:52, 16.30s/it]
 90%|█████████ | 34269/37963 [146:57:40<16:09:18, 15.74s/it]
 90%|█████████ | 34270/37963 [146:57:54<15:45:54, 15.37s/it]
                                                            
{'loss': '0.05832', 'grad_norm': '2.425', 'learning_rate': '4.925e-07', 'epoch': '0.9027'}

 90%|█████████ | 34270/37963 [146:57:54<15:45:54, 15.37s/it]
 90%|█████████ | 34271/37963 [146:58:09<15:28:04, 15.08s/it]
 90%|█████████ | 34272/37963 [146:58:23<15:14:57, 14.87s/it]
 90%|█████████ | 34273/37963 [146:58:37<15:00:30, 14.64s/it]
 90%|█████████ | 34274/37963 [146:58:52<14:54:55, 14.56s/it]
 90%|█████████ | 34275/37963 [146:59:06<14:46:21, 14.42s/it]
 90%|█████████ | 34276/37963 [146:59:20<14:47:58, 14.45s/it]
 90%|█████████ | 34277/37963 [146:59:34<14:41:54, 14.36s/it]
 90%|█████████ | 34278/37963 [146:59:48<14:33:17, 14.22s/it]
 90%|█████████ | 34279/37963 [147:00:09<16:27:28, 16.08s/it]
 90%|█████████ | 34280/37963 [147:00:23<15:56:24, 15.58s/it]
                                                            
{'loss': '0.06664', 'grad_norm': '4.966', 'learning_rate': '4.899e-07', 'epoch': '0.903'}

 90%|█████████ | 34280/37963 [147:00:23<15:56:24, 15.58s/it]
 90%|█████████ | 34281/37963 [147:00:38<15:35:44, 15.25s/it]
 90%|█████████ | 34282/37963 [147:00:51<15:09:15, 14.82s/it]
 90%|█████████ | 34283/37963 [147:01:19<19:03:45, 18.65s/it]
 90%|█████████ | 34284/37963 [147:01:33<17:42:20, 17.33s/it]
 90%|█████████ | 34285/37963 [147:01:54<18:55:01, 18.52s/it]
 90%|█████████ | 34286/37963 [147:02:09<17:39:15, 17.28s/it]
 90%|█████████ | 34287/37963 [147:02:23<16:38:13, 16.29s/it]
 90%|█████████ | 34288/37963 [147:02:37<16:03:01, 15.72s/it]
 90%|█████████ | 34289/37963 [147:02:52<15:35:44, 15.28s/it]
 90%|█████████ | 34290/37963 [147:03:06<15:18:34, 15.01s/it]
                                                            
{'loss': '0.06854', 'grad_norm': '3.692', 'learning_rate': '4.872e-07', 'epoch': '0.9033'}

 90%|█████████ | 34290/37963 [147:03:06<15:18:34, 15.01s/it]
 90%|█████████ | 34291/37963 [147:03:20<15:06:18, 14.81s/it]
 90%|█████████ | 34292/37963 [147:03:34<14:43:15, 14.44s/it]
 90%|█████████ | 34293/37963 [147:03:48<14:31:06, 14.24s/it]
 90%|█████████ | 34294/37963 [147:04:02<14:34:22, 14.30s/it]
 90%|█████████ | 34295/37963 [147:04:17<14:37:46, 14.36s/it]
 90%|█████████ | 34296/37963 [147:04:31<14:37:52, 14.36s/it]
 90%|█████████ | 34297/37963 [147:04:45<14:35:37, 14.33s/it]
 90%|█████████ | 34298/37963 [147:05:05<16:25:01, 16.13s/it]
 90%|█████████ | 34299/37963 [147:05:20<15:53:05, 15.61s/it]
 90%|█████████ | 34300/37963 [147:05:34<15:29:30, 15.23s/it]
                                                            
{'loss': '0.06211', 'grad_norm': '3.309', 'learning_rate': '4.846e-07', 'epoch': '0.9035'}

 90%|█████████ | 34300/37963 [147:05:34<15:29:30, 15.23s/it]
 90%|█████████ | 34301/37963 [147:05:49<15:14:33, 14.98s/it]
 90%|█████████ | 34302/37963 [147:06:03<15:06:47, 14.86s/it]
 90%|█████████ | 34303/37963 [147:06:31<19:07:09, 18.81s/it]
 90%|█████████ | 34304/37963 [147:06:46<17:45:16, 17.47s/it]
 90%|█████████ | 34305/37963 [147:07:00<16:48:25, 16.54s/it]
 90%|█████████ | 34306/37963 [147:07:14<16:08:29, 15.89s/it]
 90%|█████████ | 34307/37963 [147:07:29<15:41:11, 15.45s/it]
 90%|█████████ | 34308/37963 [147:07:43<15:21:51, 15.13s/it]
 90%|█████████ | 34309/37963 [147:07:57<15:02:22, 14.82s/it]
 90%|█████████ | 34310/37963 [147:08:12<14:54:29, 14.69s/it]
                                                            
{'loss': '0.07377', 'grad_norm': '3.697', 'learning_rate': '4.82e-07', 'epoch': '0.9038'}

 90%|█████████ | 34310/37963 [147:08:12<14:54:29, 14.69s/it]
 90%|█████████ | 34311/37963 [147:08:26<14:48:41, 14.60s/it]
 90%|█████████ | 34312/37963 [147:08:40<14:44:46, 14.54s/it]
 90%|█████████ | 34313/37963 [147:08:55<14:41:12, 14.49s/it]
 90%|█████████ | 34314/37963 [147:09:09<14:39:32, 14.46s/it]
 90%|█████████ | 34315/37963 [147:09:30<16:37:57, 16.41s/it]
 90%|█████████ | 34316/37963 [147:09:44<16:00:18, 15.80s/it]
 90%|█████████ | 34317/37963 [147:09:59<15:33:54, 15.37s/it]
 90%|█████████ | 34318/37963 [147:10:13<15:15:13, 15.07s/it]
 90%|█████████ | 34319/37963 [147:10:27<14:59:14, 14.81s/it]
 90%|█████████ | 34320/37963 [147:10:42<14:51:19, 14.68s/it]
                                                            
{'loss': '0.06684', 'grad_norm': '3.295', 'learning_rate': '4.794e-07', 'epoch': '0.904'}

 90%|█████████ | 34320/37963 [147:10:42<14:51:19, 14.68s/it]
 90%|█████████ | 34321/37963 [147:10:56<14:40:56, 14.51s/it]
 90%|█████████ | 34322/37963 [147:11:10<14:34:47, 14.42s/it]
 90%|█████████ | 34323/37963 [147:11:24<14:31:27, 14.36s/it]
 90%|█████████ | 34324/37963 [147:11:38<14:25:43, 14.27s/it]
 90%|█████████ | 34325/37963 [147:11:53<14:30:17, 14.35s/it]
 90%|█████████ | 34326/37963 [147:12:07<14:32:15, 14.39s/it]
 90%|█████████ | 34327/37963 [147:12:21<14:23:14, 14.24s/it]
 90%|█████████ | 34328/37963 [147:12:36<14:25:54, 14.29s/it]
 90%|█████████ | 34329/37963 [147:12:50<14:28:40, 14.34s/it]
 90%|█████████ | 34330/37963 [147:13:12<16:36:06, 16.45s/it]
                                                            
{'loss': '0.06574', 'grad_norm': '6.55', 'learning_rate': '4.768e-07', 'epoch': '0.9043'}

 90%|█████████ | 34330/37963 [147:13:12<16:36:06, 16.45s/it]
 90%|█████████ | 34331/37963 [147:13:33<17:59:48, 17.84s/it]
 90%|█████████ | 34332/37963 [147:13:54<19:02:06, 18.87s/it]
 90%|█████████ | 34333/37963 [147:14:08<17:39:12, 17.51s/it]
 90%|█████████ | 34334/37963 [147:14:29<18:38:08, 18.49s/it]
 90%|█████████ | 34335/37963 [147:14:43<17:19:29, 17.19s/it]
 90%|█████████ | 34336/37963 [147:14:57<16:22:10, 16.25s/it]
 90%|█████████ | 34337/37963 [147:15:11<15:36:16, 15.49s/it]
 90%|█████████ | 34338/37963 [147:15:25<15:14:08, 15.13s/it]
 90%|█████████ | 34339/37963 [147:15:39<14:58:06, 14.87s/it]
 90%|█████████ | 34340/37963 [147:15:54<14:48:24, 14.71s/it]
                                                            
{'loss': '0.06055', 'grad_norm': '6.271', 'learning_rate': '4.742e-07', 'epoch': '0.9046'}

 90%|█████████ | 34340/37963 [147:15:54<14:48:24, 14.71s/it]
 90%|█████████ | 34341/37963 [147:16:08<14:42:45, 14.62s/it]
 90%|█████████ | 34342/37963 [147:16:23<14:38:04, 14.55s/it]
 90%|█████████ | 34343/37963 [147:16:37<14:36:12, 14.52s/it]
 90%|█████████ | 34344/37963 [147:16:51<14:32:59, 14.47s/it]
 90%|█████████ | 34345/37963 [147:17:06<14:31:45, 14.46s/it]
 90%|█████████ | 34346/37963 [147:17:20<14:29:41, 14.43s/it]
 90%|█████████ | 34347/37963 [147:17:35<14:28:15, 14.41s/it]
 90%|█████████ | 34348/37963 [147:17:55<16:11:28, 16.12s/it]
 90%|█████████ | 34349/37963 [147:18:09<15:39:44, 15.60s/it]
 90%|█████████ | 34350/37963 [147:18:24<15:20:09, 15.28s/it]
                                                            
{'loss': '0.06963', 'grad_norm': '3.233', 'learning_rate': '4.716e-07', 'epoch': '0.9048'}

 90%|█████████ | 34350/37963 [147:18:24<15:20:09, 15.28s/it]
 90%|█████████ | 34351/37963 [147:18:45<17:04:44, 17.02s/it]
 90%|█████████ | 34352/37963 [147:19:07<18:33:31, 18.50s/it]
 90%|█████████ | 34353/37963 [147:19:21<17:20:52, 17.30s/it]
 90%|█████████ | 34354/37963 [147:19:36<16:28:07, 16.43s/it]
 90%|█████████ | 34355/37963 [147:19:50<15:47:55, 15.76s/it]
 90%|█████████ | 34356/37963 [147:20:04<15:24:22, 15.38s/it]
 91%|█████████ | 34357/37963 [147:20:19<15:05:54, 15.07s/it]
 91%|█████████ | 34358/37963 [147:20:33<14:53:36, 14.87s/it]
 91%|█████████ | 34359/37963 [147:20:47<14:44:10, 14.72s/it]
 91%|█████████ | 34360/37963 [147:21:01<14:30:11, 14.49s/it]
                                                            
{'loss': '0.05668', 'grad_norm': '2.891', 'learning_rate': '4.69e-07', 'epoch': '0.9051'}

 91%|█████████ | 34360/37963 [147:21:01<14:30:11, 14.49s/it]
 91%|█████████ | 34361/37963 [147:21:15<14:16:52, 14.27s/it]
 91%|█████████ | 34362/37963 [147:21:36<16:14:05, 16.23s/it]
 91%|█████████ | 34363/37963 [147:21:50<15:34:10, 15.57s/it]
 91%|█████████ | 34364/37963 [147:22:04<15:02:00, 15.04s/it]
 91%|█████████ | 34365/37963 [147:22:18<14:49:18, 14.83s/it]
 91%|█████████ | 34366/37963 [147:22:32<14:40:02, 14.68s/it]
 91%|█████████ | 34367/37963 [147:22:47<14:37:49, 14.65s/it]
 91%|█████████ | 34368/37963 [147:23:01<14:23:24, 14.41s/it]
 91%|█████████ | 34369/37963 [147:23:15<14:23:39, 14.42s/it]
 91%|█████████ | 34370/37963 [147:23:29<14:13:06, 14.25s/it]
                                                            
{'loss': '0.06663', 'grad_norm': '3.321', 'learning_rate': '4.664e-07', 'epoch': '0.9054'}

 91%|█████████ | 34370/37963 [147:23:29<14:13:06, 14.25s/it]
 91%|█████████ | 34371/37963 [147:23:43<14:14:42, 14.28s/it]
 91%|█████████ | 34372/37963 [147:23:58<14:16:57, 14.32s/it]
 91%|█████████ | 34373/37963 [147:24:13<14:23:39, 14.43s/it]
 91%|█████████ | 34374/37963 [147:24:27<14:23:48, 14.44s/it]
 91%|█████████ | 34375/37963 [147:24:41<14:22:52, 14.43s/it]
 91%|█████████ | 34376/37963 [147:24:56<14:23:24, 14.44s/it]
 91%|█████████ | 34377/37963 [147:25:10<14:21:31, 14.41s/it]
 91%|█████████ | 34378/37963 [147:25:25<14:21:31, 14.42s/it]
 91%|█████████ | 34379/37963 [147:25:51<17:59:23, 18.07s/it]
 91%|█████████ | 34380/37963 [147:26:12<18:51:06, 18.94s/it]
                                                            
{'loss': '0.06962', 'grad_norm': '3.497', 'learning_rate': '4.638e-07', 'epoch': '0.9056'}

 91%|█████████ | 34380/37963 [147:26:12<18:51:06, 18.94s/it]
 91%|█████████ | 34381/37963 [147:26:27<17:29:07, 17.57s/it]
 91%|█████████ | 34382/37963 [147:26:48<18:44:12, 18.84s/it]
 91%|█████████ | 34383/37963 [147:27:03<17:25:07, 17.52s/it]
 91%|█████████ | 34384/37963 [147:27:17<16:19:30, 16.42s/it]
 91%|█████████ | 34385/37963 [147:27:31<15:44:20, 15.84s/it]
 91%|█████████ | 34386/37963 [147:27:46<15:21:08, 15.45s/it]
 91%|█████████ | 34387/37963 [147:28:00<15:01:45, 15.13s/it]
 91%|█████████ | 34388/37963 [147:28:14<14:45:44, 14.87s/it]
 91%|█████████ | 34389/37963 [147:28:29<14:38:26, 14.75s/it]
 91%|█████████ | 34390/37963 [147:28:43<14:24:35, 14.52s/it]
                                                            
{'loss': '0.06993', 'grad_norm': '2.709', 'learning_rate': '4.613e-07', 'epoch': '0.9059'}

 91%|█████████ | 34390/37963 [147:28:43<14:24:35, 14.52s/it]
 91%|█████████ | 34391/37963 [147:28:57<14:21:45, 14.48s/it]
 91%|█████████ | 34392/37963 [147:29:12<14:23:51, 14.51s/it]
 91%|█████████ | 34393/37963 [147:29:25<14:07:46, 14.25s/it]
 91%|█████████ | 34394/37963 [147:29:40<14:07:36, 14.25s/it]
 91%|█████████ | 34395/37963 [147:29:54<14:09:21, 14.28s/it]
 91%|█████████ | 34396/37963 [147:30:15<16:06:24, 16.26s/it]
 91%|█████████ | 34397/37963 [147:30:29<15:33:51, 15.71s/it]
 91%|█████████ | 34398/37963 [147:30:44<15:11:00, 15.33s/it]
 91%|█████████ | 34399/37963 [147:30:58<14:54:32, 15.06s/it]
 91%|█████████ | 34400/37963 [147:31:18<16:26:51, 16.62s/it]
                                                            
{'loss': '0.06606', 'grad_norm': '3.447', 'learning_rate': '4.587e-07', 'epoch': '0.9061'}

 91%|█████████ | 34400/37963 [147:31:18<16:26:51, 16.62s/it]
 91%|█████████ | 34401/37963 [147:31:40<18:00:55, 18.21s/it]
 91%|█████████ | 34402/37963 [147:31:55<16:48:05, 16.99s/it]
 91%|█████████ | 34403/37963 [147:32:09<16:00:14, 16.18s/it]
 91%|█████████ | 34404/37963 [147:32:23<15:25:18, 15.60s/it]
 91%|█████████ | 34405/37963 [147:32:38<15:05:34, 15.27s/it]
 91%|█████████ | 34406/37963 [147:32:52<14:49:10, 15.00s/it]
 91%|█████████ | 34407/37963 [147:33:06<14:39:35, 14.84s/it]
 91%|█████████ | 34408/37963 [147:33:21<14:30:57, 14.70s/it]
 91%|█████████ | 34409/37963 [147:33:35<14:24:18, 14.59s/it]
 91%|█████████ | 34410/37963 [147:33:56<16:14:01, 16.45s/it]
                                                            
{'loss': '0.07138', 'grad_norm': '2.433', 'learning_rate': '4.562e-07', 'epoch': '0.9064'}

 91%|█████████ | 34410/37963 [147:33:56<16:14:01, 16.45s/it]
 91%|█████████ | 34411/37963 [147:34:10<15:34:44, 15.79s/it]
 91%|█████████ | 34412/37963 [147:34:24<15:03:43, 15.27s/it]
 91%|█████████ | 34413/37963 [147:34:38<14:34:31, 14.78s/it]
 91%|█████████ | 34414/37963 [147:34:52<14:27:56, 14.67s/it]
 91%|█████████ | 34415/37963 [147:35:07<14:22:40, 14.59s/it]
 91%|█████████ | 34416/37963 [147:35:21<14:19:26, 14.54s/it]
 91%|█████████ | 34417/37963 [147:35:36<14:18:07, 14.52s/it]
 91%|█████████ | 34418/37963 [147:35:49<14:06:54, 14.33s/it]
 91%|█████████ | 34419/37963 [147:36:04<14:08:07, 14.36s/it]
 91%|█████████ | 34420/37963 [147:36:18<14:03:11, 14.28s/it]
                                                            
{'loss': '0.07046', 'grad_norm': '2.425', 'learning_rate': '4.536e-07', 'epoch': '0.9067'}

 91%|█████████ | 34420/37963 [147:36:18<14:03:11, 14.28s/it]
 91%|█████████ | 34421/37963 [147:36:32<14:04:53, 14.31s/it]
 91%|█████████ | 34422/37963 [147:36:47<14:07:20, 14.36s/it]
 91%|█████████ | 34423/37963 [147:37:01<14:08:09, 14.38s/it]
 91%|█████████ | 34424/37963 [147:37:16<14:07:40, 14.37s/it]
 91%|█████████ | 34425/37963 [147:37:30<14:04:26, 14.32s/it]
 91%|█████████ | 34426/37963 [147:37:44<14:04:36, 14.33s/it]
 91%|█████████ | 34427/37963 [147:37:59<14:06:36, 14.37s/it]
 91%|█████████ | 34428/37963 [147:38:19<15:59:22, 16.28s/it]
 91%|█████████ | 34429/37963 [147:38:48<19:32:36, 19.91s/it]
 91%|█████████ | 34430/37963 [147:39:08<19:46:56, 20.16s/it]
                                                            
{'loss': '0.0667', 'grad_norm': '3.62', 'learning_rate': '4.511e-07', 'epoch': '0.9069'}

 91%|█████████ | 34430/37963 [147:39:08<19:46:56, 20.16s/it]
 91%|█████████ | 34431/37963 [147:39:22<17:55:12, 18.27s/it]
 91%|█████████ | 34432/37963 [147:39:36<16:37:41, 16.95s/it]
 91%|█████████ | 34433/37963 [147:39:51<15:52:36, 16.19s/it]
 91%|█████████ | 34434/37963 [147:40:05<15:20:53, 15.66s/it]
 91%|█████████ | 34435/37963 [147:40:19<14:51:57, 15.17s/it]
 91%|█████████ | 34436/37963 [147:40:33<14:37:49, 14.93s/it]
 91%|█████████ | 34437/37963 [147:40:48<14:26:05, 14.74s/it]
 91%|█████████ | 34438/37963 [147:41:02<14:22:41, 14.68s/it]
 91%|█████████ | 34439/37963 [147:41:17<14:16:48, 14.59s/it]
 91%|█████████ | 34440/37963 [147:41:31<14:12:08, 14.51s/it]
                                                            
{'loss': '0.07422', 'grad_norm': '3.459', 'learning_rate': '4.485e-07', 'epoch': '0.9072'}

 91%|█████████ | 34440/37963 [147:41:31<14:12:08, 14.51s/it]
 91%|█████████ | 34441/37963 [147:41:45<14:09:33, 14.47s/it]
 91%|█████████ | 34442/37963 [147:42:00<14:03:31, 14.37s/it]
 91%|█████████ | 34443/37963 [147:42:20<15:43:34, 16.08s/it]
 91%|█████████ | 34444/37963 [147:42:34<15:05:35, 15.44s/it]
 91%|█████████ | 34445/37963 [147:42:48<14:46:01, 15.11s/it]
 91%|█████████ | 34446/37963 [147:43:02<14:32:55, 14.89s/it]
 91%|█████████ | 34447/37963 [147:43:17<14:23:33, 14.74s/it]
 91%|█████████ | 34448/37963 [147:43:38<16:16:53, 16.68s/it]
 91%|█████████ | 34449/37963 [147:43:58<17:19:12, 17.74s/it]
 91%|█████████ | 34450/37963 [147:44:12<16:15:52, 16.67s/it]
                                                            
{'loss': '0.06241', 'grad_norm': '3.652', 'learning_rate': '4.46e-07', 'epoch': '0.9075'}

 91%|█████████ | 34450/37963 [147:44:12<16:15:52, 16.67s/it]
 91%|█████████ | 34451/37963 [147:44:27<15:36:03, 15.99s/it]
 91%|█████████ | 34452/37963 [147:44:41<15:00:57, 15.40s/it]
 91%|█████████ | 34453/37963 [147:44:55<14:43:10, 15.10s/it]
 91%|█████████ | 34454/37963 [147:45:09<14:30:36, 14.89s/it]
 91%|█████████ | 34455/37963 [147:45:24<14:21:30, 14.74s/it]
 91%|█████████ | 34456/37963 [147:45:38<14:12:00, 14.58s/it]
 91%|█████████ | 34457/37963 [147:45:53<14:11:22, 14.57s/it]
 91%|█████████ | 34458/37963 [147:46:13<15:53:42, 16.33s/it]
 91%|█████████ | 34459/37963 [147:46:27<15:19:03, 15.74s/it]
 91%|█████████ | 34460/37963 [147:46:42<14:53:54, 15.31s/it]
                                                            
{'loss': '0.06552', 'grad_norm': '3.407', 'learning_rate': '4.435e-07', 'epoch': '0.9077'}

 91%|█████████ | 34460/37963 [147:46:42<14:53:54, 15.31s/it]
 91%|█████████ | 34461/37963 [147:46:56<14:37:46, 15.04s/it]
 91%|█████████ | 34462/37963 [147:47:11<14:26:41, 14.85s/it]
 91%|█████████ | 34463/37963 [147:47:25<14:11:36, 14.60s/it]
 91%|█████████ | 34464/37963 [147:47:39<14:09:00, 14.56s/it]
 91%|█████████ | 34465/37963 [147:47:53<14:07:25, 14.54s/it]
 91%|█████████ | 34466/37963 [147:48:07<13:58:17, 14.38s/it]
 91%|█████████ | 34467/37963 [147:48:22<13:55:11, 14.33s/it]
 91%|█████████ | 34468/37963 [147:48:36<13:48:51, 14.23s/it]
 91%|█████████ | 34469/37963 [147:48:50<13:50:55, 14.27s/it]
 91%|█████████ | 34470/37963 [147:49:04<13:45:45, 14.18s/it]
                                                            
{'loss': '0.08566', 'grad_norm': '3.921', 'learning_rate': '4.41e-07', 'epoch': '0.908'}

 91%|█████████ | 34470/37963 [147:49:04<13:45:45, 14.18s/it]
 91%|█████████ | 34471/37963 [147:49:18<13:48:08, 14.23s/it]
 91%|█████████ | 34472/37963 [147:49:33<13:49:37, 14.26s/it]
 91%|█████████ | 34473/37963 [147:49:46<13:39:38, 14.09s/it]
 91%|█████████ | 34474/37963 [147:50:01<13:43:42, 14.17s/it]
 91%|█████████ | 34475/37963 [147:50:15<13:40:40, 14.12s/it]
 91%|█████████ | 34476/37963 [147:50:29<13:44:52, 14.19s/it]
 91%|█████████ | 34477/37963 [147:50:50<15:37:02, 16.13s/it]
 91%|█████████ | 34478/37963 [147:51:17<18:54:38, 19.53s/it]
 91%|█████████ | 34479/37963 [147:51:38<19:20:38, 19.99s/it]
 91%|█████████ | 34480/37963 [147:51:53<17:43:01, 18.31s/it]
                                                            
{'loss': '0.06616', 'grad_norm': '3.303', 'learning_rate': '4.385e-07', 'epoch': '0.9083'}

 91%|█████████ | 34480/37963 [147:51:53<17:43:01, 18.31s/it]
 91%|█████████ | 34481/37963 [147:52:07<16:34:14, 17.13s/it]
 91%|█████████ | 34482/37963 [147:52:21<15:46:33, 16.32s/it]
 91%|█████████ | 34483/37963 [147:52:36<15:11:57, 15.72s/it]
 91%|█████████ | 34484/37963 [147:52:50<14:46:31, 15.29s/it]
 91%|█████████ | 34485/37963 [147:53:05<14:31:38, 15.04s/it]
 91%|█████████ | 34486/37963 [147:53:19<14:16:17, 14.78s/it]
 91%|█████████ | 34487/37963 [147:53:33<14:09:53, 14.67s/it]
 91%|█████████ | 34488/37963 [147:53:48<14:04:16, 14.58s/it]
 91%|█████████ | 34489/37963 [147:54:02<13:59:56, 14.51s/it]
 91%|█████████ | 34490/37963 [147:54:16<13:57:33, 14.47s/it]
                                                            
{'loss': '0.0609', 'grad_norm': '2.17', 'learning_rate': '4.36e-07', 'epoch': '0.9085'}

 91%|█████████ | 34490/37963 [147:54:16<13:57:33, 14.47s/it]
 91%|█████████ | 34491/37963 [147:54:31<13:55:37, 14.44s/it]
 91%|█████████ | 34492/37963 [147:54:45<13:49:52, 14.35s/it]
 91%|█████████ | 34493/37963 [147:55:06<15:42:19, 16.29s/it]
 91%|█████████ | 34494/37963 [147:55:20<15:09:57, 15.74s/it]
 91%|█████████ | 34495/37963 [147:55:41<16:38:47, 17.28s/it]
 91%|█████████ | 34496/37963 [147:55:55<15:51:09, 16.46s/it]
 91%|█████████ | 34497/37963 [147:56:10<15:14:51, 15.84s/it]
 91%|█████████ | 34498/37963 [147:56:31<16:43:42, 17.38s/it]
 91%|█████████ | 34499/37963 [147:56:45<15:51:43, 16.48s/it]
 91%|█████████ | 34500/37963 [147:56:59<15:13:43, 15.83s/it]
                                                            
{'loss': '0.06912', 'grad_norm': '3.061', 'learning_rate': '4.335e-07', 'epoch': '0.9088'}

 91%|█████████ | 34500/37963 [147:56:59<15:13:43, 15.83s/it]
 91%|█████████ | 34501/37963 [147:57:14<14:47:46, 15.39s/it]
 91%|█████████ | 34502/37963 [147:57:28<14:28:37, 15.06s/it]
 91%|█████████ | 34503/37963 [147:57:43<14:18:17, 14.88s/it]
 91%|█████████ | 34504/37963 [147:57:57<14:10:29, 14.75s/it]
 91%|█████████ | 34505/37963 [147:58:11<14:02:22, 14.62s/it]
 91%|█████████ | 34506/37963 [147:58:32<15:44:22, 16.39s/it]
 91%|█████████ | 34507/37963 [147:58:46<15:07:46, 15.76s/it]
 91%|█████████ | 34508/37963 [147:59:01<14:42:59, 15.33s/it]
 91%|█████████ | 34509/37963 [147:59:15<14:26:12, 15.05s/it]
 91%|█████████ | 34510/37963 [147:59:29<14:08:20, 14.74s/it]
                                                            
{'loss': '0.05949', 'grad_norm': '4.982', 'learning_rate': '4.31e-07', 'epoch': '0.909'}

 91%|█████████ | 34510/37963 [147:59:29<14:08:20, 14.74s/it]
 91%|█████████ | 34511/37963 [147:59:43<13:50:26, 14.43s/it]
 91%|█████████ | 34512/37963 [147:59:57<13:43:15, 14.31s/it]
 91%|█████████ | 34513/37963 [148:00:11<13:44:16, 14.34s/it]
 91%|█████████ | 34514/37963 [148:00:26<13:45:56, 14.37s/it]
 91%|█████████ | 34515/37963 [148:00:40<13:45:55, 14.37s/it]
 91%|█████████ | 34516/37963 [148:00:54<13:45:04, 14.36s/it]
 91%|█████████ | 34517/37963 [148:01:09<13:44:39, 14.36s/it]
 91%|█████████ | 34518/37963 [148:01:23<13:46:59, 14.40s/it]
 91%|█████████ | 34519/37963 [148:01:37<13:40:04, 14.29s/it]
 91%|█████████ | 34520/37963 [148:01:51<13:40:37, 14.30s/it]
                                                            
{'loss': '0.07183', 'grad_norm': '3.676', 'learning_rate': '4.286e-07', 'epoch': '0.9093'}

 91%|█████████ | 34520/37963 [148:01:51<13:40:37, 14.30s/it]
 91%|█████████ | 34521/37963 [148:02:05<13:35:11, 14.21s/it]
 91%|█████████ | 34522/37963 [148:02:20<13:35:19, 14.22s/it]
 91%|█████████ | 34523/37963 [148:02:34<13:37:40, 14.26s/it]
 91%|█████████ | 34524/37963 [148:02:55<15:27:34, 16.18s/it]
 91%|█████████ | 34525/37963 [148:03:09<14:58:31, 15.68s/it]
 91%|█████████ | 34526/37963 [148:03:23<14:30:59, 15.21s/it]
 91%|█████████ | 34527/37963 [148:03:38<14:17:23, 14.97s/it]
 91%|█████████ | 34528/37963 [148:04:06<18:10:30, 19.05s/it]
 91%|█████████ | 34529/37963 [148:04:27<18:37:22, 19.52s/it]
 91%|█████████ | 34530/37963 [148:04:41<17:09:37, 18.00s/it]
                                                            
{'loss': '0.05176', 'grad_norm': '2.195', 'learning_rate': '4.261e-07', 'epoch': '0.9096'}

 91%|█████████ | 34530/37963 [148:04:41<17:09:37, 18.00s/it]
 91%|█████████ | 34531/37963 [148:04:56<16:06:29, 16.90s/it]
 91%|█████████ | 34532/37963 [148:05:10<15:23:14, 16.15s/it]
 91%|█████████ | 34533/37963 [148:05:24<14:53:25, 15.63s/it]
 91%|█████████ | 34534/37963 [148:05:39<14:32:18, 15.26s/it]
 91%|█████████ | 34535/37963 [148:05:53<14:14:39, 14.96s/it]
 91%|█████████ | 34536/37963 [148:06:07<13:58:32, 14.68s/it]
 91%|█████████ | 34537/37963 [148:06:22<13:54:19, 14.61s/it]
 91%|█████████ | 34538/37963 [148:06:36<13:46:48, 14.48s/it]
 91%|█████████ | 34539/37963 [148:06:50<13:41:13, 14.39s/it]
 91%|█████████ | 34540/37963 [148:07:04<13:25:52, 14.13s/it]
                                                            
{'loss': '0.06698', 'grad_norm': '2.837', 'learning_rate': '4.236e-07', 'epoch': '0.9098'}

 91%|█████████ | 34540/37963 [148:07:04<13:25:52, 14.13s/it]
 91%|█████████ | 34541/37963 [148:07:18<13:29:45, 14.20s/it]
 91%|█████████ | 34542/37963 [148:07:32<13:32:44, 14.25s/it]
 91%|█████████ | 34543/37963 [148:08:00<17:22:16, 18.29s/it]
 91%|█████████ | 34544/37963 [148:08:14<16:15:24, 17.12s/it]
 91%|█████████ | 34545/37963 [148:08:29<15:27:37, 16.28s/it]
 91%|█████████ | 34546/37963 [148:08:43<14:53:23, 15.69s/it]
 91%|█████████ | 34547/37963 [148:09:04<16:27:26, 17.34s/it]
 91%|█████████ | 34548/37963 [148:09:19<15:36:49, 16.46s/it]
 91%|█████████ | 34549/37963 [148:09:33<15:06:25, 15.93s/it]
 91%|█████████ | 34550/37963 [148:09:48<14:40:44, 15.48s/it]
                                                            
{'loss': '0.07156', 'grad_norm': '3.211', 'learning_rate': '4.212e-07', 'epoch': '0.9101'}

 91%|█████████ | 34550/37963 [148:09:48<14:40:44, 15.48s/it]
 91%|█████████ | 34551/37963 [148:10:02<14:22:22, 15.16s/it]
 91%|█████████ | 34552/37963 [148:10:22<15:50:32, 16.72s/it]
 91%|█████████ | 34553/37963 [148:10:37<15:12:21, 16.05s/it]
 91%|█████████ | 34554/37963 [148:10:51<14:39:33, 15.48s/it]
 91%|█████████ | 34555/37963 [148:11:06<14:22:10, 15.18s/it]
 91%|█████████ | 34556/37963 [148:11:20<14:07:18, 14.92s/it]
 91%|█████████ | 34557/37963 [148:11:34<13:54:27, 14.70s/it]
 91%|█████████ | 34558/37963 [148:11:48<13:36:38, 14.39s/it]
 91%|█████████ | 34559/37963 [148:12:02<13:36:34, 14.39s/it]
 91%|█████████ | 34560/37963 [148:12:17<13:36:00, 14.39s/it]
                                                            
{'loss': '0.06797', 'grad_norm': '3.845', 'learning_rate': '4.187e-07', 'epoch': '0.9104'}

 91%|█████████ | 34560/37963 [148:12:17<13:36:00, 14.39s/it]
 91%|█████████ | 34561/37963 [148:12:31<13:35:59, 14.39s/it]
 91%|█████████ | 34562/37963 [148:12:45<13:35:59, 14.40s/it]
 91%|█████████ | 34563/37963 [148:13:00<13:35:55, 14.40s/it]
 91%|█████████ | 34564/37963 [148:13:14<13:29:11, 14.28s/it]
 91%|█████████ | 34565/37963 [148:13:28<13:29:29, 14.29s/it]
 91%|█████████ | 34566/37963 [148:13:43<13:31:12, 14.33s/it]
 91%|█████████ | 34567/37963 [148:13:57<13:31:19, 14.33s/it]
 91%|█████████ | 34568/37963 [148:14:11<13:24:48, 14.22s/it]
 91%|█████████ | 34569/37963 [148:14:25<13:23:47, 14.21s/it]
 91%|█████████ | 34570/37963 [148:14:39<13:26:32, 14.26s/it]
                                                            
{'loss': '0.06817', 'grad_norm': '3.302', 'learning_rate': '4.163e-07', 'epoch': '0.9106'}

 91%|█████████ | 34570/37963 [148:14:39<13:26:32, 14.26s/it]
 91%|█████████ | 34571/37963 [148:14:53<13:21:56, 14.19s/it]
 91%|█████████ | 34572/37963 [148:15:14<15:13:04, 16.16s/it]
 91%|█████████ | 34573/37963 [148:15:29<14:42:56, 15.63s/it]
 91%|█████████ | 34574/37963 [148:15:43<14:20:51, 15.24s/it]
 91%|█████████ | 34575/37963 [148:15:57<14:05:39, 14.98s/it]
 91%|█████████ | 34576/37963 [148:16:18<15:47:07, 16.78s/it]
 91%|█████████ | 34577/37963 [148:16:33<15:06:36, 16.07s/it]
 91%|█████████ | 34578/37963 [148:16:54<16:32:15, 17.59s/it]
 91%|█████████ | 34579/37963 [148:17:08<15:37:10, 16.62s/it]
 91%|█████████ | 34580/37963 [148:17:22<14:50:15, 15.79s/it]
                                                            
{'loss': '0.07303', 'grad_norm': '2.331', 'learning_rate': '4.139e-07', 'epoch': '0.9109'}

 91%|█████████ | 34580/37963 [148:17:22<14:50:15, 15.79s/it]
 91%|█████████ | 34581/37963 [148:17:36<14:16:19, 15.19s/it]
 91%|█████████ | 34582/37963 [148:17:50<13:52:26, 14.77s/it]
 91%|█████████ | 34583/37963 [148:18:04<13:46:53, 14.68s/it]
 91%|█████████ | 34584/37963 [148:18:18<13:42:22, 14.60s/it]
 91%|█████████ | 34585/37963 [148:18:33<13:39:27, 14.56s/it]
 91%|█████████ | 34586/37963 [148:18:47<13:37:10, 14.52s/it]
 91%|█████████ | 34587/37963 [148:19:02<13:34:00, 14.47s/it]
 91%|█████████ | 34588/37963 [148:19:16<13:32:04, 14.44s/it]
 91%|█████████ | 34589/37963 [148:19:30<13:27:24, 14.36s/it]
 91%|█████████ | 34590/37963 [148:19:45<13:26:17, 14.34s/it]
                                                            
{'loss': '0.05936', 'grad_norm': '3.708', 'learning_rate': '4.114e-07', 'epoch': '0.9112'}

 91%|█████████ | 34590/37963 [148:19:45<13:26:17, 14.34s/it]
 91%|█████████ | 34591/37963 [148:19:59<13:26:12, 14.35s/it]
 91%|█████████ | 34592/37963 [148:20:26<17:09:04, 18.32s/it]
 91%|█████████ | 34593/37963 [148:20:48<17:58:37, 19.20s/it]
 91%|█████████ | 34594/37963 [148:21:02<16:33:46, 17.70s/it]
 91%|█████████ | 34595/37963 [148:21:16<15:34:11, 16.64s/it]
 91%|█████████ | 34596/37963 [148:21:30<14:46:27, 15.80s/it]
 91%|█████████ | 34597/37963 [148:21:44<14:16:33, 15.27s/it]
 91%|█████████ | 34598/37963 [148:21:58<14:03:23, 15.04s/it]
 91%|█████████ | 34599/37963 [148:22:13<13:48:12, 14.77s/it]
 91%|█████████ | 34600/37963 [148:22:33<15:27:46, 16.55s/it]
                                                            
{'loss': '0.06766', 'grad_norm': '3.414', 'learning_rate': '4.09e-07', 'epoch': '0.9114'}

 91%|█████████ | 34600/37963 [148:22:33<15:27:46, 16.55s/it]
 91%|█████████ | 34601/37963 [148:22:48<14:53:06, 15.94s/it]
 91%|█████████ | 34602/37963 [148:23:02<14:26:16, 15.46s/it]
 91%|█████████ | 34603/37963 [148:23:16<14:06:05, 15.11s/it]
 91%|█████████ | 34604/37963 [148:23:31<13:49:47, 14.82s/it]
 91%|█████████ | 34605/37963 [148:23:44<13:32:59, 14.53s/it]
 91%|█████████ | 34606/37963 [148:23:59<13:31:59, 14.51s/it]
 91%|█████████ | 34607/37963 [148:24:13<13:23:39, 14.37s/it]
 91%|█████████ | 34608/37963 [148:24:27<13:23:10, 14.36s/it]
 91%|█████████ | 34609/37963 [148:24:42<13:27:54, 14.45s/it]
 91%|█████████ | 34610/37963 [148:24:56<13:26:12, 14.43s/it]
                                                            
{'loss': '0.07205', 'grad_norm': '2.922', 'learning_rate': '4.066e-07', 'epoch': '0.9117'}

 91%|█████████ | 34610/37963 [148:24:56<13:26:12, 14.43s/it]
 91%|█████████ | 34611/37963 [148:25:11<13:24:46, 14.41s/it]
 91%|█████████ | 34612/37963 [148:25:25<13:25:17, 14.42s/it]
 91%|█████████ | 34613/37963 [148:25:40<13:24:13, 14.40s/it]
 91%|█████████ | 34614/37963 [148:25:54<13:22:45, 14.38s/it]
 91%|█████████ | 34615/37963 [148:26:08<13:24:30, 14.42s/it]
 91%|█████████ | 34616/37963 [148:26:23<13:23:52, 14.41s/it]
 91%|█████████ | 34617/37963 [148:26:37<13:14:48, 14.25s/it]
 91%|█████████ | 34618/37963 [148:26:51<13:17:11, 14.30s/it]
 91%|█████████ | 34619/37963 [148:27:05<13:17:49, 14.32s/it]
 91%|█████████ | 34620/37963 [148:27:26<14:58:15, 16.12s/it]
                                                            
{'loss': '0.07212', 'grad_norm': '2.658', 'learning_rate': '4.042e-07', 'epoch': '0.9119'}

 91%|█████████ | 34620/37963 [148:27:26<14:58:15, 16.12s/it]
 91%|█████████ | 34621/37963 [148:27:40<14:30:10, 15.62s/it]
 91%|█████████ | 34622/37963 [148:27:55<14:08:34, 15.24s/it]
 91%|█████████ | 34623/37963 [148:28:09<13:54:04, 14.98s/it]
 91%|█████████ | 34624/37963 [148:28:23<13:44:14, 14.81s/it]
 91%|█████████ | 34625/37963 [148:28:45<15:31:15, 16.74s/it]
 91%|█████████ | 34626/37963 [148:29:05<16:39:35, 17.97s/it]
 91%|█████████ | 34627/37963 [148:29:27<17:36:10, 19.00s/it]
 91%|█████████ | 34628/37963 [148:29:41<16:14:37, 17.53s/it]
 91%|█████████ | 34629/37963 [148:29:55<15:23:48, 16.63s/it]
 91%|█████████ | 34630/37963 [148:30:10<14:47:32, 15.98s/it]
                                                            
{'loss': '0.0605', 'grad_norm': '2.593', 'learning_rate': '4.018e-07', 'epoch': '0.9122'}

 91%|█████████ | 34630/37963 [148:30:10<14:47:32, 15.98s/it]
 91%|█████████ | 34631/37963 [148:30:24<14:15:44, 15.41s/it]
 91%|█████████ | 34632/37963 [148:30:38<13:59:59, 15.13s/it]
 91%|█████████ | 34633/37963 [148:30:53<13:46:40, 14.90s/it]
 91%|█████████ | 34634/37963 [148:31:07<13:37:41, 14.74s/it]
 91%|█████████ | 34635/37963 [148:31:22<13:33:09, 14.66s/it]
 91%|█████████ | 34636/37963 [148:31:36<13:33:13, 14.67s/it]
 91%|█████████ | 34637/37963 [148:31:50<13:24:01, 14.50s/it]
 91%|█████████ | 34638/37963 [148:32:05<13:21:34, 14.46s/it]
 91%|█████████ | 34639/37963 [148:32:18<13:05:31, 14.18s/it]
 91%|█████████ | 34640/37963 [148:32:33<13:05:32, 14.18s/it]
                                                            
{'loss': '0.0643', 'grad_norm': '2.841', 'learning_rate': '3.994e-07', 'epoch': '0.9125'}

 91%|█████████ | 34640/37963 [148:32:33<13:05:32, 14.18s/it]
 91%|█████████ | 34641/37963 [148:33:00<16:41:24, 18.09s/it]
 91%|█████████▏| 34642/37963 [148:33:21<17:28:11, 18.94s/it]
 91%|█████████▏| 34643/37963 [148:33:35<16:16:27, 17.65s/it]
 91%|█████████▏| 34644/37963 [148:33:50<15:22:49, 16.68s/it]
 91%|█████████▏| 34645/37963 [148:34:04<14:46:13, 16.03s/it]
 91%|█████████▏| 34646/37963 [148:34:19<14:18:55, 15.54s/it]
 91%|█████████▏| 34647/37963 [148:34:39<15:46:57, 17.13s/it]
 91%|█████████▏| 34648/37963 [148:34:54<15:03:02, 16.34s/it]
 91%|█████████▏| 34649/37963 [148:35:09<14:35:07, 15.84s/it]
 91%|█████████▏| 34650/37963 [148:35:23<14:10:15, 15.40s/it]
                                                            
{'loss': '0.07651', 'grad_norm': '4.115', 'learning_rate': '3.97e-07', 'epoch': '0.9127'}

 91%|█████████▏| 34650/37963 [148:35:23<14:10:15, 15.40s/it]
 91%|█████████▏| 34651/37963 [148:35:37<13:43:55, 14.93s/it]
 91%|█████████▏| 34652/37963 [148:35:51<13:34:43, 14.76s/it]
 91%|█████████▏| 34653/37963 [148:36:06<13:28:38, 14.66s/it]
 91%|█████████▏| 34654/37963 [148:36:20<13:25:33, 14.61s/it]
 91%|█████████▏| 34655/37963 [148:36:34<13:08:04, 14.29s/it]
 91%|█████████▏| 34656/37963 [148:36:48<13:09:00, 14.32s/it]
 91%|█████████▏| 34657/37963 [148:37:03<13:12:44, 14.39s/it]
 91%|█████████▏| 34658/37963 [148:37:17<13:13:41, 14.41s/it]
 91%|█████████▏| 34659/37963 [148:37:31<13:03:15, 14.22s/it]
 91%|█████████▏| 34660/37963 [148:37:45<13:05:40, 14.27s/it]
                                                            
{'loss': '0.06487', 'grad_norm': '3.275', 'learning_rate': '3.946e-07', 'epoch': '0.913'}

 91%|█████████▏| 34660/37963 [148:37:45<13:05:40, 14.27s/it]
 91%|█████████▏| 34661/37963 [148:38:00<13:05:34, 14.27s/it]
 91%|█████████▏| 34662/37963 [148:38:14<13:07:58, 14.32s/it]
 91%|█████████▏| 34663/37963 [148:38:28<13:09:34, 14.36s/it]
 91%|█████████▏| 34664/37963 [148:38:43<13:10:04, 14.37s/it]
 91%|█████████▏| 34665/37963 [148:38:57<13:09:19, 14.36s/it]
 91%|█████████▏| 34666/37963 [148:39:11<13:04:52, 14.28s/it]
 91%|█████████▏| 34667/37963 [148:39:26<13:05:56, 14.31s/it]
 91%|█████████▏| 34668/37963 [148:39:46<14:51:50, 16.24s/it]
 91%|█████████▏| 34669/37963 [148:40:01<14:20:08, 15.67s/it]
 91%|█████████▏| 34670/37963 [148:40:15<13:55:41, 15.23s/it]
                                                            
{'loss': '0.06456', 'grad_norm': '3.903', 'learning_rate': '3.923e-07', 'epoch': '0.9133'}

 91%|█████████▏| 34670/37963 [148:40:15<13:55:41, 15.23s/it]
 91%|█████████▏| 34671/37963 [148:40:29<13:43:04, 15.00s/it]
 91%|█████████▏| 34672/37963 [148:40:44<13:31:38, 14.80s/it]
 91%|█████████▏| 34673/37963 [148:40:58<13:23:58, 14.66s/it]
 91%|█████████▏| 34674/37963 [148:41:12<13:17:14, 14.54s/it]
 91%|█████████▏| 34675/37963 [148:41:33<14:58:45, 16.40s/it]
 91%|█████████▏| 34676/37963 [148:42:00<17:56:28, 19.65s/it]
 91%|█████████▏| 34677/37963 [148:42:15<16:29:02, 18.06s/it]
 91%|█████████▏| 34678/37963 [148:42:29<15:27:30, 16.94s/it]
 91%|█████████▏| 34679/37963 [148:42:43<14:46:26, 16.20s/it]
 91%|█████████▏| 34680/37963 [148:42:58<14:16:56, 15.66s/it]
                                                            
{'loss': '0.07501', 'grad_norm': '3.217', 'learning_rate': '3.899e-07', 'epoch': '0.9135'}

 91%|█████████▏| 34680/37963 [148:42:58<14:16:56, 15.66s/it]
 91%|█████████▏| 34681/37963 [148:43:12<13:49:43, 15.17s/it]
 91%|█████████▏| 34682/37963 [148:43:26<13:39:45, 14.99s/it]
 91%|█████████▏| 34683/37963 [148:43:40<13:19:49, 14.63s/it]
 91%|█████████▏| 34684/37963 [148:43:55<13:15:19, 14.55s/it]
 91%|█████████▏| 34685/37963 [148:44:09<13:13:27, 14.52s/it]
 91%|█████████▏| 34686/37963 [148:44:23<13:10:38, 14.48s/it]
 91%|█████████▏| 34687/37963 [148:44:38<13:09:10, 14.45s/it]
 91%|█████████▏| 34688/37963 [148:44:52<13:02:35, 14.34s/it]
 91%|█████████▏| 34689/37963 [148:45:13<14:49:10, 16.30s/it]
 91%|█████████▏| 34690/37963 [148:45:27<14:20:27, 15.77s/it]
                                                            
{'loss': '0.06462', 'grad_norm': '2.166', 'learning_rate': '3.876e-07', 'epoch': '0.9138'}

 91%|█████████▏| 34690/37963 [148:45:27<14:20:27, 15.77s/it]
 91%|█████████▏| 34691/37963 [148:45:55<17:33:42, 19.32s/it]
 91%|█████████▏| 34692/37963 [148:46:09<16:12:57, 17.85s/it]
 91%|█████████▏| 34693/37963 [148:46:23<15:08:32, 16.67s/it]
 91%|█████████▏| 34694/37963 [148:46:38<14:31:55, 16.00s/it]
 91%|█████████▏| 34695/37963 [148:46:52<14:05:24, 15.52s/it]
 91%|█████████▏| 34696/37963 [148:47:06<13:47:10, 15.19s/it]
 91%|█████████▏| 34697/37963 [148:47:27<15:19:24, 16.89s/it]
 91%|█████████▏| 34698/37963 [148:47:42<14:42:12, 16.21s/it]
 91%|█████████▏| 34699/37963 [148:47:56<14:11:20, 15.65s/it]
 91%|█████████▏| 34700/37963 [148:48:11<13:50:39, 15.27s/it]
                                                            
{'loss': '0.07105', 'grad_norm': '2.458', 'learning_rate': '3.852e-07', 'epoch': '0.9141'}

 91%|█████████▏| 34700/37963 [148:48:11<13:50:39, 15.27s/it]
 91%|█████████▏| 34701/37963 [148:48:25<13:33:07, 14.96s/it]
 91%|█████████▏| 34702/37963 [148:48:39<13:21:20, 14.74s/it]
 91%|█████████▏| 34703/37963 [148:48:54<13:15:43, 14.65s/it]
 91%|█████████▏| 34704/37963 [148:49:08<13:12:17, 14.59s/it]
 91%|█████████▏| 34705/37963 [148:49:22<13:08:59, 14.53s/it]
 91%|█████████▏| 34706/37963 [148:49:37<13:06:14, 14.48s/it]
 91%|█████████▏| 34707/37963 [148:49:51<13:01:53, 14.41s/it]
 91%|█████████▏| 34708/37963 [148:50:05<13:02:23, 14.42s/it]
 91%|█████████▏| 34709/37963 [148:50:20<13:03:34, 14.45s/it]
 91%|█████████▏| 34710/37963 [148:50:34<13:01:59, 14.42s/it]
                                                            
{'loss': '0.05854', 'grad_norm': '2.782', 'learning_rate': '3.829e-07', 'epoch': '0.9143'}

 91%|█████████▏| 34710/37963 [148:50:34<13:01:59, 14.42s/it]
 91%|█████████▏| 34711/37963 [148:50:49<13:01:23, 14.42s/it]
 91%|█████████▏| 34712/37963 [148:51:03<13:00:46, 14.41s/it]
 91%|█████████▏| 34713/37963 [148:51:18<13:00:43, 14.41s/it]
 91%|█████████▏| 34714/37963 [148:51:32<13:02:44, 14.45s/it]
 91%|█████████▏| 34715/37963 [148:51:46<12:53:29, 14.29s/it]
 91%|█████████▏| 34716/37963 [148:52:00<12:54:25, 14.31s/it]
 91%|█████████▏| 34717/37963 [148:52:15<12:55:34, 14.34s/it]
 91%|█████████▏| 34718/37963 [148:52:35<14:36:18, 16.20s/it]
 91%|█████████▏| 34719/37963 [148:52:50<14:07:58, 15.68s/it]
 91%|█████████▏| 34720/37963 [148:53:04<13:47:26, 15.31s/it]
                                                            
{'loss': '0.06337', 'grad_norm': '2.966', 'learning_rate': '3.805e-07', 'epoch': '0.9146'}

 91%|█████████▏| 34720/37963 [148:53:04<13:47:26, 15.31s/it]
 91%|█████████▏| 34721/37963 [148:53:18<13:29:40, 14.98s/it]
 91%|█████████▏| 34722/37963 [148:53:39<15:05:13, 16.76s/it]
 91%|█████████▏| 34723/37963 [148:53:53<14:18:59, 15.91s/it]
 91%|█████████▏| 34724/37963 [148:54:08<13:54:02, 15.45s/it]
 91%|█████████▏| 34725/37963 [148:54:36<17:16:00, 19.20s/it]
 91%|█████████▏| 34726/37963 [148:54:50<15:56:33, 17.73s/it]
 91%|█████████▏| 34727/37963 [148:55:04<15:01:09, 16.71s/it]
 91%|█████████▏| 34728/37963 [148:55:19<14:22:14, 15.99s/it]
 91%|█████████▏| 34729/37963 [148:55:32<13:46:43, 15.34s/it]
 91%|█████████▏| 34730/37963 [148:55:47<13:31:08, 15.05s/it]
                                                            
{'loss': '0.06106', 'grad_norm': '3.41', 'learning_rate': '3.782e-07', 'epoch': '0.9148'}

 91%|█████████▏| 34730/37963 [148:55:47<13:31:08, 15.05s/it]
 91%|█████████▏| 34731/37963 [148:56:00<13:08:23, 14.64s/it]
 91%|█████████▏| 34732/37963 [148:56:14<12:52:36, 14.35s/it]
 91%|█████████▏| 34733/37963 [148:56:29<12:55:22, 14.40s/it]
 91%|█████████▏| 34734/37963 [148:56:43<12:54:53, 14.40s/it]
 91%|█████████▏| 34735/37963 [148:56:57<12:55:45, 14.42s/it]
 91%|█████████▏| 34736/37963 [148:57:12<12:55:33, 14.42s/it]
 92%|█████████▏| 34737/37963 [148:57:33<14:39:28, 16.36s/it]
 92%|█████████▏| 34738/37963 [148:57:54<15:59:05, 17.84s/it]
 92%|█████████▏| 34739/37963 [148:58:09<15:04:15, 16.83s/it]
 92%|█████████▏| 34740/37963 [148:58:29<15:58:36, 17.85s/it]
                                                            
{'loss': '0.06472', 'grad_norm': '2.174', 'learning_rate': '3.759e-07', 'epoch': '0.9151'}

 92%|█████████▏| 34740/37963 [148:58:29<15:58:36, 17.85s/it]
 92%|█████████▏| 34741/37963 [148:58:43<15:03:09, 16.82s/it]
 92%|█████████▏| 34742/37963 [148:58:58<14:23:11, 16.08s/it]
 92%|█████████▏| 34743/37963 [148:59:12<13:50:16, 15.47s/it]
 92%|█████████▏| 34744/37963 [148:59:26<13:31:18, 15.12s/it]
 92%|█████████▏| 34745/37963 [148:59:40<13:11:42, 14.76s/it]
 92%|█████████▏| 34746/37963 [149:00:00<14:43:27, 16.48s/it]
 92%|█████████▏| 34747/37963 [149:00:15<14:08:43, 15.83s/it]
 92%|█████████▏| 34748/37963 [149:00:29<13:44:32, 15.39s/it]
 92%|█████████▏| 34749/37963 [149:00:44<13:31:32, 15.15s/it]
 92%|█████████▏| 34750/37963 [149:00:58<13:16:48, 14.88s/it]
                                                            
{'loss': '0.06143', 'grad_norm': '2.882', 'learning_rate': '3.736e-07', 'epoch': '0.9154'}

 92%|█████████▏| 34750/37963 [149:00:58<13:16:48, 14.88s/it]
 92%|█████████▏| 34751/37963 [149:01:12<13:08:23, 14.73s/it]
 92%|█████████▏| 34752/37963 [149:01:27<13:04:36, 14.66s/it]
 92%|█████████▏| 34753/37963 [149:01:41<13:00:32, 14.59s/it]
 92%|█████████▏| 34754/37963 [149:01:56<12:57:57, 14.55s/it]
 92%|█████████▏| 34755/37963 [149:02:10<12:55:12, 14.50s/it]
 92%|█████████▏| 34756/37963 [149:02:24<12:53:14, 14.47s/it]
 92%|█████████▏| 34757/37963 [149:02:39<12:51:36, 14.44s/it]
 92%|█████████▏| 34758/37963 [149:02:53<12:48:20, 14.38s/it]
 92%|█████████▏| 34759/37963 [149:03:08<12:52:32, 14.47s/it]
 92%|█████████▏| 34760/37963 [149:03:22<12:52:20, 14.47s/it]
                                                            
{'loss': '0.06621', 'grad_norm': '2.928', 'learning_rate': '3.713e-07', 'epoch': '0.9156'}

 92%|█████████▏| 34760/37963 [149:03:22<12:52:20, 14.47s/it]
 92%|█████████▏| 34761/37963 [149:03:36<12:50:19, 14.43s/it]
 92%|█████████▏| 34762/37963 [149:03:50<12:42:55, 14.30s/it]
 92%|█████████▏| 34763/37963 [149:04:04<12:32:54, 14.12s/it]
 92%|█████████▏| 34764/37963 [149:04:19<12:36:49, 14.20s/it]
 92%|█████████▏| 34765/37963 [149:04:33<12:36:21, 14.19s/it]
 92%|█████████▏| 34766/37963 [149:04:53<14:14:54, 16.04s/it]
 92%|█████████▏| 34767/37963 [149:05:08<13:50:02, 15.58s/it]
 92%|█████████▏| 34768/37963 [149:05:22<13:30:27, 15.22s/it]
 92%|█████████▏| 34769/37963 [149:05:36<13:13:09, 14.90s/it]
 92%|█████████▏| 34770/37963 [149:05:51<13:06:11, 14.77s/it]
                                                            
{'loss': '0.06207', 'grad_norm': '3.551', 'learning_rate': '3.69e-07', 'epoch': '0.9159'}

 92%|█████████▏| 34770/37963 [149:05:51<13:06:11, 14.77s/it]
 92%|█████████▏| 34771/37963 [149:06:05<13:02:25, 14.71s/it]
 92%|█████████▏| 34772/37963 [149:06:27<14:57:35, 16.88s/it]
 92%|█████████▏| 34773/37963 [149:06:48<16:07:15, 18.19s/it]
 92%|█████████▏| 34774/37963 [149:07:03<15:05:55, 17.04s/it]
 92%|█████████▏| 34775/37963 [149:07:24<16:05:57, 18.18s/it]
 92%|█████████▏| 34776/37963 [149:07:38<15:05:56, 17.06s/it]
 92%|█████████▏| 34777/37963 [149:07:52<14:23:12, 16.26s/it]
 92%|█████████▏| 34778/37963 [149:08:07<13:50:46, 15.65s/it]
 92%|█████████▏| 34779/37963 [149:08:21<13:32:51, 15.32s/it]
 92%|█████████▏| 34780/37963 [149:08:35<13:07:30, 14.84s/it]
                                                            
{'loss': '0.06298', 'grad_norm': '2.853', 'learning_rate': '3.667e-07', 'epoch': '0.9162'}

 92%|█████████▏| 34780/37963 [149:08:35<13:07:30, 14.84s/it]
 92%|█████████▏| 34781/37963 [149:08:49<12:51:06, 14.54s/it]
 92%|█████████▏| 34782/37963 [149:09:03<12:48:51, 14.50s/it]
 92%|█████████▏| 34783/37963 [149:09:17<12:44:43, 14.43s/it]
 92%|█████████▏| 34784/37963 [149:09:32<12:43:08, 14.40s/it]
 92%|█████████▏| 34785/37963 [149:09:46<12:39:30, 14.34s/it]
 92%|█████████▏| 34786/37963 [149:10:06<14:16:16, 16.17s/it]
 92%|█████████▏| 34787/37963 [149:10:28<15:40:10, 17.76s/it]
 92%|█████████▏| 34788/37963 [149:10:42<14:39:50, 16.63s/it]
 92%|█████████▏| 34789/37963 [149:10:56<14:05:49, 15.99s/it]
 92%|█████████▏| 34790/37963 [149:11:16<15:09:56, 17.21s/it]
                                                            
{'loss': '0.07148', 'grad_norm': '3.397', 'learning_rate': '3.644e-07', 'epoch': '0.9164'}

 92%|█████████▏| 34790/37963 [149:11:16<15:09:56, 17.21s/it]
 92%|█████████▏| 34791/37963 [149:11:31<14:25:55, 16.38s/it]
 92%|█████████▏| 34792/37963 [149:11:45<13:43:29, 15.58s/it]
 92%|█████████▏| 34793/37963 [149:11:59<13:26:01, 15.26s/it]
 92%|█████████▏| 34794/37963 [149:12:13<13:12:31, 15.01s/it]
 92%|█████████▏| 34795/37963 [149:12:34<14:38:37, 16.64s/it]
 92%|█████████▏| 34796/37963 [149:12:48<14:05:06, 16.01s/it]
 92%|█████████▏| 34797/37963 [149:13:03<13:40:58, 15.56s/it]
 92%|█████████▏| 34798/37963 [149:13:17<13:20:09, 15.17s/it]
 92%|█████████▏| 34799/37963 [149:13:32<13:10:15, 14.99s/it]
 92%|█████████▏| 34800/37963 [149:13:46<13:00:23, 14.80s/it]
                                                            
{'loss': '0.06944', 'grad_norm': '4.998', 'learning_rate': '3.621e-07', 'epoch': '0.9167'}

 92%|█████████▏| 34800/37963 [149:13:46<13:00:23, 14.80s/it]
 92%|█████████▏| 34801/37963 [149:14:01<12:53:19, 14.67s/it]
 92%|█████████▏| 34802/37963 [149:14:15<12:45:53, 14.54s/it]
 92%|█████████▏| 34803/37963 [149:14:29<12:44:26, 14.51s/it]
 92%|█████████▏| 34804/37963 [149:14:44<12:42:41, 14.49s/it]
 92%|█████████▏| 34805/37963 [149:14:58<12:38:30, 14.41s/it]
 92%|█████████▏| 34806/37963 [149:15:12<12:40:21, 14.45s/it]
 92%|█████████▏| 34807/37963 [149:15:27<12:40:01, 14.45s/it]
 92%|█████████▏| 34808/37963 [149:15:41<12:37:01, 14.40s/it]
 92%|█████████▏| 34809/37963 [149:15:56<12:38:44, 14.43s/it]
 92%|█████████▏| 34810/37963 [149:16:09<12:27:21, 14.22s/it]
                                                            
{'loss': '0.0724', 'grad_norm': '2.572', 'learning_rate': '3.598e-07', 'epoch': '0.9169'}

 92%|█████████▏| 34810/37963 [149:16:09<12:27:21, 14.22s/it]
 92%|█████████▏| 34811/37963 [149:16:23<12:21:16, 14.11s/it]
 92%|█████████▏| 34812/37963 [149:16:38<12:25:50, 14.20s/it]
 92%|█████████▏| 34813/37963 [149:16:59<14:13:34, 16.26s/it]
 92%|█████████▏| 34814/37963 [149:17:13<13:44:14, 15.70s/it]
 92%|█████████▏| 34815/37963 [149:17:28<13:23:33, 15.32s/it]
 92%|█████████▏| 34816/37963 [149:17:42<13:08:24, 15.03s/it]
 92%|█████████▏| 34817/37963 [149:17:56<12:58:59, 14.86s/it]
 92%|█████████▏| 34818/37963 [149:18:11<12:51:37, 14.72s/it]
 92%|█████████▏| 34819/37963 [149:18:25<12:45:33, 14.61s/it]
 92%|█████████▏| 34820/37963 [149:18:39<12:36:50, 14.45s/it]
                                                            
{'loss': '0.06137', 'grad_norm': '2.652', 'learning_rate': '3.576e-07', 'epoch': '0.9172'}

 92%|█████████▏| 34820/37963 [149:18:39<12:36:50, 14.45s/it]
 92%|█████████▏| 34821/37963 [149:19:00<14:23:21, 16.49s/it]
 92%|█████████▏| 34822/37963 [149:19:22<15:46:22, 18.08s/it]
 92%|█████████▏| 34823/37963 [149:19:37<14:53:01, 17.06s/it]
 92%|█████████▏| 34824/37963 [149:19:51<14:11:49, 16.28s/it]
 92%|█████████▏| 34825/37963 [149:20:06<13:41:49, 15.71s/it]
 92%|█████████▏| 34826/37963 [149:20:26<14:57:34, 17.17s/it]
 92%|█████████▏| 34827/37963 [149:20:41<14:15:10, 16.36s/it]
 92%|█████████▏| 34828/37963 [149:20:55<13:39:16, 15.68s/it]
 92%|█████████▏| 34829/37963 [149:21:09<13:19:25, 15.31s/it]
 92%|█████████▏| 34830/37963 [149:21:24<13:04:41, 15.03s/it]
                                                            
{'loss': '0.06071', 'grad_norm': '2.841', 'learning_rate': '3.553e-07', 'epoch': '0.9175'}

 92%|█████████▏| 34830/37963 [149:21:24<13:04:41, 15.03s/it]
 92%|█████████▏| 34831/37963 [149:21:38<12:55:02, 14.85s/it]
 92%|█████████▏| 34832/37963 [149:21:53<12:48:44, 14.73s/it]
 92%|█████████▏| 34833/37963 [149:22:07<12:42:14, 14.61s/it]
 92%|█████████▏| 34834/37963 [149:22:21<12:38:55, 14.55s/it]
 92%|█████████▏| 34835/37963 [149:22:49<16:08:59, 18.59s/it]
 92%|█████████▏| 34836/37963 [149:23:04<15:02:29, 17.32s/it]
 92%|█████████▏| 34837/37963 [149:23:18<14:18:08, 16.47s/it]
 92%|█████████▏| 34838/37963 [149:23:32<13:36:19, 15.67s/it]
 92%|█████████▏| 34839/37963 [149:23:53<14:55:37, 17.20s/it]
 92%|█████████▏| 34840/37963 [149:24:07<14:11:49, 16.37s/it]
                                                            
{'loss': '0.061', 'grad_norm': '2.078', 'learning_rate': '3.531e-07', 'epoch': '0.9177'}

 92%|█████████▏| 34840/37963 [149:24:07<14:11:49, 16.37s/it]
 92%|█████████▏| 34841/37963 [149:24:22<13:40:42, 15.77s/it]
 92%|█████████▏| 34842/37963 [149:24:36<13:20:43, 15.39s/it]
 92%|█████████▏| 34843/37963 [149:24:50<13:04:57, 15.10s/it]
 92%|█████████▏| 34844/37963 [149:25:11<14:31:13, 16.76s/it]
 92%|█████████▏| 34845/37963 [149:25:25<13:53:48, 16.05s/it]
 92%|█████████▏| 34846/37963 [149:25:40<13:27:53, 15.55s/it]
 92%|█████████▏| 34847/37963 [149:25:54<13:09:24, 15.20s/it]
 92%|█████████▏| 34848/37963 [149:26:09<12:57:43, 14.98s/it]
 92%|█████████▏| 34849/37963 [149:26:23<12:47:50, 14.79s/it]
 92%|█████████▏| 34850/37963 [149:26:38<12:41:59, 14.69s/it]
                                                            
{'loss': '0.06863', 'grad_norm': '3.507', 'learning_rate': '3.508e-07', 'epoch': '0.918'}

 92%|█████████▏| 34850/37963 [149:26:38<12:41:59, 14.69s/it]
 92%|█████████▏| 34851/37963 [149:26:51<12:27:32, 14.41s/it]
 92%|█████████▏| 34852/37963 [149:27:05<12:18:05, 14.24s/it]
 92%|█████████▏| 34853/37963 [149:27:19<12:18:43, 14.25s/it]
 92%|█████████▏| 34854/37963 [149:27:34<12:22:12, 14.32s/it]
 92%|█████████▏| 34855/37963 [149:27:48<12:14:41, 14.18s/it]
 92%|█████████▏| 34856/37963 [149:28:02<12:21:47, 14.32s/it]
 92%|█████████▏| 34857/37963 [149:28:17<12:23:26, 14.36s/it]
 92%|█████████▏| 34858/37963 [149:28:31<12:25:59, 14.42s/it]
 92%|█████████▏| 34859/37963 [149:28:46<12:27:02, 14.44s/it]
 92%|█████████▏| 34860/37963 [149:29:00<12:26:31, 14.44s/it]
                                                            
{'loss': '0.06725', 'grad_norm': '2.415', 'learning_rate': '3.486e-07', 'epoch': '0.9183'}

 92%|█████████▏| 34860/37963 [149:29:00<12:26:31, 14.44s/it]
 92%|█████████▏| 34861/37963 [149:29:21<14:01:23, 16.27s/it]
 92%|█████████▏| 34862/37963 [149:29:35<13:32:07, 15.71s/it]
 92%|█████████▏| 34863/37963 [149:29:50<13:10:42, 15.30s/it]
 92%|█████████▏| 34864/37963 [149:30:04<12:56:20, 15.03s/it]
 92%|█████████▏| 34865/37963 [149:30:18<12:46:28, 14.84s/it]
 92%|█████████▏| 34866/37963 [149:30:33<12:39:09, 14.71s/it]
 92%|█████████▏| 34867/37963 [149:30:47<12:24:30, 14.43s/it]
 92%|█████████▏| 34868/37963 [149:31:01<12:22:49, 14.40s/it]
 92%|█████████▏| 34869/37963 [149:31:15<12:22:31, 14.40s/it]
 92%|█████████▏| 34870/37963 [149:31:30<12:22:53, 14.41s/it]
                                                            
{'loss': '0.06821', 'grad_norm': '3.351', 'learning_rate': '3.464e-07', 'epoch': '0.9185'}

 92%|█████████▏| 34870/37963 [149:31:30<12:22:53, 14.41s/it]
 92%|█████████▏| 34871/37963 [149:31:51<14:03:28, 16.37s/it]
 92%|█████████▏| 34872/37963 [149:32:05<13:33:13, 15.79s/it]
 92%|█████████▏| 34873/37963 [149:32:20<13:11:38, 15.37s/it]
 92%|█████████▏| 34874/37963 [149:32:34<12:56:42, 15.09s/it]
 92%|█████████▏| 34875/37963 [149:32:55<14:26:58, 16.85s/it]
 92%|█████████▏| 34876/37963 [149:33:09<13:48:45, 16.11s/it]
 92%|█████████▏| 34877/37963 [149:33:24<13:21:43, 15.59s/it]
 92%|█████████▏| 34878/37963 [149:33:38<13:03:06, 15.23s/it]
 92%|█████████▏| 34879/37963 [149:33:52<12:45:31, 14.89s/it]
 92%|█████████▏| 34880/37963 [149:34:07<12:37:13, 14.74s/it]
                                                            
{'loss': '0.0662', 'grad_norm': '2.839', 'learning_rate': '3.441e-07', 'epoch': '0.9188'}

 92%|█████████▏| 34880/37963 [149:34:07<12:37:13, 14.74s/it]
 92%|█████████▏| 34881/37963 [149:34:21<12:30:46, 14.62s/it]
 92%|█████████▏| 34882/37963 [149:34:42<14:13:57, 16.63s/it]
 92%|█████████▏| 34883/37963 [149:34:56<13:27:44, 15.74s/it]
 92%|█████████▏| 34884/37963 [149:35:16<14:40:02, 17.15s/it]
 92%|█████████▏| 34885/37963 [149:35:31<13:56:54, 16.31s/it]
 92%|█████████▏| 34886/37963 [149:35:45<13:28:03, 15.76s/it]
 92%|█████████▏| 34887/37963 [149:36:00<13:06:59, 15.35s/it]
 92%|█████████▏| 34888/37963 [149:36:14<12:51:16, 15.05s/it]
 92%|█████████▏| 34889/37963 [149:36:35<14:20:14, 16.79s/it]
 92%|█████████▏| 34890/37963 [149:36:49<13:43:17, 16.07s/it]
                                                            
{'loss': '0.07462', 'grad_norm': '4.157', 'learning_rate': '3.419e-07', 'epoch': '0.9191'}

 92%|█████████▏| 34890/37963 [149:36:49<13:43:17, 16.07s/it]
 92%|█████████▏| 34891/37963 [149:37:03<13:16:26, 15.56s/it]
 92%|█████████▏| 34892/37963 [149:37:24<14:36:09, 17.12s/it]
 92%|█████████▏| 34893/37963 [149:37:38<13:48:50, 16.20s/it]
 92%|█████████▏| 34894/37963 [149:37:52<13:10:04, 15.45s/it]
 92%|█████████▏| 34895/37963 [149:38:06<12:53:17, 15.12s/it]
 92%|█████████▏| 34896/37963 [149:38:20<12:38:10, 14.83s/it]
 92%|█████████▏| 34897/37963 [149:38:35<12:31:08, 14.70s/it]
 92%|█████████▏| 34898/37963 [149:38:49<12:28:36, 14.65s/it]
 92%|█████████▏| 34899/37963 [149:39:04<12:22:04, 14.53s/it]
 92%|█████████▏| 34900/37963 [149:39:18<12:20:24, 14.50s/it]
                                                            
{'loss': '0.05993', 'grad_norm': '3.664', 'learning_rate': '3.397e-07', 'epoch': '0.9193'}

 92%|█████████▏| 34900/37963 [149:39:18<12:20:24, 14.50s/it]
 92%|█████████▏| 34901/37963 [149:39:33<12:20:02, 14.50s/it]
 92%|█████████▏| 34902/37963 [149:39:47<12:19:09, 14.49s/it]
 92%|█████████▏| 34903/37963 [149:40:01<12:09:47, 14.31s/it]
 92%|█████████▏| 34904/37963 [149:40:15<12:12:07, 14.36s/it]
 92%|█████████▏| 34905/37963 [149:40:30<12:12:50, 14.38s/it]
 92%|█████████▏| 34906/37963 [149:40:44<12:12:37, 14.38s/it]
 92%|█████████▏| 34907/37963 [149:40:59<12:12:31, 14.38s/it]
 92%|█████████▏| 34908/37963 [149:41:13<12:09:02, 14.32s/it]
 92%|█████████▏| 34909/37963 [149:41:34<13:46:49, 16.24s/it]
 92%|█████████▏| 34910/37963 [149:41:48<13:17:15, 15.67s/it]
                                                            
{'loss': '0.05617', 'grad_norm': '2.549', 'learning_rate': '3.375e-07', 'epoch': '0.9196'}

 92%|█████████▏| 34910/37963 [149:41:48<13:17:15, 15.67s/it]
 92%|█████████▏| 34911/37963 [149:42:02<12:57:04, 15.28s/it]
 92%|█████████▏| 34912/37963 [149:42:17<12:44:57, 15.04s/it]
 92%|█████████▏| 34913/37963 [149:42:31<12:33:11, 14.82s/it]
 92%|█████████▏| 34914/37963 [149:42:45<12:24:58, 14.66s/it]
 92%|█████████▏| 34915/37963 [149:42:59<12:10:04, 14.37s/it]
 92%|█████████▏| 34916/37963 [149:43:13<12:07:21, 14.32s/it]
 92%|█████████▏| 34917/37963 [149:43:28<12:08:06, 14.34s/it]
 92%|█████████▏| 34918/37963 [149:43:41<11:58:36, 14.16s/it]
 92%|█████████▏| 34919/37963 [149:44:09<15:17:05, 18.08s/it]
 92%|█████████▏| 34920/37963 [149:44:23<14:18:26, 16.93s/it]
                                                            
{'loss': '0.0666', 'grad_norm': '3.638', 'learning_rate': '3.353e-07', 'epoch': '0.9198'}

 92%|█████████▏| 34920/37963 [149:44:23<14:18:26, 16.93s/it]
 92%|█████████▏| 34921/37963 [149:44:37<13:30:36, 15.99s/it]
 92%|█████████▏| 34922/37963 [149:44:50<12:57:55, 15.35s/it]
 92%|█████████▏| 34923/37963 [149:45:11<14:19:58, 16.97s/it]
 92%|█████████▏| 34924/37963 [149:45:25<13:32:25, 16.04s/it]
 92%|█████████▏| 34925/37963 [149:45:39<13:07:22, 15.55s/it]
 92%|█████████▏| 34926/37963 [149:45:54<12:50:21, 15.22s/it]
 92%|█████████▏| 34927/37963 [149:46:09<12:42:07, 15.06s/it]
 92%|█████████▏| 34928/37963 [149:46:23<12:31:25, 14.86s/it]
 92%|█████████▏| 34929/37963 [149:46:37<12:23:41, 14.71s/it]
 92%|█████████▏| 34930/37963 [149:46:58<13:50:46, 16.43s/it]
                                                            
{'loss': '0.06614', 'grad_norm': '3.103', 'learning_rate': '3.331e-07', 'epoch': '0.9201'}

 92%|█████████▏| 34930/37963 [149:46:58<13:50:46, 16.43s/it]
 92%|█████████▏| 34931/37963 [149:47:19<14:58:53, 17.79s/it]
 92%|█████████▏| 34932/37963 [149:47:33<14:06:09, 16.75s/it]
 92%|█████████▏| 34933/37963 [149:47:48<13:31:38, 16.07s/it]
 92%|█████████▏| 34934/37963 [149:48:02<13:01:20, 15.48s/it]
 92%|█████████▏| 34935/37963 [149:48:16<12:43:57, 15.14s/it]
 92%|█████████▏| 34936/37963 [149:48:30<12:25:02, 14.77s/it]
 92%|█████████▏| 34937/37963 [149:48:51<13:55:26, 16.57s/it]
 92%|█████████▏| 34938/37963 [149:49:05<13:22:55, 15.93s/it]
 92%|█████████▏| 34939/37963 [149:49:20<12:59:10, 15.46s/it]
 92%|█████████▏| 34940/37963 [149:49:34<12:43:17, 15.15s/it]
                                                            
{'loss': '0.06979', 'grad_norm': '4.025', 'learning_rate': '3.309e-07', 'epoch': '0.9204'}

 92%|█████████▏| 34940/37963 [149:49:34<12:43:17, 15.15s/it]
 92%|█████████▏| 34941/37963 [149:49:48<12:31:38, 14.92s/it]
 92%|█████████▏| 34942/37963 [149:50:09<14:03:41, 16.76s/it]
 92%|█████████▏| 34943/37963 [149:50:24<13:28:19, 16.06s/it]
 92%|█████████▏| 34944/37963 [149:50:38<12:58:11, 15.47s/it]
 92%|█████████▏| 34945/37963 [149:50:52<12:43:01, 15.17s/it]
 92%|█████████▏| 34946/37963 [149:51:07<12:31:22, 14.94s/it]
 92%|█████████▏| 34947/37963 [149:51:21<12:23:47, 14.80s/it]
 92%|█████████▏| 34948/37963 [149:51:36<12:17:18, 14.67s/it]
 92%|█████████▏| 34949/37963 [149:51:50<12:13:10, 14.60s/it]
 92%|█████████▏| 34950/37963 [149:52:04<12:06:35, 14.47s/it]
                                                            
{'loss': '0.06088', 'grad_norm': '3.629', 'learning_rate': '3.288e-07', 'epoch': '0.9206'}

 92%|█████████▏| 34950/37963 [149:52:04<12:06:35, 14.47s/it]
 92%|█████████▏| 34951/37963 [149:52:19<12:05:34, 14.45s/it]
 92%|█████████▏| 34952/37963 [149:52:33<12:03:48, 14.42s/it]
 92%|█████████▏| 34953/37963 [149:52:47<12:02:47, 14.41s/it]
 92%|█████████▏| 34954/37963 [149:53:02<12:02:31, 14.41s/it]
 92%|█████████▏| 34955/37963 [149:53:16<12:00:52, 14.38s/it]
 92%|█████████▏| 34956/37963 [149:53:37<13:35:22, 16.27s/it]
 92%|█████████▏| 34957/37963 [149:53:51<13:06:37, 15.70s/it]
 92%|█████████▏| 34958/37963 [149:54:05<12:38:43, 15.15s/it]
 92%|█████████▏| 34959/37963 [149:54:19<12:25:57, 14.90s/it]
 92%|█████████▏| 34960/37963 [149:54:34<12:18:17, 14.75s/it]
                                                            
{'loss': '0.07399', 'grad_norm': '3.228', 'learning_rate': '3.266e-07', 'epoch': '0.9209'}

 92%|█████████▏| 34960/37963 [149:54:34<12:18:17, 14.75s/it]
 92%|█████████▏| 34961/37963 [149:54:48<12:11:30, 14.62s/it]
 92%|█████████▏| 34962/37963 [149:55:02<12:07:22, 14.54s/it]
 92%|█████████▏| 34963/37963 [149:55:17<12:05:45, 14.52s/it]
 92%|█████████▏| 34964/37963 [149:55:31<12:01:27, 14.43s/it]
 92%|█████████▏| 34965/37963 [149:55:45<12:00:19, 14.42s/it]
 92%|█████████▏| 34966/37963 [149:56:00<11:59:11, 14.40s/it]
 92%|█████████▏| 34967/37963 [149:56:21<13:36:47, 16.36s/it]
 92%|█████████▏| 34968/37963 [149:56:42<14:48:23, 17.80s/it]
 92%|█████████▏| 34969/37963 [149:56:56<13:53:26, 16.70s/it]
 92%|█████████▏| 34970/37963 [149:57:10<13:15:51, 15.95s/it]
                                                            
{'loss': '0.05789', 'grad_norm': '2.925', 'learning_rate': '3.245e-07', 'epoch': '0.9212'}

 92%|█████████▏| 34970/37963 [149:57:10<13:15:51, 15.95s/it]
 92%|█████████▏| 34971/37963 [149:57:24<12:40:55, 15.26s/it]
 92%|█████████▏| 34972/37963 [149:57:38<12:28:33, 15.02s/it]
 92%|█████████▏| 34973/37963 [149:57:59<13:53:16, 16.72s/it]
 92%|█████████▏| 34974/37963 [149:58:13<13:19:06, 16.04s/it]
 92%|█████████▏| 34975/37963 [149:58:28<12:55:18, 15.57s/it]
 92%|█████████▏| 34976/37963 [149:58:42<12:38:20, 15.23s/it]
 92%|█████████▏| 34977/37963 [149:58:57<12:27:09, 15.01s/it]
 92%|█████████▏| 34978/37963 [149:59:17<13:48:24, 16.65s/it]
 92%|█████████▏| 34979/37963 [149:59:32<13:15:21, 15.99s/it]
 92%|█████████▏| 34980/37963 [149:59:53<14:31:07, 17.52s/it]
                                                            
{'loss': '0.06768', 'grad_norm': '2.649', 'learning_rate': '3.223e-07', 'epoch': '0.9214'}

 92%|█████████▏| 34980/37963 [149:59:53<14:31:07, 17.52s/it]
 92%|█████████▏| 34981/37963 [150:00:07<13:44:15, 16.58s/it]
 92%|█████████▏| 34982/37963 [150:00:22<13:11:59, 15.94s/it]
 92%|█████████▏| 34983/37963 [150:00:36<12:46:47, 15.44s/it]
 92%|█████████▏| 34984/37963 [150:00:50<12:27:49, 15.06s/it]
 92%|█████████▏| 34985/37963 [150:01:05<12:17:27, 14.86s/it]
 92%|█████████▏| 34986/37963 [150:01:25<13:41:58, 16.57s/it]
 92%|█████████▏| 34987/37963 [150:01:40<13:09:16, 15.91s/it]
 92%|█████████▏| 34988/37963 [150:01:54<12:44:42, 15.42s/it]
 92%|█████████▏| 34989/37963 [150:02:08<12:29:00, 15.11s/it]
 92%|█████████▏| 34990/37963 [150:02:22<12:07:23, 14.68s/it]
                                                            
{'loss': '0.0704', 'grad_norm': '2.946', 'learning_rate': '3.202e-07', 'epoch': '0.9217'}

 92%|█████████▏| 34990/37963 [150:02:22<12:07:23, 14.68s/it]
 92%|█████████▏| 34991/37963 [150:02:36<12:02:39, 14.59s/it]
 92%|█████████▏| 34992/37963 [150:02:57<13:32:19, 16.41s/it]
 92%|█████████▏| 34993/37963 [150:03:11<13:01:54, 15.80s/it]
 92%|█████████▏| 34994/37963 [150:03:25<12:32:41, 15.21s/it]
 92%|█████████▏| 34995/37963 [150:03:39<12:20:11, 14.96s/it]
 92%|█████████▏| 34996/37963 [150:03:54<12:10:40, 14.78s/it]
 92%|█████████▏| 34997/37963 [150:04:08<12:04:47, 14.66s/it]
 92%|█████████▏| 34998/37963 [150:04:23<11:59:59, 14.57s/it]
 92%|█████████▏| 34999/37963 [150:04:37<11:58:10, 14.54s/it]
 92%|█████████▏| 35000/37963 [150:04:51<11:49:46, 14.37s/it]
                                                            
{'loss': '0.05063', 'grad_norm': '2.946', 'learning_rate': '3.18e-07', 'epoch': '0.922'}

 92%|█████████▏| 35000/37963 [150:04:51<11:49:46, 14.37s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.31s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.31s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 92%|█████████▏| 35001/37963 [150:06:38<34:35:46, 42.05s/it]
 92%|█████████▏| 35002/37963 [150:06:52<27:45:29, 33.75s/it]
 92%|█████████▏| 35003/37963 [150:07:06<22:59:05, 27.95s/it]
 92%|█████████▏| 35004/37963 [150:07:21<19:38:37, 23.90s/it]
 92%|█████████▏| 35005/37963 [150:07:35<17:17:40, 21.05s/it]
 92%|█████████▏| 35006/37963 [150:07:49<15:25:09, 18.77s/it]
 92%|█████████▏| 35007/37963 [150:08:10<15:54:09, 19.37s/it]
 92%|█████████▏| 35008/37963 [150:08:24<14:40:15, 17.87s/it]
 92%|█████████▏| 35009/37963 [150:08:38<13:41:02, 16.68s/it]
 92%|█████████▏| 35010/37963 [150:08:52<13:06:23, 15.98s/it]
                                                            
{'loss': '0.0669', 'grad_norm': '2.794', 'learning_rate': '3.159e-07', 'epoch': '0.9222'}

 92%|█████████▏| 35010/37963 [150:08:52<13:06:23, 15.98s/it]
 92%|█████████▏| 35011/37963 [150:09:07<12:42:42, 15.50s/it]
 92%|█████████▏| 35012/37963 [150:09:21<12:24:49, 15.14s/it]
 92%|█████████▏| 35013/37963 [150:09:35<12:15:07, 14.95s/it]
 92%|█████████▏| 35014/37963 [150:09:56<13:43:57, 16.76s/it]
 92%|█████████▏| 35015/37963 [150:10:18<14:48:53, 18.09s/it]
 92%|█████████▏| 35016/37963 [150:10:31<13:44:05, 16.78s/it]
 92%|█████████▏| 35017/37963 [150:10:46<13:07:58, 16.05s/it]
 92%|█████████▏| 35018/37963 [150:11:00<12:40:44, 15.50s/it]
 92%|█████████▏| 35019/37963 [150:11:14<12:23:16, 15.15s/it]
 92%|█████████▏| 35020/37963 [150:11:28<12:08:43, 14.86s/it]
                                                            
{'loss': '0.07451', 'grad_norm': '3.499', 'learning_rate': '3.138e-07', 'epoch': '0.9225'}

 92%|█████████▏| 35020/37963 [150:11:28<12:08:43, 14.86s/it]
 92%|█████████▏| 35021/37963 [150:11:42<11:51:35, 14.51s/it]
 92%|█████████▏| 35022/37963 [150:11:56<11:49:19, 14.47s/it]
 92%|█████████▏| 35023/37963 [150:12:17<13:21:06, 16.35s/it]
 92%|█████████▏| 35024/37963 [150:12:32<12:55:07, 15.82s/it]
 92%|█████████▏| 35025/37963 [150:12:46<12:34:23, 15.41s/it]
 92%|█████████▏| 35026/37963 [150:13:01<12:18:48, 15.09s/it]
 92%|█████████▏| 35027/37963 [150:13:22<13:50:53, 16.98s/it]
 92%|█████████▏| 35028/37963 [150:13:43<14:48:06, 18.16s/it]
 92%|█████████▏| 35029/37963 [150:13:57<13:52:56, 17.03s/it]
 92%|█████████▏| 35030/37963 [150:14:11<13:10:30, 16.17s/it]
                                                            
{'loss': '0.05881', 'grad_norm': '1.945', 'learning_rate': '3.116e-07', 'epoch': '0.9227'}

 92%|█████████▏| 35030/37963 [150:14:11<13:10:30, 16.17s/it]
 92%|█████████▏| 35031/37963 [150:14:25<12:34:33, 15.44s/it]
 92%|█████████▏| 35032/37963 [150:14:39<12:17:57, 15.11s/it]
 92%|█████████▏| 35033/37963 [150:14:54<12:03:26, 14.81s/it]
 92%|█████████▏| 35034/37963 [150:15:14<13:28:36, 16.56s/it]
 92%|█████████▏| 35035/37963 [150:15:29<12:56:33, 15.91s/it]
 92%|█████████▏| 35036/37963 [150:15:43<12:34:32, 15.47s/it]
 92%|█████████▏| 35037/37963 [150:15:57<12:12:54, 15.03s/it]
 92%|█████████▏| 35038/37963 [150:16:11<12:02:42, 14.82s/it]
 92%|█████████▏| 35039/37963 [150:16:26<11:56:07, 14.69s/it]
 92%|█████████▏| 35040/37963 [150:16:40<11:52:41, 14.63s/it]
                                                            
{'loss': '0.06501', 'grad_norm': '5.271', 'learning_rate': '3.095e-07', 'epoch': '0.923'}

 92%|█████████▏| 35040/37963 [150:16:40<11:52:41, 14.63s/it]
 92%|█████████▏| 35041/37963 [150:16:54<11:43:07, 14.44s/it]
 92%|█████████▏| 35042/37963 [150:17:15<13:16:39, 16.36s/it]
 92%|█████████▏| 35043/37963 [150:17:29<12:47:18, 15.77s/it]
 92%|█████████▏| 35044/37963 [150:17:44<12:26:09, 15.34s/it]
 92%|█████████▏| 35045/37963 [150:17:58<12:10:53, 15.03s/it]
 92%|█████████▏| 35046/37963 [150:18:12<11:53:44, 14.68s/it]
 92%|█████████▏| 35047/37963 [150:18:26<11:49:42, 14.60s/it]
 92%|█████████▏| 35048/37963 [150:18:41<11:46:53, 14.55s/it]
 92%|█████████▏| 35049/37963 [150:18:55<11:46:18, 14.54s/it]
 92%|█████████▏| 35050/37963 [150:19:10<11:44:15, 14.51s/it]
                                                            
{'loss': '0.07283', 'grad_norm': '2.998', 'learning_rate': '3.074e-07', 'epoch': '0.9233'}

 92%|█████████▏| 35050/37963 [150:19:10<11:44:15, 14.51s/it]
 92%|█████████▏| 35051/37963 [150:19:24<11:40:15, 14.43s/it]
 92%|█████████▏| 35052/37963 [150:19:38<11:37:16, 14.37s/it]
 92%|█████████▏| 35053/37963 [150:19:53<11:39:12, 14.42s/it]
 92%|█████████▏| 35054/37963 [150:20:07<11:41:03, 14.46s/it]
 92%|█████████▏| 35055/37963 [150:20:28<13:12:15, 16.35s/it]
 92%|█████████▏| 35056/37963 [150:20:42<12:43:22, 15.76s/it]
 92%|█████████▏| 35057/37963 [150:20:57<12:23:24, 15.35s/it]
 92%|█████████▏| 35058/37963 [150:21:11<12:06:27, 15.00s/it]
 92%|█████████▏| 35059/37963 [150:21:25<11:56:53, 14.81s/it]
 92%|█████████▏| 35060/37963 [150:21:40<11:50:24, 14.68s/it]
                                                            
{'loss': '0.06484', 'grad_norm': '2.862', 'learning_rate': '3.053e-07', 'epoch': '0.9235'}

 92%|█████████▏| 35060/37963 [150:21:40<11:50:24, 14.68s/it]
 92%|█████████▏| 35061/37963 [150:21:54<11:45:46, 14.59s/it]
 92%|█████████▏| 35062/37963 [150:22:15<13:20:04, 16.55s/it]
 92%|█████████▏| 35063/37963 [150:22:30<12:49:39, 15.92s/it]
 92%|█████████▏| 35064/37963 [150:22:51<14:04:31, 17.48s/it]
 92%|█████████▏| 35065/37963 [150:23:05<13:12:16, 16.40s/it]
 92%|█████████▏| 35066/37963 [150:23:19<12:44:13, 15.83s/it]
 92%|█████████▏| 35067/37963 [150:23:34<12:23:25, 15.40s/it]
 92%|█████████▏| 35068/37963 [150:23:48<12:08:25, 15.10s/it]
 92%|█████████▏| 35069/37963 [150:24:02<11:57:19, 14.87s/it]
 92%|█████████▏| 35070/37963 [150:24:16<11:45:03, 14.62s/it]
                                                            
{'loss': '0.0588', 'grad_norm': '5.585', 'learning_rate': '3.032e-07', 'epoch': '0.9238'}

 92%|█████████▏| 35070/37963 [150:24:16<11:45:03, 14.62s/it]
 92%|█████████▏| 35071/37963 [150:24:31<11:36:49, 14.46s/it]
 92%|█████████▏| 35072/37963 [150:24:45<11:35:28, 14.43s/it]
 92%|█████████▏| 35073/37963 [150:25:06<13:17:07, 16.55s/it]
 92%|█████████▏| 35074/37963 [150:25:21<12:42:42, 15.84s/it]
 92%|█████████▏| 35075/37963 [150:25:35<12:21:48, 15.41s/it]
 92%|█████████▏| 35076/37963 [150:25:56<13:45:13, 17.15s/it]
 92%|█████████▏| 35077/37963 [150:26:17<14:40:34, 18.31s/it]
 92%|█████████▏| 35078/37963 [150:26:31<13:36:52, 16.99s/it]
 92%|█████████▏| 35079/37963 [150:26:46<12:59:53, 16.23s/it]
 92%|█████████▏| 35080/37963 [150:27:00<12:32:43, 15.67s/it]
                                                            
{'loss': '0.07578', 'grad_norm': '4.15', 'learning_rate': '3.012e-07', 'epoch': '0.9241'}

 92%|█████████▏| 35080/37963 [150:27:00<12:32:43, 15.67s/it]
 92%|█████████▏| 35081/37963 [150:27:14<12:14:36, 15.29s/it]
 92%|█████████▏| 35082/37963 [150:27:28<11:51:41, 14.82s/it]
 92%|█████████▏| 35083/37963 [150:27:48<13:09:26, 16.45s/it]
 92%|█████████▏| 35084/37963 [150:28:03<12:38:57, 15.82s/it]
 92%|█████████▏| 35085/37963 [150:28:17<12:15:59, 15.34s/it]
 92%|█████████▏| 35086/37963 [150:28:31<11:53:58, 14.89s/it]
 92%|█████████▏| 35087/37963 [150:28:45<11:47:04, 14.75s/it]
 92%|█████████▏| 35088/37963 [150:29:00<11:42:36, 14.66s/it]
 92%|█████████▏| 35089/37963 [150:29:14<11:36:04, 14.53s/it]
 92%|█████████▏| 35090/37963 [150:29:35<13:05:19, 16.40s/it]
                                                            
{'loss': '0.06814', 'grad_norm': '3.237', 'learning_rate': '2.991e-07', 'epoch': '0.9243'}

 92%|█████████▏| 35090/37963 [150:29:35<13:05:19, 16.40s/it]
 92%|█████████▏| 35091/37963 [150:29:49<12:34:44, 15.77s/it]
 92%|█████████▏| 35092/37963 [150:30:03<12:15:58, 15.38s/it]
 92%|█████████▏| 35093/37963 [150:30:17<11:48:33, 14.81s/it]
 92%|█████████▏| 35094/37963 [150:30:31<11:43:16, 14.71s/it]
 92%|█████████▏| 35095/37963 [150:30:45<11:33:32, 14.51s/it]
 92%|█████████▏| 35096/37963 [150:31:00<11:29:00, 14.42s/it]
 92%|█████████▏| 35097/37963 [150:31:14<11:23:16, 14.30s/it]
 92%|█████████▏| 35098/37963 [150:31:28<11:25:29, 14.36s/it]
 92%|█████████▏| 35099/37963 [150:31:43<11:27:02, 14.39s/it]
 92%|█████████▏| 35100/37963 [150:31:57<11:26:41, 14.39s/it]
                                                            
{'loss': '0.0669', 'grad_norm': '2.793', 'learning_rate': '2.97e-07', 'epoch': '0.9246'}

 92%|█████████▏| 35100/37963 [150:31:57<11:26:41, 14.39s/it]
 92%|█████████▏| 35101/37963 [150:32:11<11:22:18, 14.30s/it]
 92%|█████████▏| 35102/37963 [150:32:25<11:23:03, 14.32s/it]
 92%|█████████▏| 35103/37963 [150:32:39<11:16:35, 14.19s/it]
 92%|█████████▏| 35104/37963 [150:32:54<11:19:35, 14.26s/it]
 92%|█████████▏| 35105/37963 [150:33:08<11:22:44, 14.33s/it]
 92%|█████████▏| 35106/37963 [150:33:29<12:54:34, 16.27s/it]
 92%|█████████▏| 35107/37963 [150:33:43<12:27:34, 15.71s/it]
 92%|█████████▏| 35108/37963 [150:33:58<12:09:15, 15.33s/it]
 92%|█████████▏| 35109/37963 [150:34:12<11:56:16, 15.06s/it]
 92%|█████████▏| 35110/37963 [150:34:27<11:46:44, 14.86s/it]
                                                            
{'loss': '0.05946', 'grad_norm': '4.362', 'learning_rate': '2.95e-07', 'epoch': '0.9249'}

 92%|█████████▏| 35110/37963 [150:34:27<11:46:44, 14.86s/it]
 92%|█████████▏| 35111/37963 [150:34:48<13:19:42, 16.82s/it]
 92%|█████████▏| 35112/37963 [150:35:02<12:44:27, 16.09s/it]
 92%|█████████▏| 35113/37963 [150:35:17<12:16:49, 15.51s/it]
 92%|█████████▏| 35114/37963 [150:35:38<13:35:02, 17.16s/it]
 92%|█████████▏| 35115/37963 [150:35:52<12:50:21, 16.23s/it]
 93%|█████████▎| 35116/37963 [150:36:06<12:25:12, 15.71s/it]
 93%|█████████▎| 35117/37963 [150:36:21<12:07:12, 15.33s/it]
 93%|█████████▎| 35118/37963 [150:36:35<11:56:21, 15.11s/it]
 93%|█████████▎| 35119/37963 [150:36:50<11:45:13, 14.88s/it]
 93%|█████████▎| 35120/37963 [150:37:10<13:04:23, 16.55s/it]
                                                            
{'loss': '0.07104', 'grad_norm': '4.186', 'learning_rate': '2.929e-07', 'epoch': '0.9251'}

 93%|█████████▎| 35120/37963 [150:37:10<13:04:23, 16.55s/it]
 93%|█████████▎| 35121/37963 [150:37:25<12:34:38, 15.93s/it]
 93%|█████████▎| 35122/37963 [150:37:39<12:12:12, 15.46s/it]
 93%|█████████▎| 35123/37963 [150:37:53<11:55:38, 15.12s/it]
 93%|█████████▎| 35124/37963 [150:38:08<11:44:33, 14.89s/it]
 93%|█████████▎| 35125/37963 [150:38:22<11:31:05, 14.61s/it]
 93%|█████████▎| 35126/37963 [150:38:49<14:30:41, 18.41s/it]
 93%|█████████▎| 35127/37963 [150:39:03<13:33:53, 17.22s/it]
 93%|█████████▎| 35128/37963 [150:39:17<12:41:53, 16.12s/it]
 93%|█████████▎| 35129/37963 [150:39:31<12:18:23, 15.63s/it]
 93%|█████████▎| 35130/37963 [150:39:46<11:58:53, 15.23s/it]
                                                            
{'loss': '0.06216', 'grad_norm': '2.716', 'learning_rate': '2.909e-07', 'epoch': '0.9254'}

 93%|█████████▎| 35130/37963 [150:39:46<11:58:53, 15.23s/it]
 93%|█████████▎| 35131/37963 [150:40:00<11:46:16, 14.96s/it]
 93%|█████████▎| 35132/37963 [150:40:14<11:36:39, 14.77s/it]
 93%|█████████▎| 35133/37963 [150:40:35<13:01:48, 16.58s/it]
 93%|█████████▎| 35134/37963 [150:40:49<12:31:23, 15.94s/it]
 93%|█████████▎| 35135/37963 [150:41:04<12:08:34, 15.46s/it]
 93%|█████████▎| 35136/37963 [150:41:18<11:54:05, 15.16s/it]
 93%|█████████▎| 35137/37963 [150:41:39<13:08:56, 16.75s/it]
 93%|█████████▎| 35138/37963 [150:41:53<12:29:06, 15.91s/it]
 93%|█████████▎| 35139/37963 [150:42:07<12:02:33, 15.35s/it]
 93%|█████████▎| 35140/37963 [150:42:21<11:50:26, 15.10s/it]
                                                            
{'loss': '0.05506', 'grad_norm': '3.342', 'learning_rate': '2.888e-07', 'epoch': '0.9256'}

 93%|█████████▎| 35140/37963 [150:42:21<11:50:26, 15.10s/it]
 93%|█████████▎| 35141/37963 [150:42:36<11:40:56, 14.90s/it]
 93%|█████████▎| 35142/37963 [150:42:50<11:27:41, 14.63s/it]
 93%|█████████▎| 35143/37963 [150:43:04<11:21:06, 14.49s/it]
 93%|█████████▎| 35144/37963 [150:43:18<11:13:35, 14.34s/it]
 93%|█████████▎| 35145/37963 [150:43:32<11:15:17, 14.38s/it]
 93%|█████████▎| 35146/37963 [150:43:47<11:14:14, 14.36s/it]
 93%|█████████▎| 35147/37963 [150:44:01<11:10:33, 14.29s/it]
 93%|█████████▎| 35148/37963 [150:44:15<11:10:45, 14.30s/it]
 93%|█████████▎| 35149/37963 [150:44:29<11:08:34, 14.26s/it]
 93%|█████████▎| 35150/37963 [150:44:44<11:11:06, 14.31s/it]
                                                            
{'loss': '0.07129', 'grad_norm': '3.718', 'learning_rate': '2.868e-07', 'epoch': '0.9259'}

 93%|█████████▎| 35150/37963 [150:44:44<11:11:06, 14.31s/it]
 93%|█████████▎| 35151/37963 [150:44:58<11:13:17, 14.37s/it]
 93%|█████████▎| 35152/37963 [150:45:12<11:12:33, 14.36s/it]
 93%|█████████▎| 35153/37963 [150:45:32<12:30:16, 16.02s/it]
 93%|█████████▎| 35154/37963 [150:45:47<12:07:51, 15.55s/it]
 93%|█████████▎| 35155/37963 [150:46:01<11:52:54, 15.23s/it]
 93%|█████████▎| 35156/37963 [150:46:16<11:40:00, 14.96s/it]
 93%|█████████▎| 35157/37963 [150:46:30<11:31:41, 14.79s/it]
 93%|█████████▎| 35158/37963 [150:46:51<13:00:25, 16.69s/it]
 93%|█████████▎| 35159/37963 [150:47:06<12:27:27, 15.99s/it]
 93%|█████████▎| 35160/37963 [150:47:20<12:06:38, 15.55s/it]
                                                            
{'loss': '0.06324', 'grad_norm': '4.234', 'learning_rate': '2.848e-07', 'epoch': '0.9262'}

 93%|█████████▎| 35160/37963 [150:47:20<12:06:38, 15.55s/it]
 93%|█████████▎| 35161/37963 [150:47:34<11:49:57, 15.20s/it]
 93%|█████████▎| 35162/37963 [150:47:56<13:12:29, 16.98s/it]
 93%|█████████▎| 35163/37963 [150:48:10<12:37:22, 16.23s/it]
 93%|█████████▎| 35164/37963 [150:48:24<12:10:22, 15.66s/it]
 93%|█████████▎| 35165/37963 [150:48:39<11:53:37, 15.30s/it]
 93%|█████████▎| 35166/37963 [150:48:53<11:40:04, 15.02s/it]
 93%|█████████▎| 35167/37963 [150:49:14<13:00:06, 16.74s/it]
 93%|█████████▎| 35168/37963 [150:49:28<12:27:38, 16.05s/it]
 93%|█████████▎| 35169/37963 [150:49:43<12:02:51, 15.52s/it]
 93%|█████████▎| 35170/37963 [150:49:57<11:47:50, 15.21s/it]
                                                            
{'loss': '0.06187', 'grad_norm': '3.892', 'learning_rate': '2.828e-07', 'epoch': '0.9264'}

 93%|█████████▎| 35170/37963 [150:49:57<11:47:50, 15.21s/it]
 93%|█████████▎| 35171/37963 [150:50:11<11:32:13, 14.88s/it]
 93%|█████████▎| 35172/37963 [150:50:26<11:24:39, 14.72s/it]
 93%|█████████▎| 35173/37963 [150:50:40<11:20:46, 14.64s/it]
 93%|█████████▎| 35174/37963 [150:51:01<12:51:24, 16.60s/it]
 93%|█████████▎| 35175/37963 [150:51:23<13:57:06, 18.02s/it]
 93%|█████████▎| 35176/37963 [150:51:37<13:06:52, 16.94s/it]
 93%|█████████▎| 35177/37963 [150:51:51<12:32:13, 16.20s/it]
 93%|█████████▎| 35178/37963 [150:52:06<12:06:05, 15.64s/it]
 93%|█████████▎| 35179/37963 [150:52:20<11:46:39, 15.23s/it]
 93%|█████████▎| 35180/37963 [150:52:40<12:58:09, 16.78s/it]
                                                            
{'loss': '0.06987', 'grad_norm': '3.62', 'learning_rate': '2.807e-07', 'epoch': '0.9267'}

 93%|█████████▎| 35180/37963 [150:52:40<12:58:09, 16.78s/it]
 93%|█████████▎| 35181/37963 [150:52:55<12:21:04, 15.98s/it]
 93%|█████████▎| 35182/37963 [150:53:09<11:57:51, 15.49s/it]
 93%|█████████▎| 35183/37963 [150:53:23<11:41:19, 15.14s/it]
 93%|█████████▎| 35184/37963 [150:53:38<11:30:57, 14.92s/it]
 93%|█████████▎| 35185/37963 [150:53:52<11:23:20, 14.76s/it]
 93%|█████████▎| 35186/37963 [150:54:06<11:18:47, 14.67s/it]
 93%|█████████▎| 35187/37963 [150:54:27<12:43:17, 16.50s/it]
 93%|█████████▎| 35188/37963 [150:54:42<12:15:34, 15.90s/it]
 93%|█████████▎| 35189/37963 [150:54:56<11:46:29, 15.28s/it]
 93%|█████████▎| 35190/37963 [150:55:10<11:34:02, 15.02s/it]
                                                            
{'loss': '0.06673', 'grad_norm': '4.919', 'learning_rate': '2.787e-07', 'epoch': '0.927'}

 93%|█████████▎| 35190/37963 [150:55:10<11:34:02, 15.02s/it]
 93%|█████████▎| 35191/37963 [150:55:24<11:26:22, 14.86s/it]
 93%|█████████▎| 35192/37963 [150:55:39<11:19:34, 14.71s/it]
 93%|█████████▎| 35193/37963 [150:55:53<11:12:27, 14.57s/it]
 93%|█████████▎| 35194/37963 [150:56:07<11:09:42, 14.51s/it]
 93%|█████████▎| 35195/37963 [150:56:22<11:10:13, 14.53s/it]
 93%|█████████▎| 35196/37963 [150:56:36<11:08:00, 14.49s/it]
 93%|█████████▎| 35197/37963 [150:56:51<11:06:28, 14.46s/it]
 93%|█████████▎| 35198/37963 [150:57:05<11:01:06, 14.35s/it]
 93%|█████████▎| 35199/37963 [150:57:19<11:02:39, 14.38s/it]
 93%|█████████▎| 35200/37963 [150:57:40<12:28:47, 16.26s/it]
                                                            
{'loss': '0.05463', 'grad_norm': '2.847', 'learning_rate': '2.767e-07', 'epoch': '0.9272'}

 93%|█████████▎| 35200/37963 [150:57:40<12:28:47, 16.26s/it]
 93%|█████████▎| 35201/37963 [150:57:54<12:03:02, 15.71s/it]
 93%|█████████▎| 35202/37963 [150:58:09<11:44:51, 15.32s/it]
 93%|█████████▎| 35203/37963 [150:58:23<11:31:36, 15.03s/it]
 93%|█████████▎| 35204/37963 [150:58:38<11:23:15, 14.86s/it]
 93%|█████████▎| 35205/37963 [150:58:52<11:16:48, 14.72s/it]
 93%|█████████▎| 35206/37963 [150:59:06<11:12:05, 14.63s/it]
 93%|█████████▎| 35207/37963 [150:59:28<12:40:22, 16.55s/it]
 93%|█████████▎| 35208/37963 [150:59:41<12:00:38, 15.69s/it]
 93%|█████████▎| 35209/37963 [150:59:56<11:42:14, 15.30s/it]
 93%|█████████▎| 35210/37963 [151:00:10<11:30:07, 15.04s/it]
                                                            
{'loss': '0.06772', 'grad_norm': '3.458', 'learning_rate': '2.747e-07', 'epoch': '0.9275'}

 93%|█████████▎| 35210/37963 [151:00:10<11:30:07, 15.04s/it]
 93%|█████████▎| 35211/37963 [151:00:24<11:21:19, 14.85s/it]
 93%|█████████▎| 35212/37963 [151:00:46<12:47:11, 16.73s/it]
 93%|█████████▎| 35213/37963 [151:01:00<12:16:25, 16.07s/it]
 93%|█████████▎| 35214/37963 [151:01:15<11:53:53, 15.58s/it]
 93%|█████████▎| 35215/37963 [151:01:29<11:36:51, 15.22s/it]
 93%|█████████▎| 35216/37963 [151:01:49<12:44:56, 16.71s/it]
 93%|█████████▎| 35217/37963 [151:02:04<12:13:50, 16.03s/it]
 93%|█████████▎| 35218/37963 [151:02:17<11:43:21, 15.37s/it]
 93%|█████████▎| 35219/37963 [151:02:32<11:29:25, 15.07s/it]
 93%|█████████▎| 35220/37963 [151:02:46<11:19:46, 14.87s/it]
                                                            
{'loss': '0.07095', 'grad_norm': '1.688', 'learning_rate': '2.728e-07', 'epoch': '0.9277'}

 93%|█████████▎| 35220/37963 [151:02:46<11:19:46, 14.87s/it]
 93%|█████████▎| 35221/37963 [151:03:01<11:14:22, 14.76s/it]
 93%|█████████▎| 35222/37963 [151:03:22<12:39:22, 16.62s/it]
 93%|█████████▎| 35223/37963 [151:03:36<12:11:20, 16.01s/it]
 93%|█████████▎| 35224/37963 [151:03:57<13:23:18, 17.60s/it]
 93%|█████████▎| 35225/37963 [151:04:12<12:39:48, 16.65s/it]
 93%|█████████▎| 35226/37963 [151:04:26<12:05:23, 15.90s/it]
 93%|█████████▎| 35227/37963 [151:04:40<11:44:22, 15.45s/it]
 93%|█████████▎| 35228/37963 [151:04:55<11:29:58, 15.14s/it]
 93%|█████████▎| 35229/37963 [151:05:16<12:45:21, 16.80s/it]
 93%|█████████▎| 35230/37963 [151:05:30<12:10:53, 16.05s/it]
                                                            
{'loss': '0.06828', 'grad_norm': '3.021', 'learning_rate': '2.708e-07', 'epoch': '0.928'}

 93%|█████████▎| 35230/37963 [151:05:30<12:10:53, 16.05s/it]
 93%|█████████▎| 35231/37963 [151:05:44<11:48:05, 15.55s/it]
 93%|█████████▎| 35232/37963 [151:05:59<11:32:11, 15.21s/it]
 93%|█████████▎| 35233/37963 [151:06:13<11:20:18, 14.95s/it]
 93%|█████████▎| 35234/37963 [151:06:27<11:11:49, 14.77s/it]
 93%|█████████▎| 35235/37963 [151:06:42<11:04:22, 14.61s/it]
 93%|█████████▎| 35236/37963 [151:07:02<12:29:38, 16.49s/it]
 93%|█████████▎| 35237/37963 [151:07:17<11:58:52, 15.82s/it]
 93%|█████████▎| 35238/37963 [151:07:31<11:39:05, 15.39s/it]
 93%|█████████▎| 35239/37963 [151:07:46<11:25:22, 15.10s/it]
 93%|█████████▎| 35240/37963 [151:08:00<11:15:57, 14.89s/it]
                                                            
{'loss': '0.04641', 'grad_norm': '3.037', 'learning_rate': '2.688e-07', 'epoch': '0.9283'}

 93%|█████████▎| 35240/37963 [151:08:00<11:15:57, 14.89s/it]
 93%|█████████▎| 35241/37963 [151:08:14<11:04:36, 14.65s/it]
 93%|█████████▎| 35242/37963 [151:08:28<10:57:32, 14.50s/it]
 93%|█████████▎| 35243/37963 [151:08:43<10:57:35, 14.51s/it]
 93%|█████████▎| 35244/37963 [151:08:57<10:56:37, 14.49s/it]
 93%|█████████▎| 35245/37963 [151:09:12<10:55:09, 14.46s/it]
 93%|█████████▎| 35246/37963 [151:09:26<10:53:35, 14.43s/it]
 93%|█████████▎| 35247/37963 [151:09:40<10:47:46, 14.31s/it]
 93%|█████████▎| 35248/37963 [151:09:55<10:51:07, 14.39s/it]
 93%|█████████▎| 35249/37963 [151:10:15<12:18:15, 16.32s/it]
 93%|█████████▎| 35250/37963 [151:10:30<11:49:23, 15.69s/it]
                                                            
{'loss': '0.06001', 'grad_norm': '2.283', 'learning_rate': '2.669e-07', 'epoch': '0.9285'}

 93%|█████████▎| 35250/37963 [151:10:30<11:49:23, 15.69s/it]
 93%|█████████▎| 35251/37963 [151:10:44<11:31:14, 15.29s/it]
 93%|█████████▎| 35252/37963 [151:10:58<11:19:14, 15.03s/it]
 93%|█████████▎| 35253/37963 [151:11:13<11:10:05, 14.84s/it]
 93%|█████████▎| 35254/37963 [151:11:27<11:01:37, 14.65s/it]
 93%|█████████▎| 35255/37963 [151:11:41<10:54:49, 14.51s/it]
 93%|█████████▎| 35256/37963 [151:12:02<12:17:39, 16.35s/it]
 93%|█████████▎| 35257/37963 [151:12:16<11:44:46, 15.63s/it]
 93%|█████████▎| 35258/37963 [151:12:30<11:28:38, 15.27s/it]
 93%|█████████▎| 35259/37963 [151:12:45<11:17:27, 15.03s/it]
 93%|█████████▎| 35260/37963 [151:13:06<12:39:26, 16.86s/it]
                                                            
{'loss': '0.0658', 'grad_norm': '3.061', 'learning_rate': '2.649e-07', 'epoch': '0.9288'}

 93%|█████████▎| 35260/37963 [151:13:06<12:39:26, 16.86s/it]
 93%|█████████▎| 35261/37963 [151:13:20<12:05:50, 16.12s/it]
 93%|█████████▎| 35262/37963 [151:13:35<11:43:29, 15.63s/it]
 93%|█████████▎| 35263/37963 [151:13:49<11:24:24, 15.21s/it]
 93%|█████████▎| 35264/37963 [151:14:03<11:05:53, 14.80s/it]
 93%|█████████▎| 35265/37963 [151:14:24<12:28:18, 16.64s/it]
 93%|█████████▎| 35266/37963 [151:14:38<11:56:43, 15.95s/it]
 93%|█████████▎| 35267/37963 [151:14:52<11:34:05, 15.45s/it]
 93%|█████████▎| 35268/37963 [151:15:07<11:20:57, 15.16s/it]
 93%|█████████▎| 35269/37963 [151:15:21<11:10:21, 14.93s/it]
 93%|█████████▎| 35270/37963 [151:15:35<10:57:26, 14.65s/it]
                                                            
{'loss': '0.06081', 'grad_norm': '3.326', 'learning_rate': '2.63e-07', 'epoch': '0.9291'}

 93%|█████████▎| 35270/37963 [151:15:35<10:57:26, 14.65s/it]
 93%|█████████▎| 35271/37963 [151:15:56<12:26:47, 16.64s/it]
 93%|█████████▎| 35272/37963 [151:16:18<13:27:44, 18.01s/it]
 93%|█████████▎| 35273/37963 [151:16:32<12:39:11, 16.93s/it]
 93%|█████████▎| 35274/37963 [151:16:47<12:06:02, 16.20s/it]
 93%|█████████▎| 35275/37963 [151:17:01<11:38:47, 15.60s/it]
 93%|█████████▎| 35276/37963 [151:17:15<11:20:31, 15.20s/it]
 93%|█████████▎| 35277/37963 [151:17:29<11:06:39, 14.89s/it]
 93%|█████████▎| 35278/37963 [151:17:50<12:26:44, 16.69s/it]
 93%|█████████▎| 35279/37963 [151:18:04<11:55:16, 15.99s/it]
 93%|█████████▎| 35280/37963 [151:18:19<11:34:17, 15.53s/it]
                                                            
{'loss': '0.06918', 'grad_norm': '3.829', 'learning_rate': '2.61e-07', 'epoch': '0.9293'}

 93%|█████████▎| 35280/37963 [151:18:19<11:34:17, 15.53s/it]
 93%|█████████▎| 35281/37963 [151:18:33<11:20:55, 15.23s/it]
 93%|█████████▎| 35282/37963 [151:18:48<11:09:32, 14.98s/it]
 93%|█████████▎| 35283/37963 [151:19:02<11:03:23, 14.85s/it]
 93%|█████████▎| 35284/37963 [151:19:23<12:18:44, 16.55s/it]
 93%|█████████▎| 35285/37963 [151:19:37<11:49:52, 15.90s/it]
 93%|█████████▎| 35286/37963 [151:19:52<11:30:58, 15.49s/it]
 93%|█████████▎| 35287/37963 [151:20:06<11:11:13, 15.05s/it]
 93%|█████████▎| 35288/37963 [151:20:20<11:01:41, 14.84s/it]
 93%|█████████▎| 35289/37963 [151:20:35<10:55:27, 14.71s/it]
 93%|█████████▎| 35290/37963 [151:20:49<10:50:38, 14.60s/it]
                                                            
{'loss': '0.06549', 'grad_norm': '3.628', 'learning_rate': '2.591e-07', 'epoch': '0.9296'}

 93%|█████████▎| 35290/37963 [151:20:49<10:50:38, 14.60s/it]
 93%|█████████▎| 35291/37963 [151:21:03<10:48:58, 14.57s/it]
 93%|█████████▎| 35292/37963 [151:21:18<10:45:43, 14.51s/it]
 93%|█████████▎| 35293/37963 [151:21:32<10:43:09, 14.45s/it]
 93%|█████████▎| 35294/37963 [151:21:46<10:42:20, 14.44s/it]
 93%|█████████▎| 35295/37963 [151:22:01<10:39:49, 14.39s/it]
 93%|█████████▎| 35296/37963 [151:22:15<10:34:33, 14.28s/it]
 93%|█████████▎| 35297/37963 [151:22:35<11:52:10, 16.03s/it]
 93%|█████████▎| 35298/37963 [151:22:49<11:31:05, 15.56s/it]
 93%|█████████▎| 35299/37963 [151:23:04<11:14:48, 15.20s/it]
 93%|█████████▎| 35300/37963 [151:23:18<11:03:26, 14.95s/it]
                                                            
{'loss': '0.05769', 'grad_norm': '3.25', 'learning_rate': '2.572e-07', 'epoch': '0.9299'}

 93%|█████████▎| 35300/37963 [151:23:18<11:03:26, 14.95s/it]
 93%|█████████▎| 35301/37963 [151:23:32<10:55:43, 14.78s/it]
 93%|█████████▎| 35302/37963 [151:23:47<10:47:19, 14.60s/it]
 93%|█████████▎| 35303/37963 [151:24:01<10:45:00, 14.55s/it]
 93%|█████████▎| 35304/37963 [151:24:16<10:44:09, 14.54s/it]
 93%|█████████▎| 35305/37963 [151:24:30<10:41:56, 14.49s/it]
 93%|█████████▎| 35306/37963 [151:24:52<12:23:27, 16.79s/it]
 93%|█████████▎| 35307/37963 [151:25:07<11:52:17, 16.09s/it]
 93%|█████████▎| 35308/37963 [151:25:21<11:29:36, 15.58s/it]
 93%|█████████▎| 35309/37963 [151:25:42<12:40:11, 17.19s/it]
 93%|█████████▎| 35310/37963 [151:25:56<12:05:26, 16.41s/it]
                                                            
{'loss': '0.05914', 'grad_norm': '3.876', 'learning_rate': '2.552e-07', 'epoch': '0.9301'}

 93%|█████████▎| 35310/37963 [151:25:56<12:05:26, 16.41s/it]
 93%|█████████▎| 35311/37963 [151:26:11<11:37:57, 15.79s/it]
 93%|█████████▎| 35312/37963 [151:26:25<11:16:46, 15.32s/it]
 93%|█████████▎| 35313/37963 [151:26:39<11:04:14, 15.04s/it]
 93%|█████████▎| 35314/37963 [151:26:54<10:55:09, 14.84s/it]
 93%|█████████▎| 35315/37963 [151:27:15<12:17:02, 16.70s/it]
 93%|█████████▎| 35316/37963 [151:27:29<11:39:28, 15.86s/it]
 93%|█████████▎| 35317/37963 [151:27:43<11:20:01, 15.42s/it]
 93%|█████████▎| 35318/37963 [151:27:58<11:06:40, 15.12s/it]
 93%|█████████▎| 35319/37963 [151:28:12<10:58:04, 14.93s/it]
 93%|█████████▎| 35320/37963 [151:28:26<10:50:52, 14.78s/it]
                                                            
{'loss': '0.06953', 'grad_norm': '3.823', 'learning_rate': '2.533e-07', 'epoch': '0.9304'}

 93%|█████████▎| 35320/37963 [151:28:26<10:50:52, 14.78s/it]
 93%|█████████▎| 35321/37963 [151:28:55<13:46:19, 18.77s/it]
 93%|█████████▎| 35322/37963 [151:29:09<12:44:10, 17.36s/it]
 93%|█████████▎| 35323/37963 [151:29:23<12:01:06, 16.39s/it]
 93%|█████████▎| 35324/37963 [151:29:37<11:28:47, 15.66s/it]
 93%|█████████▎| 35325/37963 [151:29:51<11:14:18, 15.34s/it]
 93%|█████████▎| 35326/37963 [151:30:06<11:02:06, 15.07s/it]
 93%|█████████▎| 35327/37963 [151:30:27<12:19:30, 16.83s/it]
 93%|█████████▎| 35328/37963 [151:30:41<11:48:02, 16.12s/it]
 93%|█████████▎| 35329/37963 [151:30:56<11:26:03, 15.63s/it]
 93%|█████████▎| 35330/37963 [151:31:10<11:09:22, 15.25s/it]
                                                            
{'loss': '0.0614', 'grad_norm': '4.039', 'learning_rate': '2.514e-07', 'epoch': '0.9306'}

 93%|█████████▎| 35330/37963 [151:31:10<11:09:22, 15.25s/it]
 93%|█████████▎| 35331/37963 [151:31:24<10:57:29, 14.99s/it]
 93%|█████████▎| 35332/37963 [151:31:45<12:13:16, 16.72s/it]
 93%|█████████▎| 35333/37963 [151:32:00<11:42:16, 16.02s/it]
 93%|█████████▎| 35334/37963 [151:32:14<11:20:23, 15.53s/it]
 93%|█████████▎| 35335/37963 [151:32:28<11:02:58, 15.14s/it]
 93%|█████████▎| 35336/37963 [151:32:42<10:45:24, 14.74s/it]
 93%|█████████▎| 35337/37963 [151:32:56<10:40:33, 14.64s/it]
 93%|█████████▎| 35338/37963 [151:33:11<10:34:33, 14.50s/it]
 93%|█████████▎| 35339/37963 [151:33:25<10:31:23, 14.44s/it]
 93%|█████████▎| 35340/37963 [151:33:39<10:24:06, 14.28s/it]
                                                            
{'loss': '0.07517', 'grad_norm': '4.167', 'learning_rate': '2.495e-07', 'epoch': '0.9309'}

 93%|█████████▎| 35340/37963 [151:33:39<10:24:06, 14.28s/it]
 93%|█████████▎| 35341/37963 [151:33:53<10:25:57, 14.32s/it]
 93%|█████████▎| 35342/37963 [151:34:08<10:26:24, 14.34s/it]
 93%|█████████▎| 35343/37963 [151:34:22<10:21:53, 14.24s/it]
 93%|█████████▎| 35344/37963 [151:34:36<10:23:01, 14.27s/it]
 93%|█████████▎| 35345/37963 [151:34:57<11:48:37, 16.24s/it]
 93%|█████████▎| 35346/37963 [151:35:11<11:24:12, 15.69s/it]
 93%|█████████▎| 35347/37963 [151:35:26<11:07:27, 15.31s/it]
 93%|█████████▎| 35348/37963 [151:35:39<10:48:56, 14.89s/it]
 93%|█████████▎| 35349/37963 [151:35:53<10:34:36, 14.57s/it]
 93%|█████████▎| 35350/37963 [151:36:08<10:31:37, 14.50s/it]
                                                            
{'loss': '0.0654', 'grad_norm': '3.24', 'learning_rate': '2.476e-07', 'epoch': '0.9312'}

 93%|█████████▎| 35350/37963 [151:36:08<10:31:37, 14.50s/it]
 93%|█████████▎| 35351/37963 [151:36:22<10:30:20, 14.48s/it]
 93%|█████████▎| 35352/37963 [151:36:36<10:20:49, 14.27s/it]
 93%|█████████▎| 35353/37963 [151:36:50<10:22:09, 14.30s/it]
 93%|█████████▎| 35354/37963 [151:37:05<10:22:47, 14.32s/it]
 93%|█████████▎| 35355/37963 [151:37:26<11:49:05, 16.31s/it]
 93%|█████████▎| 35356/37963 [151:37:40<11:24:24, 15.75s/it]
 93%|█████████▎| 35357/37963 [151:37:54<11:05:51, 15.33s/it]
 93%|█████████▎| 35358/37963 [151:38:08<10:47:59, 14.93s/it]
 93%|█████████▎| 35359/37963 [151:38:29<12:01:38, 16.63s/it]
 93%|█████████▎| 35360/37963 [151:38:50<12:55:42, 17.88s/it]
                                                            
{'loss': '0.06148', 'grad_norm': '3.583', 'learning_rate': '2.458e-07', 'epoch': '0.9314'}

 93%|█████████▎| 35360/37963 [151:38:50<12:55:42, 17.88s/it]
 93%|█████████▎| 35361/37963 [151:39:04<12:09:31, 16.82s/it]
 93%|█████████▎| 35362/37963 [151:39:18<11:37:21, 16.09s/it]
 93%|█████████▎| 35363/37963 [151:39:33<11:14:33, 15.57s/it]
 93%|█████████▎| 35364/37963 [151:39:47<10:56:54, 15.17s/it]
 93%|█████████▎| 35365/37963 [151:40:01<10:47:32, 14.95s/it]
 93%|█████████▎| 35366/37963 [151:40:16<10:39:31, 14.78s/it]
 93%|█████████▎| 35367/37963 [151:40:30<10:34:15, 14.66s/it]
 93%|█████████▎| 35368/37963 [151:40:52<12:00:40, 16.66s/it]
 93%|█████████▎| 35369/37963 [151:41:06<11:30:36, 15.97s/it]
 93%|█████████▎| 35370/37963 [151:41:27<12:33:57, 17.45s/it]
                                                            
{'loss': '0.07416', 'grad_norm': '3.748', 'learning_rate': '2.439e-07', 'epoch': '0.9317'}

 93%|█████████▎| 35370/37963 [151:41:27<12:33:57, 17.45s/it]
 93%|█████████▎| 35371/37963 [151:41:41<11:53:55, 16.53s/it]
 93%|█████████▎| 35372/37963 [151:41:56<11:26:44, 15.90s/it]
 93%|█████████▎| 35373/37963 [151:42:10<11:07:28, 15.46s/it]
 93%|█████████▎| 35374/37963 [151:42:30<12:05:27, 16.81s/it]
 93%|█████████▎| 35375/37963 [151:42:44<11:22:53, 15.83s/it]
 93%|█████████▎| 35376/37963 [151:42:58<11:02:29, 15.37s/it]
 93%|█████████▎| 35377/37963 [151:43:12<10:43:17, 14.93s/it]
 93%|█████████▎| 35378/37963 [151:43:26<10:33:41, 14.71s/it]
 93%|█████████▎| 35379/37963 [151:43:40<10:28:22, 14.59s/it]
 93%|█████████▎| 35380/37963 [151:43:55<10:25:15, 14.52s/it]
                                                            
{'loss': '0.06406', 'grad_norm': '5.361', 'learning_rate': '2.42e-07', 'epoch': '0.932'}

 93%|█████████▎| 35380/37963 [151:43:55<10:25:15, 14.52s/it]
 93%|█████████▎| 35381/37963 [151:44:09<10:23:38, 14.49s/it]
 93%|█████████▎| 35382/37963 [151:44:29<11:38:22, 16.24s/it]
 93%|█████████▎| 35383/37963 [151:44:44<11:15:02, 15.70s/it]
 93%|█████████▎| 35384/37963 [151:44:58<10:57:44, 15.30s/it]
 93%|█████████▎| 35385/37963 [151:45:13<10:47:24, 15.07s/it]
 93%|█████████▎| 35386/37963 [151:45:27<10:36:01, 14.81s/it]
 93%|█████████▎| 35387/37963 [151:45:41<10:29:41, 14.67s/it]
 93%|█████████▎| 35388/37963 [151:45:55<10:15:32, 14.34s/it]
 93%|█████████▎| 35389/37963 [151:46:09<10:08:08, 14.18s/it]
 93%|█████████▎| 35390/37963 [151:46:22<10:02:53, 14.06s/it]
                                                            
{'loss': '0.0624', 'grad_norm': '3.925', 'learning_rate': '2.401e-07', 'epoch': '0.9322'}

 93%|█████████▎| 35390/37963 [151:46:22<10:02:53, 14.06s/it]
 93%|█████████▎| 35391/37963 [151:46:36<10:00:36, 14.01s/it]
 93%|█████████▎| 35392/37963 [151:46:51<10:06:28, 14.15s/it]
 93%|█████████▎| 35393/37963 [151:47:05<10:01:34, 14.04s/it]
 93%|█████████▎| 35394/37963 [151:47:18<9:59:36, 14.00s/it] 
 93%|█████████▎| 35395/37963 [151:47:39<11:23:23, 15.97s/it]
 93%|█████████▎| 35396/37963 [151:47:53<10:58:31, 15.39s/it]
 93%|█████████▎| 35397/37963 [151:48:06<10:32:51, 14.80s/it]
 93%|█████████▎| 35398/37963 [151:48:21<10:28:11, 14.69s/it]
 93%|█████████▎| 35399/37963 [151:48:35<10:22:18, 14.56s/it]
 93%|█████████▎| 35400/37963 [151:48:50<10:20:52, 14.53s/it]
                                                            
{'loss': '0.07319', 'grad_norm': '3.155', 'learning_rate': '2.383e-07', 'epoch': '0.9325'}

 93%|█████████▎| 35400/37963 [151:48:50<10:20:52, 14.53s/it]
 93%|█████████▎| 35401/37963 [151:49:04<10:20:30, 14.53s/it]
 93%|█████████▎| 35402/37963 [151:49:19<10:18:18, 14.49s/it]
 93%|█████████▎| 35403/37963 [151:49:39<11:38:52, 16.38s/it]
 93%|█████████▎| 35404/37963 [151:49:54<11:11:48, 15.75s/it]
 93%|█████████▎| 35405/37963 [151:50:08<10:51:08, 15.27s/it]
 93%|█████████▎| 35406/37963 [151:50:22<10:38:47, 14.99s/it]
 93%|█████████▎| 35407/37963 [151:50:43<11:52:35, 16.73s/it]
 93%|█████████▎| 35408/37963 [151:50:57<11:21:47, 16.01s/it]
 93%|█████████▎| 35409/37963 [151:51:18<12:24:59, 17.50s/it]
 93%|█████████▎| 35410/37963 [151:51:33<11:45:23, 16.58s/it]
                                                            
{'loss': '0.0626', 'grad_norm': '3.346', 'learning_rate': '2.364e-07', 'epoch': '0.9328'}

 93%|█████████▎| 35410/37963 [151:51:33<11:45:23, 16.58s/it]
 93%|█████████▎| 35411/37963 [151:51:47<11:11:45, 15.79s/it]
 93%|█████████▎| 35412/37963 [151:52:01<10:54:18, 15.39s/it]
 93%|█████████▎| 35413/37963 [151:52:15<10:41:11, 15.09s/it]
 93%|█████████▎| 35414/37963 [151:52:30<10:29:08, 14.81s/it]
 93%|█████████▎| 35415/37963 [151:52:44<10:24:11, 14.70s/it]
 93%|█████████▎| 35416/37963 [151:52:58<10:17:56, 14.56s/it]
 93%|█████████▎| 35417/37963 [151:53:12<10:10:59, 14.40s/it]
 93%|█████████▎| 35418/37963 [151:53:40<13:03:20, 18.47s/it]
 93%|█████████▎| 35419/37963 [151:53:55<12:11:10, 17.24s/it]
 93%|█████████▎| 35420/37963 [151:54:09<11:35:10, 16.40s/it]
                                                            
{'loss': '0.06408', 'grad_norm': '4.129', 'learning_rate': '2.346e-07', 'epoch': '0.933'}

 93%|█████████▎| 35420/37963 [151:54:09<11:35:10, 16.40s/it]
 93%|█████████▎| 35421/37963 [151:54:23<11:04:46, 15.69s/it]
 93%|█████████▎| 35422/37963 [151:54:38<10:48:05, 15.30s/it]
 93%|█████████▎| 35423/37963 [151:54:58<11:56:01, 16.91s/it]
 93%|█████████▎| 35424/37963 [151:55:13<11:22:53, 16.14s/it]
 93%|█████████▎| 35425/37963 [151:55:27<10:58:13, 15.56s/it]
 93%|█████████▎| 35426/37963 [151:55:41<10:36:55, 15.06s/it]
 93%|█████████▎| 35427/37963 [151:55:55<10:26:42, 14.83s/it]
 93%|█████████▎| 35428/37963 [151:56:09<10:20:35, 14.69s/it]
 93%|█████████▎| 35429/37963 [151:56:24<10:15:41, 14.58s/it]
 93%|█████████▎| 35430/37963 [151:56:37<10:04:49, 14.33s/it]
                                                            
{'loss': '0.06967', 'grad_norm': '2.882', 'learning_rate': '2.328e-07', 'epoch': '0.9333'}

 93%|█████████▎| 35430/37963 [151:56:37<10:04:49, 14.33s/it]
 93%|█████████▎| 35431/37963 [151:56:59<11:31:02, 16.38s/it]
 93%|█████████▎| 35432/37963 [151:57:13<11:05:46, 15.78s/it]
 93%|█████████▎| 35433/37963 [151:57:27<10:48:15, 15.37s/it]
 93%|█████████▎| 35434/37963 [151:57:42<10:34:42, 15.06s/it]
 93%|█████████▎| 35435/37963 [151:57:56<10:24:55, 14.83s/it]
 93%|█████████▎| 35436/37963 [151:58:10<10:16:50, 14.65s/it]
 93%|█████████▎| 35437/37963 [151:58:24<10:08:31, 14.45s/it]
 93%|█████████▎| 35438/37963 [151:58:39<10:07:41, 14.44s/it]
 93%|█████████▎| 35439/37963 [151:58:53<10:07:38, 14.44s/it]
 93%|█████████▎| 35440/37963 [151:59:07<10:05:41, 14.40s/it]
                                                            
{'loss': '0.06764', 'grad_norm': '3.289', 'learning_rate': '2.309e-07', 'epoch': '0.9335'}

 93%|█████████▎| 35440/37963 [151:59:07<10:05:41, 14.40s/it]
 93%|█████████▎| 35441/37963 [151:59:22<10:04:35, 14.38s/it]
 93%|█████████▎| 35442/37963 [151:59:36<10:04:22, 14.38s/it]
 93%|█████████▎| 35443/37963 [151:59:56<11:18:37, 16.16s/it]
 93%|█████████▎| 35444/37963 [152:00:10<10:52:30, 15.54s/it]
 93%|█████████▎| 35445/37963 [152:00:25<10:40:30, 15.26s/it]
 93%|█████████▎| 35446/37963 [152:00:40<10:30:11, 15.02s/it]
 93%|█████████▎| 35447/37963 [152:00:54<10:21:37, 14.82s/it]
 93%|█████████▎| 35448/37963 [152:01:08<10:16:42, 14.71s/it]
 93%|█████████▎| 35449/37963 [152:01:22<10:08:06, 14.51s/it]
 93%|█████████▎| 35450/37963 [152:01:37<10:06:46, 14.49s/it]
                                                            
{'loss': '0.05761', 'grad_norm': '4.425', 'learning_rate': '2.291e-07', 'epoch': '0.9338'}

 93%|█████████▎| 35450/37963 [152:01:37<10:06:46, 14.49s/it]
 93%|█████████▎| 35451/37963 [152:01:58<11:27:25, 16.42s/it]
 93%|█████████▎| 35452/37963 [152:02:12<11:03:26, 15.85s/it]
 93%|█████████▎| 35453/37963 [152:02:26<10:36:50, 15.22s/it]
 93%|█████████▎| 35454/37963 [152:02:40<10:26:26, 14.98s/it]
 93%|█████████▎| 35455/37963 [152:02:55<10:18:10, 14.79s/it]
 93%|█████████▎| 35456/37963 [152:03:22<12:52:01, 18.48s/it]
 93%|█████████▎| 35457/37963 [152:03:36<12:00:49, 17.26s/it]
 93%|█████████▎| 35458/37963 [152:03:51<11:23:46, 16.38s/it]
 93%|█████████▎| 35459/37963 [152:04:05<10:56:23, 15.73s/it]
 93%|█████████▎| 35460/37963 [152:04:19<10:40:52, 15.36s/it]
                                                            
{'loss': '0.06178', 'grad_norm': '3.007', 'learning_rate': '2.273e-07', 'epoch': '0.9341'}

 93%|█████████▎| 35460/37963 [152:04:19<10:40:52, 15.36s/it]
 93%|█████████▎| 35461/37963 [152:04:34<10:28:17, 15.07s/it]
 93%|█████████▎| 35462/37963 [152:04:48<10:21:12, 14.90s/it]
 93%|█████████▎| 35463/37963 [152:05:03<10:15:03, 14.76s/it]
 93%|█████████▎| 35464/37963 [152:05:17<10:10:38, 14.66s/it]
 93%|█████████▎| 35465/37963 [152:05:32<10:07:17, 14.59s/it]
 93%|█████████▎| 35466/37963 [152:05:52<11:20:49, 16.36s/it]
 93%|█████████▎| 35467/37963 [152:06:13<12:13:33, 17.63s/it]
 93%|█████████▎| 35468/37963 [152:06:26<11:24:22, 16.46s/it]
 93%|█████████▎| 35469/37963 [152:06:41<10:57:45, 15.82s/it]
 93%|█████████▎| 35470/37963 [152:06:54<10:31:16, 15.19s/it]
                                                            
{'loss': '0.06681', 'grad_norm': '3.804', 'learning_rate': '2.255e-07', 'epoch': '0.9343'}

 93%|█████████▎| 35470/37963 [152:06:54<10:31:16, 15.19s/it]
 93%|█████████▎| 35471/37963 [152:07:08<10:13:54, 14.78s/it]
 93%|█████████▎| 35472/37963 [152:07:29<11:28:55, 16.59s/it]
 93%|█████████▎| 35473/37963 [152:07:43<11:01:55, 15.95s/it]
 93%|█████████▎| 35474/37963 [152:07:58<10:42:12, 15.48s/it]
 93%|█████████▎| 35475/37963 [152:08:12<10:30:04, 15.19s/it]
 93%|█████████▎| 35476/37963 [152:08:26<10:15:35, 14.85s/it]
 93%|█████████▎| 35477/37963 [152:08:41<10:10:12, 14.73s/it]
 93%|█████████▎| 35478/37963 [152:09:01<11:22:35, 16.48s/it]
 93%|█████████▎| 35479/37963 [152:09:16<10:57:18, 15.88s/it]
 93%|█████████▎| 35480/37963 [152:09:30<10:38:14, 15.42s/it]
                                                            
{'loss': '0.04824', 'grad_norm': '2.556', 'learning_rate': '2.237e-07', 'epoch': '0.9346'}

 93%|█████████▎| 35480/37963 [152:09:30<10:38:14, 15.42s/it]
 93%|█████████▎| 35481/37963 [152:09:45<10:26:19, 15.14s/it]
 93%|█████████▎| 35482/37963 [152:09:59<10:16:25, 14.91s/it]
 93%|█████████▎| 35483/37963 [152:10:13<10:07:08, 14.69s/it]
 93%|█████████▎| 35484/37963 [152:10:27<9:58:08, 14.48s/it] 
 93%|█████████▎| 35485/37963 [152:10:41<9:52:00, 14.33s/it]
 93%|█████████▎| 35486/37963 [152:10:55<9:49:09, 14.27s/it]
 93%|█████████▎| 35487/37963 [152:11:10<9:48:22, 14.26s/it]
 93%|█████████▎| 35488/37963 [152:11:23<9:43:07, 14.14s/it]
 93%|█████████▎| 35489/37963 [152:11:38<9:48:35, 14.27s/it]
 93%|█████████▎| 35490/37963 [152:11:53<9:52:20, 14.37s/it]
                                                           
{'loss': '0.06884', 'grad_norm': '4.988', 'learning_rate': '2.219e-07', 'epoch': '0.9349'}

 93%|█████████▎| 35490/37963 [152:11:53<9:52:20, 14.37s/it]
 93%|█████████▎| 35491/37963 [152:12:07<9:53:07, 14.40s/it]
 93%|█████████▎| 35492/37963 [152:12:28<11:13:47, 16.36s/it]
 93%|█████████▎| 35493/37963 [152:12:42<10:41:13, 15.58s/it]
 93%|█████████▎| 35494/37963 [152:12:56<10:28:40, 15.28s/it]
 93%|█████████▎| 35495/37963 [152:13:11<10:17:48, 15.02s/it]
 94%|█████████▎| 35496/37963 [152:13:25<10:08:02, 14.79s/it]
 94%|█████████▎| 35497/37963 [152:13:40<10:03:15, 14.68s/it]
 94%|█████████▎| 35498/37963 [152:13:54<9:59:08, 14.58s/it] 
 94%|█████████▎| 35499/37963 [152:14:08<9:56:03, 14.51s/it]
 94%|█████████▎| 35500/37963 [152:14:30<11:23:00, 16.64s/it]
                                                            
{'loss': '0.06102', 'grad_norm': '2.708', 'learning_rate': '2.201e-07', 'epoch': '0.9351'}

 94%|█████████▎| 35500/37963 [152:14:30<11:23:00, 16.64s/it]
 94%|█████████▎| 35501/37963 [152:14:44<10:54:25, 15.95s/it]
 94%|█████████▎| 35502/37963 [152:14:58<10:30:49, 15.38s/it]
 94%|█████████▎| 35503/37963 [152:15:13<10:17:55, 15.07s/it]
 94%|█████████▎| 35504/37963 [152:15:27<10:09:34, 14.87s/it]
 94%|█████████▎| 35505/37963 [152:15:54<12:38:14, 18.51s/it]
 94%|█████████▎| 35506/37963 [152:16:08<11:47:35, 17.28s/it]
 94%|█████████▎| 35507/37963 [152:16:23<11:12:48, 16.44s/it]
 94%|█████████▎| 35508/37963 [152:16:37<10:48:30, 15.85s/it]
 94%|█████████▎| 35509/37963 [152:16:52<10:33:48, 15.50s/it]
 94%|█████████▎| 35510/37963 [152:17:06<10:19:50, 15.16s/it]
                                                            
{'loss': '0.06189', 'grad_norm': '2.445', 'learning_rate': '2.184e-07', 'epoch': '0.9354'}

 94%|█████████▎| 35510/37963 [152:17:06<10:19:50, 15.16s/it]
 94%|█████████▎| 35511/37963 [152:17:21<10:11:08, 14.95s/it]
 94%|█████████▎| 35512/37963 [152:17:35<10:04:17, 14.79s/it]
 94%|█████████▎| 35513/37963 [152:17:50<9:59:44, 14.69s/it] 
 94%|█████████▎| 35514/37963 [152:18:04<9:55:39, 14.59s/it]
 94%|█████████▎| 35515/37963 [152:18:18<9:52:21, 14.52s/it]
 94%|█████████▎| 35516/37963 [152:18:40<11:12:28, 16.49s/it]
 94%|█████████▎| 35517/37963 [152:18:54<10:47:13, 15.88s/it]
 94%|█████████▎| 35518/37963 [152:19:08<10:29:50, 15.46s/it]
 94%|█████████▎| 35519/37963 [152:19:23<10:16:05, 15.12s/it]
 94%|█████████▎| 35520/37963 [152:19:37<10:06:41, 14.90s/it]
                                                            
{'loss': '0.0608', 'grad_norm': '2.423', 'learning_rate': '2.166e-07', 'epoch': '0.9357'}

 94%|█████████▎| 35520/37963 [152:19:37<10:06:41, 14.90s/it]
 94%|█████████▎| 35521/37963 [152:19:58<11:16:22, 16.62s/it]
 94%|█████████▎| 35522/37963 [152:20:12<10:48:09, 15.93s/it]
 94%|█████████▎| 35523/37963 [152:20:27<10:30:06, 15.49s/it]
 94%|█████████▎| 35524/37963 [152:20:41<10:16:54, 15.18s/it]
 94%|█████████▎| 35525/37963 [152:20:55<10:07:22, 14.95s/it]
 94%|█████████▎| 35526/37963 [152:21:09<9:52:35, 14.59s/it] 
 94%|█████████▎| 35527/37963 [152:21:29<11:00:33, 16.27s/it]
 94%|█████████▎| 35528/37963 [152:21:44<10:35:07, 15.65s/it]
 94%|█████████▎| 35529/37963 [152:21:58<10:15:53, 15.18s/it]
 94%|█████████▎| 35530/37963 [152:22:12<10:05:20, 14.93s/it]
                                                            
{'loss': '0.05629', 'grad_norm': '3.605', 'learning_rate': '2.148e-07', 'epoch': '0.9359'}

 94%|█████████▎| 35530/37963 [152:22:12<10:05:20, 14.93s/it]
 94%|█████████▎| 35531/37963 [152:22:27<9:59:54, 14.80s/it] 
 94%|█████████▎| 35532/37963 [152:22:41<9:56:08, 14.71s/it]
 94%|█████████▎| 35533/37963 [152:22:55<9:47:56, 14.52s/it]
 94%|█████████▎| 35534/37963 [152:23:09<9:38:13, 14.28s/it]
 94%|█████████▎| 35535/37963 [152:23:23<9:39:20, 14.32s/it]
 94%|█████████▎| 35536/37963 [152:23:38<9:40:45, 14.36s/it]
 94%|█████████▎| 35537/37963 [152:23:52<9:34:34, 14.21s/it]
 94%|█████████▎| 35538/37963 [152:24:05<9:24:39, 13.97s/it]
 94%|█████████▎| 35539/37963 [152:24:19<9:27:48, 14.05s/it]
 94%|█████████▎| 35540/37963 [152:24:40<10:50:01, 16.10s/it]
                                                            
{'loss': '0.05984', 'grad_norm': '3.56', 'learning_rate': '2.131e-07', 'epoch': '0.9362'}

 94%|█████████▎| 35540/37963 [152:24:40<10:50:01, 16.10s/it]
 94%|█████████▎| 35541/37963 [152:24:55<10:29:51, 15.60s/it]
 94%|█████████▎| 35542/37963 [152:25:09<10:11:44, 15.16s/it]
 94%|█████████▎| 35543/37963 [152:25:23<10:02:38, 14.94s/it]
 94%|█████████▎| 35544/37963 [152:25:37<9:55:03, 14.76s/it] 
 94%|█████████▎| 35545/37963 [152:25:52<9:48:39, 14.61s/it]
 94%|█████████▎| 35546/37963 [152:26:06<9:41:42, 14.44s/it]
 94%|█████████▎| 35547/37963 [152:26:20<9:35:17, 14.29s/it]
 94%|█████████▎| 35548/37963 [152:26:33<9:28:46, 14.13s/it]
 94%|█████████▎| 35549/37963 [152:26:55<10:53:18, 16.24s/it]
 94%|█████████▎| 35550/37963 [152:27:09<10:26:15, 15.57s/it]
                                                            
{'loss': '0.06051', 'grad_norm': '2.427', 'learning_rate': '2.113e-07', 'epoch': '0.9364'}

 94%|█████████▎| 35550/37963 [152:27:09<10:26:15, 15.57s/it]
 94%|█████████▎| 35551/37963 [152:27:23<10:11:41, 15.22s/it]
 94%|█████████▎| 35552/37963 [152:27:37<10:02:58, 15.01s/it]
 94%|█████████▎| 35553/37963 [152:27:58<11:14:42, 16.80s/it]
 94%|█████████▎| 35554/37963 [152:28:20<12:07:19, 18.12s/it]
 94%|█████████▎| 35555/37963 [152:28:34<11:20:30, 16.96s/it]
 94%|█████████▎| 35556/37963 [152:28:48<10:42:50, 16.02s/it]
 94%|█████████▎| 35557/37963 [152:29:02<10:23:08, 15.54s/it]
 94%|█████████▎| 35558/37963 [152:29:16<9:59:24, 14.95s/it] 
 94%|█████████▎| 35559/37963 [152:29:30<9:52:27, 14.79s/it]
 94%|█████████▎| 35560/37963 [152:29:45<9:47:24, 14.67s/it]
                                                           
{'loss': '0.06526', 'grad_norm': '3.217', 'learning_rate': '2.096e-07', 'epoch': '0.9367'}

 94%|█████████▎| 35560/37963 [152:29:45<9:47:24, 14.67s/it]
 94%|█████████▎| 35561/37963 [152:29:58<9:37:36, 14.43s/it]
 94%|█████████▎| 35562/37963 [152:30:13<9:37:47, 14.44s/it]
 94%|█████████▎| 35563/37963 [152:30:27<9:36:34, 14.41s/it]
 94%|█████████▎| 35564/37963 [152:30:48<10:54:42, 16.37s/it]
 94%|█████████▎| 35565/37963 [152:31:09<11:51:12, 17.79s/it]
 94%|█████████▎| 35566/37963 [152:31:23<11:07:55, 16.72s/it]
 94%|█████████▎| 35567/37963 [152:31:38<10:39:42, 16.02s/it]
 94%|█████████▎| 35568/37963 [152:31:52<10:18:57, 15.51s/it]
 94%|█████████▎| 35569/37963 [152:32:12<11:16:07, 16.95s/it]
 94%|█████████▎| 35570/37963 [152:32:27<10:45:10, 16.18s/it]
                                                            
{'loss': '0.06169', 'grad_norm': '2.948', 'learning_rate': '2.078e-07', 'epoch': '0.937'}

 94%|█████████▎| 35570/37963 [152:32:27<10:45:10, 16.18s/it]
 94%|█████████▎| 35571/37963 [152:32:41<10:23:18, 15.63s/it]
 94%|█████████▎| 35572/37963 [152:32:56<10:08:01, 15.26s/it]
 94%|█████████▎| 35573/37963 [152:33:10<9:55:46, 14.96s/it] 
 94%|█████████▎| 35574/37963 [152:33:31<11:03:51, 16.67s/it]
 94%|█████████▎| 35575/37963 [152:33:45<10:33:47, 15.92s/it]
 94%|█████████▎| 35576/37963 [152:33:59<10:15:06, 15.46s/it]
 94%|█████████▎| 35577/37963 [152:34:13<9:57:41, 15.03s/it] 
 94%|█████████▎| 35578/37963 [152:34:27<9:46:57, 14.77s/it]
 94%|█████████▎| 35579/37963 [152:34:41<9:39:15, 14.58s/it]
 94%|█████████▎| 35580/37963 [152:34:56<9:36:37, 14.52s/it]
                                                           
{'loss': '0.06715', 'grad_norm': '3.721', 'learning_rate': '2.061e-07', 'epoch': '0.9372'}

 94%|█████████▎| 35580/37963 [152:34:56<9:36:37, 14.52s/it]
 94%|█████████▎| 35581/37963 [152:35:10<9:36:27, 14.52s/it]
 94%|█████████▎| 35582/37963 [152:35:25<9:36:10, 14.52s/it]
 94%|█████████▎| 35583/37963 [152:35:39<9:33:59, 14.47s/it]
 94%|█████████▎| 35584/37963 [152:35:54<9:33:22, 14.46s/it]
 94%|█████████▎| 35585/37963 [152:36:08<9:32:18, 14.44s/it]
 94%|█████████▎| 35586/37963 [152:36:22<9:29:28, 14.37s/it]
 94%|█████████▎| 35587/37963 [152:36:37<9:29:09, 14.37s/it]
 94%|█████████▎| 35588/37963 [152:36:51<9:28:35, 14.36s/it]
 94%|█████████▎| 35589/37963 [152:37:12<10:42:04, 16.23s/it]
 94%|█████████▎| 35590/37963 [152:37:26<10:20:34, 15.69s/it]
                                                            
{'loss': '0.06224', 'grad_norm': '3.22', 'learning_rate': '2.044e-07', 'epoch': '0.9375'}

 94%|█████████▎| 35590/37963 [152:37:26<10:20:34, 15.69s/it]
 94%|█████████▍| 35591/37963 [152:37:40<10:04:30, 15.29s/it]
 94%|█████████▍| 35592/37963 [152:37:54<9:49:17, 14.91s/it] 
 94%|█████████▍| 35593/37963 [152:38:09<9:42:59, 14.76s/it]
 94%|█████████▍| 35594/37963 [152:38:23<9:38:12, 14.64s/it]
 94%|█████████▍| 35595/37963 [152:38:37<9:34:05, 14.55s/it]
 94%|█████████▍| 35596/37963 [152:38:52<9:32:33, 14.51s/it]
 94%|█████████▍| 35597/37963 [152:39:13<10:50:03, 16.49s/it]
 94%|█████████▍| 35598/37963 [152:39:27<10:21:09, 15.76s/it]
 94%|█████████▍| 35599/37963 [152:39:41<10:03:50, 15.33s/it]
 94%|█████████▍| 35600/37963 [152:39:56<9:52:30, 15.04s/it] 
                                                           
{'loss': '0.05772', 'grad_norm': '2.961', 'learning_rate': '2.027e-07', 'epoch': '0.9378'}

 94%|█████████▍| 35600/37963 [152:39:56<9:52:30, 15.04s/it]
 94%|█████████▍| 35601/37963 [152:40:10<9:44:59, 14.86s/it]
 94%|█████████▍| 35602/37963 [152:40:31<10:56:57, 16.70s/it]
 94%|█████████▍| 35603/37963 [152:40:46<10:29:54, 16.01s/it]
 94%|█████████▍| 35604/37963 [152:41:07<11:27:55, 17.50s/it]
 94%|█████████▍| 35605/37963 [152:41:21<10:52:02, 16.59s/it]
 94%|█████████▍| 35606/37963 [152:41:35<10:26:02, 15.94s/it]
 94%|█████████▍| 35607/37963 [152:41:50<10:08:12, 15.49s/it]
 94%|█████████▍| 35608/37963 [152:42:04<9:54:43, 15.15s/it] 
 94%|█████████▍| 35609/37963 [152:42:19<9:45:56, 14.93s/it]
 94%|█████████▍| 35610/37963 [152:42:33<9:40:12, 14.79s/it]
                                                           
{'loss': '0.06465', 'grad_norm': '3.971', 'learning_rate': '2.01e-07', 'epoch': '0.938'}

 94%|█████████▍| 35610/37963 [152:42:33<9:40:12, 14.79s/it]
 94%|█████████▍| 35611/37963 [152:42:48<9:35:34, 14.68s/it]
 94%|█████████▍| 35612/37963 [152:43:08<10:41:12, 16.36s/it]
 94%|█████████▍| 35613/37963 [152:43:22<10:18:38, 15.80s/it]
 94%|█████████▍| 35614/37963 [152:43:37<10:02:16, 15.38s/it]
 94%|█████████▍| 35615/37963 [152:43:58<11:05:51, 17.02s/it]
 94%|█████████▍| 35616/37963 [152:44:12<10:34:27, 16.22s/it]
 94%|█████████▍| 35617/37963 [152:44:26<10:11:19, 15.63s/it]
 94%|█████████▍| 35618/37963 [152:44:41<9:56:12, 15.25s/it] 
 94%|█████████▍| 35619/37963 [152:44:55<9:46:23, 15.01s/it]
 94%|█████████▍| 35620/37963 [152:45:15<10:44:25, 16.50s/it]
                                                            
{'loss': '0.0565', 'grad_norm': '2.755', 'learning_rate': '1.993e-07', 'epoch': '0.9383'}

 94%|█████████▍| 35620/37963 [152:45:15<10:44:25, 16.50s/it]
 94%|█████████▍| 35621/37963 [152:45:30<10:20:58, 15.91s/it]
 94%|█████████▍| 35622/37963 [152:45:44<10:02:29, 15.44s/it]
 94%|█████████▍| 35623/37963 [152:46:04<10:59:44, 16.92s/it]
 94%|█████████▍| 35624/37963 [152:46:19<10:30:56, 16.19s/it]
 94%|█████████▍| 35625/37963 [152:46:33<10:10:10, 15.66s/it]
 94%|█████████▍| 35626/37963 [152:46:47<9:54:23, 15.26s/it] 
 94%|█████████▍| 35627/37963 [152:47:02<9:44:29, 15.01s/it]
 94%|█████████▍| 35628/37963 [152:47:16<9:37:10, 14.83s/it]
 94%|█████████▍| 35629/37963 [152:47:30<9:28:36, 14.62s/it]
 94%|█████████▍| 35630/37963 [152:47:45<9:22:58, 14.48s/it]
                                                           
{'loss': '0.06469', 'grad_norm': '3.455', 'learning_rate': '1.976e-07', 'epoch': '0.9385'}

 94%|█████████▍| 35630/37963 [152:47:45<9:22:58, 14.48s/it]
 94%|█████████▍| 35631/37963 [152:47:59<9:19:18, 14.39s/it]
 94%|█████████▍| 35632/37963 [152:48:13<9:19:32, 14.40s/it]
 94%|█████████▍| 35633/37963 [152:48:28<9:20:07, 14.42s/it]
 94%|█████████▍| 35634/37963 [152:48:42<9:19:56, 14.43s/it]
 94%|█████████▍| 35635/37963 [152:48:57<9:20:26, 14.44s/it]
 94%|█████████▍| 35636/37963 [152:49:11<9:19:56, 14.44s/it]
 94%|█████████▍| 35637/37963 [152:49:25<9:18:51, 14.42s/it]
 94%|█████████▍| 35638/37963 [152:49:40<9:18:24, 14.41s/it]
 94%|█████████▍| 35639/37963 [152:49:54<9:18:07, 14.41s/it]
 94%|█████████▍| 35640/37963 [152:50:15<10:34:20, 16.38s/it]
                                                            
{'loss': '0.06418', 'grad_norm': '4.017', 'learning_rate': '1.959e-07', 'epoch': '0.9388'}

 94%|█████████▍| 35640/37963 [152:50:15<10:34:20, 16.38s/it]
 94%|█████████▍| 35641/37963 [152:50:30<10:11:02, 15.79s/it]
 94%|█████████▍| 35642/37963 [152:50:44<9:54:31, 15.37s/it] 
 94%|█████████▍| 35643/37963 [152:50:58<9:42:46, 15.07s/it]
 94%|█████████▍| 35644/37963 [152:51:13<9:35:47, 14.90s/it]
 94%|█████████▍| 35645/37963 [152:51:33<10:39:43, 16.56s/it]
 94%|█████████▍| 35646/37963 [152:51:48<10:13:12, 15.88s/it]
 94%|█████████▍| 35647/37963 [152:52:02<9:52:04, 15.34s/it] 
 94%|█████████▍| 35648/37963 [152:52:16<9:40:50, 15.05s/it]
 94%|█████████▍| 35649/37963 [152:52:30<9:32:56, 14.86s/it]
 94%|█████████▍| 35650/37963 [152:52:45<9:26:55, 14.71s/it]
                                                           
{'loss': '0.06371', 'grad_norm': '2.491', 'learning_rate': '1.942e-07', 'epoch': '0.9391'}

 94%|█████████▍| 35650/37963 [152:52:45<9:26:55, 14.71s/it]
 94%|█████████▍| 35651/37963 [152:53:06<10:40:42, 16.63s/it]
 94%|█████████▍| 35652/37963 [152:53:19<10:04:36, 15.70s/it]
 94%|█████████▍| 35653/37963 [152:53:34<9:49:10, 15.30s/it] 
 94%|█████████▍| 35654/37963 [152:53:48<9:38:57, 15.04s/it]
 94%|█████████▍| 35655/37963 [152:54:03<9:30:28, 14.83s/it]
 94%|█████████▍| 35656/37963 [152:54:23<10:39:36, 16.63s/it]
 94%|█████████▍| 35657/37963 [152:54:37<10:08:24, 15.83s/it]
 94%|█████████▍| 35658/37963 [152:54:52<9:51:53, 15.41s/it] 
 94%|█████████▍| 35659/37963 [152:55:06<9:39:14, 15.08s/it]
 94%|█████████▍| 35660/37963 [152:55:20<9:24:58, 14.72s/it]
                                                           
{'loss': '0.06411', 'grad_norm': '2.477', 'learning_rate': '1.926e-07', 'epoch': '0.9393'}

 94%|█████████▍| 35660/37963 [152:55:20<9:24:58, 14.72s/it]
 94%|█████████▍| 35661/37963 [152:55:42<10:43:59, 16.79s/it]
 94%|█████████▍| 35662/37963 [152:55:56<10:15:06, 16.04s/it]
 94%|█████████▍| 35663/37963 [152:56:17<11:16:51, 17.66s/it]
 94%|█████████▍| 35664/37963 [152:56:31<10:33:22, 16.53s/it]
 94%|█████████▍| 35665/37963 [152:56:45<10:04:14, 15.78s/it]
 94%|█████████▍| 35666/37963 [152:57:00<9:47:56, 15.36s/it] 
 94%|█████████▍| 35667/37963 [152:57:14<9:36:16, 15.06s/it]
 94%|█████████▍| 35668/37963 [152:57:35<10:41:26, 16.77s/it]
 94%|█████████▍| 35669/37963 [152:57:49<10:14:20, 16.07s/it]
 94%|█████████▍| 35670/37963 [152:58:04<9:55:35, 15.58s/it] 
                                                           
{'loss': '0.05829', 'grad_norm': '3', 'learning_rate': '1.909e-07', 'epoch': '0.9396'}

 94%|█████████▍| 35670/37963 [152:58:04<9:55:35, 15.58s/it]
 94%|█████████▍| 35671/37963 [152:58:24<10:54:11, 17.13s/it]
 94%|█████████▍| 35672/37963 [152:58:39<10:22:24, 16.30s/it]
 94%|█████████▍| 35673/37963 [152:58:53<9:56:54, 15.64s/it] 
 94%|█████████▍| 35674/37963 [152:59:07<9:43:08, 15.29s/it]
 94%|█████████▍| 35675/37963 [152:59:22<9:33:32, 15.04s/it]
 94%|█████████▍| 35676/37963 [152:59:36<9:25:49, 14.84s/it]
 94%|█████████▍| 35677/37963 [152:59:50<9:10:58, 14.46s/it]
 94%|█████████▍| 35678/37963 [153:00:04<9:10:28, 14.45s/it]
 94%|█████████▍| 35679/37963 [153:00:19<9:09:56, 14.45s/it]
 94%|█████████▍| 35680/37963 [153:00:33<9:09:29, 14.44s/it]
                                                           
{'loss': '0.06776', 'grad_norm': '2.039', 'learning_rate': '1.892e-07', 'epoch': '0.9399'}

 94%|█████████▍| 35680/37963 [153:00:33<9:09:29, 14.44s/it]
 94%|█████████▍| 35681/37963 [153:00:47<9:07:24, 14.39s/it]
 94%|█████████▍| 35682/37963 [153:01:01<9:01:44, 14.25s/it]
 94%|█████████▍| 35683/37963 [153:01:16<9:02:33, 14.28s/it]
 94%|█████████▍| 35684/37963 [153:01:30<9:03:57, 14.32s/it]
 94%|█████████▍| 35685/37963 [153:01:44<9:04:42, 14.35s/it]
 94%|█████████▍| 35686/37963 [153:01:59<9:04:43, 14.35s/it]
 94%|█████████▍| 35687/37963 [153:02:13<9:04:54, 14.37s/it]
 94%|█████████▍| 35688/37963 [153:02:28<9:04:56, 14.37s/it]
 94%|█████████▍| 35689/37963 [153:02:41<8:58:08, 14.20s/it]
 94%|█████████▍| 35690/37963 [153:03:02<10:10:34, 16.12s/it]
                                                            
{'loss': '0.06552', 'grad_norm': '3.011', 'learning_rate': '1.876e-07', 'epoch': '0.9401'}

 94%|█████████▍| 35690/37963 [153:03:02<10:10:34, 16.12s/it]
 94%|█████████▍| 35691/37963 [153:03:16<9:51:12, 15.61s/it] 
 94%|█████████▍| 35692/37963 [153:03:31<9:36:48, 15.24s/it]
 94%|█████████▍| 35693/37963 [153:03:52<10:41:46, 16.96s/it]
 94%|█████████▍| 35694/37963 [153:04:06<10:08:47, 16.10s/it]
 94%|█████████▍| 35695/37963 [153:04:20<9:47:40, 15.55s/it] 
 94%|█████████▍| 35696/37963 [153:04:34<9:29:31, 15.07s/it]
 94%|█████████▍| 35697/37963 [153:04:48<9:21:57, 14.88s/it]
 94%|█████████▍| 35698/37963 [153:05:03<9:14:32, 14.69s/it]
 94%|█████████▍| 35699/37963 [153:05:24<10:24:56, 16.56s/it]
 94%|█████████▍| 35700/37963 [153:05:38<10:01:14, 15.94s/it]
                                                            
{'loss': '0.0715', 'grad_norm': '3.817', 'learning_rate': '1.86e-07', 'epoch': '0.9404'}

 94%|█████████▍| 35700/37963 [153:05:38<10:01:14, 15.94s/it]
 94%|█████████▍| 35701/37963 [153:05:52<9:39:31, 15.37s/it] 
 94%|█████████▍| 35702/37963 [153:06:07<9:28:20, 15.08s/it]
 94%|█████████▍| 35703/37963 [153:06:21<9:21:24, 14.90s/it]
 94%|█████████▍| 35704/37963 [153:06:35<9:15:44, 14.76s/it]
 94%|█████████▍| 35705/37963 [153:06:57<10:27:30, 16.67s/it]
 94%|█████████▍| 35706/37963 [153:07:10<9:54:10, 15.80s/it] 
 94%|█████████▍| 35707/37963 [153:07:25<9:38:17, 15.38s/it]
 94%|█████████▍| 35708/37963 [153:07:39<9:20:40, 14.92s/it]
 94%|█████████▍| 35709/37963 [153:07:53<9:14:20, 14.76s/it]
 94%|█████████▍| 35710/37963 [153:08:15<10:33:51, 16.88s/it]
                                                            
{'loss': '0.07023', 'grad_norm': '3.304', 'learning_rate': '1.843e-07', 'epoch': '0.9407'}

 94%|█████████▍| 35710/37963 [153:08:15<10:33:51, 16.88s/it]
 94%|█████████▍| 35711/37963 [153:08:35<11:14:54, 17.98s/it]
 94%|█████████▍| 35712/37963 [153:08:50<10:34:41, 16.92s/it]
 94%|█████████▍| 35713/37963 [153:09:04<10:06:10, 16.16s/it]
 94%|█████████▍| 35714/37963 [153:09:19<9:46:20, 15.64s/it] 
 94%|█████████▍| 35715/37963 [153:09:33<9:32:31, 15.28s/it]
 94%|█████████▍| 35716/37963 [153:09:54<10:34:58, 16.96s/it]
 94%|█████████▍| 35717/37963 [153:10:08<10:05:32, 16.18s/it]
 94%|█████████▍| 35718/37963 [153:10:23<9:45:29, 15.65s/it] 
 94%|█████████▍| 35719/37963 [153:10:43<10:40:58, 17.14s/it]
 94%|█████████▍| 35720/37963 [153:10:57<10:06:14, 16.22s/it]
                                                            
{'loss': '0.06011', 'grad_norm': '2.331', 'learning_rate': '1.827e-07', 'epoch': '0.9409'}

 94%|█████████▍| 35720/37963 [153:10:57<10:06:14, 16.22s/it]
 94%|█████████▍| 35721/37963 [153:11:12<9:47:04, 15.71s/it] 
 94%|█████████▍| 35722/37963 [153:11:26<9:32:06, 15.32s/it]
 94%|█████████▍| 35723/37963 [153:11:41<9:23:08, 15.08s/it]
 94%|█████████▍| 35724/37963 [153:11:55<9:15:10, 14.88s/it]
 94%|█████████▍| 35725/37963 [153:12:10<9:09:52, 14.74s/it]
 94%|█████████▍| 35726/37963 [153:12:24<9:05:46, 14.64s/it]
 94%|█████████▍| 35727/37963 [153:12:39<9:03:16, 14.58s/it]
 94%|█████████▍| 35728/37963 [153:12:53<9:00:58, 14.52s/it]
 94%|█████████▍| 35729/37963 [153:13:07<8:59:07, 14.48s/it]
 94%|█████████▍| 35730/37963 [153:13:22<8:57:20, 14.44s/it]
                                                           
{'loss': '0.07001', 'grad_norm': '3.122', 'learning_rate': '1.811e-07', 'epoch': '0.9412'}

 94%|█████████▍| 35730/37963 [153:13:22<8:57:20, 14.44s/it]
 94%|█████████▍| 35731/37963 [153:13:36<8:56:29, 14.42s/it]
 94%|█████████▍| 35732/37963 [153:13:50<8:56:58, 14.44s/it]
 94%|█████████▍| 35733/37963 [153:14:04<8:49:33, 14.25s/it]
 94%|█████████▍| 35734/37963 [153:14:19<8:50:35, 14.28s/it]
 94%|█████████▍| 35735/37963 [153:14:33<8:51:36, 14.32s/it]
 94%|█████████▍| 35736/37963 [153:14:48<8:52:54, 14.36s/it]
 94%|█████████▍| 35737/37963 [153:15:02<8:52:35, 14.36s/it]
 94%|█████████▍| 35738/37963 [153:15:22<10:01:25, 16.22s/it]
 94%|█████████▍| 35739/37963 [153:15:37<9:40:30, 15.66s/it] 
 94%|█████████▍| 35740/37963 [153:15:51<9:27:49, 15.33s/it]
                                                           
{'loss': '0.06597', 'grad_norm': '3.471', 'learning_rate': '1.795e-07', 'epoch': '0.9414'}

 94%|█████████▍| 35740/37963 [153:15:51<9:27:49, 15.33s/it]
 94%|█████████▍| 35741/37963 [153:16:11<10:19:41, 16.73s/it]
 94%|█████████▍| 35742/37963 [153:16:25<9:49:44, 15.93s/it] 
 94%|█████████▍| 35743/37963 [153:16:40<9:32:11, 15.46s/it]
 94%|█████████▍| 35744/37963 [153:16:54<9:15:59, 15.03s/it]
 94%|█████████▍| 35745/37963 [153:17:08<9:08:56, 14.85s/it]
 94%|█████████▍| 35746/37963 [153:17:23<9:03:27, 14.71s/it]
 94%|█████████▍| 35747/37963 [153:17:37<8:59:16, 14.60s/it]
 94%|█████████▍| 35748/37963 [153:17:58<10:08:09, 16.47s/it]
 94%|█████████▍| 35749/37963 [153:18:12<9:44:21, 15.84s/it] 
 94%|█████████▍| 35750/37963 [153:18:26<9:27:38, 15.39s/it]
                                                           
{'loss': '0.06191', 'grad_norm': '2.36', 'learning_rate': '1.779e-07', 'epoch': '0.9417'}

 94%|█████████▍| 35750/37963 [153:18:27<9:27:38, 15.39s/it]
 94%|█████████▍| 35751/37963 [153:18:41<9:16:10, 15.09s/it]
 94%|█████████▍| 35752/37963 [153:18:55<9:07:15, 14.85s/it]
 94%|█████████▍| 35753/37963 [153:19:10<9:02:59, 14.74s/it]
 94%|█████████▍| 35754/37963 [153:19:24<8:58:48, 14.63s/it]
 94%|█████████▍| 35755/37963 [153:19:38<8:55:54, 14.56s/it]
 94%|█████████▍| 35756/37963 [153:20:00<10:14:07, 16.70s/it]
 94%|█████████▍| 35757/37963 [153:20:15<9:49:06, 16.02s/it] 
 94%|█████████▍| 35758/37963 [153:20:36<10:45:53, 17.58s/it]
 94%|█████████▍| 35759/37963 [153:20:50<10:10:32, 16.62s/it]
 94%|█████████▍| 35760/37963 [153:21:11<10:59:54, 17.97s/it]
                                                            
{'loss': '0.06421', 'grad_norm': '4.017', 'learning_rate': '1.763e-07', 'epoch': '0.942'}

 94%|█████████▍| 35760/37963 [153:21:11<10:59:54, 17.97s/it]
 94%|█████████▍| 35761/37963 [153:21:25<10:15:10, 16.76s/it]
 94%|█████████▍| 35762/37963 [153:21:40<9:48:36, 16.05s/it] 
 94%|█████████▍| 35763/37963 [153:21:54<9:29:57, 15.54s/it]
 94%|█████████▍| 35764/37963 [153:22:08<9:15:09, 15.15s/it]
 94%|█████████▍| 35765/37963 [153:22:22<9:04:37, 14.87s/it]
 94%|█████████▍| 35766/37963 [153:22:43<10:10:20, 16.67s/it]
 94%|█████████▍| 35767/37963 [153:22:58<9:44:22, 15.97s/it] 
 94%|█████████▍| 35768/37963 [153:23:19<10:41:59, 17.55s/it]
 94%|█████████▍| 35769/37963 [153:23:33<10:07:18, 16.61s/it]
 94%|█████████▍| 35770/37963 [153:23:48<9:43:31, 15.97s/it] 
                                                           
{'loss': '0.03962', 'grad_norm': '2.312', 'learning_rate': '1.747e-07', 'epoch': '0.9422'}

 94%|█████████▍| 35770/37963 [153:23:48<9:43:31, 15.97s/it]
 94%|█████████▍| 35771/37963 [153:24:02<9:26:15, 15.50s/it]
 94%|█████████▍| 35772/37963 [153:24:16<9:09:08, 15.04s/it]
 94%|█████████▍| 35773/37963 [153:24:30<9:01:39, 14.84s/it]
 94%|█████████▍| 35774/37963 [153:24:45<8:56:36, 14.71s/it]
 94%|█████████▍| 35775/37963 [153:24:59<8:50:44, 14.55s/it]
 94%|█████████▍| 35776/37963 [153:25:13<8:47:08, 14.46s/it]
 94%|█████████▍| 35777/37963 [153:25:27<8:43:26, 14.37s/it]
 94%|█████████▍| 35778/37963 [153:25:42<8:43:32, 14.38s/it]
 94%|█████████▍| 35779/37963 [153:25:56<8:44:46, 14.42s/it]
 94%|█████████▍| 35780/37963 [153:26:11<8:43:16, 14.38s/it]
                                                           
{'loss': '0.06671', 'grad_norm': '2.966', 'learning_rate': '1.731e-07', 'epoch': '0.9425'}

 94%|█████████▍| 35780/37963 [153:26:11<8:43:16, 14.38s/it]
 94%|█████████▍| 35781/37963 [153:26:25<8:42:59, 14.38s/it]
 94%|█████████▍| 35782/37963 [153:26:39<8:42:08, 14.36s/it]
 94%|█████████▍| 35783/37963 [153:26:53<8:38:30, 14.27s/it]
 94%|█████████▍| 35784/37963 [153:27:08<8:39:03, 14.29s/it]
 94%|█████████▍| 35785/37963 [153:27:22<8:39:36, 14.31s/it]
 94%|█████████▍| 35786/37963 [153:27:36<8:38:12, 14.28s/it]
 94%|█████████▍| 35787/37963 [153:27:50<8:34:35, 14.19s/it]
 94%|█████████▍| 35788/37963 [153:28:11<9:43:18, 16.09s/it]
 94%|█████████▍| 35789/37963 [153:28:25<9:25:59, 15.62s/it]
 94%|█████████▍| 35790/37963 [153:28:47<10:34:22, 17.52s/it]
                                                            
{'loss': '0.06624', 'grad_norm': '3.409', 'learning_rate': '1.715e-07', 'epoch': '0.9428'}

 94%|█████████▍| 35790/37963 [153:28:47<10:34:22, 17.52s/it]
 94%|█████████▍| 35791/37963 [153:29:01<9:57:20, 16.50s/it] 
 94%|█████████▍| 35792/37963 [153:29:16<9:35:23, 15.90s/it]
 94%|█████████▍| 35793/37963 [153:29:30<9:17:53, 15.43s/it]
 94%|█████████▍| 35794/37963 [153:29:45<9:06:31, 15.12s/it]
 94%|█████████▍| 35795/37963 [153:29:59<8:58:16, 14.90s/it]
 94%|█████████▍| 35796/37963 [153:30:20<10:00:46, 16.63s/it]
 94%|█████████▍| 35797/37963 [153:30:34<9:35:14, 15.93s/it] 
 94%|█████████▍| 35798/37963 [153:30:48<9:14:35, 15.37s/it]
 94%|█████████▍| 35799/37963 [153:31:03<9:03:58, 15.08s/it]
 94%|█████████▍| 35800/37963 [153:31:17<8:56:05, 14.87s/it]
                                                           
{'loss': '0.06595', 'grad_norm': '3.344', 'learning_rate': '1.699e-07', 'epoch': '0.943'}

 94%|█████████▍| 35800/37963 [153:31:17<8:56:05, 14.87s/it]
 94%|█████████▍| 35801/37963 [153:31:31<8:51:11, 14.74s/it]
 94%|█████████▍| 35802/37963 [153:31:45<8:41:51, 14.49s/it]
 94%|█████████▍| 35803/37963 [153:32:00<8:39:25, 14.43s/it]
 94%|█████████▍| 35804/37963 [153:32:14<8:38:24, 14.41s/it]
 94%|█████████▍| 35805/37963 [153:32:41<10:52:19, 18.14s/it]
 94%|█████████▍| 35806/37963 [153:32:55<10:09:28, 16.95s/it]
 94%|█████████▍| 35807/37963 [153:33:16<10:58:24, 18.32s/it]
 94%|█████████▍| 35808/37963 [153:33:31<10:16:34, 17.17s/it]
 94%|█████████▍| 35809/37963 [153:33:45<9:46:22, 16.33s/it] 
 94%|█████████▍| 35810/37963 [153:34:00<9:28:50, 15.85s/it]
                                                           
{'loss': '0.05177', 'grad_norm': '3.76', 'learning_rate': '1.684e-07', 'epoch': '0.9433'}

 94%|█████████▍| 35810/37963 [153:34:00<9:28:50, 15.85s/it]
 94%|█████████▍| 35811/37963 [153:34:14<9:08:44, 15.30s/it]
 94%|█████████▍| 35812/37963 [153:34:28<8:59:15, 15.04s/it]
 94%|█████████▍| 35813/37963 [153:34:43<8:51:31, 14.83s/it]
 94%|█████████▍| 35814/37963 [153:34:57<8:48:58, 14.77s/it]
 94%|█████████▍| 35815/37963 [153:35:12<8:45:35, 14.68s/it]
 94%|█████████▍| 35816/37963 [153:35:26<8:42:07, 14.59s/it]
 94%|█████████▍| 35817/37963 [153:35:53<10:57:22, 18.38s/it]
 94%|█████████▍| 35818/37963 [153:36:08<10:16:27, 17.24s/it]
 94%|█████████▍| 35819/37963 [153:36:22<9:45:26, 16.38s/it] 
 94%|█████████▍| 35820/37963 [153:36:37<9:26:04, 15.85s/it]
                                                           
{'loss': '0.06183', 'grad_norm': '2.825', 'learning_rate': '1.668e-07', 'epoch': '0.9436'}

 94%|█████████▍| 35820/37963 [153:36:37<9:26:04, 15.85s/it]
 94%|█████████▍| 35821/37963 [153:36:51<9:10:01, 15.41s/it]
 94%|█████████▍| 35822/37963 [153:37:06<8:59:12, 15.11s/it]
 94%|█████████▍| 35823/37963 [153:37:20<8:51:58, 14.92s/it]
 94%|█████████▍| 35824/37963 [153:37:35<8:45:41, 14.75s/it]
 94%|█████████▍| 35825/37963 [153:37:49<8:41:46, 14.64s/it]
 94%|█████████▍| 35826/37963 [153:38:03<8:31:35, 14.36s/it]
 94%|█████████▍| 35827/37963 [153:38:17<8:29:41, 14.32s/it]
 94%|█████████▍| 35828/37963 [153:38:31<8:27:28, 14.26s/it]
 94%|█████████▍| 35829/37963 [153:38:45<8:22:23, 14.13s/it]
 94%|█████████▍| 35830/37963 [153:38:59<8:18:54, 14.03s/it]
                                                           
{'loss': '0.06957', 'grad_norm': '3.992', 'learning_rate': '1.653e-07', 'epoch': '0.9438'}

 94%|█████████▍| 35830/37963 [153:38:59<8:18:54, 14.03s/it]
 94%|█████████▍| 35831/37963 [153:39:13<8:22:35, 14.14s/it]
 94%|█████████▍| 35832/37963 [153:39:28<8:25:07, 14.22s/it]
 94%|█████████▍| 35833/37963 [153:39:42<8:27:34, 14.30s/it]
 94%|█████████▍| 35834/37963 [153:39:56<8:22:03, 14.15s/it]
 94%|█████████▍| 35835/37963 [153:40:10<8:24:51, 14.23s/it]
 94%|█████████▍| 35836/37963 [153:40:25<8:26:47, 14.30s/it]
 94%|█████████▍| 35837/37963 [153:40:39<8:26:56, 14.31s/it]
 94%|█████████▍| 35838/37963 [153:41:00<9:34:55, 16.23s/it]
 94%|█████████▍| 35839/37963 [153:41:14<9:10:53, 15.56s/it]
 94%|█████████▍| 35840/37963 [153:41:36<10:16:18, 17.42s/it]
                                                            
{'loss': '0.06692', 'grad_norm': '2.484', 'learning_rate': '1.637e-07', 'epoch': '0.9441'}

 94%|█████████▍| 35840/37963 [153:41:36<10:16:18, 17.42s/it]
 94%|█████████▍| 35841/37963 [153:41:50<9:44:35, 16.53s/it] 
 94%|█████████▍| 35842/37963 [153:42:04<9:21:00, 15.87s/it]
 94%|█████████▍| 35843/37963 [153:42:19<9:06:07, 15.46s/it]
 94%|█████████▍| 35844/37963 [153:42:40<10:10:30, 17.29s/it]
 94%|█████████▍| 35845/37963 [153:42:55<9:37:12, 16.35s/it] 
 94%|█████████▍| 35846/37963 [153:43:09<9:17:07, 15.79s/it]
 94%|█████████▍| 35847/37963 [153:43:23<9:02:30, 15.38s/it]
 94%|█████████▍| 35848/37963 [153:43:38<8:48:55, 15.00s/it]
 94%|█████████▍| 35849/37963 [153:43:52<8:40:41, 14.78s/it]
 94%|█████████▍| 35850/37963 [153:44:06<8:37:19, 14.69s/it]
                                                           
{'loss': '0.05391', 'grad_norm': '3.066', 'learning_rate': '1.622e-07', 'epoch': '0.9443'}

 94%|█████████▍| 35850/37963 [153:44:06<8:37:19, 14.69s/it]
 94%|█████████▍| 35851/37963 [153:44:21<8:33:41, 14.59s/it]
 94%|█████████▍| 35852/37963 [153:44:41<9:31:40, 16.25s/it]
 94%|█████████▍| 35853/37963 [153:44:55<9:12:45, 15.72s/it]
 94%|█████████▍| 35854/37963 [153:45:16<10:09:03, 17.33s/it]
 94%|█████████▍| 35855/37963 [153:45:38<10:51:47, 18.55s/it]
 94%|█████████▍| 35856/37963 [153:45:52<10:07:29, 17.30s/it]
 94%|█████████▍| 35857/37963 [153:46:07<9:37:48, 16.46s/it] 
 94%|█████████▍| 35858/37963 [153:46:21<9:15:13, 15.83s/it]
 94%|█████████▍| 35859/37963 [153:46:35<8:55:31, 15.27s/it]
 94%|█████████▍| 35860/37963 [153:46:49<8:46:28, 15.02s/it]
                                                           
{'loss': '0.06416', 'grad_norm': '3.925', 'learning_rate': '1.607e-07', 'epoch': '0.9446'}

 94%|█████████▍| 35860/37963 [153:46:49<8:46:28, 15.02s/it]
 94%|█████████▍| 35861/37963 [153:47:04<8:40:28, 14.86s/it]
 94%|█████████▍| 35862/37963 [153:47:18<8:34:54, 14.70s/it]
 94%|█████████▍| 35863/37963 [153:47:33<8:30:35, 14.59s/it]
 94%|█████████▍| 35864/37963 [153:47:53<9:29:14, 16.27s/it]
 94%|█████████▍| 35865/37963 [153:48:13<10:15:48, 17.61s/it]
 94%|█████████▍| 35866/37963 [153:48:28<9:44:15, 16.72s/it] 
 94%|█████████▍| 35867/37963 [153:48:43<9:20:09, 16.04s/it]
 94%|█████████▍| 35868/37963 [153:48:57<9:02:55, 15.55s/it]
 94%|█████████▍| 35869/37963 [153:49:11<8:50:50, 15.21s/it]
 94%|█████████▍| 35870/37963 [153:49:26<8:41:31, 14.95s/it]
                                                           
{'loss': '0.06879', 'grad_norm': '3.326', 'learning_rate': '1.591e-07', 'epoch': '0.9449'}

 94%|█████████▍| 35870/37963 [153:49:26<8:41:31, 14.95s/it]
 94%|█████████▍| 35871/37963 [153:49:40<8:35:20, 14.78s/it]
 94%|█████████▍| 35872/37963 [153:49:54<8:31:02, 14.66s/it]
 94%|█████████▍| 35873/37963 [153:50:09<8:26:13, 14.53s/it]
 94%|█████████▍| 35874/37963 [153:50:23<8:24:23, 14.49s/it]
 94%|█████████▍| 35875/37963 [153:50:37<8:20:29, 14.38s/it]
 95%|█████████▍| 35876/37963 [153:50:52<8:20:51, 14.40s/it]
 95%|█████████▍| 35877/37963 [153:51:05<8:13:35, 14.20s/it]
 95%|█████████▍| 35878/37963 [153:51:20<8:15:40, 14.26s/it]
 95%|█████████▍| 35879/37963 [153:51:34<8:15:14, 14.26s/it]
 95%|█████████▍| 35880/37963 [153:51:48<8:16:02, 14.29s/it]
                                                           
{'loss': '0.04452', 'grad_norm': '2.505', 'learning_rate': '1.576e-07', 'epoch': '0.9451'}

 95%|█████████▍| 35880/37963 [153:51:48<8:16:02, 14.29s/it]
 95%|█████████▍| 35881/37963 [153:52:03<8:16:32, 14.31s/it]
 95%|█████████▍| 35882/37963 [153:52:17<8:17:05, 14.33s/it]
 95%|█████████▍| 35883/37963 [153:52:32<8:20:02, 14.42s/it]
 95%|█████████▍| 35884/37963 [153:52:46<8:19:17, 14.41s/it]
 95%|█████████▍| 35885/37963 [153:53:07<9:26:01, 16.34s/it]
 95%|█████████▍| 35886/37963 [153:53:22<9:07:17, 15.81s/it]
 95%|█████████▍| 35887/37963 [153:53:36<8:51:57, 15.37s/it]
 95%|█████████▍| 35888/37963 [153:53:57<9:47:27, 16.99s/it]
 95%|█████████▍| 35889/37963 [153:54:10<9:12:22, 15.98s/it]
 95%|█████████▍| 35890/37963 [153:54:24<8:53:04, 15.43s/it]
                                                           
{'loss': '0.05224', 'grad_norm': '2.747', 'learning_rate': '1.561e-07', 'epoch': '0.9454'}

 95%|█████████▍| 35890/37963 [153:54:24<8:53:04, 15.43s/it]
 95%|█████████▍| 35891/37963 [153:54:39<8:42:28, 15.13s/it]
 95%|█████████▍| 35892/37963 [153:54:53<8:28:08, 14.72s/it]
 95%|█████████▍| 35893/37963 [153:55:07<8:24:55, 14.64s/it]
 95%|█████████▍| 35894/37963 [153:55:29<9:39:36, 16.81s/it]
 95%|█████████▍| 35895/37963 [153:55:43<9:06:47, 15.86s/it]
 95%|█████████▍| 35896/37963 [153:55:57<8:50:05, 15.39s/it]
 95%|█████████▍| 35897/37963 [153:56:11<8:37:16, 15.02s/it]
 95%|█████████▍| 35898/37963 [153:56:25<8:29:19, 14.80s/it]
 95%|█████████▍| 35899/37963 [153:56:39<8:17:54, 14.47s/it]
 95%|█████████▍| 35900/37963 [153:56:54<8:17:07, 14.46s/it]
                                                           
{'loss': '0.05293', 'grad_norm': '3.841', 'learning_rate': '1.546e-07', 'epoch': '0.9457'}

 95%|█████████▍| 35900/37963 [153:56:54<8:17:07, 14.46s/it]
 95%|█████████▍| 35901/37963 [153:57:14<9:22:23, 16.36s/it]
 95%|█████████▍| 35902/37963 [153:57:29<9:02:23, 15.79s/it]
 95%|█████████▍| 35903/37963 [153:57:49<9:50:24, 17.20s/it]
 95%|█████████▍| 35904/37963 [153:58:10<10:26:23, 18.25s/it]
 95%|█████████▍| 35905/37963 [153:58:24<9:45:41, 17.08s/it] 
 95%|█████████▍| 35906/37963 [153:58:38<9:15:22, 16.20s/it]
 95%|█████████▍| 35907/37963 [153:58:53<8:56:15, 15.65s/it]
 95%|█████████▍| 35908/37963 [153:59:07<8:41:44, 15.23s/it]
 95%|█████████▍| 35909/37963 [153:59:21<8:27:10, 14.82s/it]
 95%|█████████▍| 35910/37963 [153:59:35<8:22:01, 14.67s/it]
                                                           
{'loss': '0.06437', 'grad_norm': '2.773', 'learning_rate': '1.531e-07', 'epoch': '0.9459'}

 95%|█████████▍| 35910/37963 [153:59:35<8:22:01, 14.67s/it]
 95%|█████████▍| 35911/37963 [153:59:50<8:19:26, 14.60s/it]
 95%|█████████▍| 35912/37963 [154:00:11<9:23:50, 16.49s/it]
 95%|█████████▍| 35913/37963 [154:00:25<9:01:25, 15.85s/it]
 95%|█████████▍| 35914/37963 [154:00:46<9:52:38, 17.35s/it]
 95%|█████████▍| 35915/37963 [154:01:00<9:21:02, 16.44s/it]
 95%|█████████▍| 35916/37963 [154:01:15<9:00:14, 15.84s/it]
 95%|█████████▍| 35917/37963 [154:01:28<8:39:50, 15.24s/it]
 95%|█████████▍| 35918/37963 [154:01:43<8:30:28, 14.98s/it]
 95%|█████████▍| 35919/37963 [154:01:57<8:26:00, 14.85s/it]
 95%|█████████▍| 35920/37963 [154:02:12<8:21:14, 14.72s/it]
                                                           
{'loss': '0.05416', 'grad_norm': '1.844', 'learning_rate': '1.517e-07', 'epoch': '0.9462'}

 95%|█████████▍| 35920/37963 [154:02:12<8:21:14, 14.72s/it]
 95%|█████████▍| 35921/37963 [154:02:26<8:17:00, 14.60s/it]
 95%|█████████▍| 35922/37963 [154:02:40<8:14:24, 14.53s/it]
 95%|█████████▍| 35923/37963 [154:02:54<8:07:27, 14.34s/it]
 95%|█████████▍| 35924/37963 [154:03:09<8:05:44, 14.29s/it]
 95%|█████████▍| 35925/37963 [154:03:23<8:06:02, 14.31s/it]
 95%|█████████▍| 35926/37963 [154:03:37<8:06:00, 14.32s/it]
 95%|█████████▍| 35927/37963 [154:03:52<8:07:10, 14.36s/it]
 95%|█████████▍| 35928/37963 [154:04:06<8:08:03, 14.39s/it]
 95%|█████████▍| 35929/37963 [154:04:20<8:07:24, 14.38s/it]
 95%|█████████▍| 35930/37963 [154:04:35<8:07:37, 14.39s/it]
                                                           
{'loss': '0.05422', 'grad_norm': '2.092', 'learning_rate': '1.502e-07', 'epoch': '0.9465'}

 95%|█████████▍| 35930/37963 [154:04:35<8:07:37, 14.39s/it]
 95%|█████████▍| 35931/37963 [154:04:49<8:02:59, 14.26s/it]
 95%|█████████▍| 35932/37963 [154:05:03<8:04:10, 14.30s/it]
 95%|█████████▍| 35933/37963 [154:05:24<9:07:57, 16.20s/it]
 95%|█████████▍| 35934/37963 [154:05:38<8:48:17, 15.62s/it]
 95%|█████████▍| 35935/37963 [154:05:52<8:34:58, 15.24s/it]
 95%|█████████▍| 35936/37963 [154:06:07<8:24:49, 14.94s/it]
 95%|█████████▍| 35937/37963 [154:06:28<9:26:22, 16.77s/it]
 95%|█████████▍| 35938/37963 [154:06:42<9:02:03, 16.06s/it]
 95%|█████████▍| 35939/37963 [154:06:56<8:39:12, 15.39s/it]
 95%|█████████▍| 35940/37963 [154:07:10<8:28:42, 15.09s/it]
                                                           
{'loss': '0.0571', 'grad_norm': '2.105', 'learning_rate': '1.487e-07', 'epoch': '0.9467'}

 95%|█████████▍| 35940/37963 [154:07:10<8:28:42, 15.09s/it]
 95%|█████████▍| 35941/37963 [154:07:24<8:17:49, 14.77s/it]
 95%|█████████▍| 35942/37963 [154:07:45<9:13:20, 16.43s/it]
 95%|█████████▍| 35943/37963 [154:07:59<8:49:18, 15.72s/it]
 95%|█████████▍| 35944/37963 [154:08:13<8:35:40, 15.32s/it]
 95%|█████████▍| 35945/37963 [154:08:27<8:17:41, 14.80s/it]
 95%|█████████▍| 35946/37963 [154:08:41<8:11:27, 14.62s/it]
 95%|█████████▍| 35947/37963 [154:09:02<9:13:37, 16.48s/it]
 95%|█████████▍| 35948/37963 [154:09:16<8:51:21, 15.82s/it]
 95%|█████████▍| 35949/37963 [154:09:30<8:37:07, 15.41s/it]
 95%|█████████▍| 35950/37963 [154:09:44<8:21:21, 14.94s/it]
                                                           
{'loss': '0.07081', 'grad_norm': '6.389', 'learning_rate': '1.473e-07', 'epoch': '0.947'}

 95%|█████████▍| 35950/37963 [154:09:44<8:21:21, 14.94s/it]
 95%|█████████▍| 35951/37963 [154:09:59<8:13:42, 14.72s/it]
 95%|█████████▍| 35952/37963 [154:10:12<8:04:27, 14.45s/it]
 95%|█████████▍| 35953/37963 [154:10:40<10:19:56, 18.51s/it]
 95%|█████████▍| 35954/37963 [154:10:55<9:36:37, 17.22s/it] 
 95%|█████████▍| 35955/37963 [154:11:09<9:08:13, 16.38s/it]
 95%|█████████▍| 35956/37963 [154:11:23<8:41:57, 15.60s/it]
 95%|█████████▍| 35957/37963 [154:11:37<8:29:45, 15.25s/it]
 95%|█████████▍| 35958/37963 [154:11:51<8:19:16, 14.94s/it]
 95%|█████████▍| 35959/37963 [154:12:06<8:13:01, 14.76s/it]
 95%|█████████▍| 35960/37963 [154:12:20<8:08:30, 14.63s/it]
                                                           
{'loss': '0.06483', 'grad_norm': '2.711', 'learning_rate': '1.458e-07', 'epoch': '0.9472'}

 95%|█████████▍| 35960/37963 [154:12:20<8:08:30, 14.63s/it]
 95%|█████████▍| 35961/37963 [154:12:34<8:04:58, 14.53s/it]
 95%|█████████▍| 35962/37963 [154:12:55<9:03:19, 16.29s/it]
 95%|█████████▍| 35963/37963 [154:13:09<8:39:00, 15.57s/it]
 95%|█████████▍| 35964/37963 [154:13:30<9:32:02, 17.17s/it]
 95%|█████████▍| 35965/37963 [154:13:44<9:04:13, 16.34s/it]
 95%|█████████▍| 35966/37963 [154:13:58<8:44:37, 15.76s/it]
 95%|█████████▍| 35967/37963 [154:14:12<8:24:05, 15.15s/it]
 95%|█████████▍| 35968/37963 [154:14:27<8:17:25, 14.96s/it]
 95%|█████████▍| 35969/37963 [154:14:41<8:08:12, 14.69s/it]
 95%|█████████▍| 35970/37963 [154:14:55<8:01:05, 14.48s/it]
                                                           
{'loss': '0.05305', 'grad_norm': '2.311', 'learning_rate': '1.443e-07', 'epoch': '0.9475'}

 95%|█████████▍| 35970/37963 [154:14:55<8:01:05, 14.48s/it]
 95%|█████████▍| 35971/37963 [154:15:09<7:59:46, 14.45s/it]
 95%|█████████▍| 35972/37963 [154:15:24<8:00:13, 14.47s/it]
 95%|█████████▍| 35973/37963 [154:15:38<8:01:18, 14.51s/it]
 95%|█████████▍| 35974/37963 [154:15:53<7:59:29, 14.46s/it]
 95%|█████████▍| 35975/37963 [154:16:07<8:00:18, 14.50s/it]
 95%|█████████▍| 35976/37963 [154:16:22<7:59:02, 14.47s/it]
 95%|█████████▍| 35977/37963 [154:16:36<7:57:46, 14.43s/it]
 95%|█████████▍| 35978/37963 [154:16:50<7:51:47, 14.26s/it]
 95%|█████████▍| 35979/37963 [154:17:04<7:48:00, 14.15s/it]
 95%|█████████▍| 35980/37963 [154:17:18<7:49:41, 14.21s/it]
                                                           
{'loss': '0.05624', 'grad_norm': '2.947', 'learning_rate': '1.429e-07', 'epoch': '0.9478'}

 95%|█████████▍| 35980/37963 [154:17:18<7:49:41, 14.21s/it]
 95%|█████████▍| 35981/37963 [154:17:32<7:51:07, 14.26s/it]
 95%|█████████▍| 35982/37963 [154:17:46<7:47:03, 14.15s/it]
 95%|█████████▍| 35983/37963 [154:18:06<8:45:38, 15.93s/it]
 95%|█████████▍| 35984/37963 [154:18:20<8:23:46, 15.27s/it]
 95%|█████████▍| 35985/37963 [154:18:34<8:12:45, 14.95s/it]
 95%|█████████▍| 35986/37963 [154:18:56<9:15:18, 16.85s/it]
 95%|█████████▍| 35987/37963 [154:19:09<8:45:37, 15.96s/it]
 95%|█████████▍| 35988/37963 [154:19:24<8:29:27, 15.48s/it]
 95%|█████████▍| 35989/37963 [154:19:38<8:18:33, 15.15s/it]
 95%|█████████▍| 35990/37963 [154:19:53<8:11:20, 14.94s/it]
                                                           
{'loss': '0.06684', 'grad_norm': '3.076', 'learning_rate': '1.415e-07', 'epoch': '0.948'}

 95%|█████████▍| 35990/37963 [154:19:53<8:11:20, 14.94s/it]
 95%|█████████▍| 35991/37963 [154:20:07<8:06:18, 14.80s/it]
 95%|█████████▍| 35992/37963 [154:20:21<7:59:00, 14.58s/it]
 95%|█████████▍| 35993/37963 [154:20:42<9:01:25, 16.49s/it]
 95%|█████████▍| 35994/37963 [154:20:57<8:41:17, 15.88s/it]
 95%|█████████▍| 35995/37963 [154:21:11<8:26:11, 15.43s/it]
 95%|█████████▍| 35996/37963 [154:21:31<9:12:38, 16.86s/it]
 95%|█████████▍| 35997/37963 [154:21:46<8:47:41, 16.10s/it]
 95%|█████████▍| 35998/37963 [154:22:00<8:31:42, 15.62s/it]
 95%|█████████▍| 35999/37963 [154:22:14<8:19:06, 15.25s/it]
 95%|█████████▍| 36000/37963 [154:22:29<8:11:10, 15.01s/it]
                                                           
{'loss': '0.07591', 'grad_norm': '2.67', 'learning_rate': '1.4e-07', 'epoch': '0.9483'}

 95%|█████████▍| 36000/37963 [154:22:29<8:11:10, 15.01s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.17s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.17s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 95%|█████████▍| 36001/37963 [154:24:15<23:02:49, 42.29s/it]
 95%|█████████▍| 36002/37963 [154:24:36<19:35:20, 35.96s/it]
 95%|█████████▍| 36003/37963 [154:24:50<16:03:11, 29.49s/it]
 95%|█████████▍| 36004/37963 [154:25:05<13:32:26, 24.88s/it]
 95%|█████████▍| 36005/37963 [154:25:19<11:49:38, 21.75s/it]
 95%|█████████▍| 36006/37963 [154:25:33<10:38:32, 19.58s/it]
 95%|█████████▍| 36007/37963 [154:25:48<9:46:38, 18.00s/it] 
 95%|█████████▍| 36008/37963 [154:26:02<9:11:08, 16.91s/it]
 95%|█████████▍| 36009/37963 [154:26:23<9:46:19, 18.00s/it]
 95%|█████████▍| 36010/37963 [154:26:37<9:10:42, 16.92s/it]
                                                           
{'loss': '0.06746', 'grad_norm': '3.1', 'learning_rate': '1.386e-07', 'epoch': '0.9486'}

 95%|█████████▍| 36010/37963 [154:26:37<9:10:42, 16.92s/it]
 95%|█████████▍| 36011/37963 [154:26:51<8:45:57, 16.17s/it]
 95%|█████████▍| 36012/37963 [154:27:11<9:20:17, 17.23s/it]
 95%|█████████▍| 36013/37963 [154:27:25<8:50:55, 16.34s/it]
 95%|█████████▍| 36014/37963 [154:27:40<8:30:36, 15.72s/it]
 95%|█████████▍| 36015/37963 [154:27:54<8:16:45, 15.30s/it]
 95%|█████████▍| 36016/37963 [154:28:09<8:08:16, 15.05s/it]
 95%|█████████▍| 36017/37963 [154:28:23<7:59:26, 14.78s/it]
 95%|█████████▍| 36018/37963 [154:28:37<7:54:47, 14.65s/it]
 95%|█████████▍| 36019/37963 [154:28:51<7:51:42, 14.56s/it]
 95%|█████████▍| 36020/37963 [154:29:06<7:49:35, 14.50s/it]
                                                           
{'loss': '0.06095', 'grad_norm': '3.806', 'learning_rate': '1.372e-07', 'epoch': '0.9488'}

 95%|█████████▍| 36020/37963 [154:29:06<7:49:35, 14.50s/it]
 95%|█████████▍| 36021/37963 [154:29:20<7:48:02, 14.46s/it]
 95%|█████████▍| 36022/37963 [154:29:34<7:46:28, 14.42s/it]
 95%|█████████▍| 36023/37963 [154:29:49<7:45:57, 14.41s/it]
 95%|█████████▍| 36024/37963 [154:30:03<7:45:08, 14.39s/it]
 95%|█████████▍| 36025/37963 [154:30:18<7:44:57, 14.40s/it]
 95%|█████████▍| 36026/37963 [154:30:32<7:44:53, 14.40s/it]
 95%|█████████▍| 36027/37963 [154:30:46<7:44:50, 14.41s/it]
 95%|█████████▍| 36028/37963 [154:31:01<7:44:00, 14.39s/it]
 95%|█████████▍| 36029/37963 [154:31:15<7:43:58, 14.39s/it]
 95%|█████████▍| 36030/37963 [154:31:29<7:42:12, 14.35s/it]
                                                           
{'loss': '0.06738', 'grad_norm': '4.052', 'learning_rate': '1.358e-07', 'epoch': '0.9491'}

 95%|█████████▍| 36030/37963 [154:31:29<7:42:12, 14.35s/it]
 95%|█████████▍| 36031/37963 [154:31:44<7:41:56, 14.35s/it]
 95%|█████████▍| 36032/37963 [154:32:11<9:50:51, 18.36s/it]
 95%|█████████▍| 36033/37963 [154:32:26<9:13:37, 17.21s/it]
 95%|█████████▍| 36034/37963 [154:32:40<8:44:25, 16.31s/it]
 95%|█████████▍| 36035/37963 [154:32:55<8:25:54, 15.74s/it]
 95%|█████████▍| 36036/37963 [154:33:09<8:12:40, 15.34s/it]
 95%|█████████▍| 36037/37963 [154:33:23<8:02:53, 15.04s/it]
 95%|█████████▍| 36038/37963 [154:33:37<7:51:47, 14.71s/it]
 95%|█████████▍| 36039/37963 [154:33:51<7:45:22, 14.51s/it]
 95%|█████████▍| 36040/37963 [154:34:12<8:48:30, 16.49s/it]
                                                           
{'loss': '0.06219', 'grad_norm': '2.371', 'learning_rate': '1.344e-07', 'epoch': '0.9493'}

 95%|█████████▍| 36040/37963 [154:34:12<8:48:30, 16.49s/it]
 95%|█████████▍| 36041/37963 [154:34:27<8:28:08, 15.86s/it]
 95%|█████████▍| 36042/37963 [154:34:41<8:11:34, 15.35s/it]
 95%|█████████▍| 36043/37963 [154:34:55<8:01:45, 15.05s/it]
 95%|█████████▍| 36044/37963 [154:35:10<7:56:06, 14.89s/it]
 95%|█████████▍| 36045/37963 [154:35:24<7:50:46, 14.73s/it]
 95%|█████████▍| 36046/37963 [154:35:39<7:47:52, 14.64s/it]
 95%|█████████▍| 36047/37963 [154:35:53<7:43:38, 14.52s/it]
 95%|█████████▍| 36048/37963 [154:36:14<8:45:56, 16.48s/it]
 95%|█████████▍| 36049/37963 [154:36:35<9:28:21, 17.82s/it]
 95%|█████████▍| 36050/37963 [154:36:56<10:00:05, 18.82s/it]
                                                            
{'loss': '0.06757', 'grad_norm': '6.023', 'learning_rate': '1.33e-07', 'epoch': '0.9496'}

 95%|█████████▍| 36050/37963 [154:36:56<10:00:05, 18.82s/it]
 95%|█████████▍| 36051/37963 [154:37:11<9:18:03, 17.51s/it] 
 95%|█████████▍| 36052/37963 [154:37:25<8:48:21, 16.59s/it]
 95%|█████████▍| 36053/37963 [154:37:39<8:27:24, 15.94s/it]
 95%|█████████▍| 36054/37963 [154:37:54<8:12:56, 15.49s/it]
 95%|█████████▍| 36055/37963 [154:38:08<8:01:53, 15.15s/it]
 95%|█████████▍| 36056/37963 [154:38:22<7:47:49, 14.72s/it]
 95%|█████████▍| 36057/37963 [154:38:42<8:39:22, 16.35s/it]
 95%|█████████▍| 36058/37963 [154:38:56<8:20:36, 15.77s/it]
 95%|█████████▍| 36059/37963 [154:39:11<8:06:29, 15.33s/it]
 95%|█████████▍| 36060/37963 [154:39:25<7:53:28, 14.93s/it]
                                                           
{'loss': '0.05824', 'grad_norm': '3.056', 'learning_rate': '1.316e-07', 'epoch': '0.9499'}

 95%|█████████▍| 36060/37963 [154:39:25<7:53:28, 14.93s/it]
 95%|█████████▍| 36061/37963 [154:39:39<7:48:35, 14.78s/it]
 95%|█████████▍| 36062/37963 [154:40:00<8:43:51, 16.53s/it]
 95%|█████████▍| 36063/37963 [154:40:14<8:19:12, 15.76s/it]
 95%|█████████▍| 36064/37963 [154:40:28<8:05:43, 15.35s/it]
 95%|█████████▌| 36065/37963 [154:40:42<7:55:50, 15.04s/it]
 95%|█████████▌| 36066/37963 [154:40:57<7:47:34, 14.79s/it]
 95%|█████████▌| 36067/37963 [154:41:11<7:44:56, 14.71s/it]
 95%|█████████▌| 36068/37963 [154:41:26<7:41:14, 14.60s/it]
 95%|█████████▌| 36069/37963 [154:41:40<7:39:04, 14.54s/it]
 95%|█████████▌| 36070/37963 [154:41:54<7:32:16, 14.34s/it]
                                                           
{'loss': '0.06105', 'grad_norm': '2.84', 'learning_rate': '1.303e-07', 'epoch': '0.9501'}

 95%|█████████▌| 36070/37963 [154:41:54<7:32:16, 14.34s/it]
 95%|█████████▌| 36071/37963 [154:42:08<7:33:18, 14.38s/it]
 95%|█████████▌| 36072/37963 [154:42:23<7:32:53, 14.37s/it]
 95%|█████████▌| 36073/37963 [154:42:37<7:33:48, 14.41s/it]
 95%|█████████▌| 36074/37963 [154:42:52<7:35:23, 14.46s/it]
 95%|█████████▌| 36075/37963 [154:43:06<7:34:01, 14.43s/it]
 95%|█████████▌| 36076/37963 [154:43:20<7:33:32, 14.42s/it]
 95%|█████████▌| 36077/37963 [154:43:35<7:33:23, 14.42s/it]
 95%|█████████▌| 36078/37963 [154:43:49<7:29:05, 14.29s/it]
 95%|█████████▌| 36079/37963 [154:44:10<8:34:03, 16.37s/it]
 95%|█████████▌| 36080/37963 [154:44:31<9:17:28, 17.76s/it]
                                                           
{'loss': '0.05463', 'grad_norm': '1.975', 'learning_rate': '1.289e-07', 'epoch': '0.9504'}

 95%|█████████▌| 36080/37963 [154:44:31<9:17:28, 17.76s/it]
 95%|█████████▌| 36081/37963 [154:44:45<8:41:07, 16.61s/it]
 95%|█████████▌| 36082/37963 [154:45:00<8:22:22, 16.02s/it]
 95%|█████████▌| 36083/37963 [154:45:14<8:06:28, 15.53s/it]
 95%|█████████▌| 36084/37963 [154:45:28<7:55:28, 15.18s/it]
 95%|█████████▌| 36085/37963 [154:45:43<7:47:46, 14.94s/it]
 95%|█████████▌| 36086/37963 [154:45:57<7:40:37, 14.72s/it]
 95%|█████████▌| 36087/37963 [154:46:11<7:37:42, 14.64s/it]
 95%|█████████▌| 36088/37963 [154:46:26<7:34:45, 14.55s/it]
 95%|█████████▌| 36089/37963 [154:46:40<7:32:53, 14.50s/it]
 95%|█████████▌| 36090/37963 [154:47:01<8:32:22, 16.41s/it]
                                                           
{'loss': '0.06307', 'grad_norm': '4.333', 'learning_rate': '1.275e-07', 'epoch': '0.9507'}

 95%|█████████▌| 36090/37963 [154:47:01<8:32:22, 16.41s/it]
 95%|█████████▌| 36091/37963 [154:47:16<8:13:21, 15.81s/it]
 95%|█████████▌| 36092/37963 [154:47:30<7:58:34, 15.35s/it]
 95%|█████████▌| 36093/37963 [154:47:43<7:37:15, 14.67s/it]
 95%|█████████▌| 36094/37963 [154:47:57<7:34:20, 14.59s/it]
 95%|█████████▌| 36095/37963 [154:48:12<7:34:25, 14.60s/it]
 95%|█████████▌| 36096/37963 [154:48:26<7:31:26, 14.51s/it]
 95%|█████████▌| 36097/37963 [154:48:47<8:29:12, 16.37s/it]
 95%|█████████▌| 36098/37963 [154:49:15<10:19:34, 19.93s/it]
 95%|█████████▌| 36099/37963 [154:49:29<9:27:14, 18.26s/it] 
 95%|█████████▌| 36100/37963 [154:49:44<8:49:43, 17.06s/it]
                                                           
{'loss': '0.0574', 'grad_norm': '1.9', 'learning_rate': '1.262e-07', 'epoch': '0.9509'}

 95%|█████████▌| 36100/37963 [154:49:44<8:49:43, 17.06s/it]
 95%|█████████▌| 36101/37963 [154:49:58<8:24:47, 16.27s/it]
 95%|█████████▌| 36102/37963 [154:50:13<8:06:58, 15.70s/it]
 95%|█████████▌| 36103/37963 [154:50:27<7:53:01, 15.26s/it]
 95%|█████████▌| 36104/37963 [154:50:41<7:41:54, 14.91s/it]
 95%|█████████▌| 36105/37963 [154:51:01<8:33:58, 16.60s/it]
 95%|█████████▌| 36106/37963 [154:51:16<8:13:35, 15.95s/it]
 95%|█████████▌| 36107/37963 [154:51:30<7:59:22, 15.50s/it]
 95%|█████████▌| 36108/37963 [154:51:44<7:46:18, 15.08s/it]
 95%|█████████▌| 36109/37963 [154:51:59<7:39:14, 14.86s/it]
 95%|█████████▌| 36110/37963 [154:52:13<7:35:37, 14.75s/it]
                                                           
{'loss': '0.07299', 'grad_norm': '2.702', 'learning_rate': '1.248e-07', 'epoch': '0.9512'}

 95%|█████████▌| 36110/37963 [154:52:13<7:35:37, 14.75s/it]
 95%|█████████▌| 36111/37963 [154:52:34<8:26:55, 16.42s/it]
 95%|█████████▌| 36112/37963 [154:52:48<8:08:08, 15.82s/it]
 95%|█████████▌| 36113/37963 [154:53:02<7:52:25, 15.32s/it]
 95%|█████████▌| 36114/37963 [154:53:16<7:40:10, 14.93s/it]
 95%|█████████▌| 36115/37963 [154:53:30<7:32:16, 14.68s/it]
 95%|█████████▌| 36116/37963 [154:53:45<7:30:50, 14.65s/it]
 95%|█████████▌| 36117/37963 [154:53:59<7:27:50, 14.56s/it]
 95%|█████████▌| 36118/37963 [154:54:14<7:26:43, 14.53s/it]
 95%|█████████▌| 36119/37963 [154:54:28<7:23:17, 14.42s/it]
 95%|█████████▌| 36120/37963 [154:54:42<7:23:18, 14.43s/it]
                                                           
{'loss': '0.05116', 'grad_norm': '2.554', 'learning_rate': '1.235e-07', 'epoch': '0.9515'}

 95%|█████████▌| 36120/37963 [154:54:42<7:23:18, 14.43s/it]
 95%|█████████▌| 36121/37963 [154:54:57<7:22:40, 14.42s/it]
 95%|█████████▌| 36122/37963 [154:55:11<7:23:37, 14.46s/it]
 95%|█████████▌| 36123/37963 [154:55:26<7:22:48, 14.44s/it]
 95%|█████████▌| 36124/37963 [154:55:40<7:22:35, 14.44s/it]
 95%|█████████▌| 36125/37963 [154:55:54<7:22:04, 14.43s/it]
 95%|█████████▌| 36126/37963 [154:56:15<8:22:08, 16.40s/it]
 95%|█████████▌| 36127/37963 [154:56:30<8:05:27, 15.86s/it]
 95%|█████████▌| 36128/37963 [154:56:45<7:52:33, 15.45s/it]
 95%|█████████▌| 36129/37963 [154:56:59<7:40:47, 15.08s/it]
 95%|█████████▌| 36130/37963 [154:57:13<7:34:25, 14.87s/it]
                                                           
{'loss': '0.06639', 'grad_norm': '2.775', 'learning_rate': '1.222e-07', 'epoch': '0.9517'}

 95%|█████████▌| 36130/37963 [154:57:13<7:34:25, 14.87s/it]
 95%|█████████▌| 36131/37963 [154:57:28<7:29:54, 14.73s/it]
 95%|█████████▌| 36132/37963 [154:57:41<7:21:41, 14.47s/it]
 95%|█████████▌| 36133/37963 [154:58:02<8:19:33, 16.38s/it]
 95%|█████████▌| 36134/37963 [154:58:16<7:55:05, 15.59s/it]
 95%|█████████▌| 36135/37963 [154:58:30<7:44:05, 15.23s/it]
 95%|█████████▌| 36136/37963 [154:58:45<7:36:55, 15.01s/it]
 95%|█████████▌| 36137/37963 [154:58:59<7:30:29, 14.80s/it]
 95%|█████████▌| 36138/37963 [154:59:13<7:19:14, 14.44s/it]
 95%|█████████▌| 36139/37963 [154:59:27<7:19:10, 14.45s/it]
 95%|█████████▌| 36140/37963 [154:59:42<7:19:31, 14.47s/it]
                                                           
{'loss': '0.06534', 'grad_norm': '2.7', 'learning_rate': '1.208e-07', 'epoch': '0.952'}

 95%|█████████▌| 36140/37963 [154:59:42<7:19:31, 14.47s/it]
 95%|█████████▌| 36141/37963 [155:00:03<8:20:05, 16.47s/it]
 95%|█████████▌| 36142/37963 [155:00:17<7:56:39, 15.71s/it]
 95%|█████████▌| 36143/37963 [155:00:31<7:44:07, 15.30s/it]
 95%|█████████▌| 36144/37963 [155:00:46<7:35:36, 15.03s/it]
 95%|█████████▌| 36145/37963 [155:01:00<7:29:05, 14.82s/it]
 95%|█████████▌| 36146/37963 [155:01:28<9:28:28, 18.77s/it]
 95%|█████████▌| 36147/37963 [155:01:41<8:39:31, 17.16s/it]
 95%|█████████▌| 36148/37963 [155:02:02<9:10:52, 18.21s/it]
 95%|█████████▌| 36149/37963 [155:02:16<8:29:34, 16.85s/it]
 95%|█████████▌| 36150/37963 [155:02:30<8:06:36, 16.10s/it]
                                                           
{'loss': '0.06456', 'grad_norm': '3.21', 'learning_rate': '1.195e-07', 'epoch': '0.9522'}

 95%|█████████▌| 36150/37963 [155:02:30<8:06:36, 16.10s/it]
 95%|█████████▌| 36151/37963 [155:02:44<7:51:22, 15.61s/it]
 95%|█████████▌| 36152/37963 [155:02:59<7:39:52, 15.24s/it]
 95%|█████████▌| 36153/37963 [155:03:13<7:26:11, 14.79s/it]
 95%|█████████▌| 36154/37963 [155:03:27<7:22:10, 14.67s/it]
 95%|█████████▌| 36155/37963 [155:03:41<7:19:05, 14.57s/it]
 95%|█████████▌| 36156/37963 [155:04:02<8:12:51, 16.36s/it]
 95%|█████████▌| 36157/37963 [155:04:16<7:49:01, 15.58s/it]
 95%|█████████▌| 36158/37963 [155:04:30<7:33:36, 15.08s/it]
 95%|█████████▌| 36159/37963 [155:04:50<8:24:59, 16.80s/it]
 95%|█████████▌| 36160/37963 [155:05:04<7:59:01, 15.94s/it]
                                                           
{'loss': '0.05848', 'grad_norm': '3.432', 'learning_rate': '1.182e-07', 'epoch': '0.9525'}

 95%|█████████▌| 36160/37963 [155:05:04<7:59:01, 15.94s/it]
 95%|█████████▌| 36161/37963 [155:05:19<7:44:40, 15.47s/it]
 95%|█████████▌| 36162/37963 [155:05:33<7:30:42, 15.02s/it]
 95%|█████████▌| 36163/37963 [155:05:47<7:24:43, 14.82s/it]
 95%|█████████▌| 36164/37963 [155:06:01<7:20:01, 14.68s/it]
 95%|█████████▌| 36165/37963 [155:06:16<7:16:57, 14.58s/it]
 95%|█████████▌| 36166/37963 [155:06:30<7:12:37, 14.44s/it]
 95%|█████████▌| 36167/37963 [155:06:44<7:09:26, 14.35s/it]
 95%|█████████▌| 36168/37963 [155:06:58<7:08:13, 14.31s/it]
 95%|█████████▌| 36169/37963 [155:07:13<7:08:27, 14.33s/it]
 95%|█████████▌| 36170/37963 [155:07:27<7:08:39, 14.34s/it]
                                                           
{'loss': '0.05848', 'grad_norm': '3.709', 'learning_rate': '1.169e-07', 'epoch': '0.9528'}

 95%|█████████▌| 36170/37963 [155:07:27<7:08:39, 14.34s/it]
 95%|█████████▌| 36171/37963 [155:07:41<7:03:57, 14.20s/it]
 95%|█████████▌| 36172/37963 [155:07:55<7:06:52, 14.30s/it]
 95%|█████████▌| 36173/37963 [155:08:10<7:07:38, 14.33s/it]
 95%|█████████▌| 36174/37963 [155:08:24<7:07:44, 14.35s/it]
 95%|█████████▌| 36175/37963 [155:08:38<7:07:44, 14.35s/it]
 95%|█████████▌| 36176/37963 [155:08:53<7:07:12, 14.34s/it]
 95%|█████████▌| 36177/37963 [155:09:14<8:06:30, 16.34s/it]
 95%|█████████▌| 36178/37963 [155:09:28<7:47:28, 15.71s/it]
 95%|█████████▌| 36179/37963 [155:09:42<7:35:43, 15.33s/it]
 95%|█████████▌| 36180/37963 [155:10:03<8:19:12, 16.80s/it]
                                                           
{'loss': '0.07288', 'grad_norm': '4.891', 'learning_rate': '1.156e-07', 'epoch': '0.953'}

 95%|█████████▌| 36180/37963 [155:10:03<8:19:12, 16.80s/it]
 95%|█████████▌| 36181/37963 [155:10:17<7:55:19, 16.00s/it]
 95%|█████████▌| 36182/37963 [155:10:31<7:40:26, 15.51s/it]
 95%|█████████▌| 36183/37963 [155:10:46<7:29:43, 15.16s/it]
 95%|█████████▌| 36184/37963 [155:11:00<7:22:05, 14.91s/it]
 95%|█████████▌| 36185/37963 [155:11:14<7:12:56, 14.61s/it]
 95%|█████████▌| 36186/37963 [155:11:28<7:11:47, 14.58s/it]
 95%|█████████▌| 36187/37963 [155:11:43<7:09:40, 14.52s/it]
 95%|█████████▌| 36188/37963 [155:11:57<7:08:33, 14.49s/it]
 95%|█████████▌| 36189/37963 [155:12:12<7:08:19, 14.49s/it]
 95%|█████████▌| 36190/37963 [155:12:33<8:06:08, 16.45s/it]
                                                           
{'loss': '0.073', 'grad_norm': '3.791', 'learning_rate': '1.143e-07', 'epoch': '0.9533'}

 95%|█████████▌| 36190/37963 [155:12:33<8:06:08, 16.45s/it]
 95%|█████████▌| 36191/37963 [155:12:47<7:47:58, 15.85s/it]
 95%|█████████▌| 36192/37963 [155:13:01<7:33:17, 15.36s/it]
 95%|█████████▌| 36193/37963 [155:13:15<7:21:35, 14.97s/it]
 95%|█████████▌| 36194/37963 [155:13:30<7:15:58, 14.79s/it]
 95%|█████████▌| 36195/37963 [155:13:51<8:11:25, 16.68s/it]
 95%|█████████▌| 36196/37963 [155:14:11<8:44:18, 17.80s/it]
 95%|█████████▌| 36197/37963 [155:14:26<8:13:59, 16.78s/it]
 95%|█████████▌| 36198/37963 [155:14:47<8:51:00, 18.05s/it]
 95%|█████████▌| 36199/37963 [155:15:01<8:19:16, 16.98s/it]
 95%|█████████▌| 36200/37963 [155:15:15<7:55:40, 16.19s/it]
                                                           
{'loss': '0.06', 'grad_norm': '3.231', 'learning_rate': '1.13e-07', 'epoch': '0.9536'}

 95%|█████████▌| 36200/37963 [155:15:15<7:55:40, 16.19s/it]
 95%|█████████▌| 36201/37963 [155:15:30<7:40:04, 15.67s/it]
 95%|█████████▌| 36202/37963 [155:15:44<7:25:34, 15.18s/it]
 95%|█████████▌| 36203/37963 [155:15:58<7:18:39, 14.95s/it]
 95%|█████████▌| 36204/37963 [155:16:13<7:11:58, 14.73s/it]
 95%|█████████▌| 36205/37963 [155:16:34<8:06:59, 16.62s/it]
 95%|█████████▌| 36206/37963 [155:16:48<7:47:44, 15.97s/it]
 95%|█████████▌| 36207/37963 [155:17:02<7:33:44, 15.50s/it]
 95%|█████████▌| 36208/37963 [155:17:17<7:24:11, 15.19s/it]
 95%|█████████▌| 36209/37963 [155:17:38<8:13:40, 16.89s/it]
 95%|█████████▌| 36210/37963 [155:17:52<7:46:09, 15.96s/it]
                                                           
{'loss': '0.07205', 'grad_norm': '2.653', 'learning_rate': '1.118e-07', 'epoch': '0.9538'}

 95%|█████████▌| 36210/37963 [155:17:52<7:46:09, 15.96s/it]
 95%|█████████▌| 36211/37963 [155:18:06<7:28:35, 15.36s/it]
 95%|█████████▌| 36212/37963 [155:18:20<7:18:01, 15.01s/it]
 95%|█████████▌| 36213/37963 [155:18:34<7:11:54, 14.81s/it]
 95%|█████████▌| 36214/37963 [155:18:48<7:07:47, 14.68s/it]
 95%|█████████▌| 36215/37963 [155:19:03<7:05:01, 14.59s/it]
 95%|█████████▌| 36216/37963 [155:19:17<7:03:02, 14.53s/it]
 95%|█████████▌| 36217/37963 [155:19:32<7:01:18, 14.48s/it]
 95%|█████████▌| 36218/37963 [155:19:45<6:54:43, 14.26s/it]
 95%|█████████▌| 36219/37963 [155:19:59<6:50:14, 14.11s/it]
 95%|█████████▌| 36220/37963 [155:20:13<6:52:01, 14.18s/it]
                                                           
{'loss': '0.06345', 'grad_norm': '4.424', 'learning_rate': '1.105e-07', 'epoch': '0.9541'}

 95%|█████████▌| 36220/37963 [155:20:13<6:52:01, 14.18s/it]
 95%|█████████▌| 36221/37963 [155:20:28<6:53:32, 14.24s/it]
 95%|█████████▌| 36222/37963 [155:20:42<6:54:19, 14.28s/it]
 95%|█████████▌| 36223/37963 [155:20:57<6:54:34, 14.30s/it]
 95%|█████████▌| 36224/37963 [155:21:11<6:55:28, 14.34s/it]
 95%|█████████▌| 36225/37963 [155:21:25<6:55:50, 14.36s/it]
 95%|█████████▌| 36226/37963 [155:21:46<7:54:28, 16.39s/it]
 95%|█████████▌| 36227/37963 [155:22:01<7:37:27, 15.81s/it]
 95%|█████████▌| 36228/37963 [155:22:15<7:21:39, 15.27s/it]
 95%|█████████▌| 36229/37963 [155:22:29<7:09:17, 14.85s/it]
 95%|█████████▌| 36230/37963 [155:22:43<7:05:00, 14.71s/it]
                                                           
{'loss': '0.07645', 'grad_norm': '3.164', 'learning_rate': '1.092e-07', 'epoch': '0.9544'}

 95%|█████████▌| 36230/37963 [155:22:43<7:05:00, 14.71s/it]
 95%|█████████▌| 36231/37963 [155:23:04<7:55:27, 16.47s/it]
 95%|█████████▌| 36232/37963 [155:23:18<7:36:48, 15.83s/it]
 95%|█████████▌| 36233/37963 [155:23:33<7:23:58, 15.40s/it]
 95%|█████████▌| 36234/37963 [155:23:47<7:14:12, 15.07s/it]
 95%|█████████▌| 36235/37963 [155:24:01<7:07:25, 14.84s/it]
 95%|█████████▌| 36236/37963 [155:24:16<7:03:14, 14.70s/it]
 95%|█████████▌| 36237/37963 [155:24:30<7:00:33, 14.62s/it]
 95%|█████████▌| 36238/37963 [155:24:44<6:58:00, 14.54s/it]
 95%|█████████▌| 36239/37963 [155:25:05<7:52:37, 16.45s/it]
 95%|█████████▌| 36240/37963 [155:25:19<7:33:23, 15.79s/it]
                                                           
{'loss': '0.0643', 'grad_norm': '4.559', 'learning_rate': '1.08e-07', 'epoch': '0.9546'}

 95%|█████████▌| 36240/37963 [155:25:19<7:33:23, 15.79s/it]
 95%|█████████▌| 36241/37963 [155:25:34<7:22:31, 15.42s/it]
 95%|█████████▌| 36242/37963 [155:25:48<7:12:10, 15.07s/it]
 95%|█████████▌| 36243/37963 [155:26:09<8:04:35, 16.90s/it]
 95%|█████████▌| 36244/37963 [155:26:24<7:42:31, 16.14s/it]
 95%|█████████▌| 36245/37963 [155:26:45<8:21:56, 17.53s/it]
 95%|█████████▌| 36246/37963 [155:26:59<7:54:44, 16.59s/it]
 95%|█████████▌| 36247/37963 [155:27:13<7:36:05, 15.95s/it]
 95%|█████████▌| 36248/37963 [155:27:28<7:22:14, 15.47s/it]
 95%|█████████▌| 36249/37963 [155:27:42<7:12:52, 15.15s/it]
 95%|█████████▌| 36250/37963 [155:28:03<8:02:41, 16.91s/it]
                                                           
{'loss': '0.0621', 'grad_norm': '3.402', 'learning_rate': '1.067e-07', 'epoch': '0.9549'}

 95%|█████████▌| 36250/37963 [155:28:03<8:02:41, 16.91s/it]
 95%|█████████▌| 36251/37963 [155:28:17<7:35:18, 15.96s/it]
 95%|█████████▌| 36252/37963 [155:28:31<7:16:13, 15.30s/it]
 95%|█████████▌| 36253/37963 [155:28:45<7:07:48, 15.01s/it]
 95%|█████████▌| 36254/37963 [155:28:59<7:00:20, 14.76s/it]
 96%|█████████▌| 36255/37963 [155:29:20<7:54:29, 16.67s/it]
 96%|█████████▌| 36256/37963 [155:29:35<7:35:57, 16.03s/it]
 96%|█████████▌| 36257/37963 [155:29:49<7:21:22, 15.52s/it]
 96%|█████████▌| 36258/37963 [155:30:09<8:00:59, 16.93s/it]
 96%|█████████▌| 36259/37963 [155:30:23<7:34:31, 16.00s/it]
 96%|█████████▌| 36260/37963 [155:30:38<7:19:57, 15.50s/it]
                                                           
{'loss': '0.06249', 'grad_norm': '3.8', 'learning_rate': '1.055e-07', 'epoch': '0.9551'}

 96%|█████████▌| 36260/37963 [155:30:38<7:19:57, 15.50s/it]
 96%|█████████▌| 36261/37963 [155:30:52<7:10:03, 15.16s/it]
 96%|█████████▌| 36262/37963 [155:31:06<7:03:14, 14.93s/it]
 96%|█████████▌| 36263/37963 [155:31:21<6:57:48, 14.75s/it]
 96%|█████████▌| 36264/37963 [155:31:35<6:54:26, 14.64s/it]
 96%|█████████▌| 36265/37963 [155:31:49<6:51:56, 14.56s/it]
 96%|█████████▌| 36266/37963 [155:32:04<6:49:18, 14.47s/it]
 96%|█████████▌| 36267/37963 [155:32:18<6:48:10, 14.44s/it]
 96%|█████████▌| 36268/37963 [155:32:32<6:47:31, 14.43s/it]
 96%|█████████▌| 36269/37963 [155:32:47<6:46:47, 14.41s/it]
 96%|█████████▌| 36270/37963 [155:33:01<6:49:01, 14.50s/it]
                                                           
{'loss': '0.05751', 'grad_norm': '4.49', 'learning_rate': '1.043e-07', 'epoch': '0.9554'}

 96%|█████████▌| 36270/37963 [155:33:01<6:49:01, 14.50s/it]
 96%|█████████▌| 36271/37963 [155:33:16<6:48:07, 14.47s/it]
 96%|█████████▌| 36272/37963 [155:33:30<6:47:04, 14.44s/it]
 96%|█████████▌| 36273/37963 [155:33:45<6:46:22, 14.43s/it]
 96%|█████████▌| 36274/37963 [155:33:59<6:45:13, 14.40s/it]
 96%|█████████▌| 36275/37963 [155:34:20<7:37:16, 16.25s/it]
 96%|█████████▌| 36276/37963 [155:34:34<7:17:41, 15.57s/it]
 96%|█████████▌| 36277/37963 [155:34:47<6:59:22, 14.92s/it]
 96%|█████████▌| 36278/37963 [155:35:01<6:51:51, 14.67s/it]
 96%|█████████▌| 36279/37963 [155:35:15<6:49:16, 14.58s/it]
 96%|█████████▌| 36280/37963 [155:35:30<6:47:30, 14.53s/it]
                                                           
{'loss': '0.07213', 'grad_norm': '4.544', 'learning_rate': '1.03e-07', 'epoch': '0.9557'}

 96%|█████████▌| 36280/37963 [155:35:30<6:47:30, 14.53s/it]
 96%|█████████▌| 36281/37963 [155:35:44<6:41:38, 14.33s/it]
 96%|█████████▌| 36282/37963 [155:36:04<7:34:51, 16.24s/it]
 96%|█████████▌| 36283/37963 [155:36:19<7:20:52, 15.75s/it]
 96%|█████████▌| 36284/37963 [155:36:33<7:09:29, 15.35s/it]
 96%|█████████▌| 36285/37963 [155:36:48<7:01:18, 15.06s/it]
 96%|█████████▌| 36286/37963 [155:37:02<6:54:55, 14.85s/it]
 96%|█████████▌| 36287/37963 [155:37:23<7:44:25, 16.63s/it]
 96%|█████████▌| 36288/37963 [155:37:38<7:27:05, 16.02s/it]
 96%|█████████▌| 36289/37963 [155:37:52<7:13:09, 15.53s/it]
 96%|█████████▌| 36290/37963 [155:38:06<7:00:51, 15.09s/it]
                                                           
{'loss': '0.06251', 'grad_norm': '2.691', 'learning_rate': '1.018e-07', 'epoch': '0.9559'}

 96%|█████████▌| 36290/37963 [155:38:06<7:00:51, 15.09s/it]
 96%|█████████▌| 36291/37963 [155:38:20<6:54:25, 14.87s/it]
 96%|█████████▌| 36292/37963 [155:38:41<7:46:15, 16.74s/it]
 96%|█████████▌| 36293/37963 [155:38:55<7:22:01, 15.88s/it]
 96%|█████████▌| 36294/37963 [155:39:17<8:08:05, 17.55s/it]
 96%|█████████▌| 36295/37963 [155:39:31<7:38:30, 16.49s/it]
 96%|█████████▌| 36296/37963 [155:39:45<7:16:25, 15.71s/it]
 96%|█████████▌| 36297/37963 [155:39:59<7:05:07, 15.31s/it]
 96%|█████████▌| 36298/37963 [155:40:20<7:50:10, 16.94s/it]
 96%|█████████▌| 36299/37963 [155:40:34<7:28:34, 16.17s/it]
 96%|█████████▌| 36300/37963 [155:40:48<7:12:35, 15.61s/it]
                                                           
{'loss': '0.05847', 'grad_norm': '3.065', 'learning_rate': '1.006e-07', 'epoch': '0.9562'}

 96%|█████████▌| 36300/37963 [155:40:48<7:12:35, 15.61s/it]
 96%|█████████▌| 36301/37963 [155:41:09<7:53:56, 17.11s/it]
 96%|█████████▌| 36302/37963 [155:41:23<7:26:51, 16.14s/it]
 96%|█████████▌| 36303/37963 [155:41:37<7:11:55, 15.61s/it]
 96%|█████████▌| 36304/37963 [155:41:58<7:53:59, 17.14s/it]
 96%|█████████▌| 36305/37963 [155:42:12<7:30:31, 16.30s/it]
 96%|█████████▌| 36306/37963 [155:42:27<7:14:07, 15.72s/it]
 96%|█████████▌| 36307/37963 [155:42:41<7:03:35, 15.35s/it]
 96%|█████████▌| 36308/37963 [155:42:56<6:54:46, 15.04s/it]
 96%|█████████▌| 36309/37963 [155:43:10<6:49:51, 14.87s/it]
 96%|█████████▌| 36310/37963 [155:43:24<6:44:15, 14.67s/it]
                                                           
{'loss': '0.05472', 'grad_norm': '3.162', 'learning_rate': '9.939e-08', 'epoch': '0.9565'}

 96%|█████████▌| 36310/37963 [155:43:24<6:44:15, 14.67s/it]
 96%|█████████▌| 36311/37963 [155:43:39<6:43:06, 14.64s/it]
 96%|█████████▌| 36312/37963 [155:43:52<6:34:43, 14.34s/it]
 96%|█████████▌| 36313/37963 [155:44:07<6:34:49, 14.36s/it]
 96%|█████████▌| 36314/37963 [155:44:21<6:31:34, 14.25s/it]
 96%|█████████▌| 36315/37963 [155:44:35<6:32:15, 14.28s/it]
 96%|█████████▌| 36316/37963 [155:44:49<6:31:32, 14.26s/it]
 96%|█████████▌| 36317/37963 [155:45:04<6:32:30, 14.31s/it]
 96%|█████████▌| 36318/37963 [155:45:18<6:33:38, 14.36s/it]
 96%|█████████▌| 36319/37963 [155:45:33<6:33:09, 14.35s/it]
 96%|█████████▌| 36320/37963 [155:45:47<6:29:46, 14.23s/it]
                                                           
{'loss': '0.06077', 'grad_norm': '3.206', 'learning_rate': '9.82e-08', 'epoch': '0.9567'}

 96%|█████████▌| 36320/37963 [155:45:47<6:29:46, 14.23s/it]
 96%|█████████▌| 36321/37963 [155:46:01<6:28:19, 14.19s/it]
 96%|█████████▌| 36322/37963 [155:46:15<6:30:14, 14.27s/it]
 96%|█████████▌| 36323/37963 [155:46:30<6:30:55, 14.30s/it]
 96%|█████████▌| 36324/37963 [155:46:44<6:30:31, 14.30s/it]
 96%|█████████▌| 36325/37963 [155:46:58<6:30:15, 14.30s/it]
 96%|█████████▌| 36326/37963 [155:47:19<7:26:43, 16.37s/it]
 96%|█████████▌| 36327/37963 [155:47:34<7:10:15, 15.78s/it]
 96%|█████████▌| 36328/37963 [155:47:48<6:58:43, 15.37s/it]
 96%|█████████▌| 36329/37963 [155:48:02<6:47:19, 14.96s/it]
 96%|█████████▌| 36330/37963 [155:48:23<7:33:33, 16.66s/it]
                                                           
{'loss': '0.06606', 'grad_norm': '4.37', 'learning_rate': '9.701e-08', 'epoch': '0.957'}

 96%|█████████▌| 36330/37963 [155:48:23<7:33:33, 16.66s/it]
 96%|█████████▌| 36331/37963 [155:48:37<7:11:21, 15.86s/it]
 96%|█████████▌| 36332/37963 [155:48:51<6:59:07, 15.42s/it]
 96%|█████████▌| 36333/37963 [155:49:06<6:51:25, 15.14s/it]
 96%|█████████▌| 36334/37963 [155:49:19<6:39:08, 14.70s/it]
 96%|█████████▌| 36335/37963 [155:49:34<6:36:43, 14.62s/it]
 96%|█████████▌| 36336/37963 [155:49:48<6:34:20, 14.54s/it]
 96%|█████████▌| 36337/37963 [155:50:02<6:32:06, 14.47s/it]
 96%|█████████▌| 36338/37963 [155:50:24<7:28:48, 16.57s/it]
 96%|█████████▌| 36339/37963 [155:50:38<7:07:56, 15.81s/it]
 96%|█████████▌| 36340/37963 [155:50:59<7:52:02, 17.45s/it]
                                                           
{'loss': '0.0615', 'grad_norm': '2.739', 'learning_rate': '9.583e-08', 'epoch': '0.9573'}

 96%|█████████▌| 36340/37963 [155:50:59<7:52:02, 17.45s/it]
 96%|█████████▌| 36341/37963 [155:51:13<7:21:45, 16.34s/it]
 96%|█████████▌| 36342/37963 [155:51:27<7:05:27, 15.75s/it]
 96%|█████████▌| 36343/37963 [155:51:49<7:51:10, 17.45s/it]
 96%|█████████▌| 36344/37963 [155:52:03<7:21:26, 16.36s/it]
 96%|█████████▌| 36345/37963 [155:52:17<7:02:49, 15.68s/it]
 96%|█████████▌| 36346/37963 [155:52:38<7:44:53, 17.25s/it]
 96%|█████████▌| 36347/37963 [155:52:52<7:21:09, 16.38s/it]
 96%|█████████▌| 36348/37963 [155:53:07<7:06:51, 15.86s/it]
 96%|█████████▌| 36349/37963 [155:53:21<6:54:25, 15.41s/it]
 96%|█████████▌| 36350/37963 [155:53:42<7:39:39, 17.10s/it]
                                                           
{'loss': '0.06208', 'grad_norm': '2.836', 'learning_rate': '9.465e-08', 'epoch': '0.9575'}

 96%|█████████▌| 36350/37963 [155:53:42<7:39:39, 17.10s/it]
 96%|█████████▌| 36351/37963 [155:53:56<7:17:08, 16.27s/it]
 96%|█████████▌| 36352/37963 [155:54:17<7:53:23, 17.63s/it]
 96%|█████████▌| 36353/37963 [155:54:31<7:26:47, 16.65s/it]
 96%|█████████▌| 36354/37963 [155:54:45<7:03:35, 15.80s/it]
 96%|█████████▌| 36355/37963 [155:54:59<6:49:34, 15.28s/it]
 96%|█████████▌| 36356/37963 [155:55:14<6:41:27, 14.99s/it]
 96%|█████████▌| 36357/37963 [155:55:27<6:29:07, 14.54s/it]
 96%|█████████▌| 36358/37963 [155:55:41<6:27:09, 14.47s/it]
 96%|█████████▌| 36359/37963 [155:55:56<6:24:17, 14.38s/it]
 96%|█████████▌| 36360/37963 [155:56:10<6:21:15, 14.27s/it]
                                                           
{'loss': '0.07007', 'grad_norm': '3.111', 'learning_rate': '9.348e-08', 'epoch': '0.9578'}

 96%|█████████▌| 36360/37963 [155:56:10<6:21:15, 14.27s/it]
 96%|█████████▌| 36361/37963 [155:56:24<6:22:14, 14.32s/it]
 96%|█████████▌| 36362/37963 [155:56:39<6:23:46, 14.38s/it]
 96%|█████████▌| 36363/37963 [155:56:53<6:23:19, 14.37s/it]
 96%|█████████▌| 36364/37963 [155:57:07<6:18:45, 14.21s/it]
 96%|█████████▌| 36365/37963 [155:57:21<6:19:22, 14.24s/it]
 96%|█████████▌| 36366/37963 [155:57:35<6:17:15, 14.17s/it]
 96%|█████████▌| 36367/37963 [155:57:50<6:20:01, 14.29s/it]
 96%|█████████▌| 36368/37963 [155:58:04<6:18:41, 14.25s/it]
 96%|█████████▌| 36369/37963 [155:58:18<6:19:47, 14.30s/it]
 96%|█████████▌| 36370/37963 [155:58:33<6:20:28, 14.33s/it]
                                                           
{'loss': '0.0571', 'grad_norm': '3.732', 'learning_rate': '9.232e-08', 'epoch': '0.958'}

 96%|█████████▌| 36370/37963 [155:58:33<6:20:28, 14.33s/it]
 96%|█████████▌| 36371/37963 [155:58:47<6:20:42, 14.35s/it]
 96%|█████████▌| 36372/37963 [155:59:01<6:20:25, 14.35s/it]
 96%|█████████▌| 36373/37963 [155:59:16<6:21:04, 14.38s/it]
 96%|█████████▌| 36374/37963 [155:59:30<6:19:32, 14.33s/it]
 96%|█████████▌| 36375/37963 [155:59:44<6:19:24, 14.34s/it]
 96%|█████████▌| 36376/37963 [156:00:05<7:11:58, 16.33s/it]
 96%|█████████▌| 36377/37963 [156:00:20<6:55:54, 15.73s/it]
 96%|█████████▌| 36378/37963 [156:00:41<7:37:36, 17.32s/it]
 96%|█████████▌| 36379/37963 [156:00:55<7:13:34, 16.42s/it]
 96%|█████████▌| 36380/37963 [156:01:09<6:56:27, 15.78s/it]
                                                           
{'loss': '0.07532', 'grad_norm': '2.804', 'learning_rate': '9.117e-08', 'epoch': '0.9583'}

 96%|█████████▌| 36380/37963 [156:01:09<6:56:27, 15.78s/it]
 96%|█████████▌| 36381/37963 [156:01:24<6:45:23, 15.38s/it]
 96%|█████████▌| 36382/37963 [156:01:38<6:37:13, 15.07s/it]
 96%|█████████▌| 36383/37963 [156:01:53<6:32:04, 14.89s/it]
 96%|█████████▌| 36384/37963 [156:02:07<6:25:15, 14.64s/it]
 96%|█████████▌| 36385/37963 [156:02:21<6:23:11, 14.57s/it]
 96%|█████████▌| 36386/37963 [156:02:35<6:19:56, 14.46s/it]
 96%|█████████▌| 36387/37963 [156:02:49<6:16:13, 14.32s/it]
 96%|█████████▌| 36388/37963 [156:03:03<6:14:32, 14.27s/it]
 96%|█████████▌| 36389/37963 [156:03:31<7:58:49, 18.25s/it]
 96%|█████████▌| 36390/37963 [156:03:51<8:15:30, 18.90s/it]
                                                           
{'loss': '0.06182', 'grad_norm': '2.577', 'learning_rate': '9.003e-08', 'epoch': '0.9586'}

 96%|█████████▌| 36390/37963 [156:03:51<8:15:30, 18.90s/it]
 96%|█████████▌| 36391/37963 [156:04:06<7:39:41, 17.55s/it]
 96%|█████████▌| 36392/37963 [156:04:20<7:12:06, 16.50s/it]
 96%|█████████▌| 36393/37963 [156:04:34<6:54:55, 15.86s/it]
 96%|█████████▌| 36394/37963 [156:04:55<7:34:23, 17.38s/it]
 96%|█████████▌| 36395/37963 [156:05:10<7:11:31, 16.51s/it]
 96%|█████████▌| 36396/37963 [156:05:24<6:54:32, 15.87s/it]
 96%|█████████▌| 36397/37963 [156:05:44<7:28:40, 17.19s/it]
 96%|█████████▌| 36398/37963 [156:05:58<7:04:28, 16.27s/it]
 96%|█████████▌| 36399/37963 [156:06:13<6:49:20, 15.70s/it]
 96%|█████████▌| 36400/37963 [156:06:27<6:38:51, 15.31s/it]
                                                           
{'loss': '0.06671', 'grad_norm': '3.734', 'learning_rate': '8.889e-08', 'epoch': '0.9588'}

 96%|█████████▌| 36400/37963 [156:06:27<6:38:51, 15.31s/it]
 96%|█████████▌| 36401/37963 [156:06:42<6:31:45, 15.05s/it]
 96%|█████████▌| 36402/37963 [156:07:02<7:16:10, 16.77s/it]
 96%|█████████▌| 36403/37963 [156:07:17<6:57:43, 16.07s/it]
 96%|█████████▌| 36404/37963 [156:07:31<6:44:00, 15.55s/it]
 96%|█████████▌| 36405/37963 [156:07:46<6:36:07, 15.26s/it]
 96%|█████████▌| 36406/37963 [156:08:00<6:28:56, 14.99s/it]
 96%|█████████▌| 36407/37963 [156:08:14<6:22:48, 14.76s/it]
 96%|█████████▌| 36408/37963 [156:08:29<6:19:47, 14.65s/it]
 96%|█████████▌| 36409/37963 [156:08:43<6:14:12, 14.45s/it]
 96%|█████████▌| 36410/37963 [156:08:57<6:13:04, 14.41s/it]
                                                           
{'loss': '0.05308', 'grad_norm': '2.81', 'learning_rate': '8.776e-08', 'epoch': '0.9591'}

 96%|█████████▌| 36410/37963 [156:08:57<6:13:04, 14.41s/it]
 96%|█████████▌| 36411/37963 [156:09:12<6:13:49, 14.45s/it]
 96%|█████████▌| 36412/37963 [156:09:26<6:13:10, 14.44s/it]
 96%|█████████▌| 36413/37963 [156:09:40<6:12:29, 14.42s/it]
 96%|█████████▌| 36414/37963 [156:09:55<6:11:00, 14.37s/it]
 96%|█████████▌| 36415/37963 [156:10:09<6:10:52, 14.38s/it]
 96%|█████████▌| 36416/37963 [156:10:23<6:11:14, 14.40s/it]
 96%|█████████▌| 36417/37963 [156:10:37<6:07:57, 14.28s/it]
 96%|█████████▌| 36418/37963 [156:10:52<6:09:22, 14.34s/it]
 96%|█████████▌| 36419/37963 [156:11:06<6:10:21, 14.39s/it]
 96%|█████████▌| 36420/37963 [156:11:21<6:09:57, 14.39s/it]
                                                           
{'loss': '0.06231', 'grad_norm': '2.662', 'learning_rate': '8.663e-08', 'epoch': '0.9594'}

 96%|█████████▌| 36420/37963 [156:11:21<6:09:57, 14.39s/it]
 96%|█████████▌| 36421/37963 [156:11:35<6:08:23, 14.33s/it]
 96%|█████████▌| 36422/37963 [156:11:49<6:08:11, 14.34s/it]
 96%|█████████▌| 36423/37963 [156:12:04<6:07:57, 14.34s/it]
 96%|█████████▌| 36424/37963 [156:12:18<6:07:38, 14.33s/it]
 96%|█████████▌| 36425/37963 [156:12:39<7:00:36, 16.41s/it]
 96%|█████████▌| 36426/37963 [156:12:54<6:44:29, 15.79s/it]
 96%|█████████▌| 36427/37963 [156:13:08<6:33:30, 15.37s/it]
 96%|█████████▌| 36428/37963 [156:13:28<7:09:14, 16.78s/it]
 96%|█████████▌| 36429/37963 [156:13:42<6:50:25, 16.05s/it]
 96%|█████████▌| 36430/37963 [156:13:57<6:37:42, 15.57s/it]
                                                           
{'loss': '0.06717', 'grad_norm': '3.919', 'learning_rate': '8.551e-08', 'epoch': '0.9596'}

 96%|█████████▌| 36430/37963 [156:13:57<6:37:42, 15.57s/it]
 96%|█████████▌| 36431/37963 [156:14:11<6:28:07, 15.20s/it]
 96%|█████████▌| 36432/37963 [156:14:26<6:21:23, 14.95s/it]
 96%|█████████▌| 36433/37963 [156:14:39<6:12:51, 14.62s/it]
 96%|█████████▌| 36434/37963 [156:14:54<6:10:23, 14.53s/it]
 96%|█████████▌| 36435/37963 [156:15:08<6:09:11, 14.50s/it]
 96%|█████████▌| 36436/37963 [156:15:23<6:09:11, 14.51s/it]
 96%|█████████▌| 36437/37963 [156:15:37<6:07:39, 14.46s/it]
 96%|█████████▌| 36438/37963 [156:16:12<8:42:19, 20.55s/it]
 96%|█████████▌| 36439/37963 [156:16:26<7:55:15, 18.71s/it]
 96%|█████████▌| 36440/37963 [156:16:41<7:22:29, 17.43s/it]
                                                           
{'loss': '0.06246', 'grad_norm': '3.081', 'learning_rate': '8.44e-08', 'epoch': '0.9599'}

 96%|█████████▌| 36440/37963 [156:16:41<7:22:29, 17.43s/it]
 96%|█████████▌| 36441/37963 [156:16:55<6:59:36, 16.54s/it]
 96%|█████████▌| 36442/37963 [156:17:10<6:43:20, 15.91s/it]
 96%|█████████▌| 36443/37963 [156:17:30<7:20:14, 17.38s/it]
 96%|█████████▌| 36444/37963 [156:17:45<6:57:12, 16.48s/it]
 96%|█████████▌| 36445/37963 [156:18:05<7:29:02, 17.75s/it]
 96%|█████████▌| 36446/37963 [156:18:19<6:59:25, 16.59s/it]
 96%|█████████▌| 36447/37963 [156:18:34<6:42:34, 15.93s/it]
 96%|█████████▌| 36448/37963 [156:18:48<6:30:25, 15.46s/it]
 96%|█████████▌| 36449/37963 [156:19:02<6:21:56, 15.14s/it]
 96%|█████████▌| 36450/37963 [156:19:17<6:16:45, 14.94s/it]
                                                           
{'loss': '0.0619', 'grad_norm': '3.392', 'learning_rate': '8.33e-08', 'epoch': '0.9601'}

 96%|█████████▌| 36450/37963 [156:19:17<6:16:45, 14.94s/it]
 96%|█████████▌| 36451/37963 [156:19:38<6:59:27, 16.65s/it]
 96%|█████████▌| 36452/37963 [156:19:52<6:42:54, 16.00s/it]
 96%|█████████▌| 36453/37963 [156:20:07<6:30:50, 15.53s/it]
 96%|█████████▌| 36454/37963 [156:20:21<6:21:59, 15.19s/it]
 96%|█████████▌| 36455/37963 [156:20:35<6:15:54, 14.96s/it]
 96%|█████████▌| 36456/37963 [156:20:50<6:11:31, 14.79s/it]
 96%|█████████▌| 36457/37963 [156:21:04<6:09:36, 14.73s/it]
 96%|█████████▌| 36458/37963 [156:21:19<6:06:45, 14.62s/it]
 96%|█████████▌| 36459/37963 [156:21:33<6:05:20, 14.57s/it]
 96%|█████████▌| 36460/37963 [156:21:48<6:04:28, 14.55s/it]
                                                           
{'loss': '0.0678', 'grad_norm': '3.193', 'learning_rate': '8.221e-08', 'epoch': '0.9604'}

 96%|█████████▌| 36460/37963 [156:21:48<6:04:28, 14.55s/it]
 96%|█████████▌| 36461/37963 [156:22:02<6:03:06, 14.51s/it]
 96%|█████████▌| 36462/37963 [156:22:16<6:01:49, 14.46s/it]
 96%|█████████▌| 36463/37963 [156:22:31<5:59:59, 14.40s/it]
 96%|█████████▌| 36464/37963 [156:22:45<6:00:32, 14.43s/it]
 96%|█████████▌| 36465/37963 [156:23:00<5:59:56, 14.42s/it]
 96%|█████████▌| 36466/37963 [156:23:14<5:59:12, 14.40s/it]
 96%|█████████▌| 36467/37963 [156:23:28<5:58:51, 14.39s/it]
 96%|█████████▌| 36468/37963 [156:23:42<5:54:50, 14.24s/it]
 96%|█████████▌| 36469/37963 [156:23:57<5:55:56, 14.29s/it]
 96%|█████████▌| 36470/37963 [156:24:10<5:52:28, 14.16s/it]
                                                           
{'loss': '0.06601', 'grad_norm': '2.56', 'learning_rate': '8.112e-08', 'epoch': '0.9607'}

 96%|█████████▌| 36470/37963 [156:24:10<5:52:28, 14.16s/it]
 96%|█████████▌| 36471/37963 [156:24:25<5:55:20, 14.29s/it]
 96%|█████████▌| 36472/37963 [156:24:39<5:56:02, 14.33s/it]
 96%|█████████▌| 36473/37963 [156:24:54<5:57:45, 14.41s/it]
 96%|█████████▌| 36474/37963 [156:25:15<6:49:19, 16.49s/it]
 96%|█████████▌| 36475/37963 [156:25:30<6:33:56, 15.88s/it]
 96%|█████████▌| 36476/37963 [156:25:44<6:23:22, 15.47s/it]
 96%|█████████▌| 36477/37963 [156:26:05<7:00:54, 16.99s/it]
 96%|█████████▌| 36478/37963 [156:26:19<6:42:23, 16.26s/it]
 96%|█████████▌| 36479/37963 [156:26:34<6:25:55, 15.60s/it]
 96%|█████████▌| 36480/37963 [156:26:48<6:17:04, 15.26s/it]
                                                           
{'loss': '0.06419', 'grad_norm': '3.721', 'learning_rate': '8.004e-08', 'epoch': '0.9609'}

 96%|█████████▌| 36480/37963 [156:26:48<6:17:04, 15.26s/it]
 96%|█████████▌| 36481/37963 [156:27:02<6:09:10, 14.95s/it]
 96%|█████████▌| 36482/37963 [156:27:16<6:00:43, 14.61s/it]
 96%|█████████▌| 36483/37963 [156:27:30<5:56:06, 14.44s/it]
 96%|█████████▌| 36484/37963 [156:27:45<5:56:15, 14.45s/it]
 96%|█████████▌| 36485/37963 [156:27:59<5:55:05, 14.42s/it]
 96%|█████████▌| 36486/37963 [156:28:20<6:44:39, 16.44s/it]
 96%|█████████▌| 36487/37963 [156:28:41<7:19:02, 17.85s/it]
 96%|█████████▌| 36488/37963 [156:29:02<7:43:22, 18.85s/it]
 96%|█████████▌| 36489/37963 [156:29:23<7:59:23, 19.51s/it]
 96%|█████████▌| 36490/37963 [156:29:38<7:20:58, 17.96s/it]
                                                           
{'loss': '0.06117', 'grad_norm': '4.234', 'learning_rate': '7.896e-08', 'epoch': '0.9612'}

 96%|█████████▌| 36490/37963 [156:29:38<7:20:58, 17.96s/it]
 96%|█████████▌| 36491/37963 [156:29:52<6:54:51, 16.91s/it]
 96%|█████████▌| 36492/37963 [156:30:13<7:21:01, 17.99s/it]
 96%|█████████▌| 36493/37963 [156:30:27<6:54:12, 16.91s/it]
 96%|█████████▌| 36494/37963 [156:30:41<6:33:43, 16.08s/it]
 96%|█████████▌| 36495/37963 [156:30:56<6:20:42, 15.56s/it]
 96%|█████████▌| 36496/37963 [156:31:10<6:11:23, 15.19s/it]
 96%|█████████▌| 36497/37963 [156:31:24<5:59:56, 14.73s/it]
 96%|█████████▌| 36498/37963 [156:31:44<6:41:47, 16.46s/it]
 96%|█████████▌| 36499/37963 [156:31:58<6:22:43, 15.69s/it]
 96%|█████████▌| 36500/37963 [156:32:12<6:11:40, 15.24s/it]
                                                           
{'loss': '0.07432', 'grad_norm': '3.859', 'learning_rate': '7.79e-08', 'epoch': '0.9615'}

 96%|█████████▌| 36500/37963 [156:32:12<6:11:40, 15.24s/it]
 96%|█████████▌| 36501/37963 [156:32:27<6:05:13, 14.99s/it]
 96%|█████████▌| 36502/37963 [156:32:41<5:59:58, 14.78s/it]
 96%|█████████▌| 36503/37963 [156:32:55<5:57:34, 14.69s/it]
 96%|█████████▌| 36504/37963 [156:33:09<5:52:52, 14.51s/it]
 96%|█████████▌| 36505/37963 [156:33:24<5:50:47, 14.44s/it]
 96%|█████████▌| 36506/37963 [156:33:38<5:50:38, 14.44s/it]
 96%|█████████▌| 36507/37963 [156:33:52<5:48:57, 14.38s/it]
 96%|█████████▌| 36508/37963 [156:34:07<5:47:20, 14.32s/it]
 96%|█████████▌| 36509/37963 [156:34:21<5:47:57, 14.36s/it]
 96%|█████████▌| 36510/37963 [156:34:35<5:42:49, 14.16s/it]
                                                           
{'loss': '0.05548', 'grad_norm': '3.655', 'learning_rate': '7.684e-08', 'epoch': '0.9617'}

 96%|█████████▌| 36510/37963 [156:34:35<5:42:49, 14.16s/it]
 96%|█████████▌| 36511/37963 [156:34:49<5:44:08, 14.22s/it]
 96%|█████████▌| 36512/37963 [156:35:03<5:45:25, 14.28s/it]
 96%|█████████▌| 36513/37963 [156:35:18<5:46:59, 14.36s/it]
 96%|█████████▌| 36514/37963 [156:35:32<5:42:40, 14.19s/it]
 96%|█████████▌| 36515/37963 [156:35:46<5:42:06, 14.18s/it]
 96%|█████████▌| 36516/37963 [156:36:00<5:43:26, 14.24s/it]
 96%|█████████▌| 36517/37963 [156:36:15<5:44:17, 14.29s/it]
 96%|█████████▌| 36518/37963 [156:36:29<5:45:16, 14.34s/it]
 96%|█████████▌| 36519/37963 [156:36:44<5:45:20, 14.35s/it]
 96%|█████████▌| 36520/37963 [156:36:58<5:45:19, 14.36s/it]
                                                           
{'loss': '0.06141', 'grad_norm': '4.109', 'learning_rate': '7.579e-08', 'epoch': '0.962'}

 96%|█████████▌| 36520/37963 [156:36:58<5:45:19, 14.36s/it]
 96%|█████████▌| 36521/37963 [156:37:12<5:45:04, 14.36s/it]
 96%|█████████▌| 36522/37963 [156:37:27<5:45:10, 14.37s/it]
 96%|█████████▌| 36523/37963 [156:37:48<6:35:35, 16.48s/it]
 96%|█████████▌| 36524/37963 [156:38:03<6:20:12, 15.85s/it]
 96%|█████████▌| 36525/37963 [156:38:17<6:09:23, 15.41s/it]
 96%|█████████▌| 36526/37963 [156:38:38<6:49:49, 17.11s/it]
 96%|█████████▌| 36527/37963 [156:38:52<6:30:23, 16.31s/it]
 96%|█████████▌| 36528/37963 [156:39:07<6:16:41, 15.75s/it]
 96%|█████████▌| 36529/37963 [156:39:21<6:06:13, 15.32s/it]
 96%|█████████▌| 36530/37963 [156:39:35<5:55:20, 14.88s/it]
                                                           
{'loss': '0.06396', 'grad_norm': '3.494', 'learning_rate': '7.474e-08', 'epoch': '0.9623'}

 96%|█████████▌| 36530/37963 [156:39:35<5:55:20, 14.88s/it]
 96%|█████████▌| 36531/37963 [156:39:49<5:50:01, 14.67s/it]
 96%|█████████▌| 36532/37963 [156:40:03<5:45:39, 14.49s/it]
 96%|█████████▌| 36533/37963 [156:40:18<5:44:38, 14.46s/it]
 96%|█████████▌| 36534/37963 [156:40:39<6:32:42, 16.49s/it]
 96%|█████████▌| 36535/37963 [156:40:53<6:17:19, 15.85s/it]
 96%|█████████▌| 36536/37963 [156:41:27<8:26:52, 21.31s/it]
 96%|█████████▌| 36537/37963 [156:41:42<7:37:22, 19.24s/it]
 96%|█████████▌| 36538/37963 [156:41:56<7:02:38, 17.80s/it]
 96%|█████████▌| 36539/37963 [156:42:10<6:35:54, 16.68s/it]
 96%|█████████▋| 36540/37963 [156:42:31<7:04:26, 17.90s/it]
                                                           
{'loss': '0.05852', 'grad_norm': '3.58', 'learning_rate': '7.37e-08', 'epoch': '0.9625'}

 96%|█████████▋| 36540/37963 [156:42:31<7:04:26, 17.90s/it]
 96%|█████████▋| 36541/37963 [156:42:45<6:37:06, 16.76s/it]
 96%|█████████▋| 36542/37963 [156:42:59<6:17:31, 15.94s/it]
 96%|█████████▋| 36543/37963 [156:43:14<6:07:17, 15.52s/it]
 96%|█████████▋| 36544/37963 [156:43:28<5:56:21, 15.07s/it]
 96%|█████████▋| 36545/37963 [156:43:42<5:49:55, 14.81s/it]
 96%|█████████▋| 36546/37963 [156:43:56<5:42:07, 14.49s/it]
 96%|█████████▋| 36547/37963 [156:44:10<5:41:15, 14.46s/it]
 96%|█████████▋| 36548/37963 [156:44:24<5:38:20, 14.35s/it]
 96%|█████████▋| 36549/37963 [156:44:46<6:28:18, 16.48s/it]
 96%|█████████▋| 36550/37963 [156:44:59<6:06:59, 15.58s/it]
                                                           
{'loss': '0.05352', 'grad_norm': '2.506', 'learning_rate': '7.267e-08', 'epoch': '0.9628'}

 96%|█████████▋| 36550/37963 [156:44:59<6:06:59, 15.58s/it]
 96%|█████████▋| 36551/37963 [156:45:13<5:56:51, 15.16s/it]
 96%|█████████▋| 36552/37963 [156:45:27<5:50:17, 14.90s/it]
 96%|█████████▋| 36553/37963 [156:45:42<5:46:46, 14.76s/it]
 96%|█████████▋| 36554/37963 [156:45:56<5:42:22, 14.58s/it]
 96%|█████████▋| 36555/37963 [156:46:10<5:40:21, 14.50s/it]
 96%|█████████▋| 36556/37963 [156:46:25<5:38:52, 14.45s/it]
 96%|█████████▋| 36557/37963 [156:46:39<5:36:51, 14.38s/it]
 96%|█████████▋| 36558/37963 [156:46:53<5:36:30, 14.37s/it]
 96%|█████████▋| 36559/37963 [156:47:08<5:36:41, 14.39s/it]
 96%|█████████▋| 36560/37963 [156:47:22<5:35:56, 14.37s/it]
                                                           
{'loss': '0.06841', 'grad_norm': '2.302', 'learning_rate': '7.165e-08', 'epoch': '0.963'}

 96%|█████████▋| 36560/37963 [156:47:22<5:35:56, 14.37s/it]
 96%|█████████▋| 36561/37963 [156:47:36<5:35:45, 14.37s/it]
 96%|█████████▋| 36562/37963 [156:47:50<5:33:14, 14.27s/it]
 96%|█████████▋| 36563/37963 [156:48:05<5:34:45, 14.35s/it]
 96%|█████████▋| 36564/37963 [156:48:19<5:34:56, 14.36s/it]
 96%|█████████▋| 36565/37963 [156:48:34<5:34:20, 14.35s/it]
 96%|█████████▋| 36566/37963 [156:48:48<5:34:06, 14.35s/it]
 96%|█████████▋| 36567/37963 [156:49:02<5:31:57, 14.27s/it]
 96%|█████████▋| 36568/37963 [156:49:16<5:32:17, 14.29s/it]
 96%|█████████▋| 36569/37963 [156:49:31<5:32:24, 14.31s/it]
 96%|█████████▋| 36570/37963 [156:49:52<6:21:22, 16.43s/it]
                                                           
{'loss': '0.07052', 'grad_norm': '2.08', 'learning_rate': '7.064e-08', 'epoch': '0.9633'}

 96%|█████████▋| 36570/37963 [156:49:52<6:21:22, 16.43s/it]
 96%|█████████▋| 36571/37963 [156:50:07<6:06:57, 15.82s/it]
 96%|█████████▋| 36572/37963 [156:50:28<6:42:19, 17.35s/it]
 96%|█████████▋| 36573/37963 [156:50:42<6:20:13, 16.41s/it]
 96%|█████████▋| 36574/37963 [156:50:56<6:05:32, 15.79s/it]
 96%|█████████▋| 36575/37963 [156:51:10<5:50:29, 15.15s/it]
 96%|█████████▋| 36576/37963 [156:51:24<5:45:08, 14.93s/it]
 96%|█████████▋| 36577/37963 [156:51:39<5:41:36, 14.79s/it]
 96%|█████████▋| 36578/37963 [156:51:53<5:39:02, 14.69s/it]
 96%|█████████▋| 36579/37963 [156:52:07<5:36:45, 14.60s/it]
 96%|█████████▋| 36580/37963 [156:52:22<5:35:35, 14.56s/it]
                                                           
{'loss': '0.05659', 'grad_norm': '3.961', 'learning_rate': '6.963e-08', 'epoch': '0.9636'}

 96%|█████████▋| 36580/37963 [156:52:22<5:35:35, 14.56s/it]
 96%|█████████▋| 36581/37963 [156:52:36<5:31:46, 14.40s/it]
 96%|█████████▋| 36582/37963 [156:52:50<5:30:55, 14.38s/it]
 96%|█████████▋| 36583/37963 [156:53:12<6:18:21, 16.45s/it]
 96%|█████████▋| 36584/37963 [156:53:39<7:37:19, 19.90s/it]
 96%|█████████▋| 36585/37963 [156:54:00<7:42:44, 20.15s/it]
 96%|█████████▋| 36586/37963 [156:54:21<7:46:51, 20.34s/it]
 96%|█████████▋| 36587/37963 [156:54:35<7:05:54, 18.57s/it]
 96%|█████████▋| 36588/37963 [156:54:50<6:36:46, 17.31s/it]
 96%|█████████▋| 36589/37963 [156:55:04<6:16:45, 16.45s/it]
 96%|█████████▋| 36590/37963 [156:55:19<6:02:15, 15.83s/it]
                                                           
{'loss': '0.05304', 'grad_norm': '2.821', 'learning_rate': '6.863e-08', 'epoch': '0.9638'}

 96%|█████████▋| 36590/37963 [156:55:19<6:02:15, 15.83s/it]
 96%|█████████▋| 36591/37963 [156:55:33<5:52:00, 15.39s/it]
 96%|█████████▋| 36592/37963 [156:55:47<5:42:23, 14.98s/it]
 96%|█████████▋| 36593/37963 [156:56:01<5:36:25, 14.73s/it]
 96%|█████████▋| 36594/37963 [156:56:16<5:33:54, 14.63s/it]
 96%|█████████▋| 36595/37963 [156:56:30<5:31:45, 14.55s/it]
 96%|█████████▋| 36596/37963 [156:56:44<5:30:38, 14.51s/it]
 96%|█████████▋| 36597/37963 [156:57:05<6:09:29, 16.23s/it]
 96%|█████████▋| 36598/37963 [156:57:19<5:56:48, 15.68s/it]
 96%|█████████▋| 36599/37963 [156:57:33<5:47:28, 15.28s/it]
 96%|█████████▋| 36600/37963 [156:57:48<5:40:53, 15.01s/it]
                                                           
{'loss': '0.05928', 'grad_norm': '3.952', 'learning_rate': '6.763e-08', 'epoch': '0.9641'}

 96%|█████████▋| 36600/37963 [156:57:48<5:40:53, 15.01s/it]
 96%|█████████▋| 36601/37963 [156:58:02<5:35:36, 14.78s/it]
 96%|█████████▋| 36602/37963 [156:58:16<5:32:39, 14.67s/it]
 96%|█████████▋| 36603/37963 [156:58:31<5:29:18, 14.53s/it]
 96%|█████████▋| 36604/37963 [156:58:45<5:27:51, 14.47s/it]
 96%|█████████▋| 36605/37963 [156:58:59<5:27:27, 14.47s/it]
 96%|█████████▋| 36606/37963 [156:59:14<5:26:55, 14.45s/it]
 96%|█████████▋| 36607/37963 [156:59:28<5:23:33, 14.32s/it]
 96%|█████████▋| 36608/37963 [156:59:42<5:24:40, 14.38s/it]
 96%|█████████▋| 36609/37963 [156:59:56<5:19:38, 14.16s/it]
 96%|█████████▋| 36610/37963 [157:00:10<5:19:05, 14.15s/it]
                                                           
{'loss': '0.07824', 'grad_norm': '3.3', 'learning_rate': '6.664e-08', 'epoch': '0.9644'}

 96%|█████████▋| 36610/37963 [157:00:10<5:19:05, 14.15s/it]
 96%|█████████▋| 36611/37963 [157:00:25<5:20:23, 14.22s/it]
 96%|█████████▋| 36612/37963 [157:00:39<5:21:02, 14.26s/it]
 96%|█████████▋| 36613/37963 [157:00:53<5:20:57, 14.26s/it]
 96%|█████████▋| 36614/37963 [157:01:08<5:21:34, 14.30s/it]
 96%|█████████▋| 36615/37963 [157:01:22<5:21:32, 14.31s/it]
 96%|█████████▋| 36616/37963 [157:01:36<5:19:12, 14.22s/it]
 96%|█████████▋| 36617/37963 [157:01:50<5:15:36, 14.07s/it]
 96%|█████████▋| 36618/37963 [157:02:04<5:17:44, 14.17s/it]
 96%|█████████▋| 36619/37963 [157:02:25<6:06:14, 16.35s/it]
 96%|█████████▋| 36620/37963 [157:02:47<6:38:46, 17.82s/it]
                                                           
{'loss': '0.06134', 'grad_norm': '2.683', 'learning_rate': '6.566e-08', 'epoch': '0.9646'}

 96%|█████████▋| 36620/37963 [157:02:47<6:38:46, 17.82s/it]
 96%|█████████▋| 36621/37963 [157:03:01<6:15:56, 16.81s/it]
 96%|█████████▋| 36622/37963 [157:03:16<5:59:50, 16.10s/it]
 96%|█████████▋| 36623/37963 [157:03:30<5:46:40, 15.52s/it]
 96%|█████████▋| 36624/37963 [157:03:44<5:38:58, 15.19s/it]
 96%|█████████▋| 36625/37963 [157:03:58<5:29:31, 14.78s/it]
 96%|█████████▋| 36626/37963 [157:04:12<5:22:28, 14.47s/it]
 96%|█████████▋| 36627/37963 [157:04:26<5:21:15, 14.43s/it]
 96%|█████████▋| 36628/37963 [157:04:40<5:20:32, 14.41s/it]
 96%|█████████▋| 36629/37963 [157:04:55<5:21:18, 14.45s/it]
 96%|█████████▋| 36630/37963 [157:05:09<5:20:36, 14.43s/it]
                                                           
{'loss': '0.0604', 'grad_norm': '2.704', 'learning_rate': '6.469e-08', 'epoch': '0.9649'}

 96%|█████████▋| 36630/37963 [157:05:09<5:20:36, 14.43s/it]
 96%|█████████▋| 36631/37963 [157:05:31<6:07:37, 16.56s/it]
 96%|█████████▋| 36632/37963 [157:05:52<6:36:17, 17.86s/it]
 96%|█████████▋| 36633/37963 [157:06:13<6:57:19, 18.83s/it]
 96%|█████████▋| 36634/37963 [157:06:27<6:27:48, 17.51s/it]
 97%|█████████▋| 36635/37963 [157:06:55<7:36:27, 20.62s/it]
 97%|█████████▋| 36636/37963 [157:07:10<6:54:12, 18.73s/it]
 97%|█████████▋| 36637/37963 [157:07:24<6:24:58, 17.42s/it]
 97%|█████████▋| 36638/37963 [157:07:38<6:04:43, 16.52s/it]
 97%|█████████▋| 36639/37963 [157:07:53<5:50:29, 15.88s/it]
 97%|█████████▋| 36640/37963 [157:08:07<5:39:23, 15.39s/it]
                                                           
{'loss': '0.05916', 'grad_norm': '3.597', 'learning_rate': '6.373e-08', 'epoch': '0.9652'}

 97%|█████████▋| 36640/37963 [157:08:07<5:39:23, 15.39s/it]
 97%|█████████▋| 36641/37963 [157:08:21<5:28:52, 14.93s/it]
 97%|█████████▋| 36642/37963 [157:08:35<5:24:45, 14.75s/it]
 97%|█████████▋| 36643/37963 [157:08:49<5:22:04, 14.64s/it]
 97%|█████████▋| 36644/37963 [157:09:04<5:19:49, 14.55s/it]
 97%|█████████▋| 36645/37963 [157:09:17<5:13:04, 14.25s/it]
 97%|█████████▋| 36646/37963 [157:09:38<5:53:51, 16.12s/it]
 97%|█████████▋| 36647/37963 [157:09:52<5:38:12, 15.42s/it]
 97%|█████████▋| 36648/37963 [157:10:06<5:29:23, 15.03s/it]
 97%|█████████▋| 36649/37963 [157:10:20<5:24:49, 14.83s/it]
 97%|█████████▋| 36650/37963 [157:10:34<5:21:26, 14.69s/it]
                                                           
{'loss': '0.0568', 'grad_norm': '3.262', 'learning_rate': '6.277e-08', 'epoch': '0.9654'}

 97%|█████████▋| 36650/37963 [157:10:35<5:21:26, 14.69s/it]
 97%|█████████▋| 36651/37963 [157:10:49<5:19:01, 14.59s/it]
 97%|█████████▋| 36652/37963 [157:11:03<5:13:23, 14.34s/it]
 97%|█████████▋| 36653/37963 [157:11:16<5:07:57, 14.11s/it]
 97%|█████████▋| 36654/37963 [157:11:31<5:09:37, 14.19s/it]
 97%|█████████▋| 36655/37963 [157:11:45<5:10:34, 14.25s/it]
 97%|█████████▋| 36656/37963 [157:11:59<5:11:48, 14.31s/it]
 97%|█████████▋| 36657/37963 [157:12:14<5:11:33, 14.31s/it]
 97%|█████████▋| 36658/37963 [157:12:28<5:11:58, 14.34s/it]
 97%|█████████▋| 36659/37963 [157:12:43<5:12:05, 14.36s/it]
 97%|█████████▋| 36660/37963 [157:12:57<5:09:59, 14.27s/it]
                                                           
{'loss': '0.05959', 'grad_norm': '2.914', 'learning_rate': '6.182e-08', 'epoch': '0.9657'}

 97%|█████████▋| 36660/37963 [157:12:57<5:09:59, 14.27s/it]
 97%|█████████▋| 36661/37963 [157:13:11<5:08:07, 14.20s/it]
 97%|█████████▋| 36662/37963 [157:13:25<5:09:11, 14.26s/it]
 97%|█████████▋| 36663/37963 [157:13:39<5:09:37, 14.29s/it]
 97%|█████████▋| 36664/37963 [157:13:53<5:07:56, 14.22s/it]
 97%|█████████▋| 36665/37963 [157:14:07<5:03:27, 14.03s/it]
 97%|█████████▋| 36666/37963 [157:14:21<5:03:11, 14.03s/it]
 97%|█████████▋| 36667/37963 [157:14:35<5:05:20, 14.14s/it]
 97%|█████████▋| 36668/37963 [157:14:56<5:49:25, 16.19s/it]
 97%|█████████▋| 36669/37963 [157:15:11<5:37:23, 15.64s/it]
 97%|█████████▋| 36670/37963 [157:15:25<5:26:50, 15.17s/it]
                                                           
{'loss': '0.063', 'grad_norm': '2.761', 'learning_rate': '6.087e-08', 'epoch': '0.9659'}

 97%|█████████▋| 36670/37963 [157:15:25<5:26:50, 15.17s/it]
 97%|█████████▋| 36671/37963 [157:15:46<6:03:06, 16.86s/it]
 97%|█████████▋| 36672/37963 [157:16:00<5:47:10, 16.13s/it]
 97%|█████████▋| 36673/37963 [157:16:14<5:33:43, 15.52s/it]
 97%|█████████▋| 36674/37963 [157:16:29<5:25:51, 15.17s/it]
 97%|█████████▋| 36675/37963 [157:16:43<5:20:43, 14.94s/it]
 97%|█████████▋| 36676/37963 [157:16:57<5:17:40, 14.81s/it]
 97%|█████████▋| 36677/37963 [157:17:11<5:12:20, 14.57s/it]
 97%|█████████▋| 36678/37963 [157:17:26<5:11:04, 14.52s/it]
 97%|█████████▋| 36679/37963 [157:17:40<5:09:56, 14.48s/it]
 97%|█████████▋| 36680/37963 [157:18:08<6:32:44, 18.37s/it]
                                                           
{'loss': '0.07329', 'grad_norm': '3.621', 'learning_rate': '5.994e-08', 'epoch': '0.9662'}

 97%|█████████▋| 36680/37963 [157:18:08<6:32:44, 18.37s/it]
 97%|█████████▋| 36681/37963 [157:18:22<6:03:12, 17.00s/it]
 97%|█████████▋| 36682/37963 [157:18:43<6:28:55, 18.22s/it]
 97%|█████████▋| 36683/37963 [157:19:04<6:47:32, 19.10s/it]
 97%|█████████▋| 36684/37963 [157:19:18<6:17:35, 17.71s/it]
 97%|█████████▋| 36685/37963 [157:19:39<6:36:09, 18.60s/it]
 97%|█████████▋| 36686/37963 [157:19:53<6:07:04, 17.25s/it]
 97%|█████████▋| 36687/37963 [157:20:07<5:48:31, 16.39s/it]
 97%|█████████▋| 36688/37963 [157:20:22<5:34:59, 15.76s/it]
 97%|█████████▋| 36689/37963 [157:20:36<5:25:58, 15.35s/it]
 97%|█████████▋| 36690/37963 [157:20:50<5:17:02, 14.94s/it]
                                                           
{'loss': '0.06205', 'grad_norm': '2.768', 'learning_rate': '5.901e-08', 'epoch': '0.9665'}

 97%|█████████▋| 36690/37963 [157:20:50<5:17:02, 14.94s/it]
 97%|█████████▋| 36691/37963 [157:21:04<5:11:26, 14.69s/it]
 97%|█████████▋| 36692/37963 [157:21:18<5:07:05, 14.50s/it]
 97%|█████████▋| 36693/37963 [157:21:33<5:06:01, 14.46s/it]
 97%|█████████▋| 36694/37963 [157:21:53<5:46:46, 16.40s/it]
 97%|█████████▋| 36695/37963 [157:22:08<5:33:57, 15.80s/it]
 97%|█████████▋| 36696/37963 [157:22:22<5:24:34, 15.37s/it]
 97%|█████████▋| 36697/37963 [157:22:37<5:18:08, 15.08s/it]
 97%|█████████▋| 36698/37963 [157:22:51<5:10:43, 14.74s/it]
 97%|█████████▋| 36699/37963 [157:23:05<5:08:20, 14.64s/it]
 97%|█████████▋| 36700/37963 [157:23:19<5:01:22, 14.32s/it]
                                                           
{'loss': '0.05963', 'grad_norm': '4.292', 'learning_rate': '5.809e-08', 'epoch': '0.9667'}

 97%|█████████▋| 36700/37963 [157:23:19<5:01:22, 14.32s/it]
 97%|█████████▋| 36701/37963 [157:23:33<5:01:38, 14.34s/it]
 97%|█████████▋| 36702/37963 [157:23:47<5:01:37, 14.35s/it]
 97%|█████████▋| 36703/37963 [157:24:01<4:59:10, 14.25s/it]
 97%|█████████▋| 36704/37963 [157:24:16<5:00:55, 14.34s/it]
 97%|█████████▋| 36705/37963 [157:24:30<5:00:33, 14.34s/it]
 97%|█████████▋| 36706/37963 [157:24:44<4:59:28, 14.29s/it]
 97%|█████████▋| 36707/37963 [157:24:59<5:00:16, 14.34s/it]
 97%|█████████▋| 36708/37963 [157:25:13<4:56:21, 14.17s/it]
 97%|█████████▋| 36709/37963 [157:25:27<4:57:23, 14.23s/it]
 97%|█████████▋| 36710/37963 [157:25:41<4:58:14, 14.28s/it]
                                                           
{'loss': '0.05936', 'grad_norm': '3.617', 'learning_rate': '5.717e-08', 'epoch': '0.967'}

 97%|█████████▋| 36710/37963 [157:25:41<4:58:14, 14.28s/it]
 97%|█████████▋| 36711/37963 [157:25:56<4:58:43, 14.32s/it]
 97%|█████████▋| 36712/37963 [157:26:10<4:59:02, 14.34s/it]
 97%|█████████▋| 36713/37963 [157:26:24<4:56:30, 14.23s/it]
 97%|█████████▋| 36714/37963 [157:26:38<4:56:15, 14.23s/it]
 97%|█████████▋| 36715/37963 [157:26:53<4:57:11, 14.29s/it]
 97%|█████████▋| 36716/37963 [157:27:07<4:54:54, 14.19s/it]
 97%|█████████▋| 36717/37963 [157:27:28<5:40:28, 16.40s/it]
 97%|█████████▋| 36718/37963 [157:27:43<5:27:40, 15.79s/it]
 97%|█████████▋| 36719/37963 [157:27:57<5:19:28, 15.41s/it]
 97%|█████████▋| 36720/37963 [157:28:12<5:13:29, 15.13s/it]
                                                           
{'loss': '0.07134', 'grad_norm': '3.398', 'learning_rate': '5.627e-08', 'epoch': '0.9673'}

 97%|█████████▋| 36720/37963 [157:28:12<5:13:29, 15.13s/it]
 97%|█████████▋| 36721/37963 [157:28:33<5:49:57, 16.91s/it]
 97%|█████████▋| 36722/37963 [157:28:47<5:34:04, 16.15s/it]
 97%|█████████▋| 36723/37963 [157:29:01<5:18:58, 15.43s/it]
 97%|█████████▋| 36724/37963 [157:29:15<5:09:14, 14.98s/it]
 97%|█████████▋| 36725/37963 [157:29:29<5:04:21, 14.75s/it]
 97%|█████████▋| 36726/37963 [157:29:50<5:41:37, 16.57s/it]
 97%|█████████▋| 36727/37963 [157:30:04<5:28:34, 15.95s/it]
 97%|█████████▋| 36728/37963 [157:30:25<5:57:50, 17.38s/it]
 97%|█████████▋| 36729/37963 [157:30:39<5:38:05, 16.44s/it]
 97%|█████████▋| 36730/37963 [157:31:00<6:04:52, 17.76s/it]
                                                           
{'loss': '0.06341', 'grad_norm': '3.797', 'learning_rate': '5.537e-08', 'epoch': '0.9675'}

 97%|█████████▋| 36730/37963 [157:31:00<6:04:52, 17.76s/it]
 97%|█████████▋| 36731/37963 [157:31:21<6:24:53, 18.74s/it]
 97%|█████████▋| 36732/37963 [157:31:36<5:57:56, 17.45s/it]
 97%|█████████▋| 36733/37963 [157:31:50<5:39:22, 16.55s/it]
 97%|█████████▋| 36734/37963 [157:32:05<5:25:59, 15.92s/it]
 97%|█████████▋| 36735/37963 [157:32:19<5:16:21, 15.46s/it]
 97%|█████████▋| 36736/37963 [157:32:39<5:45:08, 16.88s/it]
 97%|█████████▋| 36737/37963 [157:32:53<5:28:36, 16.08s/it]
 97%|█████████▋| 36738/37963 [157:33:08<5:16:32, 15.50s/it]
 97%|█████████▋| 36739/37963 [157:33:22<5:09:52, 15.19s/it]
 97%|█████████▋| 36740/37963 [157:33:36<5:04:29, 14.94s/it]
                                                           
{'loss': '0.05106', 'grad_norm': '2.021', 'learning_rate': '5.447e-08', 'epoch': '0.9678'}

 97%|█████████▋| 36740/37963 [157:33:36<5:04:29, 14.94s/it]
 97%|█████████▋| 36741/37963 [157:33:51<5:00:53, 14.77s/it]
 97%|█████████▋| 36742/37963 [157:34:11<5:36:17, 16.53s/it]
 97%|█████████▋| 36743/37963 [157:34:26<5:23:18, 15.90s/it]
 97%|█████████▋| 36744/37963 [157:34:40<5:13:33, 15.43s/it]
 97%|█████████▋| 36745/37963 [157:34:55<5:07:27, 15.15s/it]
 97%|█████████▋| 36746/37963 [157:35:08<4:59:28, 14.76s/it]
 97%|█████████▋| 36747/37963 [157:35:23<4:58:00, 14.70s/it]
 97%|█████████▋| 36748/37963 [157:35:38<4:56:37, 14.65s/it]
 97%|█████████▋| 36749/37963 [157:35:52<4:55:06, 14.58s/it]
 97%|█████████▋| 36750/37963 [157:36:06<4:54:09, 14.55s/it]
                                                           
{'loss': '0.05502', 'grad_norm': '2.858', 'learning_rate': '5.359e-08', 'epoch': '0.9681'}

 97%|█████████▋| 36750/37963 [157:36:06<4:54:09, 14.55s/it]
 97%|█████████▋| 36751/37963 [157:36:21<4:52:52, 14.50s/it]
 97%|█████████▋| 36752/37963 [157:36:35<4:51:46, 14.46s/it]
 97%|█████████▋| 36753/37963 [157:36:49<4:48:38, 14.31s/it]
 97%|█████████▋| 36754/37963 [157:37:04<4:49:15, 14.36s/it]
 97%|█████████▋| 36755/37963 [157:37:18<4:49:54, 14.40s/it]
 97%|█████████▋| 36756/37963 [157:37:32<4:49:27, 14.39s/it]
 97%|█████████▋| 36757/37963 [157:37:47<4:49:43, 14.41s/it]
 97%|█████████▋| 36758/37963 [157:38:01<4:49:31, 14.42s/it]
 97%|█████████▋| 36759/37963 [157:38:15<4:43:53, 14.15s/it]
 97%|█████████▋| 36760/37963 [157:38:29<4:42:56, 14.11s/it]
                                                           
{'loss': '0.05389', 'grad_norm': '2.984', 'learning_rate': '5.271e-08', 'epoch': '0.9683'}

 97%|█████████▋| 36760/37963 [157:38:29<4:42:56, 14.11s/it]
 97%|█████████▋| 36761/37963 [157:38:43<4:42:13, 14.09s/it]
 97%|█████████▋| 36762/37963 [157:38:57<4:43:37, 14.17s/it]
 97%|█████████▋| 36763/37963 [157:39:12<4:45:15, 14.26s/it]
 97%|█████████▋| 36764/37963 [157:39:26<4:45:40, 14.30s/it]
 97%|█████████▋| 36765/37963 [157:39:40<4:44:49, 14.26s/it]
 97%|█████████▋| 36766/37963 [157:40:01<5:22:34, 16.17s/it]
 97%|█████████▋| 36767/37963 [157:40:15<5:11:35, 15.63s/it]
 97%|█████████▋| 36768/37963 [157:40:30<5:04:06, 15.27s/it]
 97%|█████████▋| 36769/37963 [157:40:44<4:59:16, 15.04s/it]
 97%|█████████▋| 36770/37963 [157:40:59<4:55:05, 14.84s/it]
                                                           
{'loss': '0.05506', 'grad_norm': '3.466', 'learning_rate': '5.184e-08', 'epoch': '0.9686'}

 97%|█████████▋| 36770/37963 [157:40:59<4:55:05, 14.84s/it]
 97%|█████████▋| 36771/37963 [157:41:13<4:52:52, 14.74s/it]
 97%|█████████▋| 36772/37963 [157:41:28<4:50:53, 14.65s/it]
 97%|█████████▋| 36773/37963 [157:41:42<4:49:00, 14.57s/it]
 97%|█████████▋| 36774/37963 [157:42:03<5:26:17, 16.47s/it]
 97%|█████████▋| 36775/37963 [157:42:17<5:11:02, 15.71s/it]
 97%|█████████▋| 36776/37963 [157:42:37<5:39:35, 17.17s/it]
 97%|█████████▋| 36777/37963 [157:42:59<6:03:39, 18.40s/it]
 97%|█████████▋| 36778/37963 [157:43:13<5:38:56, 17.16s/it]
 97%|█████████▋| 36779/37963 [157:43:41<6:40:47, 20.31s/it]
 97%|█████████▋| 36780/37963 [157:43:55<6:05:07, 18.52s/it]
                                                           
{'loss': '0.07001', 'grad_norm': '4.468', 'learning_rate': '5.097e-08', 'epoch': '0.9688'}

 97%|█████████▋| 36780/37963 [157:43:55<6:05:07, 18.52s/it]
 97%|█████████▋| 36781/37963 [157:44:09<5:40:14, 17.27s/it]
 97%|█████████▋| 36782/37963 [157:44:23<5:20:09, 16.27s/it]
 97%|█████████▋| 36783/37963 [157:44:38<5:08:27, 15.68s/it]
 97%|█████████▋| 36784/37963 [157:44:52<5:00:16, 15.28s/it]
 97%|█████████▋| 36785/37963 [157:45:13<5:34:37, 17.04s/it]
 97%|█████████▋| 36786/37963 [157:45:27<5:18:30, 16.24s/it]
 97%|█████████▋| 36787/37963 [157:45:42<5:07:32, 15.69s/it]
 97%|█████████▋| 36788/37963 [157:45:56<4:59:00, 15.27s/it]
 97%|█████████▋| 36789/37963 [157:46:10<4:51:10, 14.88s/it]
 97%|█████████▋| 36790/37963 [157:46:24<4:48:14, 14.74s/it]
                                                           
{'loss': '0.06213', 'grad_norm': '3.788', 'learning_rate': '5.012e-08', 'epoch': '0.9691'}

 97%|█████████▋| 36790/37963 [157:46:24<4:48:14, 14.74s/it]
 97%|█████████▋| 36791/37963 [157:46:45<5:23:16, 16.55s/it]
 97%|█████████▋| 36792/37963 [157:47:00<5:10:10, 15.89s/it]
 97%|█████████▋| 36793/37963 [157:47:14<4:59:45, 15.37s/it]
 97%|█████████▋| 36794/37963 [157:47:28<4:53:25, 15.06s/it]
 97%|█████████▋| 36795/37963 [157:47:42<4:45:52, 14.69s/it]
 97%|█████████▋| 36796/37963 [157:47:56<4:44:06, 14.61s/it]
 97%|█████████▋| 36797/37963 [157:48:11<4:42:05, 14.52s/it]
 97%|█████████▋| 36798/37963 [157:48:25<4:41:02, 14.47s/it]
 97%|█████████▋| 36799/37963 [157:48:39<4:40:00, 14.43s/it]
 97%|█████████▋| 36800/37963 [157:48:54<4:39:20, 14.41s/it]
                                                           
{'loss': '0.05217', 'grad_norm': '3.165', 'learning_rate': '4.927e-08', 'epoch': '0.9694'}

 97%|█████████▋| 36800/37963 [157:48:54<4:39:20, 14.41s/it]
 97%|█████████▋| 36801/37963 [157:49:08<4:39:00, 14.41s/it]
 97%|█████████▋| 36802/37963 [157:49:22<4:38:25, 14.39s/it]
 97%|█████████▋| 36803/37963 [157:49:37<4:38:33, 14.41s/it]
 97%|█████████▋| 36804/37963 [157:49:51<4:38:21, 14.41s/it]
 97%|█████████▋| 36805/37963 [157:50:06<4:37:53, 14.40s/it]
 97%|█████████▋| 36806/37963 [157:50:20<4:38:10, 14.43s/it]
 97%|█████████▋| 36807/37963 [157:50:35<4:38:17, 14.44s/it]
 97%|█████████▋| 36808/37963 [157:50:48<4:34:22, 14.25s/it]
 97%|█████████▋| 36809/37963 [157:51:03<4:34:53, 14.29s/it]
 97%|█████████▋| 36810/37963 [157:51:17<4:35:50, 14.35s/it]
                                                           
{'loss': '0.06083', 'grad_norm': '4.695', 'learning_rate': '4.842e-08', 'epoch': '0.9696'}

 97%|█████████▋| 36810/37963 [157:51:17<4:35:50, 14.35s/it]
 97%|█████████▋| 36811/37963 [157:51:32<4:35:46, 14.36s/it]
 97%|█████████▋| 36812/37963 [157:51:46<4:34:31, 14.31s/it]
 97%|█████████▋| 36813/37963 [157:52:00<4:34:57, 14.35s/it]
 97%|█████████▋| 36814/37963 [157:52:15<4:33:36, 14.29s/it]
 97%|█████████▋| 36815/37963 [157:52:29<4:34:27, 14.34s/it]
 97%|█████████▋| 36816/37963 [157:52:50<5:10:42, 16.25s/it]
 97%|█████████▋| 36817/37963 [157:53:04<4:59:34, 15.68s/it]
 97%|█████████▋| 36818/37963 [157:53:18<4:52:05, 15.31s/it]
 97%|█████████▋| 36819/37963 [157:53:33<4:45:37, 14.98s/it]
 97%|█████████▋| 36820/37963 [157:53:47<4:41:46, 14.79s/it]
                                                           
{'loss': '0.06931', 'grad_norm': '2.462', 'learning_rate': '4.759e-08', 'epoch': '0.9699'}

 97%|█████████▋| 36820/37963 [157:53:47<4:41:46, 14.79s/it]
 97%|█████████▋| 36821/37963 [157:54:08<5:14:50, 16.54s/it]
 97%|█████████▋| 36822/37963 [157:54:22<5:01:27, 15.85s/it]
 97%|█████████▋| 36823/37963 [157:54:36<4:50:52, 15.31s/it]
 97%|█████████▋| 36824/37963 [157:54:56<5:20:15, 16.87s/it]
 97%|█████████▋| 36825/37963 [157:55:11<5:06:01, 16.13s/it]
 97%|█████████▋| 36826/37963 [157:55:32<5:35:12, 17.69s/it]
 97%|█████████▋| 36827/37963 [157:55:47<5:16:04, 16.69s/it]
 97%|█████████▋| 36828/37963 [157:56:08<5:44:11, 18.19s/it]
 97%|█████████▋| 36829/37963 [157:56:29<5:58:55, 18.99s/it]
 97%|█████████▋| 36830/37963 [157:56:44<5:32:44, 17.62s/it]
                                                           
{'loss': '0.07136', 'grad_norm': '2.716', 'learning_rate': '4.676e-08', 'epoch': '0.9702'}

 97%|█████████▋| 36830/37963 [157:56:44<5:32:44, 17.62s/it]
 97%|█████████▋| 36831/37963 [157:56:58<5:11:46, 16.52s/it]
 97%|█████████▋| 36832/37963 [157:57:18<5:34:45, 17.76s/it]
 97%|█████████▋| 36833/37963 [157:57:33<5:15:38, 16.76s/it]
 97%|█████████▋| 36834/37963 [157:57:47<5:01:58, 16.05s/it]
 97%|█████████▋| 36835/37963 [157:58:01<4:51:05, 15.48s/it]
 97%|█████████▋| 36836/37963 [157:58:16<4:45:06, 15.18s/it]
 97%|█████████▋| 36837/37963 [157:58:30<4:40:17, 14.94s/it]
 97%|█████████▋| 36838/37963 [157:58:44<4:37:11, 14.78s/it]
 97%|█████████▋| 36839/37963 [157:59:05<5:09:50, 16.54s/it]
 97%|█████████▋| 36840/37963 [157:59:19<4:57:04, 15.87s/it]
                                                           
{'loss': '0.06948', 'grad_norm': '4.941', 'learning_rate': '4.594e-08', 'epoch': '0.9704'}

 97%|█████████▋| 36840/37963 [157:59:19<4:57:04, 15.87s/it]
 97%|█████████▋| 36841/37963 [157:59:33<4:46:24, 15.32s/it]
 97%|█████████▋| 36842/37963 [157:59:47<4:37:09, 14.83s/it]
 97%|█████████▋| 36843/37963 [158:00:02<4:34:33, 14.71s/it]
 97%|█████████▋| 36844/37963 [158:00:15<4:29:34, 14.45s/it]
 97%|█████████▋| 36845/37963 [158:00:30<4:29:26, 14.46s/it]
 97%|█████████▋| 36846/37963 [158:00:44<4:28:37, 14.43s/it]
 97%|█████████▋| 36847/37963 [158:00:58<4:25:42, 14.29s/it]
 97%|█████████▋| 36848/37963 [158:01:12<4:24:31, 14.23s/it]
 97%|█████████▋| 36849/37963 [158:01:27<4:24:52, 14.27s/it]
 97%|█████████▋| 36850/37963 [158:01:41<4:25:38, 14.32s/it]
                                                           
{'loss': '0.07623', 'grad_norm': '3.743', 'learning_rate': '4.513e-08', 'epoch': '0.9707'}

 97%|█████████▋| 36850/37963 [158:01:41<4:25:38, 14.32s/it]
 97%|█████████▋| 36851/37963 [158:01:55<4:23:54, 14.24s/it]
 97%|█████████▋| 36852/37963 [158:02:10<4:24:56, 14.31s/it]
 97%|█████████▋| 36853/37963 [158:02:24<4:24:58, 14.32s/it]
 97%|█████████▋| 36854/37963 [158:02:38<4:25:40, 14.37s/it]
 97%|█████████▋| 36855/37963 [158:02:52<4:22:27, 14.21s/it]
 97%|█████████▋| 36856/37963 [158:03:07<4:23:18, 14.27s/it]
 97%|█████████▋| 36857/37963 [158:03:21<4:24:01, 14.32s/it]
 97%|█████████▋| 36858/37963 [158:03:35<4:24:00, 14.33s/it]
 97%|█████████▋| 36859/37963 [158:03:50<4:24:25, 14.37s/it]
 97%|█████████▋| 36860/37963 [158:04:04<4:22:45, 14.29s/it]
                                                           
{'loss': '0.06064', 'grad_norm': '1.442', 'learning_rate': '4.432e-08', 'epoch': '0.9709'}

 97%|█████████▋| 36860/37963 [158:04:04<4:22:45, 14.29s/it]
 97%|█████████▋| 36861/37963 [158:04:18<4:23:13, 14.33s/it]
 97%|█████████▋| 36862/37963 [158:04:32<4:20:56, 14.22s/it]
 97%|█████████▋| 36863/37963 [158:04:47<4:22:52, 14.34s/it]
 97%|█████████▋| 36864/37963 [158:05:08<4:57:15, 16.23s/it]
 97%|█████████▋| 36865/37963 [158:05:22<4:47:10, 15.69s/it]
 97%|█████████▋| 36866/37963 [158:05:37<4:39:58, 15.31s/it]
 97%|█████████▋| 36867/37963 [158:05:50<4:32:16, 14.91s/it]
 97%|█████████▋| 36868/37963 [158:06:04<4:26:06, 14.58s/it]
 97%|█████████▋| 36869/37963 [158:06:19<4:24:54, 14.53s/it]
 97%|█████████▋| 36870/37963 [158:06:33<4:22:49, 14.43s/it]
                                                           
{'loss': '0.06285', 'grad_norm': '3.853', 'learning_rate': '4.352e-08', 'epoch': '0.9712'}

 97%|█████████▋| 36870/37963 [158:06:33<4:22:49, 14.43s/it]
 97%|█████████▋| 36871/37963 [158:06:54<4:59:43, 16.47s/it]
 97%|█████████▋| 36872/37963 [158:07:15<5:23:25, 17.79s/it]
 97%|█████████▋| 36873/37963 [158:07:36<5:42:55, 18.88s/it]
 97%|█████████▋| 36874/37963 [158:07:51<5:18:01, 17.52s/it]
 97%|█████████▋| 36875/37963 [158:08:05<5:01:18, 16.62s/it]
 97%|█████████▋| 36876/37963 [158:08:26<5:22:20, 17.79s/it]
 97%|█████████▋| 36877/37963 [158:08:40<5:02:32, 16.71s/it]
 97%|█████████▋| 36878/37963 [158:09:01<5:26:10, 18.04s/it]
 97%|█████████▋| 36879/37963 [158:09:15<5:02:50, 16.76s/it]
 97%|█████████▋| 36880/37963 [158:09:29<4:48:37, 15.99s/it]
                                                           
{'loss': '0.06045', 'grad_norm': '4.052', 'learning_rate': '4.273e-08', 'epoch': '0.9715'}

 97%|█████████▋| 36880/37963 [158:09:29<4:48:37, 15.99s/it]
 97%|█████████▋| 36881/37963 [158:09:44<4:39:36, 15.51s/it]
 97%|█████████▋| 36882/37963 [158:09:58<4:32:41, 15.14s/it]
 97%|█████████▋| 36883/37963 [158:10:18<4:59:10, 16.62s/it]
 97%|█████████▋| 36884/37963 [158:10:32<4:46:44, 15.94s/it]
 97%|█████████▋| 36885/37963 [158:10:47<4:37:51, 15.47s/it]
 97%|█████████▋| 36886/37963 [158:11:00<4:27:43, 14.92s/it]
 97%|█████████▋| 36887/37963 [158:11:14<4:21:18, 14.57s/it]
 97%|█████████▋| 36888/37963 [158:11:28<4:19:58, 14.51s/it]
 97%|█████████▋| 36889/37963 [158:11:49<4:53:31, 16.40s/it]
 97%|█████████▋| 36890/37963 [158:12:03<4:41:03, 15.72s/it]
                                                           
{'loss': '0.06479', 'grad_norm': '2.82', 'learning_rate': '4.195e-08', 'epoch': '0.9717'}

 97%|█████████▋| 36890/37963 [158:12:03<4:41:03, 15.72s/it]
 97%|█████████▋| 36891/37963 [158:12:17<4:31:12, 15.18s/it]
 97%|█████████▋| 36892/37963 [158:12:32<4:26:42, 14.94s/it]
 97%|█████████▋| 36893/37963 [158:12:46<4:22:30, 14.72s/it]
 97%|█████████▋| 36894/37963 [158:13:00<4:17:19, 14.44s/it]
 97%|█████████▋| 36895/37963 [158:13:14<4:16:28, 14.41s/it]
 97%|█████████▋| 36896/37963 [158:13:28<4:16:49, 14.44s/it]
 97%|█████████▋| 36897/37963 [158:13:43<4:16:18, 14.43s/it]
 97%|█████████▋| 36898/37963 [158:13:57<4:15:31, 14.40s/it]
 97%|█████████▋| 36899/37963 [158:14:11<4:13:21, 14.29s/it]
 97%|█████████▋| 36900/37963 [158:14:26<4:13:46, 14.32s/it]
                                                           
{'loss': '0.06182', 'grad_norm': '3.987', 'learning_rate': '4.117e-08', 'epoch': '0.972'}

 97%|█████████▋| 36900/37963 [158:14:26<4:13:46, 14.32s/it]
 97%|█████████▋| 36901/37963 [158:14:40<4:15:03, 14.41s/it]
 97%|█████████▋| 36902/37963 [158:14:55<4:14:40, 14.40s/it]
 97%|█████████▋| 36903/37963 [158:15:09<4:14:26, 14.40s/it]
 97%|█████████▋| 36904/37963 [158:15:23<4:12:26, 14.30s/it]
 97%|█████████▋| 36905/37963 [158:15:37<4:11:38, 14.27s/it]
 97%|█████████▋| 36906/37963 [158:15:52<4:12:17, 14.32s/it]
 97%|█████████▋| 36907/37963 [158:16:06<4:09:45, 14.19s/it]
 97%|█████████▋| 36908/37963 [158:16:20<4:10:35, 14.25s/it]
 97%|█████████▋| 36909/37963 [158:16:35<4:12:56, 14.40s/it]
 97%|█████████▋| 36910/37963 [158:16:49<4:12:58, 14.41s/it]
                                                           
{'loss': '0.06137', 'grad_norm': '4.309', 'learning_rate': '4.04e-08', 'epoch': '0.9723'}

 97%|█████████▋| 36910/37963 [158:16:49<4:12:58, 14.41s/it]
 97%|█████████▋| 36911/37963 [158:17:04<4:12:20, 14.39s/it]
 97%|█████████▋| 36912/37963 [158:17:18<4:12:42, 14.43s/it]
 97%|█████████▋| 36913/37963 [158:17:39<4:46:35, 16.38s/it]
 97%|█████████▋| 36914/37963 [158:17:53<4:35:55, 15.78s/it]
 97%|█████████▋| 36915/37963 [158:18:07<4:24:48, 15.16s/it]
 97%|█████████▋| 36916/37963 [158:18:22<4:20:59, 14.96s/it]
 97%|█████████▋| 36917/37963 [158:18:36<4:16:03, 14.69s/it]
 97%|█████████▋| 36918/37963 [158:18:50<4:14:09, 14.59s/it]
 97%|█████████▋| 36919/37963 [158:19:04<4:12:37, 14.52s/it]
 97%|█████████▋| 36920/37963 [158:19:25<4:43:07, 16.29s/it]
                                                           
{'loss': '0.06256', 'grad_norm': '5.365', 'learning_rate': '3.964e-08', 'epoch': '0.9725'}

 97%|█████████▋| 36920/37963 [158:19:25<4:43:07, 16.29s/it]
 97%|█████████▋| 36921/37963 [158:19:39<4:32:59, 15.72s/it]
 97%|█████████▋| 36922/37963 [158:20:06<5:31:03, 19.08s/it]
 97%|█████████▋| 36923/37963 [158:20:20<5:06:22, 17.68s/it]
 97%|█████████▋| 36924/37963 [158:20:35<4:49:18, 16.71s/it]
 97%|█████████▋| 36925/37963 [158:20:56<5:11:43, 18.02s/it]
 97%|█████████▋| 36926/37963 [158:21:17<5:27:26, 18.95s/it]
 97%|█████████▋| 36927/37963 [158:21:31<5:00:03, 17.38s/it]
 97%|█████████▋| 36928/37963 [158:21:45<4:44:15, 16.48s/it]
 97%|█████████▋| 36929/37963 [158:21:59<4:32:10, 15.79s/it]
 97%|█████████▋| 36930/37963 [158:22:14<4:24:34, 15.37s/it]
                                                           
{'loss': '0.06041', 'grad_norm': '3.687', 'learning_rate': '3.888e-08', 'epoch': '0.9728'}

 97%|█████████▋| 36930/37963 [158:22:14<4:24:34, 15.37s/it]
 97%|█████████▋| 36931/37963 [158:22:28<4:19:47, 15.10s/it]
 97%|█████████▋| 36932/37963 [158:22:48<4:45:46, 16.63s/it]
 97%|█████████▋| 36933/37963 [158:23:03<4:33:16, 15.92s/it]
 97%|█████████▋| 36934/37963 [158:23:17<4:24:58, 15.45s/it]
 97%|█████████▋| 36935/37963 [158:23:31<4:15:14, 14.90s/it]
 97%|█████████▋| 36936/37963 [158:23:45<4:12:08, 14.73s/it]
 97%|█████████▋| 36937/37963 [158:23:59<4:09:53, 14.61s/it]
 97%|█████████▋| 36938/37963 [158:24:20<4:41:26, 16.47s/it]
 97%|█████████▋| 36939/37963 [158:24:35<4:30:20, 15.84s/it]
 97%|█████████▋| 36940/37963 [158:24:49<4:22:35, 15.40s/it]
                                                           
{'loss': '0.07049', 'grad_norm': '5.085', 'learning_rate': '3.814e-08', 'epoch': '0.9731'}

 97%|█████████▋| 36940/37963 [158:24:49<4:22:35, 15.40s/it]
 97%|█████████▋| 36941/37963 [158:25:03<4:16:56, 15.08s/it]
 97%|█████████▋| 36942/37963 [158:25:18<4:13:07, 14.88s/it]
 97%|█████████▋| 36943/37963 [158:25:31<4:06:52, 14.52s/it]
 97%|█████████▋| 36944/37963 [158:25:46<4:05:54, 14.48s/it]
 97%|█████████▋| 36945/37963 [158:26:00<4:05:39, 14.48s/it]
 97%|█████████▋| 36946/37963 [158:26:15<4:05:11, 14.47s/it]
 97%|█████████▋| 36947/37963 [158:26:29<4:03:19, 14.37s/it]
 97%|█████████▋| 36948/37963 [158:26:43<4:02:40, 14.34s/it]
 97%|█████████▋| 36949/37963 [158:26:57<4:02:31, 14.35s/it]
 97%|█████████▋| 36950/37963 [158:27:12<4:01:29, 14.30s/it]
                                                           
{'loss': '0.06819', 'grad_norm': '2.981', 'learning_rate': '3.739e-08', 'epoch': '0.9733'}

 97%|█████████▋| 36950/37963 [158:27:12<4:01:29, 14.30s/it]
 97%|█████████▋| 36951/37963 [158:27:26<4:01:34, 14.32s/it]
 97%|█████████▋| 36952/37963 [158:27:40<4:01:52, 14.35s/it]
 97%|█████████▋| 36953/37963 [158:27:55<4:01:41, 14.36s/it]
 97%|█████████▋| 36954/37963 [158:28:09<4:01:39, 14.37s/it]
 97%|█████████▋| 36955/37963 [158:28:24<4:01:36, 14.38s/it]
 97%|█████████▋| 36956/37963 [158:28:37<3:57:52, 14.17s/it]
 97%|█████████▋| 36957/37963 [158:28:52<3:58:42, 14.24s/it]
 97%|█████████▋| 36958/37963 [158:29:06<3:57:09, 14.16s/it]
 97%|█████████▋| 36959/37963 [158:29:20<3:58:13, 14.24s/it]
 97%|█████████▋| 36960/37963 [158:29:41<4:32:45, 16.32s/it]
                                                           
{'loss': '0.06561', 'grad_norm': '2.858', 'learning_rate': '3.666e-08', 'epoch': '0.9736'}

 97%|█████████▋| 36960/37963 [158:29:41<4:32:45, 16.32s/it]
 97%|█████████▋| 36961/37963 [158:29:55<4:19:40, 15.55s/it]
 97%|█████████▋| 36962/37963 [158:30:09<4:13:29, 15.19s/it]
 97%|█████████▋| 36963/37963 [158:30:24<4:09:23, 14.96s/it]
 97%|█████████▋| 36964/37963 [158:30:38<4:06:11, 14.79s/it]
 97%|█████████▋| 36965/37963 [158:30:53<4:04:13, 14.68s/it]
 97%|█████████▋| 36966/37963 [158:31:07<4:02:26, 14.59s/it]
 97%|█████████▋| 36967/37963 [158:31:21<4:01:17, 14.54s/it]
 97%|█████████▋| 36968/37963 [158:31:36<4:00:01, 14.47s/it]
 97%|█████████▋| 36969/37963 [158:31:50<3:59:28, 14.46s/it]
 97%|█████████▋| 36970/37963 [158:32:18<5:06:08, 18.50s/it]
                                                           
{'loss': '0.04603', 'grad_norm': '4.065', 'learning_rate': '3.594e-08', 'epoch': '0.9738'}

 97%|█████████▋| 36970/37963 [158:32:18<5:06:08, 18.50s/it]
 97%|█████████▋| 36971/37963 [158:32:40<5:21:19, 19.44s/it]
 97%|█████████▋| 36972/37963 [158:32:53<4:53:02, 17.74s/it]
 97%|█████████▋| 36973/37963 [158:33:08<4:36:00, 16.73s/it]
 97%|█████████▋| 36974/37963 [158:33:22<4:24:13, 16.03s/it]
 97%|█████████▋| 36975/37963 [158:33:49<5:19:13, 19.39s/it]
 97%|█████████▋| 36976/37963 [158:34:03<4:51:35, 17.73s/it]
 97%|█████████▋| 36977/37963 [158:34:17<4:32:58, 16.61s/it]
 97%|█████████▋| 36978/37963 [158:34:32<4:21:53, 15.95s/it]
 97%|█████████▋| 36979/37963 [158:34:46<4:12:11, 15.38s/it]
 97%|█████████▋| 36980/37963 [158:35:06<4:38:22, 16.99s/it]
                                                           
{'loss': '0.06663', 'grad_norm': '4.239', 'learning_rate': '3.522e-08', 'epoch': '0.9741'}

 97%|█████████▋| 36980/37963 [158:35:06<4:38:22, 16.99s/it]
 97%|█████████▋| 36981/37963 [158:35:20<4:23:25, 16.09s/it]
 97%|█████████▋| 36982/37963 [158:35:35<4:14:41, 15.58s/it]
 97%|█████████▋| 36983/37963 [158:35:49<4:08:36, 15.22s/it]
 97%|█████████▋| 36984/37963 [158:36:04<4:04:04, 14.96s/it]
 97%|█████████▋| 36985/37963 [158:36:18<4:01:10, 14.80s/it]
 97%|█████████▋| 36986/37963 [158:36:32<3:58:58, 14.68s/it]
 97%|█████████▋| 36987/37963 [158:36:47<3:56:02, 14.51s/it]
 97%|█████████▋| 36988/37963 [158:37:07<4:25:50, 16.36s/it]
 97%|█████████▋| 36989/37963 [158:37:22<4:15:58, 15.77s/it]
 97%|█████████▋| 36990/37963 [158:37:36<4:09:04, 15.36s/it]
                                                           
{'loss': '0.06226', 'grad_norm': '2.827', 'learning_rate': '3.45e-08', 'epoch': '0.9744'}

 97%|█████████▋| 36990/37963 [158:37:36<4:09:04, 15.36s/it]
 97%|█████████▋| 36991/37963 [158:37:50<4:03:13, 15.01s/it]
 97%|█████████▋| 36992/37963 [158:38:04<3:55:28, 14.55s/it]
 97%|█████████▋| 36993/37963 [158:38:18<3:54:22, 14.50s/it]
 97%|█████████▋| 36994/37963 [158:38:32<3:53:41, 14.47s/it]
 97%|█████████▋| 36995/37963 [158:38:47<3:53:38, 14.48s/it]
 97%|█████████▋| 36996/37963 [158:39:01<3:52:44, 14.44s/it]
 97%|█████████▋| 36997/37963 [158:39:16<3:51:55, 14.41s/it]
 97%|█████████▋| 36998/37963 [158:39:30<3:50:34, 14.34s/it]
 97%|█████████▋| 36999/37963 [158:39:44<3:50:24, 14.34s/it]
 97%|█████████▋| 37000/37963 [158:39:59<3:50:27, 14.36s/it]
                                                           
{'loss': '0.04891', 'grad_norm': '2.531', 'learning_rate': '3.38e-08', 'epoch': '0.9746'}

 97%|█████████▋| 37000/37963 [158:39:59<3:50:27, 14.36s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:13<00:00, 13.60s/it]
Writing model shards: 100%|██████████| 1/1 [00:13<00:00, 13.60s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 97%|█████████▋| 37001/37963 [158:41:45<11:13:36, 42.01s/it]
 97%|█████████▋| 37002/37963 [158:42:00<9:01:08, 33.79s/it] 
 97%|█████████▋| 37003/37963 [158:42:13<7:24:10, 27.76s/it]
 97%|█████████▋| 37004/37963 [158:42:27<6:17:03, 23.59s/it]
 97%|█████████▋| 37005/37963 [158:42:42<5:32:35, 20.83s/it]
 97%|█████████▋| 37006/37963 [158:42:56<5:01:49, 18.92s/it]
 97%|█████████▋| 37007/37963 [158:43:17<5:11:32, 19.55s/it]
 97%|█████████▋| 37008/37963 [158:43:32<4:46:53, 18.02s/it]
 97%|█████████▋| 37009/37963 [158:43:46<4:29:20, 16.94s/it]
 97%|█████████▋| 37010/37963 [158:44:00<4:16:41, 16.16s/it]
                                                           
{'loss': '0.05574', 'grad_norm': '3.56', 'learning_rate': '3.31e-08', 'epoch': '0.9749'}

 97%|█████████▋| 37010/37963 [158:44:00<4:16:41, 16.16s/it]
 97%|█████████▋| 37011/37963 [158:44:15<4:07:06, 15.57s/it]
 97%|█████████▋| 37012/37963 [158:44:29<4:01:12, 15.22s/it]
 97%|█████████▋| 37013/37963 [158:44:43<3:56:58, 14.97s/it]
 98%|█████████▊| 37014/37963 [158:44:57<3:51:11, 14.62s/it]
 98%|█████████▊| 37015/37963 [158:45:11<3:49:35, 14.53s/it]
 98%|█████████▊| 37016/37963 [158:45:26<3:48:14, 14.46s/it]
 98%|█████████▊| 37017/37963 [158:45:40<3:47:35, 14.43s/it]
 98%|█████████▊| 37018/37963 [158:46:07<4:47:18, 18.24s/it]
 98%|█████████▊| 37019/37963 [158:46:28<4:59:27, 19.03s/it]
 98%|█████████▊| 37020/37963 [158:46:42<4:36:10, 17.57s/it]
                                                           
{'loss': '0.05871', 'grad_norm': '4.814', 'learning_rate': '3.241e-08', 'epoch': '0.9752'}

 98%|█████████▊| 37020/37963 [158:46:42<4:36:10, 17.57s/it]
 98%|█████████▊| 37021/37963 [158:46:56<4:19:31, 16.53s/it]
 98%|█████████▊| 37022/37963 [158:47:17<4:40:10, 17.86s/it]
 98%|█████████▊| 37023/37963 [158:47:32<4:23:21, 16.81s/it]
 98%|█████████▊| 37024/37963 [158:47:53<4:43:20, 18.11s/it]
 98%|█████████▊| 37025/37963 [158:48:07<4:25:52, 17.01s/it]
 98%|█████████▊| 37026/37963 [158:48:21<4:11:37, 16.11s/it]
 98%|█████████▊| 37027/37963 [158:48:35<4:01:45, 15.50s/it]
 98%|█████████▊| 37028/37963 [158:48:50<3:56:18, 15.16s/it]
 98%|█████████▊| 37029/37963 [158:49:04<3:52:53, 14.96s/it]
 98%|█████████▊| 37030/37963 [158:49:25<4:20:04, 16.72s/it]
                                                           
{'loss': '0.05805', 'grad_norm': '3.883', 'learning_rate': '3.173e-08', 'epoch': '0.9754'}

 98%|█████████▊| 37030/37963 [158:49:25<4:20:04, 16.72s/it]
 98%|█████████▊| 37031/37963 [158:49:39<4:08:06, 15.97s/it]
 98%|█████████▊| 37032/37963 [158:49:54<4:00:23, 15.49s/it]
 98%|█████████▊| 37033/37963 [158:50:08<3:54:56, 15.16s/it]
 98%|█████████▊| 37034/37963 [158:50:22<3:48:24, 14.75s/it]
 98%|█████████▊| 37035/37963 [158:50:36<3:44:34, 14.52s/it]
 98%|█████████▊| 37036/37963 [158:50:50<3:43:38, 14.48s/it]
 98%|█████████▊| 37037/37963 [158:51:11<4:12:19, 16.35s/it]
 98%|█████████▊| 37038/37963 [158:51:25<4:02:48, 15.75s/it]
 98%|█████████▊| 37039/37963 [158:51:40<3:56:39, 15.37s/it]
 98%|█████████▊| 37040/37963 [158:51:54<3:51:00, 15.02s/it]
                                                           
{'loss': '0.05188', 'grad_norm': '3.065', 'learning_rate': '3.105e-08', 'epoch': '0.9757'}

 98%|█████████▊| 37040/37963 [158:51:54<3:51:00, 15.02s/it]
 98%|█████████▊| 37041/37963 [158:52:08<3:48:09, 14.85s/it]
 98%|█████████▊| 37042/37963 [158:52:23<3:46:12, 14.74s/it]
 98%|█████████▊| 37043/37963 [158:52:37<3:44:14, 14.62s/it]
 98%|█████████▊| 37044/37963 [158:52:52<3:42:44, 14.54s/it]
 98%|█████████▊| 37045/37963 [158:53:06<3:41:22, 14.47s/it]
 98%|█████████▊| 37046/37963 [158:53:20<3:39:35, 14.37s/it]
 98%|█████████▊| 37047/37963 [158:53:34<3:37:33, 14.25s/it]
 98%|█████████▊| 37048/37963 [158:53:48<3:35:29, 14.13s/it]
 98%|█████████▊| 37049/37963 [158:54:02<3:36:15, 14.20s/it]
 98%|█████████▊| 37050/37963 [158:54:17<3:37:28, 14.29s/it]
                                                           
{'loss': '0.07929', 'grad_norm': '3.294', 'learning_rate': '3.039e-08', 'epoch': '0.976'}

 98%|█████████▊| 37050/37963 [158:54:17<3:37:28, 14.29s/it]
 98%|█████████▊| 37051/37963 [158:54:31<3:37:22, 14.30s/it]
 98%|█████████▊| 37052/37963 [158:54:45<3:36:47, 14.28s/it]
 98%|█████████▊| 37053/37963 [158:55:00<3:37:39, 14.35s/it]
 98%|█████████▊| 37054/37963 [158:55:14<3:37:23, 14.35s/it]
 98%|█████████▊| 37055/37963 [158:55:28<3:36:11, 14.29s/it]
 98%|█████████▊| 37056/37963 [158:55:50<4:10:00, 16.54s/it]
 98%|█████████▊| 37057/37963 [158:56:04<3:59:49, 15.88s/it]
 98%|█████████▊| 37058/37963 [158:56:19<3:52:48, 15.43s/it]
 98%|█████████▊| 37059/37963 [158:56:33<3:46:57, 15.06s/it]
 98%|█████████▊| 37060/37963 [158:56:47<3:43:26, 14.85s/it]
                                                           
{'loss': '0.07104', 'grad_norm': '3.058', 'learning_rate': '2.973e-08', 'epoch': '0.9762'}

 98%|█████████▊| 37060/37963 [158:56:47<3:43:26, 14.85s/it]
 98%|█████████▊| 37061/37963 [158:57:01<3:39:35, 14.61s/it]
 98%|█████████▊| 37062/37963 [158:57:16<3:38:04, 14.52s/it]
 98%|█████████▊| 37063/37963 [158:57:30<3:37:09, 14.48s/it]
 98%|█████████▊| 37064/37963 [158:57:44<3:36:18, 14.44s/it]
 98%|█████████▊| 37065/37963 [158:58:05<4:03:52, 16.29s/it]
 98%|█████████▊| 37066/37963 [158:58:26<4:25:03, 17.73s/it]
 98%|█████████▊| 37067/37963 [158:58:40<4:08:56, 16.67s/it]
 98%|█████████▊| 37068/37963 [158:58:55<3:58:27, 15.99s/it]
 98%|█████████▊| 37069/37963 [158:59:15<4:19:29, 17.42s/it]
 98%|█████████▊| 37070/37963 [158:59:30<4:05:36, 16.50s/it]
                                                           
{'loss': '0.06853', 'grad_norm': '3.407', 'learning_rate': '2.907e-08', 'epoch': '0.9765'}

 98%|█████████▊| 37070/37963 [158:59:30<4:05:36, 16.50s/it]
 98%|█████████▊| 37071/37963 [158:59:58<4:56:18, 19.93s/it]
 98%|█████████▊| 37072/37963 [159:00:12<4:28:25, 18.08s/it]
 98%|█████████▊| 37073/37963 [159:00:26<4:10:44, 16.90s/it]
 98%|█████████▊| 37074/37963 [159:00:40<3:59:06, 16.14s/it]
 98%|█████████▊| 37075/37963 [159:00:54<3:49:36, 15.51s/it]
 98%|█████████▊| 37076/37963 [159:01:09<3:44:20, 15.18s/it]
 98%|█████████▊| 37077/37963 [159:01:22<3:38:34, 14.80s/it]
 98%|█████████▊| 37078/37963 [159:01:43<4:03:32, 16.51s/it]
 98%|█████████▊| 37079/37963 [159:01:57<3:54:08, 15.89s/it]
 98%|█████████▊| 37080/37963 [159:02:11<3:45:59, 15.36s/it]
                                                           
{'loss': '0.05103', 'grad_norm': '2.946', 'learning_rate': '2.843e-08', 'epoch': '0.9767'}

 98%|█████████▊| 37080/37963 [159:02:11<3:45:59, 15.36s/it]
 98%|█████████▊| 37081/37963 [159:02:26<3:41:22, 15.06s/it]
 98%|█████████▊| 37082/37963 [159:02:40<3:38:49, 14.90s/it]
 98%|█████████▊| 37083/37963 [159:02:55<3:36:14, 14.74s/it]
 98%|█████████▊| 37084/37963 [159:03:09<3:34:35, 14.65s/it]
 98%|█████████▊| 37085/37963 [159:03:30<4:02:05, 16.54s/it]
 98%|█████████▊| 37086/37963 [159:03:45<3:52:18, 15.89s/it]
 98%|█████████▊| 37087/37963 [159:03:59<3:44:24, 15.37s/it]
 98%|█████████▊| 37088/37963 [159:04:13<3:40:01, 15.09s/it]
 98%|█████████▊| 37089/37963 [159:04:28<3:37:03, 14.90s/it]
 98%|█████████▊| 37090/37963 [159:04:42<3:34:15, 14.73s/it]
                                                           
{'loss': '0.058', 'grad_norm': '3.47', 'learning_rate': '2.779e-08', 'epoch': '0.977'}

 98%|█████████▊| 37090/37963 [159:04:42<3:34:15, 14.73s/it]
 98%|█████████▊| 37091/37963 [159:04:56<3:32:20, 14.61s/it]
 98%|█████████▊| 37092/37963 [159:05:11<3:31:01, 14.54s/it]
 98%|█████████▊| 37093/37963 [159:05:25<3:31:32, 14.59s/it]
 98%|█████████▊| 37094/37963 [159:05:40<3:30:24, 14.53s/it]
 98%|█████████▊| 37095/37963 [159:05:54<3:29:42, 14.50s/it]
 98%|█████████▊| 37096/37963 [159:06:09<3:29:06, 14.47s/it]
 98%|█████████▊| 37097/37963 [159:06:23<3:27:59, 14.41s/it]
 98%|█████████▊| 37098/37963 [159:06:37<3:27:22, 14.38s/it]
 98%|█████████▊| 37099/37963 [159:06:52<3:27:40, 14.42s/it]
 98%|█████████▊| 37100/37963 [159:07:06<3:25:53, 14.31s/it]
                                                           
{'loss': '0.04729', 'grad_norm': '2.942', 'learning_rate': '2.715e-08', 'epoch': '0.9773'}

 98%|█████████▊| 37100/37963 [159:07:06<3:25:53, 14.31s/it]
 98%|█████████▊| 37101/37963 [159:07:20<3:25:54, 14.33s/it]
 98%|█████████▊| 37102/37963 [159:07:34<3:25:43, 14.34s/it]
 98%|█████████▊| 37103/37963 [159:07:48<3:24:08, 14.24s/it]
 98%|█████████▊| 37104/37963 [159:08:09<3:51:29, 16.17s/it]
 98%|█████████▊| 37105/37963 [159:08:23<3:42:17, 15.54s/it]
 98%|█████████▊| 37106/37963 [159:08:37<3:36:38, 15.17s/it]
 98%|█████████▊| 37107/37963 [159:08:52<3:31:44, 14.84s/it]
 98%|█████████▊| 37108/37963 [159:09:06<3:29:30, 14.70s/it]
 98%|█████████▊| 37109/37963 [159:09:21<3:28:54, 14.68s/it]
 98%|█████████▊| 37110/37963 [159:09:35<3:27:51, 14.62s/it]
                                                           
{'loss': '0.0625', 'grad_norm': '3.89', 'learning_rate': '2.653e-08', 'epoch': '0.9775'}

 98%|█████████▊| 37110/37963 [159:09:35<3:27:51, 14.62s/it]
 98%|█████████▊| 37111/37963 [159:09:50<3:26:58, 14.58s/it]
 98%|█████████▊| 37112/37963 [159:10:04<3:25:49, 14.51s/it]
 98%|█████████▊| 37113/37963 [159:10:17<3:20:56, 14.18s/it]
 98%|█████████▊| 37114/37963 [159:10:38<3:49:25, 16.21s/it]
 98%|█████████▊| 37115/37963 [159:11:00<4:10:43, 17.74s/it]
 98%|█████████▊| 37116/37963 [159:11:14<3:56:31, 16.75s/it]
 98%|█████████▊| 37117/37963 [159:11:28<3:44:54, 15.95s/it]
 98%|█████████▊| 37118/37963 [159:11:42<3:36:58, 15.41s/it]
 98%|█████████▊| 37119/37963 [159:12:03<3:59:35, 17.03s/it]
 98%|█████████▊| 37120/37963 [159:12:31<4:43:27, 20.17s/it]
                                                           
{'loss': '0.05214', 'grad_norm': '2.745', 'learning_rate': '2.591e-08', 'epoch': '0.9778'}

 98%|█████████▊| 37120/37963 [159:12:31<4:43:27, 20.17s/it]
 98%|█████████▊| 37121/37963 [159:12:45<4:19:11, 18.47s/it]
 98%|█████████▊| 37122/37963 [159:12:59<4:01:27, 17.23s/it]
 98%|█████████▊| 37123/37963 [159:13:14<3:49:00, 16.36s/it]
 98%|█████████▊| 37124/37963 [159:13:28<3:40:29, 15.77s/it]
 98%|█████████▊| 37125/37963 [159:13:42<3:34:33, 15.36s/it]
 98%|█████████▊| 37126/37963 [159:14:03<3:57:17, 17.01s/it]
 98%|█████████▊| 37127/37963 [159:14:18<3:46:05, 16.23s/it]
 98%|█████████▊| 37128/37963 [159:14:32<3:37:48, 15.65s/it]
 98%|█████████▊| 37129/37963 [159:14:46<3:32:18, 15.27s/it]
 98%|█████████▊| 37130/37963 [159:15:01<3:27:58, 14.98s/it]
                                                           
{'loss': '0.06929', 'grad_norm': '4.149', 'learning_rate': '2.53e-08', 'epoch': '0.9781'}

 98%|█████████▊| 37130/37963 [159:15:01<3:27:58, 14.98s/it]
 98%|█████████▊| 37131/37963 [159:15:15<3:25:14, 14.80s/it]
 98%|█████████▊| 37132/37963 [159:15:29<3:22:25, 14.62s/it]
 98%|█████████▊| 37133/37963 [159:15:44<3:21:18, 14.55s/it]
 98%|█████████▊| 37134/37963 [159:15:58<3:18:12, 14.35s/it]
 98%|█████████▊| 37135/37963 [159:16:12<3:18:45, 14.40s/it]
 98%|█████████▊| 37136/37963 [159:16:33<3:44:59, 16.32s/it]
 98%|█████████▊| 37137/37963 [159:16:47<3:35:03, 15.62s/it]
 98%|█████████▊| 37138/37963 [159:17:01<3:28:54, 15.19s/it]
 98%|█████████▊| 37139/37963 [159:17:16<3:25:25, 14.96s/it]
 98%|█████████▊| 37140/37963 [159:17:30<3:22:49, 14.79s/it]
                                                           
{'loss': '0.0578', 'grad_norm': '4.102', 'learning_rate': '2.47e-08', 'epoch': '0.9783'}

 98%|█████████▊| 37140/37963 [159:17:30<3:22:49, 14.79s/it]
 98%|█████████▊| 37141/37963 [159:17:44<3:20:07, 14.61s/it]
 98%|█████████▊| 37142/37963 [159:17:58<3:18:50, 14.53s/it]
 98%|█████████▊| 37143/37963 [159:18:13<3:17:17, 14.44s/it]
 98%|█████████▊| 37144/37963 [159:18:27<3:16:01, 14.36s/it]
 98%|█████████▊| 37145/37963 [159:18:41<3:16:39, 14.43s/it]
 98%|█████████▊| 37146/37963 [159:18:56<3:16:16, 14.41s/it]
 98%|█████████▊| 37147/37963 [159:19:10<3:16:22, 14.44s/it]
 98%|█████████▊| 37148/37963 [159:19:24<3:13:55, 14.28s/it]
 98%|█████████▊| 37149/37963 [159:19:38<3:11:37, 14.13s/it]
 98%|█████████▊| 37150/37963 [159:19:52<3:12:46, 14.23s/it]
                                                           
{'loss': '0.0684', 'grad_norm': '5.908', 'learning_rate': '2.41e-08', 'epoch': '0.9786'}

 98%|█████████▊| 37150/37963 [159:19:52<3:12:46, 14.23s/it]
 98%|█████████▊| 37151/37963 [159:20:07<3:12:47, 14.25s/it]
 98%|█████████▊| 37152/37963 [159:20:21<3:13:22, 14.31s/it]
 98%|█████████▊| 37153/37963 [159:20:36<3:13:24, 14.33s/it]
 98%|█████████▊| 37154/37963 [159:20:57<3:41:37, 16.44s/it]
 98%|█████████▊| 37155/37963 [159:21:11<3:32:50, 15.81s/it]
 98%|█████████▊| 37156/37963 [159:21:26<3:27:36, 15.44s/it]
 98%|█████████▊| 37157/37963 [159:21:40<3:21:47, 15.02s/it]
 98%|█████████▊| 37158/37963 [159:21:54<3:19:22, 14.86s/it]
 98%|█████████▊| 37159/37963 [159:22:09<3:17:10, 14.72s/it]
 98%|█████████▊| 37160/37963 [159:22:23<3:15:52, 14.64s/it]
                                                           
{'loss': '0.06044', 'grad_norm': '3.407', 'learning_rate': '2.352e-08', 'epoch': '0.9789'}

 98%|█████████▊| 37160/37963 [159:22:23<3:15:52, 14.64s/it]
 98%|█████████▊| 37161/37963 [159:22:38<3:15:18, 14.61s/it]
 98%|█████████▊| 37162/37963 [159:22:52<3:14:23, 14.56s/it]
 98%|█████████▊| 37163/37963 [159:23:07<3:13:32, 14.52s/it]
 98%|█████████▊| 37164/37963 [159:23:27<3:38:24, 16.40s/it]
 98%|█████████▊| 37165/37963 [159:23:49<3:57:47, 17.88s/it]
 98%|█████████▊| 37166/37963 [159:24:10<4:09:38, 18.79s/it]
 98%|█████████▊| 37167/37963 [159:24:24<3:51:11, 17.43s/it]
 98%|█████████▊| 37168/37963 [159:24:38<3:39:06, 16.54s/it]
 98%|█████████▊| 37169/37963 [159:24:59<3:54:21, 17.71s/it]
 98%|█████████▊| 37170/37963 [159:25:20<4:07:35, 18.73s/it]
                                                           
{'loss': '0.07041', 'grad_norm': '3.03', 'learning_rate': '2.293e-08', 'epoch': '0.9791'}

 98%|█████████▊| 37170/37963 [159:25:20<4:07:35, 18.73s/it]
 98%|█████████▊| 37171/37963 [159:25:34<3:50:03, 17.43s/it]
 98%|█████████▊| 37172/37963 [159:25:48<3:36:19, 16.41s/it]
 98%|█████████▊| 37173/37963 [159:26:03<3:28:25, 15.83s/it]
 98%|█████████▊| 37174/37963 [159:26:24<3:47:58, 17.34s/it]
 98%|█████████▊| 37175/37963 [159:26:38<3:36:09, 16.46s/it]
 98%|█████████▊| 37176/37963 [159:26:52<3:25:44, 15.69s/it]
 98%|█████████▊| 37177/37963 [159:27:06<3:20:07, 15.28s/it]
 98%|█████████▊| 37178/37963 [159:27:21<3:16:01, 14.98s/it]
 98%|█████████▊| 37179/37963 [159:27:34<3:11:32, 14.66s/it]
 98%|█████████▊| 37180/37963 [159:27:49<3:09:51, 14.55s/it]
                                                           
{'loss': '0.05154', 'grad_norm': '3.784', 'learning_rate': '2.236e-08', 'epoch': '0.9794'}

 98%|█████████▊| 37180/37963 [159:27:49<3:09:51, 14.55s/it]
 98%|█████████▊| 37181/37963 [159:28:03<3:09:29, 14.54s/it]
 98%|█████████▊| 37182/37963 [159:28:18<3:08:25, 14.48s/it]
 98%|█████████▊| 37183/37963 [159:28:32<3:06:06, 14.32s/it]
 98%|█████████▊| 37184/37963 [159:28:46<3:06:09, 14.34s/it]
 98%|█████████▊| 37185/37963 [159:29:06<3:29:51, 16.18s/it]
 98%|█████████▊| 37186/37963 [159:29:21<3:22:41, 15.65s/it]
 98%|█████████▊| 37187/37963 [159:29:35<3:17:34, 15.28s/it]
 98%|█████████▊| 37188/37963 [159:29:50<3:14:09, 15.03s/it]
 98%|█████████▊| 37189/37963 [159:30:04<3:11:32, 14.85s/it]
 98%|█████████▊| 37190/37963 [159:30:18<3:08:10, 14.61s/it]
                                                           
{'loss': '0.0595', 'grad_norm': '2.309', 'learning_rate': '2.179e-08', 'epoch': '0.9796'}

 98%|█████████▊| 37190/37963 [159:30:18<3:08:10, 14.61s/it]
 98%|█████████▊| 37191/37963 [159:30:32<3:06:04, 14.46s/it]
 98%|█████████▊| 37192/37963 [159:30:46<3:04:11, 14.33s/it]
 98%|█████████▊| 37193/37963 [159:31:01<3:04:13, 14.35s/it]
 98%|█████████▊| 37194/37963 [159:31:15<3:03:28, 14.32s/it]
 98%|█████████▊| 37195/37963 [159:31:29<3:03:18, 14.32s/it]
 98%|█████████▊| 37196/37963 [159:31:44<3:03:20, 14.34s/it]
 98%|█████████▊| 37197/37963 [159:31:57<3:00:57, 14.17s/it]
 98%|█████████▊| 37198/37963 [159:32:12<3:01:43, 14.25s/it]
 98%|█████████▊| 37199/37963 [159:32:26<3:01:59, 14.29s/it]
 98%|█████████▊| 37200/37963 [159:32:40<3:00:52, 14.22s/it]
                                                           
{'loss': '0.06008', 'grad_norm': '2.552', 'learning_rate': '2.123e-08', 'epoch': '0.9799'}

 98%|█████████▊| 37200/37963 [159:32:40<3:00:52, 14.22s/it]
 98%|█████████▊| 37201/37963 [159:32:55<3:01:03, 14.26s/it]
 98%|█████████▊| 37202/37963 [159:33:09<3:01:15, 14.29s/it]
 98%|█████████▊| 37203/37963 [159:33:30<3:27:15, 16.36s/it]
 98%|█████████▊| 37204/37963 [159:33:45<3:19:26, 15.77s/it]
 98%|█████████▊| 37205/37963 [159:33:59<3:12:29, 15.24s/it]
 98%|█████████▊| 37206/37963 [159:34:13<3:08:32, 14.94s/it]
 98%|█████████▊| 37207/37963 [159:34:27<3:05:37, 14.73s/it]
 98%|█████████▊| 37208/37963 [159:34:41<3:03:50, 14.61s/it]
 98%|█████████▊| 37209/37963 [159:34:56<3:02:17, 14.51s/it]
 98%|█████████▊| 37210/37963 [159:35:10<3:01:33, 14.47s/it]
                                                           
{'loss': '0.06107', 'grad_norm': '2.109', 'learning_rate': '2.068e-08', 'epoch': '0.9802'}

 98%|█████████▊| 37210/37963 [159:35:10<3:01:33, 14.47s/it]
 98%|█████████▊| 37211/37963 [159:35:31<3:25:03, 16.36s/it]
 98%|█████████▊| 37212/37963 [159:35:44<3:14:14, 15.52s/it]
 98%|█████████▊| 37213/37963 [159:35:59<3:09:48, 15.18s/it]
 98%|█████████▊| 37214/37963 [159:36:13<3:06:17, 14.92s/it]
 98%|█████████▊| 37215/37963 [159:36:28<3:03:58, 14.76s/it]
 98%|█████████▊| 37216/37963 [159:36:55<3:50:39, 18.53s/it]
 98%|█████████▊| 37217/37963 [159:37:09<3:34:15, 17.23s/it]
 98%|█████████▊| 37218/37963 [159:37:23<3:23:29, 16.39s/it]
 98%|█████████▊| 37219/37963 [159:37:45<3:40:32, 17.79s/it]
 98%|█████████▊| 37220/37963 [159:37:59<3:27:43, 16.77s/it]
                                                           
{'loss': '0.0573', 'grad_norm': '4.728', 'learning_rate': '2.014e-08', 'epoch': '0.9804'}

 98%|█████████▊| 37220/37963 [159:37:59<3:27:43, 16.77s/it]
 98%|█████████▊| 37221/37963 [159:38:13<3:17:46, 15.99s/it]
 98%|█████████▊| 37222/37963 [159:38:28<3:11:54, 15.54s/it]
 98%|█████████▊| 37223/37963 [159:38:49<3:31:50, 17.18s/it]
 98%|█████████▊| 37224/37963 [159:39:02<3:17:02, 16.00s/it]
 98%|█████████▊| 37225/37963 [159:39:16<3:10:51, 15.52s/it]
 98%|█████████▊| 37226/37963 [159:39:31<3:06:29, 15.18s/it]
 98%|█████████▊| 37227/37963 [159:39:45<3:03:14, 14.94s/it]
 98%|█████████▊| 37228/37963 [159:39:59<3:00:59, 14.77s/it]
 98%|█████████▊| 37229/37963 [159:40:14<2:59:25, 14.67s/it]
 98%|█████████▊| 37230/37963 [159:40:28<2:58:07, 14.58s/it]
                                                           
{'loss': '0.0615', 'grad_norm': '4.376', 'learning_rate': '1.96e-08', 'epoch': '0.9807'}

 98%|█████████▊| 37230/37963 [159:40:28<2:58:07, 14.58s/it]
 98%|█████████▊| 37231/37963 [159:40:42<2:54:00, 14.26s/it]
 98%|█████████▊| 37232/37963 [159:40:55<2:49:54, 13.95s/it]
 98%|█████████▊| 37233/37963 [159:41:16<3:14:47, 16.01s/it]
 98%|█████████▊| 37234/37963 [159:41:30<3:08:36, 15.52s/it]
 98%|█████████▊| 37235/37963 [159:41:44<3:03:26, 15.12s/it]
 98%|█████████▊| 37236/37963 [159:41:58<2:59:07, 14.78s/it]
 98%|█████████▊| 37237/37963 [159:42:13<2:57:30, 14.67s/it]
 98%|█████████▊| 37238/37963 [159:42:27<2:56:20, 14.59s/it]
 98%|█████████▊| 37239/37963 [159:42:41<2:55:17, 14.53s/it]
 98%|█████████▊| 37240/37963 [159:42:56<2:54:05, 14.45s/it]
                                                           
{'loss': '0.04975', 'grad_norm': '4.226', 'learning_rate': '1.907e-08', 'epoch': '0.981'}

 98%|█████████▊| 37240/37963 [159:42:56<2:54:05, 14.45s/it]
 98%|█████████▊| 37241/37963 [159:43:10<2:52:55, 14.37s/it]
 98%|█████████▊| 37242/37963 [159:43:24<2:53:08, 14.41s/it]
 98%|█████████▊| 37243/37963 [159:43:39<2:53:07, 14.43s/it]
 98%|█████████▊| 37244/37963 [159:43:53<2:50:49, 14.26s/it]
 98%|█████████▊| 37245/37963 [159:44:07<2:49:10, 14.14s/it]
 98%|█████████▊| 37246/37963 [159:44:21<2:49:13, 14.16s/it]
 98%|█████████▊| 37247/37963 [159:44:35<2:50:11, 14.26s/it]
 98%|█████████▊| 37248/37963 [159:44:49<2:49:16, 14.21s/it]
 98%|█████████▊| 37249/37963 [159:45:04<2:49:33, 14.25s/it]
 98%|█████████▊| 37250/37963 [159:45:18<2:49:19, 14.25s/it]
                                                           
{'loss': '0.05925', 'grad_norm': '2.659', 'learning_rate': '1.855e-08', 'epoch': '0.9812'}

 98%|█████████▊| 37250/37963 [159:45:18<2:49:19, 14.25s/it]
 98%|█████████▊| 37251/37963 [159:45:39<3:14:17, 16.37s/it]
 98%|█████████▊| 37252/37963 [159:45:53<3:04:58, 15.61s/it]
 98%|█████████▊| 37253/37963 [159:46:07<2:59:41, 15.19s/it]
 98%|█████████▊| 37254/37963 [159:46:21<2:55:37, 14.86s/it]
 98%|█████████▊| 37255/37963 [159:46:36<2:53:37, 14.71s/it]
 98%|█████████▊| 37256/37963 [159:46:51<2:53:19, 14.71s/it]
 98%|█████████▊| 37257/37963 [159:47:05<2:51:41, 14.59s/it]
 98%|█████████▊| 37258/37963 [159:47:19<2:50:47, 14.54s/it]
 98%|█████████▊| 37259/37963 [159:47:34<2:49:54, 14.48s/it]
 98%|█████████▊| 37260/37963 [159:47:54<3:12:12, 16.40s/it]
                                                           
{'loss': '0.0665', 'grad_norm': '5.076', 'learning_rate': '1.803e-08', 'epoch': '0.9815'}

 98%|█████████▊| 37260/37963 [159:47:54<3:12:12, 16.40s/it]
 98%|█████████▊| 37261/37963 [159:48:09<3:04:56, 15.81s/it]
 98%|█████████▊| 37262/37963 [159:48:23<2:59:51, 15.39s/it]
 98%|█████████▊| 37263/37963 [159:48:45<3:20:36, 17.20s/it]
 98%|█████████▊| 37264/37963 [159:49:06<3:33:27, 18.32s/it]
 98%|█████████▊| 37265/37963 [159:49:20<3:19:27, 17.14s/it]
 98%|█████████▊| 37266/37963 [159:49:34<3:09:32, 16.32s/it]
 98%|█████████▊| 37267/37963 [159:50:02<3:48:34, 19.70s/it]
 98%|█████████▊| 37268/37963 [159:50:16<3:29:06, 18.05s/it]
 98%|█████████▊| 37269/37963 [159:50:31<3:15:58, 16.94s/it]
 98%|█████████▊| 37270/37963 [159:50:45<3:06:42, 16.17s/it]
                                                           
{'loss': '0.06744', 'grad_norm': '3.133', 'learning_rate': '1.752e-08', 'epoch': '0.9817'}

 98%|█████████▊| 37270/37963 [159:50:45<3:06:42, 16.17s/it]
 98%|█████████▊| 37271/37963 [159:50:59<3:00:00, 15.61s/it]
 98%|█████████▊| 37272/37963 [159:51:14<2:55:08, 15.21s/it]
 98%|█████████▊| 37273/37963 [159:51:28<2:51:17, 14.89s/it]
 98%|█████████▊| 37274/37963 [159:51:42<2:49:17, 14.74s/it]
 98%|█████████▊| 37275/37963 [159:52:04<3:12:30, 16.79s/it]
 98%|█████████▊| 37276/37963 [159:52:18<3:04:11, 16.09s/it]
 98%|█████████▊| 37277/37963 [159:52:32<2:56:33, 15.44s/it]
 98%|█████████▊| 37278/37963 [159:52:46<2:52:49, 15.14s/it]
 98%|█████████▊| 37279/37963 [159:53:01<2:51:00, 15.00s/it]
 98%|█████████▊| 37280/37963 [159:53:16<2:48:56, 14.84s/it]
                                                           
{'loss': '0.06446', 'grad_norm': '4.722', 'learning_rate': '1.702e-08', 'epoch': '0.982'}

 98%|█████████▊| 37280/37963 [159:53:16<2:48:56, 14.84s/it]
 98%|█████████▊| 37281/37963 [159:53:36<3:09:09, 16.64s/it]
 98%|█████████▊| 37282/37963 [159:53:51<3:01:12, 15.97s/it]
 98%|█████████▊| 37283/37963 [159:54:05<2:53:30, 15.31s/it]
 98%|█████████▊| 37284/37963 [159:54:19<2:48:57, 14.93s/it]
 98%|█████████▊| 37285/37963 [159:54:33<2:46:46, 14.76s/it]
 98%|█████████▊| 37286/37963 [159:54:48<2:45:29, 14.67s/it]
 98%|█████████▊| 37287/37963 [159:55:02<2:44:20, 14.59s/it]
 98%|█████████▊| 37288/37963 [159:55:16<2:40:57, 14.31s/it]
 98%|█████████▊| 37289/37963 [159:55:30<2:41:20, 14.36s/it]
 98%|█████████▊| 37290/37963 [159:55:44<2:40:32, 14.31s/it]
                                                           
{'loss': '0.05827', 'grad_norm': '3.079', 'learning_rate': '1.653e-08', 'epoch': '0.9823'}

 98%|█████████▊| 37290/37963 [159:55:44<2:40:32, 14.31s/it]
 98%|█████████▊| 37291/37963 [159:55:59<2:40:32, 14.33s/it]
 98%|█████████▊| 37292/37963 [159:56:13<2:40:00, 14.31s/it]
 98%|█████████▊| 37293/37963 [159:56:27<2:38:54, 14.23s/it]
 98%|█████████▊| 37294/37963 [159:56:41<2:39:19, 14.29s/it]
 98%|█████████▊| 37295/37963 [159:56:56<2:39:27, 14.32s/it]
 98%|█████████▊| 37296/37963 [159:57:10<2:39:17, 14.33s/it]
 98%|█████████▊| 37297/37963 [159:57:24<2:36:50, 14.13s/it]
 98%|█████████▊| 37298/37963 [159:57:38<2:37:09, 14.18s/it]
 98%|█████████▊| 37299/37963 [159:57:53<2:37:49, 14.26s/it]
 98%|█████████▊| 37300/37963 [159:58:14<3:00:09, 16.30s/it]
                                                           
{'loss': '0.05974', 'grad_norm': '4.211', 'learning_rate': '1.604e-08', 'epoch': '0.9825'}

 98%|█████████▊| 37300/37963 [159:58:14<3:00:09, 16.30s/it]
 98%|█████████▊| 37301/37963 [159:58:28<2:53:25, 15.72s/it]
 98%|█████████▊| 37302/37963 [159:58:42<2:46:50, 15.15s/it]
 98%|█████████▊| 37303/37963 [159:58:56<2:44:21, 14.94s/it]
 98%|█████████▊| 37304/37963 [159:59:10<2:41:36, 14.71s/it]
 98%|█████████▊| 37305/37963 [159:59:25<2:40:01, 14.59s/it]
 98%|█████████▊| 37306/37963 [159:59:39<2:37:19, 14.37s/it]
 98%|█████████▊| 37307/37963 [159:59:53<2:37:10, 14.38s/it]
 98%|█████████▊| 37308/37963 [160:00:07<2:36:57, 14.38s/it]
 98%|█████████▊| 37309/37963 [160:00:28<2:55:48, 16.13s/it]
 98%|█████████▊| 37310/37963 [160:00:42<2:49:49, 15.60s/it]
                                                           
{'loss': '0.06174', 'grad_norm': '3.635', 'learning_rate': '1.556e-08', 'epoch': '0.9828'}

 98%|█████████▊| 37310/37963 [160:00:42<2:49:49, 15.60s/it]
 98%|█████████▊| 37311/37963 [160:01:02<3:05:37, 17.08s/it]
 98%|█████████▊| 37312/37963 [160:01:16<2:54:43, 16.10s/it]
 98%|█████████▊| 37313/37963 [160:01:37<3:08:01, 17.36s/it]
 98%|█████████▊| 37314/37963 [160:01:58<3:20:22, 18.52s/it]
 98%|█████████▊| 37315/37963 [160:02:19<3:29:00, 19.35s/it]
 98%|█████████▊| 37316/37963 [160:02:33<3:11:20, 17.74s/it]
 98%|█████████▊| 37317/37963 [160:02:48<3:00:55, 16.80s/it]
 98%|█████████▊| 37318/37963 [160:03:01<2:50:52, 15.90s/it]
 98%|█████████▊| 37319/37963 [160:03:16<2:45:49, 15.45s/it]
 98%|█████████▊| 37320/37963 [160:03:30<2:42:16, 15.14s/it]
                                                           
{'loss': '0.06054', 'grad_norm': '3.107', 'learning_rate': '1.509e-08', 'epoch': '0.9831'}

 98%|█████████▊| 37320/37963 [160:03:30<2:42:16, 15.14s/it]
 98%|█████████▊| 37321/37963 [160:03:50<2:57:16, 16.57s/it]
 98%|█████████▊| 37322/37963 [160:04:04<2:49:31, 15.87s/it]
 98%|█████████▊| 37323/37963 [160:04:19<2:45:05, 15.48s/it]
 98%|█████████▊| 37324/37963 [160:04:33<2:41:37, 15.18s/it]
 98%|█████████▊| 37325/37963 [160:04:48<2:38:45, 14.93s/it]
 98%|█████████▊| 37326/37963 [160:05:02<2:36:35, 14.75s/it]
 98%|█████████▊| 37327/37963 [160:05:16<2:34:31, 14.58s/it]
 98%|█████████▊| 37328/37963 [160:05:31<2:33:56, 14.55s/it]
 98%|█████████▊| 37329/37963 [160:05:45<2:33:16, 14.51s/it]
 98%|█████████▊| 37330/37963 [160:06:00<2:32:32, 14.46s/it]
                                                           
{'loss': '0.06463', 'grad_norm': '3.6', 'learning_rate': '1.462e-08', 'epoch': '0.9833'}

 98%|█████████▊| 37330/37963 [160:06:00<2:32:32, 14.46s/it]
 98%|█████████▊| 37331/37963 [160:06:14<2:31:20, 14.37s/it]
 98%|█████████▊| 37332/37963 [160:06:34<2:51:04, 16.27s/it]
 98%|█████████▊| 37333/37963 [160:06:49<2:44:50, 15.70s/it]
 98%|█████████▊| 37334/37963 [160:07:03<2:40:21, 15.30s/it]
 98%|█████████▊| 37335/37963 [160:07:18<2:37:22, 15.04s/it]
 98%|█████████▊| 37336/37963 [160:07:32<2:35:10, 14.85s/it]
 98%|█████████▊| 37337/37963 [160:07:46<2:33:34, 14.72s/it]
 98%|█████████▊| 37338/37963 [160:08:01<2:32:23, 14.63s/it]
 98%|█████████▊| 37339/37963 [160:08:15<2:31:34, 14.57s/it]
 98%|█████████▊| 37340/37963 [160:08:30<2:30:48, 14.52s/it]
                                                           
{'loss': '0.05491', 'grad_norm': '2.016', 'learning_rate': '1.417e-08', 'epoch': '0.9836'}

 98%|█████████▊| 37340/37963 [160:08:30<2:30:48, 14.52s/it]
 98%|█████████▊| 37341/37963 [160:08:44<2:29:33, 14.43s/it]
 98%|█████████▊| 37342/37963 [160:08:58<2:27:41, 14.27s/it]
 98%|█████████▊| 37343/37963 [160:09:12<2:28:30, 14.37s/it]
 98%|█████████▊| 37344/37963 [160:09:27<2:28:24, 14.39s/it]
 98%|█████████▊| 37345/37963 [160:09:41<2:28:53, 14.46s/it]
 98%|█████████▊| 37346/37963 [160:09:56<2:28:30, 14.44s/it]
 98%|█████████▊| 37347/37963 [160:10:10<2:28:05, 14.42s/it]
 98%|█████████▊| 37348/37963 [160:10:31<2:48:44, 16.46s/it]
 98%|█████████▊| 37349/37963 [160:10:46<2:42:22, 15.87s/it]
 98%|█████████▊| 37350/37963 [160:11:00<2:38:10, 15.48s/it]
                                                           
{'loss': '0.06758', 'grad_norm': '3.606', 'learning_rate': '1.372e-08', 'epoch': '0.9839'}

 98%|█████████▊| 37350/37963 [160:11:01<2:38:10, 15.48s/it]
 98%|█████████▊| 37351/37963 [160:11:15<2:34:55, 15.19s/it]
 98%|█████████▊| 37352/37963 [160:11:29<2:32:11, 14.94s/it]
 98%|█████████▊| 37353/37963 [160:11:43<2:29:20, 14.69s/it]
 98%|█████████▊| 37354/37963 [160:11:58<2:27:59, 14.58s/it]
 98%|█████████▊| 37355/37963 [160:12:12<2:27:04, 14.51s/it]
 98%|█████████▊| 37356/37963 [160:12:27<2:26:24, 14.47s/it]
 98%|█████████▊| 37357/37963 [160:12:41<2:26:24, 14.50s/it]
 98%|█████████▊| 37358/37963 [160:13:01<2:43:12, 16.19s/it]
 98%|█████████▊| 37359/37963 [160:13:15<2:35:26, 15.44s/it]
 98%|█████████▊| 37360/37963 [160:13:36<2:51:56, 17.11s/it]
                                                           
{'loss': '0.05457', 'grad_norm': '3.15', 'learning_rate': '1.327e-08', 'epoch': '0.9841'}

 98%|█████████▊| 37360/37963 [160:13:36<2:51:56, 17.11s/it]
 98%|█████████▊| 37361/37963 [160:13:57<3:02:10, 18.16s/it]
 98%|█████████▊| 37362/37963 [160:14:18<3:11:54, 19.16s/it]
 98%|█████████▊| 37363/37963 [160:14:39<3:16:49, 19.68s/it]
 98%|█████████▊| 37364/37963 [160:14:53<3:00:38, 18.09s/it]
 98%|█████████▊| 37365/37963 [160:15:08<2:49:27, 17.00s/it]
 98%|█████████▊| 37366/37963 [160:15:22<2:41:24, 16.22s/it]
 98%|█████████▊| 37367/37963 [160:15:36<2:34:46, 15.58s/it]
 98%|█████████▊| 37368/37963 [160:15:51<2:30:53, 15.22s/it]
 98%|█████████▊| 37369/37963 [160:16:12<2:47:54, 16.96s/it]
 98%|█████████▊| 37370/37963 [160:16:26<2:39:53, 16.18s/it]
                                                           
{'loss': '0.0506', 'grad_norm': '3.421', 'learning_rate': '1.284e-08', 'epoch': '0.9844'}

 98%|█████████▊| 37370/37963 [160:16:26<2:39:53, 16.18s/it]
 98%|█████████▊| 37371/37963 [160:16:40<2:34:17, 15.64s/it]
 98%|█████████▊| 37372/37963 [160:16:54<2:29:07, 15.14s/it]
 98%|█████████▊| 37373/37963 [160:17:09<2:26:12, 14.87s/it]
 98%|█████████▊| 37374/37963 [160:17:23<2:24:30, 14.72s/it]
 98%|█████████▊| 37375/37963 [160:17:37<2:23:17, 14.62s/it]
 98%|█████████▊| 37376/37963 [160:17:52<2:22:20, 14.55s/it]
 98%|█████████▊| 37377/37963 [160:18:06<2:22:08, 14.55s/it]
 98%|█████████▊| 37378/37963 [160:18:21<2:20:54, 14.45s/it]
 98%|█████████▊| 37379/37963 [160:18:35<2:20:34, 14.44s/it]
 98%|█████████▊| 37380/37963 [160:18:49<2:20:15, 14.43s/it]
                                                           
{'loss': '0.05905', 'grad_norm': '2.649', 'learning_rate': '1.241e-08', 'epoch': '0.9846'}

 98%|█████████▊| 37380/37963 [160:18:49<2:20:15, 14.43s/it]
 98%|█████████▊| 37381/37963 [160:19:04<2:19:15, 14.36s/it]
 98%|█████████▊| 37382/37963 [160:19:18<2:18:32, 14.31s/it]
 98%|█████████▊| 37383/37963 [160:19:39<2:37:07, 16.25s/it]
 98%|█████████▊| 37384/37963 [160:19:53<2:31:17, 15.68s/it]
 98%|█████████▊| 37385/37963 [160:20:07<2:27:24, 15.30s/it]
 98%|█████████▊| 37386/37963 [160:20:21<2:22:54, 14.86s/it]
 98%|█████████▊| 37387/37963 [160:20:35<2:21:13, 14.71s/it]
 98%|█████████▊| 37388/37963 [160:20:50<2:20:15, 14.63s/it]
 98%|█████████▊| 37389/37963 [160:21:04<2:19:21, 14.57s/it]
 98%|█████████▊| 37390/37963 [160:21:18<2:16:29, 14.29s/it]
                                                           
{'loss': '0.06114', 'grad_norm': '3.179', 'learning_rate': '1.199e-08', 'epoch': '0.9849'}

 98%|█████████▊| 37390/37963 [160:21:18<2:16:29, 14.29s/it]
 98%|█████████▊| 37391/37963 [160:21:32<2:16:21, 14.30s/it]
 98%|█████████▊| 37392/37963 [160:21:45<2:12:51, 13.96s/it]
 98%|█████████▊| 37393/37963 [160:22:00<2:13:48, 14.08s/it]
 99%|█████████▊| 37394/37963 [160:22:14<2:13:31, 14.08s/it]
 99%|█████████▊| 37395/37963 [160:22:28<2:14:06, 14.17s/it]
 99%|█████████▊| 37396/37963 [160:22:43<2:14:35, 14.24s/it]
 99%|█████████▊| 37397/37963 [160:22:57<2:14:41, 14.28s/it]
 99%|█████████▊| 37398/37963 [160:23:18<2:34:19, 16.39s/it]
 99%|█████████▊| 37399/37963 [160:23:32<2:26:26, 15.58s/it]
 99%|█████████▊| 37400/37963 [160:23:47<2:23:00, 15.24s/it]
                                                           
{'loss': '0.06349', 'grad_norm': '3.175', 'learning_rate': '1.157e-08', 'epoch': '0.9852'}

 99%|█████████▊| 37400/37963 [160:23:47<2:23:00, 15.24s/it]
 99%|█████████▊| 37401/37963 [160:24:01<2:20:25, 14.99s/it]
 99%|█████████▊| 37402/37963 [160:24:15<2:18:52, 14.85s/it]
 99%|█████████▊| 37403/37963 [160:24:29<2:16:13, 14.60s/it]
 99%|█████████▊| 37404/37963 [160:24:43<2:13:42, 14.35s/it]
 99%|█████████▊| 37405/37963 [160:24:57<2:13:03, 14.31s/it]
 99%|█████████▊| 37406/37963 [160:25:12<2:13:35, 14.39s/it]
 99%|█████████▊| 37407/37963 [160:25:32<2:29:45, 16.16s/it]
 99%|█████████▊| 37408/37963 [160:25:47<2:24:45, 15.65s/it]
 99%|█████████▊| 37409/37963 [160:26:01<2:21:02, 15.27s/it]
 99%|█████████▊| 37410/37963 [160:26:22<2:37:01, 17.04s/it]
                                                           
{'loss': '0.05583', 'grad_norm': '2.727', 'learning_rate': '1.117e-08', 'epoch': '0.9854'}

 99%|█████████▊| 37410/37963 [160:26:22<2:37:01, 17.04s/it]
 99%|█████████▊| 37411/37963 [160:26:43<2:48:07, 18.27s/it]
 99%|█████████▊| 37412/37963 [160:27:04<2:53:54, 18.94s/it]
 99%|█████████▊| 37413/37963 [160:27:18<2:41:09, 17.58s/it]
 99%|█████████▊| 37414/37963 [160:27:33<2:32:08, 16.63s/it]
 99%|█████████▊| 37415/37963 [160:27:47<2:25:20, 15.91s/it]
 99%|█████████▊| 37416/37963 [160:28:01<2:20:50, 15.45s/it]
 99%|█████████▊| 37417/37963 [160:28:23<2:37:30, 17.31s/it]
 99%|█████████▊| 37418/37963 [160:28:37<2:29:20, 16.44s/it]
 99%|█████████▊| 37419/37963 [160:28:52<2:23:26, 15.82s/it]
 99%|█████████▊| 37420/37963 [160:29:05<2:17:19, 15.17s/it]
                                                           
{'loss': '0.06377', 'grad_norm': '3.752', 'learning_rate': '1.077e-08', 'epoch': '0.9857'}

 99%|█████████▊| 37420/37963 [160:29:06<2:17:19, 15.17s/it]
 99%|█████████▊| 37421/37963 [160:29:20<2:14:59, 14.94s/it]
 99%|█████████▊| 37422/37963 [160:29:34<2:13:04, 14.76s/it]
 99%|█████████▊| 37423/37963 [160:29:49<2:12:04, 14.68s/it]
 99%|█████████▊| 37424/37963 [160:30:03<2:10:33, 14.53s/it]
 99%|█████████▊| 37425/37963 [160:30:17<2:09:51, 14.48s/it]
 99%|█████████▊| 37426/37963 [160:30:32<2:09:22, 14.45s/it]
 99%|█████████▊| 37427/37963 [160:30:45<2:07:14, 14.24s/it]
 99%|█████████▊| 37428/37963 [160:30:59<2:05:44, 14.10s/it]
 99%|█████████▊| 37429/37963 [160:31:13<2:05:33, 14.11s/it]
 99%|█████████▊| 37430/37963 [160:31:34<2:22:36, 16.05s/it]
                                                           
{'loss': '0.06101', 'grad_norm': '4.9', 'learning_rate': '1.038e-08', 'epoch': '0.986'}

 99%|█████████▊| 37430/37963 [160:31:34<2:22:36, 16.05s/it]
 99%|█████████▊| 37431/37963 [160:31:48<2:17:43, 15.53s/it]
 99%|█████████▊| 37432/37963 [160:32:03<2:14:51, 15.24s/it]
 99%|█████████▊| 37433/37963 [160:32:17<2:10:56, 14.82s/it]
 99%|█████████▊| 37434/37963 [160:32:31<2:09:18, 14.67s/it]
 99%|█████████▊| 37435/37963 [160:32:45<2:08:30, 14.60s/it]
 99%|█████████▊| 37436/37963 [160:33:00<2:07:37, 14.53s/it]
 99%|█████████▊| 37437/37963 [160:33:14<2:06:57, 14.48s/it]
 99%|█████████▊| 37438/37963 [160:33:28<2:05:30, 14.34s/it]
 99%|█████████▊| 37439/37963 [160:33:43<2:05:28, 14.37s/it]
 99%|█████████▊| 37440/37963 [160:33:57<2:05:14, 14.37s/it]
                                                           
{'loss': '0.06328', 'grad_norm': '4.795', 'learning_rate': '9.991e-09', 'epoch': '0.9862'}

 99%|█████████▊| 37440/37963 [160:33:57<2:05:14, 14.37s/it]
 99%|█████████▊| 37441/37963 [160:34:11<2:05:03, 14.37s/it]
 99%|█████████▊| 37442/37963 [160:34:26<2:05:11, 14.42s/it]
 99%|█████████▊| 37443/37963 [160:34:40<2:04:37, 14.38s/it]
 99%|█████████▊| 37444/37963 [160:34:54<2:04:19, 14.37s/it]
 99%|█████████▊| 37445/37963 [160:35:09<2:03:59, 14.36s/it]
 99%|█████████▊| 37446/37963 [160:35:30<2:22:04, 16.49s/it]
 99%|█████████▊| 37447/37963 [160:35:44<2:15:35, 15.77s/it]
 99%|█████████▊| 37448/37963 [160:35:59<2:11:56, 15.37s/it]
 99%|█████████▊| 37449/37963 [160:36:13<2:08:58, 15.05s/it]
 99%|█████████▊| 37450/37963 [160:36:28<2:07:19, 14.89s/it]
                                                           
{'loss': '0.06032', 'grad_norm': '2.47', 'learning_rate': '9.613e-09', 'epoch': '0.9865'}

 99%|█████████▊| 37450/37963 [160:36:28<2:07:19, 14.89s/it]
 99%|█████████▊| 37451/37963 [160:36:42<2:05:46, 14.74s/it]
 99%|█████████▊| 37452/37963 [160:36:56<2:04:07, 14.57s/it]
 99%|█████████▊| 37453/37963 [160:37:11<2:03:21, 14.51s/it]
 99%|█████████▊| 37454/37963 [160:37:25<2:02:42, 14.46s/it]
 99%|█████████▊| 37455/37963 [160:37:45<2:16:21, 16.11s/it]
 99%|█████████▊| 37456/37963 [160:37:59<2:11:29, 15.56s/it]
 99%|█████████▊| 37457/37963 [160:38:20<2:24:24, 17.12s/it]
 99%|█████████▊| 37458/37963 [160:38:34<2:16:18, 16.19s/it]
 99%|█████████▊| 37459/37963 [160:39:01<2:43:19, 19.44s/it]
 99%|█████████▊| 37460/37963 [160:39:15<2:30:25, 17.94s/it]
                                                           
{'loss': '0.05777', 'grad_norm': '3.243', 'learning_rate': '9.243e-09', 'epoch': '0.9868'}

 99%|█████████▊| 37460/37963 [160:39:15<2:30:25, 17.94s/it]
 99%|█████████▊| 37461/37963 [160:39:36<2:37:22, 18.81s/it]
 99%|█████████▊| 37462/37963 [160:39:51<2:25:55, 17.48s/it]
 99%|█████████▊| 37463/37963 [160:40:05<2:17:40, 16.52s/it]
 99%|█████████▊| 37464/37963 [160:40:19<2:12:00, 15.87s/it]
 99%|█████████▊| 37465/37963 [160:40:34<2:08:00, 15.42s/it]
 99%|█████████▊| 37466/37963 [160:40:54<2:21:16, 17.05s/it]
 99%|█████████▊| 37467/37963 [160:41:09<2:14:15, 16.24s/it]
 99%|█████████▊| 37468/37963 [160:41:23<2:09:09, 15.65s/it]
 99%|█████████▊| 37469/37963 [160:41:37<2:05:36, 15.26s/it]
 99%|█████████▊| 37470/37963 [160:41:52<2:03:13, 15.00s/it]
                                                           
{'loss': '0.06222', 'grad_norm': '3.27', 'learning_rate': '8.88e-09', 'epoch': '0.987'}

 99%|█████████▊| 37470/37963 [160:41:52<2:03:13, 15.00s/it]
 99%|█████████▊| 37471/37963 [160:42:06<2:01:03, 14.76s/it]
 99%|█████████▊| 37472/37963 [160:42:21<2:00:18, 14.70s/it]
 99%|█████████▊| 37473/37963 [160:42:35<1:58:46, 14.54s/it]
 99%|█████████▊| 37474/37963 [160:42:49<1:58:15, 14.51s/it]
 99%|█████████▊| 37475/37963 [160:43:04<1:57:36, 14.46s/it]
 99%|█████████▊| 37476/37963 [160:43:18<1:57:22, 14.46s/it]
 99%|█████████▊| 37477/37963 [160:43:32<1:57:01, 14.45s/it]
 99%|█████████▊| 37478/37963 [160:43:46<1:55:00, 14.23s/it]
 99%|█████████▊| 37479/37963 [160:44:07<2:10:59, 16.24s/it]
 99%|█████████▊| 37480/37963 [160:44:21<2:05:19, 15.57s/it]
                                                           
{'loss': '0.05576', 'grad_norm': '2.37', 'learning_rate': '8.524e-09', 'epoch': '0.9873'}

 99%|█████████▊| 37480/37963 [160:44:21<2:05:19, 15.57s/it]
 99%|█████████▊| 37481/37963 [160:44:35<2:02:13, 15.21s/it]
 99%|█████████▊| 37482/37963 [160:44:50<1:59:39, 14.93s/it]
 99%|█████████▊| 37483/37963 [160:45:04<1:58:09, 14.77s/it]
 99%|█████████▊| 37484/37963 [160:45:19<1:56:55, 14.65s/it]
 99%|█████████▊| 37485/37963 [160:45:33<1:56:41, 14.65s/it]
 99%|█████████▊| 37486/37963 [160:45:47<1:54:52, 14.45s/it]
 99%|█████████▊| 37487/37963 [160:46:01<1:54:21, 14.41s/it]
 99%|█████████▊| 37488/37963 [160:46:16<1:54:17, 14.44s/it]
 99%|█████████▉| 37489/37963 [160:46:30<1:54:02, 14.43s/it]
 99%|█████████▉| 37490/37963 [160:46:45<1:53:11, 14.36s/it]
                                                           
{'loss': '0.05545', 'grad_norm': '2.224', 'learning_rate': '8.175e-09', 'epoch': '0.9875'}

 99%|█████████▉| 37490/37963 [160:46:45<1:53:11, 14.36s/it]
 99%|█████████▉| 37491/37963 [160:46:59<1:52:57, 14.36s/it]
 99%|█████████▉| 37492/37963 [160:47:13<1:51:14, 14.17s/it]
 99%|█████████▉| 37493/37963 [160:47:27<1:51:35, 14.25s/it]
 99%|█████████▉| 37494/37963 [160:47:48<2:07:12, 16.27s/it]
 99%|█████████▉| 37495/37963 [160:48:02<2:02:15, 15.67s/it]
 99%|█████████▉| 37496/37963 [160:48:17<1:58:58, 15.29s/it]
 99%|█████████▉| 37497/37963 [160:48:31<1:56:35, 15.01s/it]
 99%|█████████▉| 37498/37963 [160:48:45<1:54:26, 14.77s/it]
 99%|█████████▉| 37499/37963 [160:49:00<1:53:34, 14.69s/it]
 99%|█████████▉| 37500/37963 [160:49:14<1:51:20, 14.43s/it]
                                                           
{'loss': '0.0706', 'grad_norm': '4.216', 'learning_rate': '7.834e-09', 'epoch': '0.9878'}

 99%|█████████▉| 37500/37963 [160:49:14<1:51:20, 14.43s/it]
 99%|█████████▉| 37501/37963 [160:49:28<1:51:04, 14.43s/it]
 99%|█████████▉| 37502/37963 [160:49:48<2:03:56, 16.13s/it]
 99%|█████████▉| 37503/37963 [160:50:03<1:59:39, 15.61s/it]
 99%|█████████▉| 37504/37963 [160:50:23<2:11:37, 17.21s/it]
 99%|█████████▉| 37505/37963 [160:50:38<2:05:12, 16.40s/it]
 99%|█████████▉| 37506/37963 [160:50:52<2:00:17, 15.79s/it]
 99%|█████████▉| 37507/37963 [160:51:14<2:12:20, 17.41s/it]
 99%|█████████▉| 37508/37963 [160:51:28<2:04:47, 16.46s/it]
 99%|█████████▉| 37509/37963 [160:51:56<2:30:52, 19.94s/it]
 99%|█████████▉| 37510/37963 [160:52:10<2:17:58, 18.28s/it]
                                                           
{'loss': '0.06103', 'grad_norm': '3.536', 'learning_rate': '7.5e-09', 'epoch': '0.9881'}

 99%|█████████▉| 37510/37963 [160:52:10<2:17:58, 18.28s/it]
 99%|█████████▉| 37511/37963 [160:52:25<2:08:57, 17.12s/it]
 99%|█████████▉| 37512/37963 [160:52:39<2:02:27, 16.29s/it]
 99%|█████████▉| 37513/37963 [160:52:59<2:11:10, 17.49s/it]
 99%|█████████▉| 37514/37963 [160:53:13<2:03:01, 16.44s/it]
 99%|█████████▉| 37515/37963 [160:53:28<1:58:08, 15.82s/it]
 99%|█████████▉| 37516/37963 [160:53:42<1:53:28, 15.23s/it]
 99%|█████████▉| 37517/37963 [160:53:56<1:51:16, 14.97s/it]
 99%|█████████▉| 37518/37963 [160:54:10<1:49:44, 14.80s/it]
 99%|█████████▉| 37519/37963 [160:54:25<1:48:28, 14.66s/it]
 99%|█████████▉| 37520/37963 [160:54:39<1:47:42, 14.59s/it]
                                                           
{'loss': '0.05893', 'grad_norm': '3.087', 'learning_rate': '7.173e-09', 'epoch': '0.9883'}

 99%|█████████▉| 37520/37963 [160:54:39<1:47:42, 14.59s/it]
 99%|█████████▉| 37521/37963 [160:54:54<1:47:29, 14.59s/it]
 99%|█████████▉| 37522/37963 [160:55:08<1:46:54, 14.54s/it]
 99%|█████████▉| 37523/37963 [160:55:22<1:46:12, 14.48s/it]
 99%|█████████▉| 37524/37963 [160:55:37<1:45:44, 14.45s/it]
 99%|█████████▉| 37525/37963 [160:55:51<1:45:31, 14.45s/it]
 99%|█████████▉| 37526/37963 [160:56:05<1:43:57, 14.27s/it]
 99%|█████████▉| 37527/37963 [160:56:20<1:44:13, 14.34s/it]
 99%|█████████▉| 37528/37963 [160:56:40<1:57:46, 16.25s/it]
 99%|█████████▉| 37529/37963 [160:56:55<1:53:22, 15.67s/it]
 99%|█████████▉| 37530/37963 [160:57:09<1:49:38, 15.19s/it]
                                                           
{'loss': '0.06211', 'grad_norm': '3.589', 'learning_rate': '6.854e-09', 'epoch': '0.9886'}

 99%|█████████▉| 37530/37963 [160:57:09<1:49:38, 15.19s/it]
 99%|█████████▉| 37531/37963 [160:57:23<1:47:42, 14.96s/it]
 99%|█████████▉| 37532/37963 [160:57:38<1:46:26, 14.82s/it]
 99%|█████████▉| 37533/37963 [160:57:52<1:45:15, 14.69s/it]
 99%|█████████▉| 37534/37963 [160:58:06<1:44:03, 14.55s/it]
 99%|█████████▉| 37535/37963 [160:58:21<1:43:36, 14.53s/it]
 99%|█████████▉| 37536/37963 [160:58:34<1:41:06, 14.21s/it]
 99%|█████████▉| 37537/37963 [160:58:49<1:41:16, 14.26s/it]
 99%|█████████▉| 37538/37963 [160:59:03<1:40:55, 14.25s/it]
 99%|█████████▉| 37539/37963 [160:59:17<1:40:56, 14.28s/it]
 99%|█████████▉| 37540/37963 [160:59:31<1:39:43, 14.14s/it]
                                                           
{'loss': '0.05739', 'grad_norm': '3.688', 'learning_rate': '6.542e-09', 'epoch': '0.9889'}

 99%|█████████▉| 37540/37963 [160:59:31<1:39:43, 14.14s/it]
 99%|█████████▉| 37541/37963 [160:59:45<1:39:37, 14.17s/it]
 99%|█████████▉| 37542/37963 [161:00:00<1:39:44, 14.22s/it]
 99%|█████████▉| 37543/37963 [161:00:21<1:53:55, 16.27s/it]
 99%|█████████▉| 37544/37963 [161:00:35<1:49:45, 15.72s/it]
 99%|█████████▉| 37545/37963 [161:00:49<1:46:43, 15.32s/it]
 99%|█████████▉| 37546/37963 [161:01:04<1:44:34, 15.05s/it]
 99%|█████████▉| 37547/37963 [161:01:18<1:42:56, 14.85s/it]
 99%|█████████▉| 37548/37963 [161:01:33<1:41:38, 14.70s/it]
 99%|█████████▉| 37549/37963 [161:01:46<1:39:23, 14.40s/it]
 99%|█████████▉| 37550/37963 [161:02:01<1:39:01, 14.39s/it]
                                                           
{'loss': '0.05812', 'grad_norm': '3.504', 'learning_rate': '6.237e-09', 'epoch': '0.9891'}

 99%|█████████▉| 37550/37963 [161:02:01<1:39:01, 14.39s/it]
 99%|█████████▉| 37551/37963 [161:02:15<1:38:34, 14.36s/it]
 99%|█████████▉| 37552/37963 [161:02:36<1:51:58, 16.35s/it]
 99%|█████████▉| 37553/37963 [161:02:57<2:01:17, 17.75s/it]
 99%|█████████▉| 37554/37963 [161:03:11<1:53:23, 16.63s/it]
 99%|█████████▉| 37555/37963 [161:03:25<1:48:35, 15.97s/it]
 99%|█████████▉| 37556/37963 [161:03:40<1:45:07, 15.50s/it]
 99%|█████████▉| 37557/37963 [161:04:01<1:56:20, 17.19s/it]
 99%|█████████▉| 37558/37963 [161:04:29<2:19:02, 20.60s/it]
 99%|█████████▉| 37559/37963 [161:04:44<2:06:16, 18.75s/it]
 99%|█████████▉| 37560/37963 [161:04:58<1:57:10, 17.45s/it]
                                                           
{'loss': '0.05445', 'grad_norm': '2.935', 'learning_rate': '5.939e-09', 'epoch': '0.9894'}

 99%|█████████▉| 37560/37963 [161:04:58<1:57:10, 17.45s/it]
 99%|█████████▉| 37561/37963 [161:05:12<1:49:04, 16.28s/it]
 99%|█████████▉| 37562/37963 [161:05:33<1:58:04, 17.67s/it]
 99%|█████████▉| 37563/37963 [161:05:47<1:51:11, 16.68s/it]
 99%|█████████▉| 37564/37963 [161:06:01<1:45:42, 15.90s/it]
 99%|█████████▉| 37565/37963 [161:06:16<1:42:38, 15.47s/it]
 99%|█████████▉| 37566/37963 [161:06:30<1:39:32, 15.04s/it]
 99%|█████████▉| 37567/37963 [161:06:44<1:37:56, 14.84s/it]
 99%|█████████▉| 37568/37963 [161:06:59<1:37:01, 14.74s/it]
 99%|█████████▉| 37569/37963 [161:07:13<1:36:01, 14.62s/it]
 99%|█████████▉| 37570/37963 [161:07:27<1:35:16, 14.55s/it]
                                                           
{'loss': '0.06418', 'grad_norm': '4.113', 'learning_rate': '5.649e-09', 'epoch': '0.9897'}

 99%|█████████▉| 37570/37963 [161:07:27<1:35:16, 14.55s/it]
 99%|█████████▉| 37571/37963 [161:07:42<1:34:51, 14.52s/it]
 99%|█████████▉| 37572/37963 [161:07:56<1:34:21, 14.48s/it]
 99%|█████████▉| 37573/37963 [161:08:11<1:34:00, 14.46s/it]
 99%|█████████▉| 37574/37963 [161:08:25<1:33:12, 14.38s/it]
 99%|█████████▉| 37575/37963 [161:08:39<1:33:02, 14.39s/it]
 99%|█████████▉| 37576/37963 [161:08:53<1:32:29, 14.34s/it]
 99%|█████████▉| 37577/37963 [161:09:08<1:32:25, 14.37s/it]
 99%|█████████▉| 37578/37963 [161:09:22<1:32:33, 14.42s/it]
 99%|█████████▉| 37579/37963 [161:09:36<1:30:57, 14.21s/it]
 99%|█████████▉| 37580/37963 [161:09:57<1:43:00, 16.14s/it]
                                                           
{'loss': '0.05628', 'grad_norm': '4.249', 'learning_rate': '5.366e-09', 'epoch': '0.9899'}

 99%|█████████▉| 37580/37963 [161:09:57<1:43:00, 16.14s/it]
 99%|█████████▉| 37581/37963 [161:10:11<1:38:45, 15.51s/it]
 99%|█████████▉| 37582/37963 [161:10:25<1:36:25, 15.19s/it]
 99%|█████████▉| 37583/37963 [161:10:40<1:34:47, 14.97s/it]
 99%|█████████▉| 37584/37963 [161:10:54<1:33:27, 14.79s/it]
 99%|█████████▉| 37585/37963 [161:11:08<1:32:23, 14.67s/it]
 99%|█████████▉| 37586/37963 [161:11:22<1:30:40, 14.43s/it]
 99%|█████████▉| 37587/37963 [161:11:36<1:29:12, 14.23s/it]
 99%|█████████▉| 37588/37963 [161:11:51<1:29:26, 14.31s/it]
 99%|█████████▉| 37589/37963 [161:12:05<1:28:41, 14.23s/it]
 99%|█████████▉| 37590/37963 [161:12:19<1:28:40, 14.26s/it]
                                                           
{'loss': '0.06577', 'grad_norm': '2.411', 'learning_rate': '5.09e-09', 'epoch': '0.9902'}

 99%|█████████▉| 37590/37963 [161:12:19<1:28:40, 14.26s/it]
 99%|█████████▉| 37591/37963 [161:12:33<1:28:33, 14.28s/it]
 99%|█████████▉| 37592/37963 [161:12:47<1:27:49, 14.20s/it]
 99%|█████████▉| 37593/37963 [161:13:09<1:40:45, 16.34s/it]
 99%|█████████▉| 37594/37963 [161:13:23<1:36:52, 15.75s/it]
 99%|█████████▉| 37595/37963 [161:13:37<1:33:44, 15.28s/it]
 99%|█████████▉| 37596/37963 [161:13:52<1:31:43, 15.00s/it]
 99%|█████████▉| 37597/37963 [161:14:06<1:30:21, 14.81s/it]
 99%|█████████▉| 37598/37963 [161:14:20<1:29:11, 14.66s/it]
 99%|█████████▉| 37599/37963 [161:14:35<1:28:28, 14.58s/it]
 99%|█████████▉| 37600/37963 [161:14:55<1:39:05, 16.38s/it]
                                                           
{'loss': '0.06075', 'grad_norm': '2.56', 'learning_rate': '4.821e-09', 'epoch': '0.9904'}

 99%|█████████▉| 37600/37963 [161:14:55<1:39:05, 16.38s/it]
 99%|█████████▉| 37601/37963 [161:15:15<1:45:17, 17.45s/it]
 99%|█████████▉| 37602/37963 [161:15:30<1:39:25, 16.53s/it]
 99%|█████████▉| 37603/37963 [161:15:44<1:34:58, 15.83s/it]
 99%|█████████▉| 37604/37963 [161:15:58<1:32:39, 15.49s/it]
 99%|█████████▉| 37605/37963 [161:16:19<1:42:20, 17.15s/it]
 99%|█████████▉| 37606/37963 [161:16:33<1:36:10, 16.16s/it]
 99%|█████████▉| 37607/37963 [161:16:54<1:43:51, 17.50s/it]
 99%|█████████▉| 37608/37963 [161:17:16<1:51:08, 18.78s/it]
 99%|█████████▉| 37609/37963 [161:17:30<1:42:14, 17.33s/it]
 99%|█████████▉| 37610/37963 [161:17:44<1:36:02, 16.32s/it]
                                                           
{'loss': '0.05807', 'grad_norm': '3.588', 'learning_rate': '4.56e-09', 'epoch': '0.9907'}

 99%|█████████▉| 37610/37963 [161:17:44<1:36:02, 16.32s/it]
 99%|█████████▉| 37611/37963 [161:17:58<1:32:20, 15.74s/it]
 99%|█████████▉| 37612/37963 [161:18:18<1:40:13, 17.13s/it]
 99%|█████████▉| 37613/37963 [161:18:33<1:35:17, 16.33s/it]
 99%|█████████▉| 37614/37963 [161:18:47<1:31:36, 15.75s/it]
 99%|█████████▉| 37615/37963 [161:19:01<1:27:55, 15.16s/it]
 99%|█████████▉| 37616/37963 [161:19:15<1:26:17, 14.92s/it]
 99%|█████████▉| 37617/37963 [161:19:30<1:24:44, 14.70s/it]
 99%|█████████▉| 37618/37963 [161:19:44<1:23:56, 14.60s/it]
 99%|█████████▉| 37619/37963 [161:19:58<1:23:21, 14.54s/it]
 99%|█████████▉| 37620/37963 [161:20:13<1:22:47, 14.48s/it]
                                                           
{'loss': '0.055', 'grad_norm': '4.627', 'learning_rate': '4.306e-09', 'epoch': '0.991'}

 99%|█████████▉| 37620/37963 [161:20:13<1:22:47, 14.48s/it]
 99%|█████████▉| 37621/37963 [161:20:27<1:22:18, 14.44s/it]
 99%|█████████▉| 37622/37963 [161:20:41<1:22:05, 14.44s/it]
 99%|█████████▉| 37623/37963 [161:20:56<1:21:44, 14.43s/it]
 99%|█████████▉| 37624/37963 [161:21:10<1:21:26, 14.42s/it]
 99%|█████████▉| 37625/37963 [161:21:24<1:20:15, 14.25s/it]
 99%|█████████▉| 37626/37963 [161:21:38<1:20:10, 14.28s/it]
 99%|█████████▉| 37627/37963 [161:21:53<1:19:55, 14.27s/it]
 99%|█████████▉| 37628/37963 [161:22:07<1:19:55, 14.31s/it]
 99%|█████████▉| 37629/37963 [161:22:28<1:30:18, 16.22s/it]
 99%|█████████▉| 37630/37963 [161:22:42<1:26:25, 15.57s/it]
                                                           
{'loss': '0.05651', 'grad_norm': '2.908', 'learning_rate': '4.059e-09', 'epoch': '0.9912'}

 99%|█████████▉| 37630/37963 [161:22:42<1:26:25, 15.57s/it]
 99%|█████████▉| 37631/37963 [161:22:56<1:24:01, 15.19s/it]
 99%|█████████▉| 37632/37963 [161:23:10<1:21:57, 14.86s/it]
 99%|█████████▉| 37633/37963 [161:23:24<1:20:19, 14.60s/it]
 99%|█████████▉| 37634/37963 [161:23:39<1:19:48, 14.55s/it]
 99%|█████████▉| 37635/37963 [161:23:53<1:18:39, 14.39s/it]
 99%|█████████▉| 37636/37963 [161:24:07<1:18:37, 14.43s/it]
 99%|█████████▉| 37637/37963 [161:24:22<1:18:15, 14.40s/it]
 99%|█████████▉| 37638/37963 [161:24:36<1:17:39, 14.34s/it]
 99%|█████████▉| 37639/37963 [161:24:50<1:17:22, 14.33s/it]
 99%|█████████▉| 37640/37963 [161:25:04<1:17:10, 14.34s/it]
                                                           
{'loss': '0.05945', 'grad_norm': '4.411', 'learning_rate': '3.82e-09', 'epoch': '0.9915'}

 99%|█████████▉| 37640/37963 [161:25:04<1:17:10, 14.34s/it]
 99%|█████████▉| 37641/37963 [161:25:18<1:16:32, 14.26s/it]
 99%|█████████▉| 37642/37963 [161:25:40<1:27:26, 16.34s/it]
 99%|█████████▉| 37643/37963 [161:25:54<1:23:59, 15.75s/it]
 99%|█████████▉| 37644/37963 [161:26:08<1:21:38, 15.36s/it]
 99%|█████████▉| 37645/37963 [161:26:22<1:19:02, 14.91s/it]
 99%|█████████▉| 37646/37963 [161:26:37<1:18:17, 14.82s/it]
 99%|█████████▉| 37647/37963 [161:26:58<1:28:12, 16.75s/it]
 99%|█████████▉| 37648/37963 [161:27:12<1:23:10, 15.84s/it]
 99%|█████████▉| 37649/37963 [161:27:27<1:20:57, 15.47s/it]
 99%|█████████▉| 37650/37963 [161:27:40<1:18:14, 15.00s/it]
                                                           
{'loss': '0.06401', 'grad_norm': '6.28', 'learning_rate': '3.588e-09', 'epoch': '0.9918'}

 99%|█████████▉| 37650/37963 [161:27:40<1:18:14, 15.00s/it]
 99%|█████████▉| 37651/37963 [161:28:01<1:26:54, 16.71s/it]
 99%|█████████▉| 37652/37963 [161:28:16<1:23:05, 16.03s/it]
 99%|█████████▉| 37653/37963 [161:28:30<1:20:20, 15.55s/it]
 99%|█████████▉| 37654/37963 [161:28:51<1:28:37, 17.21s/it]
 99%|█████████▉| 37655/37963 [161:29:05<1:23:46, 16.32s/it]
 99%|█████████▉| 37656/37963 [161:29:20<1:20:50, 15.80s/it]
 99%|█████████▉| 37657/37963 [161:29:48<1:39:29, 19.51s/it]
 99%|█████████▉| 37658/37963 [161:30:02<1:31:15, 17.95s/it]
 99%|█████████▉| 37659/37963 [161:30:23<1:35:36, 18.87s/it]
 99%|█████████▉| 37660/37963 [161:30:38<1:28:25, 17.51s/it]
                                                           
{'loss': '0.05556', 'grad_norm': '1.992', 'learning_rate': '3.363e-09', 'epoch': '0.992'}

 99%|█████████▉| 37660/37963 [161:30:38<1:28:25, 17.51s/it]
 99%|█████████▉| 37661/37963 [161:30:52<1:22:38, 16.42s/it]
 99%|█████████▉| 37662/37963 [161:31:05<1:18:22, 15.62s/it]
 99%|█████████▉| 37663/37963 [161:31:20<1:16:11, 15.24s/it]
 99%|█████████▉| 37664/37963 [161:31:34<1:13:49, 14.81s/it]
 99%|█████████▉| 37665/37963 [161:31:47<1:12:15, 14.55s/it]
 99%|█████████▉| 37666/37963 [161:32:02<1:11:42, 14.49s/it]
 99%|█████████▉| 37667/37963 [161:32:16<1:11:30, 14.49s/it]
 99%|█████████▉| 37668/37963 [161:32:31<1:10:49, 14.41s/it]
 99%|█████████▉| 37669/37963 [161:32:45<1:10:36, 14.41s/it]
 99%|█████████▉| 37670/37963 [161:32:59<1:10:15, 14.39s/it]
                                                           
{'loss': '0.06811', 'grad_norm': '2.542', 'learning_rate': '3.145e-09', 'epoch': '0.9923'}

 99%|█████████▉| 37670/37963 [161:32:59<1:10:15, 14.39s/it]
 99%|█████████▉| 37671/37963 [161:33:14<1:09:49, 14.35s/it]
 99%|█████████▉| 37672/37963 [161:33:28<1:09:28, 14.33s/it]
 99%|█████████▉| 37673/37963 [161:33:42<1:09:22, 14.35s/it]
 99%|█████████▉| 37674/37963 [161:33:57<1:09:06, 14.35s/it]
 99%|█████████▉| 37675/37963 [161:34:11<1:09:01, 14.38s/it]
 99%|█████████▉| 37676/37963 [161:34:32<1:17:57, 16.30s/it]
 99%|█████████▉| 37677/37963 [161:34:46<1:14:36, 15.65s/it]
 99%|█████████▉| 37678/37963 [161:35:00<1:12:25, 15.25s/it]
 99%|█████████▉| 37679/37963 [161:35:15<1:10:55, 14.98s/it]
 99%|█████████▉| 37680/37963 [161:35:28<1:09:02, 14.64s/it]
                                                           
{'loss': '0.06915', 'grad_norm': '3.28', 'learning_rate': '2.935e-09', 'epoch': '0.9925'}

 99%|█████████▉| 37680/37963 [161:35:28<1:09:02, 14.64s/it]
 99%|█████████▉| 37681/37963 [161:35:43<1:08:35, 14.59s/it]
 99%|█████████▉| 37682/37963 [161:35:57<1:07:58, 14.52s/it]
 99%|█████████▉| 37683/37963 [161:36:12<1:07:29, 14.46s/it]
 99%|█████████▉| 37684/37963 [161:36:26<1:06:36, 14.32s/it]
 99%|█████████▉| 37685/37963 [161:36:40<1:06:30, 14.35s/it]
 99%|█████████▉| 37686/37963 [161:36:54<1:05:56, 14.28s/it]
 99%|█████████▉| 37687/37963 [161:37:09<1:05:48, 14.31s/it]
 99%|█████████▉| 37688/37963 [161:37:23<1:05:40, 14.33s/it]
 99%|█████████▉| 37689/37963 [161:37:37<1:05:10, 14.27s/it]
 99%|█████████▉| 37690/37963 [161:37:58<1:14:04, 16.28s/it]
                                                           
{'loss': '0.05882', 'grad_norm': '3.15', 'learning_rate': '2.732e-09', 'epoch': '0.9928'}

 99%|█████████▉| 37690/37963 [161:37:58<1:14:04, 16.28s/it]
 99%|█████████▉| 37691/37963 [161:38:12<1:10:50, 15.63s/it]
 99%|█████████▉| 37692/37963 [161:38:27<1:09:00, 15.28s/it]
 99%|█████████▉| 37693/37963 [161:38:41<1:07:09, 14.93s/it]
 99%|█████████▉| 37694/37963 [161:38:55<1:06:09, 14.76s/it]
 99%|█████████▉| 37695/37963 [161:39:16<1:14:51, 16.76s/it]
 99%|█████████▉| 37696/37963 [161:39:31<1:11:29, 16.07s/it]
 99%|█████████▉| 37697/37963 [161:39:45<1:08:58, 15.56s/it]
 99%|█████████▉| 37698/37963 [161:40:00<1:07:11, 15.21s/it]
 99%|█████████▉| 37699/37963 [161:40:14<1:05:44, 14.94s/it]
 99%|█████████▉| 37700/37963 [161:40:35<1:13:36, 16.79s/it]
                                                           
{'loss': '0.06706', 'grad_norm': '2.604', 'learning_rate': '2.536e-09', 'epoch': '0.9931'}

 99%|█████████▉| 37700/37963 [161:40:35<1:13:36, 16.79s/it]
 99%|█████████▉| 37701/37963 [161:40:49<1:09:21, 15.88s/it]
 99%|█████████▉| 37702/37963 [161:41:10<1:15:42, 17.40s/it]
 99%|█████████▉| 37703/37963 [161:41:24<1:11:25, 16.48s/it]
 99%|█████████▉| 37704/37963 [161:41:38<1:07:40, 15.68s/it]
 99%|█████████▉| 37705/37963 [161:41:59<1:14:25, 17.31s/it]
 99%|█████████▉| 37706/37963 [161:42:13<1:10:00, 16.35s/it]
 99%|█████████▉| 37707/37963 [161:42:34<1:15:27, 17.69s/it]
 99%|█████████▉| 37708/37963 [161:42:48<1:10:57, 16.70s/it]
 99%|█████████▉| 37709/37963 [161:43:02<1:06:57, 15.82s/it]
 99%|█████████▉| 37710/37963 [161:43:17<1:04:59, 15.41s/it]
                                                           
{'loss': '0.05417', 'grad_norm': '3.749', 'learning_rate': '2.348e-09', 'epoch': '0.9933'}

 99%|█████████▉| 37710/37963 [161:43:17<1:04:59, 15.41s/it]
 99%|█████████▉| 37711/37963 [161:43:31<1:03:30, 15.12s/it]
 99%|█████████▉| 37712/37963 [161:43:52<1:10:14, 16.79s/it]
 99%|█████████▉| 37713/37963 [161:44:06<1:07:03, 16.09s/it]
 99%|█████████▉| 37714/37963 [161:44:21<1:04:37, 15.57s/it]
 99%|█████████▉| 37715/37963 [161:44:34<1:02:19, 15.08s/it]
 99%|█████████▉| 37716/37963 [161:44:49<1:01:03, 14.83s/it]
 99%|█████████▉| 37717/37963 [161:45:03<1:00:15, 14.70s/it]
 99%|█████████▉| 37718/37963 [161:45:18<59:46, 14.64s/it]  
 99%|█████████▉| 37719/37963 [161:45:32<59:14, 14.57s/it]
 99%|█████████▉| 37720/37963 [161:45:47<58:52, 14.54s/it]
                                                         
{'loss': '0.05795', 'grad_norm': '3.391', 'learning_rate': '2.167e-09', 'epoch': '0.9936'}

 99%|█████████▉| 37720/37963 [161:45:47<58:52, 14.54s/it]
 99%|█████████▉| 37721/37963 [161:46:01<58:33, 14.52s/it]
 99%|█████████▉| 37722/37963 [161:46:15<58:13, 14.49s/it]
 99%|█████████▉| 37723/37963 [161:46:36<1:05:01, 16.26s/it]
 99%|█████████▉| 37724/37963 [161:46:50<1:02:22, 15.66s/it]
 99%|█████████▉| 37725/37963 [161:47:04<1:00:37, 15.28s/it]
 99%|█████████▉| 37726/37963 [161:47:19<59:31, 15.07s/it]  
 99%|█████████▉| 37727/37963 [161:47:33<58:24, 14.85s/it]
 99%|█████████▉| 37728/37963 [161:47:48<57:36, 14.71s/it]
 99%|█████████▉| 37729/37963 [161:48:02<56:56, 14.60s/it]
 99%|█████████▉| 37730/37963 [161:48:17<56:37, 14.58s/it]
                                                         
{'loss': '0.05823', 'grad_norm': '3.774', 'learning_rate': '1.993e-09', 'epoch': '0.9939'}

 99%|█████████▉| 37730/37963 [161:48:17<56:37, 14.58s/it]
 99%|█████████▉| 37731/37963 [161:48:31<56:10, 14.53s/it]
 99%|█████████▉| 37732/37963 [161:48:45<55:50, 14.50s/it]
 99%|█████████▉| 37733/37963 [161:49:00<55:23, 14.45s/it]
 99%|█████████▉| 37734/37963 [161:49:14<55:04, 14.43s/it]
 99%|█████████▉| 37735/37963 [161:49:29<54:49, 14.43s/it]
 99%|█████████▉| 37736/37963 [161:49:43<54:04, 14.29s/it]
 99%|█████████▉| 37737/37963 [161:49:57<53:54, 14.31s/it]
 99%|█████████▉| 37738/37963 [161:50:18<1:01:29, 16.40s/it]
 99%|█████████▉| 37739/37963 [161:50:33<58:56, 15.79s/it]  
 99%|█████████▉| 37740/37963 [161:50:47<57:11, 15.39s/it]
                                                         
{'loss': '0.06272', 'grad_norm': '4.501', 'learning_rate': '1.826e-09', 'epoch': '0.9941'}

 99%|█████████▉| 37740/37963 [161:50:47<57:11, 15.39s/it]
 99%|█████████▉| 37741/37963 [161:51:01<55:49, 15.09s/it]
 99%|█████████▉| 37742/37963 [161:51:22<1:01:54, 16.81s/it]
 99%|█████████▉| 37743/37963 [161:51:37<59:13, 16.15s/it]  
 99%|█████████▉| 37744/37963 [161:51:51<57:01, 15.62s/it]
 99%|█████████▉| 37745/37963 [161:52:06<55:24, 15.25s/it]
 99%|█████████▉| 37746/37963 [161:52:20<54:14, 15.00s/it]
 99%|█████████▉| 37747/37963 [161:52:34<53:18, 14.81s/it]
 99%|█████████▉| 37748/37963 [161:52:49<52:35, 14.68s/it]
 99%|█████████▉| 37749/37963 [161:53:09<58:12, 16.32s/it]
 99%|█████████▉| 37750/37963 [161:53:23<55:43, 15.70s/it]
                                                         
{'loss': '0.05428', 'grad_norm': '3.127', 'learning_rate': '1.667e-09', 'epoch': '0.9944'}

 99%|█████████▉| 37750/37963 [161:53:23<55:43, 15.70s/it]
 99%|█████████▉| 37751/37963 [161:53:44<1:01:19, 17.35s/it]
 99%|█████████▉| 37752/37963 [161:53:59<57:52, 16.46s/it]  
 99%|█████████▉| 37753/37963 [161:54:13<55:35, 15.88s/it]
 99%|█████████▉| 37754/37963 [161:54:28<53:44, 15.43s/it]
 99%|█████████▉| 37755/37963 [161:54:56<1:06:39, 19.23s/it]
 99%|█████████▉| 37756/37963 [161:55:10<1:00:55, 17.66s/it]
 99%|█████████▉| 37757/37963 [161:55:31<1:03:58, 18.63s/it]
 99%|█████████▉| 37758/37963 [161:55:44<58:39, 17.17s/it]  
 99%|█████████▉| 37759/37963 [161:55:58<55:10, 16.23s/it]
 99%|█████████▉| 37760/37963 [161:56:13<53:03, 15.68s/it]
                                                         
{'loss': '0.06854', 'grad_norm': '4.052', 'learning_rate': '1.514e-09', 'epoch': '0.9947'}

 99%|█████████▉| 37760/37963 [161:56:13<53:03, 15.68s/it]
 99%|█████████▉| 37761/37963 [161:56:27<51:37, 15.33s/it]
 99%|█████████▉| 37762/37963 [161:56:42<50:23, 15.04s/it]
 99%|█████████▉| 37763/37963 [161:56:56<49:17, 14.79s/it]
 99%|█████████▉| 37764/37963 [161:57:10<48:39, 14.67s/it]
 99%|█████████▉| 37765/37963 [161:57:25<48:05, 14.57s/it]
 99%|█████████▉| 37766/37963 [161:57:39<47:38, 14.51s/it]
 99%|█████████▉| 37767/37963 [161:57:53<47:18, 14.48s/it]
 99%|█████████▉| 37768/37963 [161:58:07<46:33, 14.33s/it]
 99%|█████████▉| 37769/37963 [161:58:21<46:01, 14.23s/it]
 99%|█████████▉| 37770/37963 [161:58:35<45:31, 14.15s/it]
                                                         
{'loss': '0.06747', 'grad_norm': '1.912', 'learning_rate': '1.37e-09', 'epoch': '0.9949'}

 99%|█████████▉| 37770/37963 [161:58:35<45:31, 14.15s/it]
 99%|█████████▉| 37771/37963 [161:58:56<51:26, 16.07s/it]
 99%|█████████▉| 37772/37963 [161:59:10<49:36, 15.58s/it]
 99%|█████████▉| 37773/37963 [161:59:25<48:03, 15.17s/it]
100%|█████████▉| 37774/37963 [161:59:39<46:49, 14.87s/it]
100%|█████████▉| 37775/37963 [161:59:53<46:08, 14.73s/it]
100%|█████████▉| 37776/37963 [162:00:07<45:30, 14.60s/it]
100%|█████████▉| 37777/37963 [162:00:22<45:03, 14.54s/it]
100%|█████████▉| 37778/37963 [162:00:36<44:43, 14.50s/it]
100%|█████████▉| 37779/37963 [162:00:51<44:22, 14.47s/it]
100%|█████████▉| 37780/37963 [162:01:05<44:09, 14.48s/it]
                                                         
{'loss': '0.06187', 'grad_norm': '3.368', 'learning_rate': '1.232e-09', 'epoch': '0.9952'}

100%|█████████▉| 37780/37963 [162:01:05<44:09, 14.48s/it]
100%|█████████▉| 37781/37963 [162:01:20<43:50, 14.45s/it]
100%|█████████▉| 37782/37963 [162:01:34<43:20, 14.37s/it]
100%|█████████▉| 37783/37963 [162:01:48<43:04, 14.36s/it]
100%|█████████▉| 37784/37963 [162:02:02<42:49, 14.36s/it]
100%|█████████▉| 37785/37963 [162:02:16<42:09, 14.21s/it]
100%|█████████▉| 37786/37963 [162:02:38<48:07, 16.31s/it]
100%|█████████▉| 37787/37963 [162:02:52<46:13, 15.76s/it]
100%|█████████▉| 37788/37963 [162:03:06<44:46, 15.35s/it]
100%|█████████▉| 37789/37963 [162:03:21<43:35, 15.03s/it]
100%|█████████▉| 37790/37963 [162:03:35<42:25, 14.71s/it]
                                                         
{'loss': '0.0626', 'grad_norm': '3.641', 'learning_rate': '1.102e-09', 'epoch': '0.9954'}

100%|█████████▉| 37790/37963 [162:03:35<42:25, 14.71s/it]
100%|█████████▉| 37791/37963 [162:03:55<47:01, 16.40s/it]
100%|█████████▉| 37792/37963 [162:04:09<45:04, 15.81s/it]
100%|█████████▉| 37793/37963 [162:04:24<43:33, 15.37s/it]
100%|█████████▉| 37794/37963 [162:04:38<42:31, 15.10s/it]
100%|█████████▉| 37795/37963 [162:04:53<41:45, 14.91s/it]
100%|█████████▉| 37796/37963 [162:05:07<40:40, 14.61s/it]
100%|█████████▉| 37797/37963 [162:05:27<45:14, 16.35s/it]
100%|█████████▉| 37798/37963 [162:05:41<43:05, 15.67s/it]
100%|█████████▉| 37799/37963 [162:06:02<47:24, 17.34s/it]
100%|█████████▉| 37800/37963 [162:06:16<44:05, 16.23s/it]
                                                         
{'loss': '0.05997', 'grad_norm': '2.239', 'learning_rate': '9.788e-10', 'epoch': '0.9957'}

100%|█████████▉| 37800/37963 [162:06:16<44:05, 16.23s/it]
100%|█████████▉| 37801/37963 [162:06:30<42:18, 15.67s/it]
100%|█████████▉| 37802/37963 [162:06:45<40:51, 15.22s/it]
100%|█████████▉| 37803/37963 [162:07:06<45:20, 17.00s/it]
100%|█████████▉| 37804/37963 [162:07:27<48:29, 18.30s/it]
100%|█████████▉| 37805/37963 [162:07:42<45:12, 17.17s/it]
100%|█████████▉| 37806/37963 [162:07:56<42:37, 16.29s/it]
100%|█████████▉| 37807/37963 [162:08:10<40:52, 15.72s/it]
100%|█████████▉| 37808/37963 [162:08:31<44:16, 17.14s/it]
100%|█████████▉| 37809/37963 [162:08:45<41:54, 16.33s/it]
100%|█████████▉| 37810/37963 [162:08:59<40:06, 15.73s/it]
                                                         
{'loss': '0.07196', 'grad_norm': '3.988', 'learning_rate': '8.631e-10', 'epoch': '0.996'}

100%|█████████▉| 37810/37963 [162:08:59<40:06, 15.73s/it]
100%|█████████▉| 37811/37963 [162:09:14<38:47, 15.31s/it]
100%|█████████▉| 37812/37963 [162:09:27<37:15, 14.81s/it]
100%|█████████▉| 37813/37963 [162:09:42<36:47, 14.71s/it]
100%|█████████▉| 37814/37963 [162:09:56<36:18, 14.62s/it]
100%|█████████▉| 37815/37963 [162:10:11<35:49, 14.52s/it]
100%|█████████▉| 37816/37963 [162:10:25<35:18, 14.41s/it]
100%|█████████▉| 37817/37963 [162:10:39<35:01, 14.39s/it]
100%|█████████▉| 37818/37963 [162:10:53<34:46, 14.39s/it]
100%|█████████▉| 37819/37963 [162:11:07<34:15, 14.27s/it]
100%|█████████▉| 37820/37963 [162:11:22<33:55, 14.23s/it]
                                                         
{'loss': '0.06594', 'grad_norm': '3.688', 'learning_rate': '7.546e-10', 'epoch': '0.9962'}

100%|█████████▉| 37820/37963 [162:11:22<33:55, 14.23s/it]
100%|█████████▉| 37821/37963 [162:11:42<37:56, 16.03s/it]
100%|█████████▉| 37822/37963 [162:11:56<36:35, 15.57s/it]
100%|█████████▉| 37823/37963 [162:12:10<34:58, 14.99s/it]
100%|█████████▉| 37824/37963 [162:12:24<34:08, 14.74s/it]
100%|█████████▉| 37825/37963 [162:12:38<33:38, 14.63s/it]
100%|█████████▉| 37826/37963 [162:12:53<33:13, 14.55s/it]
100%|█████████▉| 37827/37963 [162:13:07<32:48, 14.48s/it]
100%|█████████▉| 37828/37963 [162:13:22<32:40, 14.53s/it]
100%|█████████▉| 37829/37963 [162:13:36<32:19, 14.47s/it]
100%|█████████▉| 37830/37963 [162:13:50<32:00, 14.44s/it]
                                                         
{'loss': '0.06955', 'grad_norm': '4.322', 'learning_rate': '6.535e-10', 'epoch': '0.9965'}

100%|█████████▉| 37830/37963 [162:13:50<32:00, 14.44s/it]
100%|█████████▉| 37831/37963 [162:14:05<31:44, 14.43s/it]
100%|█████████▉| 37832/37963 [162:14:19<31:28, 14.42s/it]
100%|█████████▉| 37833/37963 [162:14:33<30:55, 14.27s/it]
100%|█████████▉| 37834/37963 [162:14:54<35:09, 16.36s/it]
100%|█████████▉| 37835/37963 [162:15:09<33:38, 15.77s/it]
100%|█████████▉| 37836/37963 [162:15:23<32:05, 15.16s/it]
100%|█████████▉| 37837/37963 [162:15:37<31:21, 14.93s/it]
100%|█████████▉| 37838/37963 [162:15:52<30:54, 14.83s/it]
100%|█████████▉| 37839/37963 [162:16:06<30:22, 14.70s/it]
100%|█████████▉| 37840/37963 [162:16:26<33:28, 16.33s/it]
                                                         
{'loss': '0.07532', 'grad_norm': '2.842', 'learning_rate': '5.596e-10', 'epoch': '0.9968'}

100%|█████████▉| 37840/37963 [162:16:26<33:28, 16.33s/it]
100%|█████████▉| 37841/37963 [162:16:40<31:36, 15.54s/it]
100%|█████████▉| 37842/37963 [162:16:54<30:36, 15.18s/it]
100%|█████████▉| 37843/37963 [162:17:08<29:51, 14.93s/it]
100%|█████████▉| 37844/37963 [162:17:23<29:04, 14.66s/it]
100%|█████████▉| 37845/37963 [162:17:37<28:42, 14.60s/it]
100%|█████████▉| 37846/37963 [162:17:51<28:23, 14.56s/it]
100%|█████████▉| 37847/37963 [162:18:13<31:59, 16.55s/it]
100%|█████████▉| 37848/37963 [162:18:27<30:21, 15.84s/it]
100%|█████████▉| 37849/37963 [162:18:41<29:15, 15.40s/it]
100%|█████████▉| 37850/37963 [162:18:56<28:24, 15.09s/it]
                                                         
{'loss': '0.05915', 'grad_norm': '3.175', 'learning_rate': '4.729e-10', 'epoch': '0.997'}

100%|█████████▉| 37850/37963 [162:18:56<28:24, 15.09s/it]
100%|█████████▉| 37851/37963 [162:19:17<31:39, 16.96s/it]
100%|█████████▉| 37852/37963 [162:19:38<33:39, 18.20s/it]
100%|█████████▉| 37853/37963 [162:19:52<31:10, 17.01s/it]
100%|█████████▉| 37854/37963 [162:20:07<29:27, 16.22s/it]
100%|█████████▉| 37855/37963 [162:20:21<28:11, 15.66s/it]
100%|█████████▉| 37856/37963 [162:20:35<27:16, 15.30s/it]
100%|█████████▉| 37857/37963 [162:20:56<30:01, 17.00s/it]
100%|█████████▉| 37858/37963 [162:21:10<28:12, 16.12s/it]
100%|█████████▉| 37859/37963 [162:21:24<26:43, 15.42s/it]
100%|█████████▉| 37860/37963 [162:21:39<25:58, 15.14s/it]
                                                         
{'loss': '0.0644', 'grad_norm': '3.754', 'learning_rate': '3.936e-10', 'epoch': '0.9973'}

100%|█████████▉| 37860/37963 [162:21:39<25:58, 15.14s/it]
100%|█████████▉| 37861/37963 [162:21:53<25:16, 14.87s/it]
100%|█████████▉| 37862/37963 [162:22:07<24:47, 14.73s/it]
100%|█████████▉| 37863/37963 [162:22:22<24:32, 14.72s/it]
100%|█████████▉| 37864/37963 [162:22:36<24:07, 14.62s/it]
100%|█████████▉| 37865/37963 [162:22:50<23:35, 14.44s/it]
100%|█████████▉| 37866/37963 [162:23:05<23:14, 14.38s/it]
100%|█████████▉| 37867/37963 [162:23:19<23:02, 14.40s/it]
100%|█████████▉| 37868/37963 [162:23:34<22:47, 14.40s/it]
100%|█████████▉| 37869/37963 [162:23:54<25:33, 16.31s/it]
100%|█████████▉| 37870/37963 [162:24:09<24:22, 15.72s/it]
                                                         
{'loss': '0.06025', 'grad_norm': '2.951', 'learning_rate': '3.216e-10', 'epoch': '0.9976'}

100%|█████████▉| 37870/37963 [162:24:09<24:22, 15.72s/it]
100%|█████████▉| 37871/37963 [162:24:23<23:30, 15.33s/it]
100%|█████████▉| 37872/37963 [162:24:37<22:49, 15.05s/it]
100%|█████████▉| 37873/37963 [162:24:52<22:16, 14.85s/it]
100%|█████████▉| 37874/37963 [162:25:06<21:49, 14.71s/it]
100%|█████████▉| 37875/37963 [162:25:20<21:21, 14.57s/it]
100%|█████████▉| 37876/37963 [162:25:34<20:52, 14.40s/it]
100%|█████████▉| 37877/37963 [162:25:49<20:40, 14.43s/it]
100%|█████████▉| 37878/37963 [162:26:03<20:06, 14.19s/it]
100%|█████████▉| 37879/37963 [162:26:17<19:54, 14.22s/it]
100%|█████████▉| 37880/37963 [162:26:31<19:35, 14.16s/it]
                                                         
{'loss': '0.06591', 'grad_norm': '2.578', 'learning_rate': '2.568e-10', 'epoch': '0.9978'}

100%|█████████▉| 37880/37963 [162:26:31<19:35, 14.16s/it]
100%|█████████▉| 37881/37963 [162:26:45<19:27, 14.24s/it]
100%|█████████▉| 37882/37963 [162:27:00<19:17, 14.29s/it]
100%|█████████▉| 37883/37963 [162:27:14<19:04, 14.31s/it]
100%|█████████▉| 37884/37963 [162:27:35<21:32, 16.36s/it]
100%|█████████▉| 37885/37963 [162:27:50<20:32, 15.80s/it]
100%|█████████▉| 37886/37963 [162:28:04<19:42, 15.36s/it]
100%|█████████▉| 37887/37963 [162:28:18<18:56, 14.96s/it]
100%|█████████▉| 37888/37963 [162:28:32<18:28, 14.78s/it]
100%|█████████▉| 37889/37963 [162:28:46<17:52, 14.50s/it]
100%|█████████▉| 37890/37963 [162:29:07<20:00, 16.44s/it]
                                                         
{'loss': '0.0642', 'grad_norm': '3.201', 'learning_rate': '1.993e-10', 'epoch': '0.9981'}

100%|█████████▉| 37890/37963 [162:29:07<20:00, 16.44s/it]
100%|█████████▉| 37891/37963 [162:29:22<19:00, 15.84s/it]
100%|█████████▉| 37892/37963 [162:29:36<18:15, 15.43s/it]
100%|█████████▉| 37893/37963 [162:29:51<17:38, 15.12s/it]
100%|█████████▉| 37894/37963 [162:30:05<17:08, 14.90s/it]
100%|█████████▉| 37895/37963 [162:30:26<19:04, 16.83s/it]
100%|█████████▉| 37896/37963 [162:30:41<17:59, 16.11s/it]
100%|█████████▉| 37897/37963 [162:30:55<17:01, 15.48s/it]
100%|█████████▉| 37898/37963 [162:31:09<16:26, 15.18s/it]
100%|█████████▉| 37899/37963 [162:31:24<15:55, 14.93s/it]
100%|█████████▉| 37900/37963 [162:31:52<19:56, 18.99s/it]
                                                         
{'loss': '0.06424', 'grad_norm': '3.929', 'learning_rate': '1.491e-10', 'epoch': '0.9983'}

100%|█████████▉| 37900/37963 [162:31:52<19:56, 18.99s/it]
100%|█████████▉| 37901/37963 [162:32:07<18:14, 17.65s/it]
100%|█████████▉| 37902/37963 [162:32:21<16:57, 16.69s/it]
100%|█████████▉| 37903/37963 [162:32:41<17:44, 17.74s/it]
100%|█████████▉| 37904/37963 [162:32:56<16:28, 16.76s/it]
100%|█████████▉| 37905/37963 [162:33:10<15:27, 16.00s/it]
100%|█████████▉| 37906/37963 [162:33:24<14:38, 15.41s/it]
100%|█████████▉| 37907/37963 [162:33:38<14:06, 15.11s/it]
100%|█████████▉| 37908/37963 [162:33:52<13:28, 14.71s/it]
100%|█████████▉| 37909/37963 [162:34:06<13:08, 14.61s/it]
100%|█████████▉| 37910/37963 [162:34:21<12:50, 14.55s/it]
                                                         
{'loss': '0.05541', 'grad_norm': '2.827', 'learning_rate': '1.061e-10', 'epoch': '0.9986'}

100%|█████████▉| 37910/37963 [162:34:21<12:50, 14.55s/it]
100%|█████████▉| 37911/37963 [162:34:35<12:33, 14.49s/it]
100%|█████████▉| 37912/37963 [162:34:49<12:09, 14.31s/it]
100%|█████████▉| 37913/37963 [162:35:04<12:00, 14.40s/it]
100%|█████████▉| 37914/37963 [162:35:18<11:45, 14.40s/it]
100%|█████████▉| 37915/37963 [162:35:32<11:25, 14.28s/it]
100%|█████████▉| 37916/37963 [162:35:46<11:12, 14.30s/it]
100%|█████████▉| 37917/37963 [162:36:01<10:58, 14.31s/it]
100%|█████████▉| 37918/37963 [162:36:21<12:06, 16.15s/it]
100%|█████████▉| 37919/37963 [162:36:36<11:26, 15.61s/it]
100%|█████████▉| 37920/37963 [162:36:50<10:56, 15.27s/it]
                                                         
{'loss': '0.05883', 'grad_norm': '3.047', 'learning_rate': '7.046e-11', 'epoch': '0.9989'}

100%|█████████▉| 37920/37963 [162:36:50<10:56, 15.27s/it]
100%|█████████▉| 37921/37963 [162:37:04<10:26, 14.91s/it]
100%|█████████▉| 37922/37963 [162:37:19<10:05, 14.76s/it]
100%|█████████▉| 37923/37963 [162:37:33<09:46, 14.67s/it]
100%|█████████▉| 37924/37963 [162:37:47<09:28, 14.57s/it]
100%|█████████▉| 37925/37963 [162:38:02<09:12, 14.54s/it]
100%|█████████▉| 37926/37963 [162:38:16<08:56, 14.50s/it]
100%|█████████▉| 37927/37963 [162:38:31<08:41, 14.48s/it]
100%|█████████▉| 37928/37963 [162:38:45<08:26, 14.46s/it]
100%|█████████▉| 37929/37963 [162:38:59<08:08, 14.38s/it]
100%|█████████▉| 37930/37963 [162:39:14<07:54, 14.38s/it]
                                                         
{'loss': '0.0543', 'grad_norm': '2.455', 'learning_rate': '4.207e-11', 'epoch': '0.9991'}

100%|█████████▉| 37930/37963 [162:39:14<07:54, 14.38s/it]
100%|█████████▉| 37931/37963 [162:39:27<07:30, 14.08s/it]
100%|█████████▉| 37932/37963 [162:39:41<07:19, 14.17s/it]
100%|█████████▉| 37933/37963 [162:40:03<08:11, 16.38s/it]
100%|█████████▉| 37934/37963 [162:40:17<07:37, 15.78s/it]
100%|█████████▉| 37935/37963 [162:40:32<07:08, 15.32s/it]
100%|█████████▉| 37936/37963 [162:40:46<06:45, 15.03s/it]
100%|█████████▉| 37937/37963 [162:41:00<06:25, 14.84s/it]
100%|█████████▉| 37938/37963 [162:41:21<06:52, 16.48s/it]
100%|█████████▉| 37939/37963 [162:41:35<06:20, 15.85s/it]
100%|█████████▉| 37940/37963 [162:41:49<05:54, 15.42s/it]
                                                         
{'loss': '0.04999', 'grad_norm': '2.466', 'learning_rate': '2.096e-11', 'epoch': '0.9994'}

100%|█████████▉| 37940/37963 [162:41:49<05:54, 15.42s/it]
100%|█████████▉| 37941/37963 [162:42:03<05:29, 15.00s/it]
100%|█████████▉| 37942/37963 [162:42:18<05:10, 14.80s/it]
100%|█████████▉| 37943/37963 [162:42:32<04:54, 14.71s/it]
100%|█████████▉| 37944/37963 [162:42:53<05:16, 16.65s/it]
100%|█████████▉| 37945/37963 [162:43:08<04:46, 15.92s/it]
100%|█████████▉| 37946/37963 [162:43:22<04:22, 15.45s/it]
100%|█████████▉| 37947/37963 [162:43:43<04:32, 17.05s/it]
100%|█████████▉| 37948/37963 [162:44:10<05:03, 20.24s/it]
100%|█████████▉| 37949/37963 [162:44:25<04:19, 18.51s/it]
100%|█████████▉| 37950/37963 [162:44:39<03:43, 17.22s/it]
                                                         
{'loss': '0.06333', 'grad_norm': '1.978', 'learning_rate': '7.133e-12', 'epoch': '0.9997'}

100%|█████████▉| 37950/37963 [162:44:39<03:43, 17.22s/it]
100%|█████████▉| 37951/37963 [162:44:53<03:16, 16.33s/it]
100%|█████████▉| 37952/37963 [162:45:08<02:53, 15.75s/it]
100%|█████████▉| 37953/37963 [162:45:29<02:52, 17.28s/it]
100%|█████████▉| 37954/37963 [162:45:43<02:27, 16.40s/it]
100%|█████████▉| 37955/37963 [162:45:57<02:06, 15.76s/it]
100%|█████████▉| 37956/37963 [162:46:12<01:47, 15.35s/it]
100%|█████████▉| 37957/37963 [162:46:26<01:30, 15.08s/it]
100%|█████████▉| 37958/37963 [162:46:40<01:13, 14.73s/it]
100%|█████████▉| 37959/37963 [162:46:54<00:58, 14.52s/it]
100%|█████████▉| 37960/37963 [162:47:09<00:43, 14.53s/it]
                                                         
{'loss': '0.05985', 'grad_norm': '4.018', 'learning_rate': '5.823e-13', 'epoch': '0.9999'}

100%|█████████▉| 37960/37963 [162:47:09<00:43, 14.53s/it]
100%|█████████▉| 37961/37963 [162:47:23<00:28, 14.39s/it]
100%|█████████▉| 37962/37963 [162:47:37<00:14, 14.26s/it]
100%|██████████| 37963/37963 [162:47:52<00:00, 14.46s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.34s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.34s/it]

                                                         
{'train_runtime': '5.862e+05', 'train_samples_per_second': '4.145', 'train_steps_per_second': '0.065', 'train_loss': '0.1315', 'epoch': '1'}

100%|██████████| 37963/37963 [162:49:17<00:00, 14.46s/it]
100%|██████████| 37963/37963 [162:49:17<00:00, 15.44s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.96s/it]
Writing model shards: 100%|██████████| 1/1 [00:14<00:00, 14.96s/it]
[rank0]:[W721 19:22:24.999625404 ProcessGroupNCCL.cpp:1476] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())